1
|
Razavi M, Ziyadidegan S, Mahmoudzadeh A, Kazeminasab S, Baharlouei E, Janfaza V, Jahromi R, Sasangohar F. Machine Learning, Deep Learning, and Data Preprocessing Techniques for Detecting, Predicting, and Monitoring Stress and Stress-Related Mental Disorders: Scoping Review. JMIR Ment Health 2024; 11:e53714. [PMID: 39167782 DOI: 10.2196/53714] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/16/2023] [Revised: 05/01/2024] [Accepted: 05/17/2024] [Indexed: 08/23/2024] Open
Abstract
BACKGROUND Mental stress and its consequent mental health disorders (MDs) constitute a significant public health issue. With the advent of machine learning (ML), there is potential to harness computational techniques for better understanding and addressing mental stress and MDs. This comprehensive review seeks to elucidate the current ML methodologies used in this domain to pave the way for enhanced detection, prediction, and analysis of mental stress and its subsequent MDs. OBJECTIVE This review aims to investigate the scope of ML methodologies used in the detection, prediction, and analysis of mental stress and its consequent MDs. METHODS Using a rigorous scoping review process with PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines, this investigation delves into the latest ML algorithms, preprocessing techniques, and data types used in the context of stress and stress-related MDs. RESULTS A total of 98 peer-reviewed publications were examined for this review. The findings highlight that support vector machine, neural network, and random forest models consistently exhibited superior accuracy and robustness among all ML algorithms examined. Physiological parameters such as heart rate measurements and skin response are prevalently used as stress predictors due to their rich explanatory information concerning stress and stress-related MDs, as well as the relative ease of data acquisition. The application of dimensionality reduction techniques, including mappings, feature selection, filtering, and noise reduction, is frequently observed as a crucial step preceding the training of ML algorithms. CONCLUSIONS The synthesis of this review identified significant research gaps and outlines future directions for the field. These encompass areas such as model interpretability, model personalization, the incorporation of naturalistic settings, and real-time processing capabilities for the detection and prediction of stress and stress-related MDs.
Collapse
Affiliation(s)
- Moein Razavi
- Department of Industrial and Systems Engineering, Texas A&M University, College Station, TX, United States
- Department of Computer Science and Engineering, Texas A&M University, College Station, TX, United States
| | - Samira Ziyadidegan
- Department of Industrial and Systems Engineering, Texas A&M University, College Station, TX, United States
| | - Ahmadreza Mahmoudzadeh
- Zachry Department of Civil and Environmental Engineering, Texas A&M University, College Station, TX, United States
| | - Saber Kazeminasab
- Harvard Medical School, Harvard University, Boston, MA, United States
| | - Elaheh Baharlouei
- Department of Computer Science, University of Houston, Houston, TX, United States
| | - Vahid Janfaza
- Department of Computer Science and Engineering, Texas A&M University, College Station, TX, United States
| | - Reza Jahromi
- Department of Industrial and Systems Engineering, Texas A&M University, College Station, TX, United States
- Department of Computer Science and Engineering, Texas A&M University, College Station, TX, United States
| | - Farzan Sasangohar
- Department of Industrial and Systems Engineering, Texas A&M University, College Station, TX, United States
| |
Collapse
|
2
|
Grasso-Cladera A, Bremer M, Ladouce S, Parada F. A systematic review of mobile brain/body imaging studies using the P300 event-related potentials to investigate cognition beyond the laboratory. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2024; 24:631-659. [PMID: 38834886 DOI: 10.3758/s13415-024-01190-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 04/15/2024] [Indexed: 06/06/2024]
Abstract
The P300 ERP component, related to the onset of task-relevant or infrequent stimuli, has been widely used in the Mobile Brain/Body Imaging (MoBI) literature. This systematic review evaluates the quality and breadth of P300 MoBI studies, revealing a maturing field with well-designed research yet grappling with standardization and global representation challenges. While affirming the reliability of measuring P300 ERP components in mobile settings, the review identifies significant hurdles in standardizing data cleaning and processing techniques, impacting comparability and reproducibility. Geographical disparities emerge, with studies predominantly in the Global North and a dearth of research from the Global South, emphasizing the need for broader inclusivity to counter the WEIRD bias in psychology. Collaborative projects and mobile EEG systems showcase the feasibility of reaching diverse populations, which is essential to advance precision psychiatry and to integrate varied data streams. Methodologically, a trend toward ecological validity is noted, shifting from lab-based to real-world settings with portable EEG system advancements. Future hardware developments are expected to balance signal quality and sensor intrusiveness, enriching data collection in everyday contexts. Innovative methodologies reflect a move toward more natural experimental settings, prompting critical questions about the applicability of traditional ERP markers, such as the P300 outside structured paradigms. The review concludes by highlighting the crucial role of integrating mobile technologies, physiological sensors, and machine learning to advance cognitive neuroscience. It advocates for an operational definition of ecological validity to bridge the gap between controlled experiments and the complexity of embodied cognitive experiences, enhancing both theoretical understanding and practical application in study design.
Collapse
Affiliation(s)
| | - Marko Bremer
- Facultad de Psicología, Centro de Estudios en Neurociencia Humana y Neuropsicología (CENHN), Diego Portales University, Santiago, Chile
- Facultad de Psicología, Programa de Magíster en Neurociencia Social, Diego Portales University, Santiago, Chile
| | - Simon Ladouce
- Department Brain and Cognition, Leuven Brain Institute, KU Leuven, Leuven, Belgium
| | - Francisco Parada
- Facultad de Psicología, Centro de Estudios en Neurociencia Humana y Neuropsicología (CENHN), Diego Portales University, Santiago, Chile.
| |
Collapse
|
3
|
Marchant S, van der Vaart M, Pillay K, Baxter L, Bhatt A, Fitzgibbon S, Hartley C, Slater R. A machine learning artefact detection method for single-channel infant event-related potential studies. J Neural Eng 2024; 21:046021. [PMID: 38925111 PMCID: PMC11250100 DOI: 10.1088/1741-2552/ad5c04] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Revised: 06/04/2024] [Accepted: 06/26/2024] [Indexed: 06/28/2024]
Abstract
Objective. Automated detection of artefact in stimulus-evoked electroencephalographic (EEG) data recorded in neonates will improve the reproducibility and speed of analysis in clinical research compared with manual identification of artefact. Some studies use very short, single-channel epochs of EEG data with little recorded EEG per infant-for example because the clinical vulnerability of the infants limits access for recording. Current artefact-detection methods that perform well on adult data and resting-state and multi-channel data in infants are not suitable for this application. The aim of this study was to create and test an automated method of detecting artefact in single-channel 1500 ms epochs of infant EEG.Approach. A total of 410 epochs of EEG were used, collected from 160 infants of 28-43 weeks postmenstrual age. This dataset-which was balanced to include epochs of background activity and responses to visual, auditory, tactile and noxious stimuli-was presented to seven independent raters, who independently labelled the epochs according to whether or not they were able to visually identify artefacts. The data was split into a training set (340 epochs) and an independent test set (70 epochs). A random forest model was trained to identify epochs as either artefact or not artefact.Main results. This model performs well, achieving a balanced accuracy of 0.81, which is as good as manual review of data. Accuracy was not significantly related to the infant age or type of stimulus.Significance. This method provides an objective tool for automated artefact rejection for short epoch, single-channel EEG in neonates and could increase the utility of EEG in neonates in both the clinical and research setting.
Collapse
Affiliation(s)
- Simon Marchant
- Department of Paediatrics, University of Oxford, Oxford, United Kingdom
| | | | - Kirubin Pillay
- Department of Paediatrics, University of Oxford, Oxford, United Kingdom
| | - Luke Baxter
- Department of Paediatrics, University of Oxford, Oxford, United Kingdom
| | - Aomesh Bhatt
- Department of Paediatrics, University of Oxford, Oxford, United Kingdom
| | - Sean Fitzgibbon
- FMRIB, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Caroline Hartley
- Department of Paediatrics, University of Oxford, Oxford, United Kingdom
| | - Rebeccah Slater
- Department of Paediatrics, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
4
|
Lee TW, Tramontano G. Neural consequences of 5-Hz transcranial alternating current stimulation over right hemisphere: An eLORETA EEG study. Neurosci Lett 2024; 835:137849. [PMID: 38825146 DOI: 10.1016/j.neulet.2024.137849] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2024] [Revised: 05/06/2024] [Accepted: 05/30/2024] [Indexed: 06/04/2024]
Abstract
INTRODUCTION Transcranial alternating current stimulation (tACS) at 5-Hz to the right hemisphere can effectively alleviate anxiety symptoms. This study aimed to explore the neural mechanisms that drive the therapeutic benefits. METHODS We collected electroencephalography (EEG) data from 24 participants with anxiety disorders before and after a tACS treatment session. tACS was applied over the right hemisphere, with 1.0 mA at F4, 1.0 mA at P4, and 2.0 mA at T8 (10-10 EEG convention). With eLORETA, we transformed the scalp signals into the current source density in the cortex. We then assessed the differences between post- and pre-treatment brain maps across multiple spectra (delta to low gamma) with non-parametric statistics. RESULTS We observed a trend of heightened power in alpha and reduced power in mid-to-high beta and low gamma, in accord with the EEG markers of anxiolytic effects reported in previous studies. Additionally, we observed a consistent trend of de-synchronization at the stimulating sites across spectra. CONCLUSION tACS 5-Hz over the right hemisphere demonstrated EEG markers of anxiety reduction. The after-effects of tACS on the brain are intricate and cannot be explained solely by the widely circulated entrainment theory. Rather, our results support the involvement of plasticity mechanisms in the offline effects of tACS.
Collapse
Affiliation(s)
- Tien-Wen Lee
- The NeuroCognitive Institute (NCI) Clinical Research Foundation, NJ 07856, USA
| | - Gerald Tramontano
- The NeuroCognitive Institute (NCI) Clinical Research Foundation, NJ 07856, USA.
| |
Collapse
|
5
|
Ron-Angevin R, Fernández-Rodríguez Á, Velasco-Álvarez F, Lespinet-Najib V, André JM. Evaluation of Different Types of Stimuli in an Event-Related Potential-Based Brain-Computer Interface Speller under Rapid Serial Visual Presentation. SENSORS (BASEL, SWITZERLAND) 2024; 24:3315. [PMID: 38894107 PMCID: PMC11174573 DOI: 10.3390/s24113315] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/02/2024] [Revised: 05/10/2024] [Accepted: 05/21/2024] [Indexed: 06/21/2024]
Abstract
Rapid serial visual presentation (RSVP) is currently a suitable gaze-independent paradigm for controlling visual brain-computer interfaces (BCIs) based on event-related potentials (ERPs), especially for users with limited eye movement control. However, unlike gaze-dependent paradigms, gaze-independent ones have received less attention concerning the specific choice of visual stimuli that are used. In gaze-dependent BCIs, images of faces-particularly those tinted red-have been shown to be effective stimuli. This study aims to evaluate whether the colour of faces used as visual stimuli influences ERP-BCI performance under RSVP. Fifteen participants tested four conditions that varied only in the visual stimulus used: grey letters (GL), red famous faces with letters (RFF), green famous faces with letters (GFF), and blue famous faces with letters (BFF). The results indicated significant accuracy differences only between the GL and GFF conditions, unlike prior gaze-dependent studies. Additionally, GL achieved higher comfort ratings compared with other face-related conditions. This study highlights that the choice of stimulus type impacts both performance and user comfort, suggesting implications for future ERP-BCI designs for users requiring gaze-independent systems.
Collapse
Affiliation(s)
- Ricardo Ron-Angevin
- Departamento de Tecnología Electrónica, Instituto Universitario de Investigación en Telecomunicación de la Universidad de Málaga (TELMA), Universidad de Málaga, 29071 Malaga, Spain; (Á.F.-R.); (F.V.-Á.)
| | - Álvaro Fernández-Rodríguez
- Departamento de Tecnología Electrónica, Instituto Universitario de Investigación en Telecomunicación de la Universidad de Málaga (TELMA), Universidad de Málaga, 29071 Malaga, Spain; (Á.F.-R.); (F.V.-Á.)
| | - Francisco Velasco-Álvarez
- Departamento de Tecnología Electrónica, Instituto Universitario de Investigación en Telecomunicación de la Universidad de Málaga (TELMA), Universidad de Málaga, 29071 Malaga, Spain; (Á.F.-R.); (F.V.-Á.)
| | - Véronique Lespinet-Najib
- Laboratoire IMS, CNRS UMR 5218, Cognitive Team, Bordeaux INP-ENSC, 33400 Bordeaux, France; (V.L.-N.); (J.-M.A.)
| | - Jean-Marc André
- Laboratoire IMS, CNRS UMR 5218, Cognitive Team, Bordeaux INP-ENSC, 33400 Bordeaux, France; (V.L.-N.); (J.-M.A.)
| |
Collapse
|
6
|
Zhang G, Garrett DR, Simmons AM, Kiat JE, Luck SJ. Evaluating the effectiveness of artifact correction and rejection in event-related potential research. Psychophysiology 2024; 61:e14511. [PMID: 38165059 PMCID: PMC11021170 DOI: 10.1111/psyp.14511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2023] [Revised: 11/18/2023] [Accepted: 12/14/2023] [Indexed: 01/03/2024]
Abstract
Eyeblinks and other large artifacts can create two major problems in event-related potential (ERP) research, namely confounds and increased noise. Here, we developed a method for assessing the effectiveness of artifact correction and rejection methods in minimizing these two problems. We then used this method to assess a common artifact minimization approach, in which independent component analysis (ICA) is used to correct ocular artifacts, and artifact rejection is used to reject trials with extreme values resulting from other sources (e.g., movement artifacts). This approach was applied to data from five common ERP components (P3b, N400, N170, mismatch negativity, and error-related negativity). Four common scoring methods (mean amplitude, peak amplitude, peak latency, and 50% area latency) were examined for each component. We found that eyeblinks differed systematically across experimental conditions for several of the components. We also found that artifact correction was reasonably effective at minimizing these confounds, although it did not usually eliminate them completely. In addition, we found that the rejection of trials with extreme voltage values was effective at reducing noise, with the benefits of eliminating these trials outweighing the reduced number of trials available for averaging. For researchers who are analyzing similar ERP components and participant populations, this combination of artifact correction and rejection approaches should minimize artifact-related confounds and lead to improved data quality. Researchers who are analyzing other components or participant populations can use the method developed in this study to determine which artifact minimization approaches are effective in their data.
Collapse
Affiliation(s)
- Guanghui Zhang
- Center for Mind & Brain, University of California-Davis, Davis, California, USA
| | - David R Garrett
- Center for Mind & Brain, University of California-Davis, Davis, California, USA
| | - Aaron M Simmons
- Center for Mind & Brain, University of California-Davis, Davis, California, USA
| | - John E Kiat
- Center for Mind & Brain, University of California-Davis, Davis, California, USA
| | - Steven J Luck
- Center for Mind & Brain, University of California-Davis, Davis, California, USA
| |
Collapse
|
7
|
Kaar SJ, Nottage JF, Angelescu I, Marques TR, Howes OD. Gamma Oscillations and Potassium Channel Modulation in Schizophrenia: Targeting GABAergic Dysfunction. Clin EEG Neurosci 2024; 55:203-213. [PMID: 36591873 PMCID: PMC10851642 DOI: 10.1177/15500594221148643] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/28/2022] [Revised: 12/08/2022] [Accepted: 12/12/2022] [Indexed: 01/03/2023]
Abstract
Impairments in gamma-aminobutyric acid (GABAergic) interneuron function lead to gamma power abnormalities and are thought to underlie symptoms in people with schizophrenia. Voltage-gated potassium 3.1 (Kv3.1) and 3.2 (Kv3.2) channels on GABAergic interneurons are critical to the generation of gamma oscillations suggesting that targeting Kv3.1/3.2 could augment GABAergic function and modulate gamma oscillation generation. Here, we studied the effect of a novel potassium Kv3.1/3.2 channel modulator, AUT00206, on resting state frontal gamma power in people with schizophrenia. We found a significant positive correlation between frontal resting gamma (35-45 Hz) power (n = 22, r = 0.613, P < .002) and positive and negative syndrome scale (PANSS) positive symptom severity. We also found a significant reduction in frontal gamma power (t13 = 3.635, P = .003) from baseline in patients who received AUT00206. This provides initial evidence that the Kv3.1/3.2 potassium channel modulator, AUT00206, may address gamma oscillation abnormalities in schizophrenia.
Collapse
Affiliation(s)
- Stephen J. Kaar
- Department of Psychosis Studies, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
- MRC London Institute of Medical Sciences, Hammersmith Hospital, London, UK
- Division of Psychology and Mental Health, Faculty of Biology, Medicine, and Health, University of Manchester, Manchester, UK
| | - Judith F. Nottage
- Department of Neuroimaging, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| | - Ilinca Angelescu
- Department of Psychosis Studies, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research London, London, UK
| | - Tiago Reis Marques
- Department of Psychosis Studies, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
- MRC London Institute of Medical Sciences, Hammersmith Hospital, London, UK
| | - Oliver D. Howes
- Department of Psychosis Studies, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
- MRC London Institute of Medical Sciences, Hammersmith Hospital, London, UK
- Faculty of Medicine, Institute of Clinical Sciences (ICS), Imperial College London, London, UK
| |
Collapse
|
8
|
Ingolfsson TM, Benatti S, Wang X, Bernini A, Ducouret P, Ryvlin P, Beniczky S, Benini L, Cossettini A. Minimizing artifact-induced false-alarms for seizure detection in wearable EEG devices with gradient-boosted tree classifiers. Sci Rep 2024; 14:2980. [PMID: 38316856 PMCID: PMC10844293 DOI: 10.1038/s41598-024-52551-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Accepted: 01/19/2024] [Indexed: 02/07/2024] Open
Abstract
Electroencephalography (EEG) is widely used to monitor epileptic seizures, and standard clinical practice consists of monitoring patients in dedicated epilepsy monitoring units via video surveillance and cumbersome EEG caps. Such a setting is not compatible with long-term tracking under typical living conditions, thereby motivating the development of unobtrusive wearable solutions. However, wearable EEG devices present the challenges of fewer channels, restricted computational capabilities, and lower signal-to-noise ratio. Moreover, artifacts presenting morphological similarities to seizures act as major noise sources and can be misinterpreted as seizures. This paper presents a combined seizure and artifacts detection framework targeting wearable EEG devices based on Gradient Boosted Trees. The seizure detector achieves nearly zero false alarms with average sensitivity values of [Formula: see text] for 182 seizures from the CHB-MIT dataset and [Formula: see text] for 25 seizures from the private dataset with no preliminary artifact detection or removal. The artifact detector achieves a state-of-the-art accuracy of [Formula: see text] (on the TUH-EEG Artifact Corpus dataset). Integrating artifact and seizure detection significantly reduces false alarms-up to [Formula: see text] compared to standalone seizure detection. Optimized for a Parallel Ultra-Low Power platform, these algorithms enable extended monitoring with a battery lifespan reaching 300 h. These findings highlight the benefits of integrating artifact detection in wearable epilepsy monitoring devices to limit the number of false positives.
Collapse
Affiliation(s)
| | - Simone Benatti
- University of Bologna, 40126, Bologna, Italy
- University of Modena and Reggio Emilia, 41121, Reggio Emilia, Italy
| | | | - Adriano Bernini
- University Hospital of Lausanne (CHUV), 1011, Lausanne, Switzerland
| | - Pauline Ducouret
- University Hospital of Lausanne (CHUV), 1011, Lausanne, Switzerland
| | - Philippe Ryvlin
- University Hospital of Lausanne (CHUV), 1011, Lausanne, Switzerland
| | - Sandor Beniczky
- Aarhus University Hospital, 8200, Aarhus, Denmark
- Danish Epilepsy Centre (Filadelfia), 4293, Dianalund, Denmark
| | - Luca Benini
- ETH Zürich, D-ITET, 8092, Zürich, Switzerland
- University of Bologna, 40126, Bologna, Italy
| | | |
Collapse
|
9
|
Darvishi-Bayazi MJ, Ghaemi MS, Lesort T, Arefin MR, Faubert J, Rish I. Amplifying pathological detection in EEG signaling pathways through cross-dataset transfer learning. Comput Biol Med 2024; 169:107893. [PMID: 38183700 DOI: 10.1016/j.compbiomed.2023.107893] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2023] [Revised: 11/28/2023] [Accepted: 12/20/2023] [Indexed: 01/08/2024]
Abstract
Pathology diagnosis based on EEG signals and decoding brain activity holds immense importance in understanding neurological disorders. With the advancement of artificial intelligence methods and machine learning techniques, the potential for accurate data-driven diagnoses and effective treatments has grown significantly. However, applying machine learning algorithms to real-world datasets presents diverse challenges at multiple levels. The scarcity of labeled data, especially in low regime scenarios with limited availability of real patient cohorts due to high costs of recruitment, underscores the vital deployment of scaling and transfer learning techniques. In this study, we explore a real-world pathology classification task to highlight the effectiveness of data and model scaling and cross-dataset knowledge transfer. As such, we observe varying performance improvements through data scaling, indicating the need for careful evaluation and labeling. Additionally, we identify the challenges of possible negative transfer and emphasize the significance of some key components to overcome distribution shifts and potential spurious correlations and achieve positive transfer. We see improvement in the performance of the target model on the target (NMT) datasets by using the knowledge from the source dataset (TUAB) when a low amount of labeled data was available. Our findings demonstrated that a small and generic model (e.g. ShallowNet) performs well on a single dataset, however, a larger model (e.g. TCN) performs better in transfer learning when leveraging a larger and more diverse dataset.
Collapse
Affiliation(s)
- Mohammad-Javad Darvishi-Bayazi
- Mila, Québec AI Institute, Montréal, QC, Canada; Faubert Lab, Montréal, QC, Canada; Université de Montréal, Montréal, QC, Canada.
| | | | - Timothee Lesort
- Mila, Québec AI Institute, Montréal, QC, Canada; Université de Montréal, Montréal, QC, Canada
| | - Md Rifat Arefin
- Mila, Québec AI Institute, Montréal, QC, Canada; Université de Montréal, Montréal, QC, Canada
| | - Jocelyn Faubert
- Faubert Lab, Montréal, QC, Canada; Université de Montréal, Montréal, QC, Canada
| | - Irina Rish
- Mila, Québec AI Institute, Montréal, QC, Canada; Université de Montréal, Montréal, QC, Canada
| |
Collapse
|
10
|
Zhang R, Rong R, Gan JQ, Xu Y, Wang H, Wang X. Reliable and fast automatic artifact rejection of Long-Term EEG recordings based on Isolation Forest. Med Biol Eng Comput 2024; 62:521-535. [PMID: 37943419 DOI: 10.1007/s11517-023-02961-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2023] [Accepted: 10/28/2023] [Indexed: 11/10/2023]
Abstract
Long-term electroencephalogram (Long-Term EEG) has the capacity to monitor over a long period, making it a valuable tool in medical institutions. However, due to the large volume of patient data, selecting clean data segments from raw Long-Term EEG for further analysis is an extremely time-consuming and labor-intensive task. Furthermore, the various actions of patients during recording make it difficult to use algorithms to denoise part of the EEG data, and thus lead to the rejection of these data. Therefore, tools for the quick rejection of heavily corrupted epochs in Long-Term EEG records are highly beneficial. In this paper, a new reliable and fast automatic artifact rejection method for Long-Term EEG based on Isolation Forest (IF) is proposed. Specifically, the IF algorithm is repetitively applied to detect outliers in the EEG data, and the boundary of inliers is promptly adjusted by using a statistical indicator to make the algorithm proceed in an iterative manner. The iteration is terminated when the distance metric between clean epochs and artifact-corrupted epochs remains unchanged. Six statistical indicators (i.e., min, max, median, mean, kurtosis, and skewness) are evaluated by setting them as centroid to adjust the boundary during iteration, and the proposed method is compared with several state-of-the-art methods on a retrospectively collected dataset. The experimental results indicate that utilizing the min value of data as the centroid yields the most optimal performance, and the proposed method is highly efficacious and reliable in the automatic artifact rejection of Long-Term EEG, as it significantly improves the overall data quality. Furthermore, the proposed method surpasses compared methods on most data segments with poor data quality, demonstrating its superior capacity to enhance the data quality of the heavily corrupted data. Besides, owing to the linear time complexity of IF, the proposed method is much faster than other methods, thus providing an advantage when dealing with extensive datasets.
Collapse
Affiliation(s)
- Runkai Zhang
- Key Laboratory of Child Development and Learning Science of Ministry of Education, School of Biological Science & Medical Engineering, Southeast University, Nanjing, 210096, Jiangsu, People's Republic of China
| | - Rong Rong
- Department of Neurology, Nanjing Drum Tower Hospital, Nanjing, 210008, Jiangsu, People's Republic of China
| | - John Q Gan
- School of Computer Science and Electronic Engineering, University of Essex, Colchester, CO4 3SQ, UK
| | - Yun Xu
- Department of Neurology, Nanjing Drum Tower Hospital, Nanjing, 210008, Jiangsu, People's Republic of China
| | - Haixian Wang
- Key Laboratory of Child Development and Learning Science of Ministry of Education, School of Biological Science & Medical Engineering, Southeast University, Nanjing, 210096, Jiangsu, People's Republic of China.
| | - Xiaoyun Wang
- Department of Neurology, Nanjing Drum Tower Hospital, Nanjing, 210008, Jiangsu, People's Republic of China.
| |
Collapse
|
11
|
Zhang G, Garrett DR, Simmons AM, Kiat JE, Luck SJ. Evaluating the effectiveness of artifact correction and rejection in event-related potential research. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.09.16.558075. [PMID: 37745415 PMCID: PMC10516012 DOI: 10.1101/2023.09.16.558075] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/26/2023]
Abstract
Eyeblinks and other large artifacts can create two major problems in event-related potential (ERP) research, namely confounds and increased noise. Here, we developed a method for assessing the effectiveness of artifact correction and rejection methods at minimizing these two problems. We then used this method to assess a common artifact minimization approach, in which independent component analysis (ICA) is used to correct ocular artifacts, and artifact rejection is used to reject trials with extreme values resulting from other sources (e.g., movement artifacts). This approach was applied to data from five common ERP components (P3b, N400, N170, mismatch negativity, and error-related negativity). Four common scoring methods (mean amplitude, peak amplitude, peak latency, and 50% area latency) were examined for each component. We found that eyeblinks differed systematically across experimental conditions for several of the components. We also found that artifact correction was reasonably effective at minimizing these confounds, although it did not usually eliminate them completely. In addition, we found that the rejection of trials with extreme voltage values was effective at reducing noise, with the benefits of eliminating these trials outweighing the reduced number of trials available for averaging. For researchers who are analyzing similar ERP components and participant populations, this combination of artifact correction and rejection approaches should minimize artifact-related confounds and lead to improved data quality. Researchers who are analyzing other components or participant populations can use the method developed in this study to determine which artifact minimization approaches are effective in their data.
Collapse
Affiliation(s)
- Guanghui Zhang
- Center for Mind & Brain, University of California-Davis, Davis, CA, USA
| | - David R Garrett
- Center for Mind & Brain, University of California-Davis, Davis, CA, USA
| | - Aaron M Simmons
- Center for Mind & Brain, University of California-Davis, Davis, CA, USA
| | - John E Kiat
- Center for Mind & Brain, University of California-Davis, Davis, CA, USA
| | - Steven J Luck
- Center for Mind & Brain, University of California-Davis, Davis, CA, USA
| |
Collapse
|
12
|
Schmoigl-Tonis M, Schranz C, Müller-Putz GR. Methods for motion artifact reduction in online brain-computer interface experiments: a systematic review. Front Hum Neurosci 2023; 17:1251690. [PMID: 37920561 PMCID: PMC10619676 DOI: 10.3389/fnhum.2023.1251690] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2023] [Accepted: 09/11/2023] [Indexed: 11/04/2023] Open
Abstract
Brain-computer interfaces (BCIs) have emerged as a promising technology for enhancing communication between the human brain and external devices. Electroencephalography (EEG) is particularly promising in this regard because it has high temporal resolution and can be easily worn on the head in everyday life. However, motion artifacts caused by muscle activity, fasciculation, cable swings, or magnetic induction pose significant challenges in real-world BCI applications. In this paper, we present a systematic review of methods for motion artifact reduction in online BCI experiments. Using the PRISMA filter method, we conducted a comprehensive literature search on PubMed, focusing on open access publications from 1966 to 2022. We evaluated 2,333 publications based on predefined filtering rules to identify existing methods and pipelines for motion artifact reduction in EEG data. We present a lookup table of all papers that passed the defined filters, all used methods, and pipelines and compare their overall performance and suitability for online BCI experiments. We summarize suitable methods, algorithms, and concepts for motion artifact reduction in online BCI applications, highlight potential research gaps, and discuss existing community consensus. This review aims to provide a comprehensive overview of the current state of the field and guide researchers in selecting appropriate methods for motion artifact reduction in online BCI experiments.
Collapse
Affiliation(s)
- Mathias Schmoigl-Tonis
- Laboratory of Collaborative Robotics, Department of Human Motion Analytics, Salzburg Research GmbH, Salzburg, Austria
- Institute of Neural Engineering, Laboratory of Brain-Computer Interfaces, Graz University of Technology, Graz, Austria
| | - Christoph Schranz
- Laboratory of Collaborative Robotics, Department of Human Motion Analytics, Salzburg Research GmbH, Salzburg, Austria
| | - Gernot R. Müller-Putz
- Institute of Neural Engineering, Laboratory of Brain-Computer Interfaces, Graz University of Technology, Graz, Austria
- BioTechMed Graz, Graz, Austria
| |
Collapse
|
13
|
Kaongoen N, Choi J, Woo Choi J, Kwon H, Hwang C, Hwang G, Kim BH, Jo S. The future of wearable EEG: a review of ear-EEG technology and its applications. J Neural Eng 2023; 20:051002. [PMID: 37748474 DOI: 10.1088/1741-2552/acfcda] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Accepted: 09/25/2023] [Indexed: 09/27/2023]
Abstract
Objective.This review paper provides a comprehensive overview of ear-electroencephalogram (EEG) technology, which involves recording EEG signals from electrodes placed in or around the ear, and its applications in the field of neural engineering.Approach.We conducted a thorough literature search using multiple databases to identify relevant studies related to ear-EEG technology and its various applications. We selected 123 publications and synthesized the information to highlight the main findings and trends in this field.Main results.Our review highlights the potential of ear-EEG technology as the future of wearable EEG technology. We discuss the advantages and limitations of ear-EEG compared to traditional scalp-based EEG and methods to overcome those limitations. Through our review, we found that ear-EEG is a promising method that produces comparable results to conventional scalp-based methods. We review the development of ear-EEG sensing devices, including the design, types of sensors, and materials. We also review the current state of research on ear-EEG in different application areas such as brain-computer interfaces, and clinical monitoring.Significance.This review paper is the first to focus solely on reviewing ear-EEG research articles. As such, it serves as a valuable resource for researchers, clinicians, and engineers working in the field of neural engineering. Our review sheds light on the exciting future prospects of ear-EEG, and its potential to advance neural engineering research and become the future of wearable EEG technology.
Collapse
Affiliation(s)
- Netiwit Kaongoen
- Information and Electronics Research Institute, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Jaehoon Choi
- School of Computing, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Jin Woo Choi
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA 94304, United States of America
| | - Haram Kwon
- School of Computing, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Chaeeun Hwang
- School of Computing, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Guebin Hwang
- Robotics Program, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Byung Hyung Kim
- Department of Artificial Intelligence, Inha University, Incheon, Republic of Korea
| | - Sungho Jo
- School of Computing, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| |
Collapse
|
14
|
Downey RJ, Ferris DP. iCanClean Removes Motion, Muscle, Eye, and Line-Noise Artifacts from Phantom EEG. SENSORS (BASEL, SWITZERLAND) 2023; 23:8214. [PMID: 37837044 PMCID: PMC10574843 DOI: 10.3390/s23198214] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Revised: 09/26/2023] [Accepted: 09/27/2023] [Indexed: 10/15/2023]
Abstract
The goal of this study was to test a novel approach (iCanClean) to remove non-brain sources from scalp EEG data recorded in mobile conditions. We created an electrically conductive phantom head with 10 brain sources, 10 contaminating sources, scalp, and hair. We tested the ability of iCanClean to remove artifacts while preserving brain activity under six conditions: Brain, Brain + Eyes, Brain + Neck Muscles, Brain + Facial Muscles, Brain + Walking Motion, and Brain + All Artifacts. We compared iCanClean to three other methods: Artifact Subspace Reconstruction (ASR), Auto-CCA, and Adaptive Filtering. Before and after cleaning, we calculated a Data Quality Score (0-100%), based on the average correlation between brain sources and EEG channels. iCanClean consistently outperformed the other three methods, regardless of the type or number of artifacts present. The most striking result was for the condition with all artifacts simultaneously present. Starting from a Data Quality Score of 15.7% (before cleaning), the Brain + All Artifacts condition improved to 55.9% after iCanClean. Meanwhile, it only improved to 27.6%, 27.2%, and 32.9% after ASR, Auto-CCA, and Adaptive Filtering. For context, the Brain condition scored 57.2% without cleaning (reasonable target). We conclude that iCanClean offers the ability to clear multiple artifact sources in real time and could facilitate human mobile brain-imaging studies with EEG.
Collapse
Affiliation(s)
| | - Daniel P. Ferris
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA;
| |
Collapse
|
15
|
Lee M, Hong Y, An S, Park U, Shin J, Lee J, Oh MS, Lee BC, Yu KH, Lim JS, Kang SW. Machine learning-based prediction of post-stroke cognitive status using electroencephalography-derived brain network attributes. Front Aging Neurosci 2023; 15:1238274. [PMID: 37842126 PMCID: PMC10568623 DOI: 10.3389/fnagi.2023.1238274] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2023] [Accepted: 09/11/2023] [Indexed: 10/17/2023] Open
Abstract
Objectives More than half of patients with acute ischemic stroke develop post-stroke cognitive impairment (PSCI), a significant barrier to future neurological recovery. Thus, predicting cognitive trajectories post-AIS is crucial. Our primary objective is to determine whether brain network properties from electroencephalography (EEG) can predict post-stroke cognitive function using machine learning approach. Methods We enrolled consecutive stroke patients who underwent both EEG during the acute stroke phase and cognitive assessments 3 months post-stroke. We preprocessed acute stroke EEG data to eliminate low-quality epochs, then performed independent component analysis and quantified network characteristics using iSyncBrain®. Cognitive function was evaluated using the Montreal cognitive assessment (MoCA). We initially categorized participants based on the lateralization of their lesions and then developed machine learning models to predict cognitive status in the left and right hemisphere lesion groups. Results Eighty-seven patients were included, and the accuracy of lesion laterality prediction using EEG attributes was 97.0%. In the left hemispheric lesion group, the network attributes of the theta band were significantly correlated with MoCA scores, and higher global efficiency, clustering coefficient, and lower characteristic path length were associated with higher MoCA scores. Most features related to cognitive scores were selected from the frontal lobe. The predictive powers (R-squared) were 0.76 and 0.65 for the left and right stroke groups, respectively. Conclusion Estimating EEG-based network properties in the acute phase of ischemic stroke through a machine learning model has a potential to predict cognitive outcomes after ischemic stroke.
Collapse
Affiliation(s)
- Minwoo Lee
- Department of Neurology, Hallym University Sacred Heart Hospital, Hallym Neurological Institute, Hallym University College of Medicine, Anyang, Republic of Korea
| | | | - Sungsik An
- Department of Neurology, Hwahong Hospital, Suwon, Republic of Korea
| | - Ukeob Park
- iMedisync, Inc., Seoul, Republic of Korea
| | | | - Jeongjae Lee
- Department of Neurology, Hallym University Sacred Heart Hospital, Hallym Neurological Institute, Hallym University College of Medicine, Anyang, Republic of Korea
| | - Mi Sun Oh
- Department of Neurology, Hallym University Sacred Heart Hospital, Hallym Neurological Institute, Hallym University College of Medicine, Anyang, Republic of Korea
| | - Byung-Chul Lee
- Department of Neurology, Hallym University Sacred Heart Hospital, Hallym Neurological Institute, Hallym University College of Medicine, Anyang, Republic of Korea
| | - Kyung-Ho Yu
- Department of Neurology, Hallym University Sacred Heart Hospital, Hallym Neurological Institute, Hallym University College of Medicine, Anyang, Republic of Korea
| | - Jae-Sung Lim
- Department of Neurology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | | |
Collapse
|
16
|
Dong Y, Tang X, Li Q, Wang Y, Jiang N, Tian L, Zheng Y, Li X, Zhao S, Li G, Fang P. An Approach for EEG Denoising Based on Wasserstein Generative Adversarial Network. IEEE Trans Neural Syst Rehabil Eng 2023; 31:3524-3534. [PMID: 37643110 DOI: 10.1109/tnsre.2023.3309815] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/31/2023]
Abstract
Electroencephalogram (EEG) recordings often contain artifacts that would lower signal quality. Many efforts have been made to eliminate or at least minimize the artifacts, and most of them rely on visual inspection and manual operations, which is time/labor-consuming, subjective, and incompatible to filter massive EEG data in real-time. In this paper, we proposed a deep learning framework named Artifact Removal Wasserstein Generative Adversarial Network (AR-WGAN), where the well-trained model can decompose input EEG, detect and delete artifacts, and then reconstruct denoised signals within a short time. The proposed approach was systematically compared with commonly used denoising methods including Denoised AutoEncoder, Wiener Filter, and Empirical Mode Decomposition, with both public and self-collected datasets. The experimental results proved the promising performance of AR-WGAN on automatic artifact removal for massive data across subjects, with correlation coefficient up to 0.726±0.033, and temporal and spatial relative root-mean-square error as low as 0.176±0.046 and 0.761±0.046, respectively. This work may demonstrate the proposed AR-WGAN as a high-performance end-to-end method for EEG denoising, with many on-line applications in clinical EEG monitoring and brain-computer interfaces.
Collapse
|
17
|
Saini F, Masina F, Wells J, Rosch R, Hamburg S, Startin C, Strydom A. The mismatch negativity as an index of cognitive abilities in adults with Down syndrome. Cereb Cortex 2023; 33:9639-9651. [PMID: 37401006 PMCID: PMC10431748 DOI: 10.1093/cercor/bhad233] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Revised: 06/09/2023] [Accepted: 06/10/2023] [Indexed: 07/05/2023] Open
Abstract
Down syndrome (DS) is associated with an ultra-high risk of developing Alzheimer's disease (AD). Understanding variability in pre-AD cognitive abilities may help understand cognitive decline in this population. The mismatch negativity (MMN) is an event-related potential component reflecting the detection of deviant stimuli that is thought to represent underlying memory processes, with reduced MMN amplitudes being associated with cognitive decline. To further understand the MMN in adults with DS without AD, we explored the relationships between MMN, age, and cognitive abilities (memory, language, and attention) in 27 individuals (aged 17-51) using a passive auditory oddball task. Statistically significant MMN was present only in 18 individuals up to 41 years of age and the latency were longer than canonical parameters reported in the literature. Reduced MMN amplitude was associated with lower memory scores, while longer MMN latencies were associated with poorer memory, verbal abilities, and attention. Therefore, the MMN may represent a valuable index of cognitive abilities in DS. In combination with previous findings, we hypothesize that while MMN response and amplitude may be associated with AD-related memory loss, MMN latency may be associated with speech signal processing. Future studies may explore the potential impact of AD on MMN in people with DS.
Collapse
Affiliation(s)
- Fedal Saini
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, 16 De Crespigny Park, London SE5 8AB, UK
| | - Fabio Masina
- IRCCS San Camillo Hospital, Via Alberoni, 70, 30126 Lido VE, Italy
| | - Jasmine Wells
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, 16 De Crespigny Park, London SE5 8AB, UK
| | - Richard Rosch
- Department of Clinical Neurophysiology, King’s College Hospital NHS Foundation Trust, Golden Jubilee, Denmark Hill, London SE5 9RS, UK
- Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology, University College London, Queen Square, London WC1N 3AR, UK
| | - Sarah Hamburg
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, 16 De Crespigny Park, London SE5 8AB, UK
- Division of Psychiatry, University College London, Maple House, 149 Tottenham Ct Rd, London W1T 7BN, UK
| | - Carla Startin
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, 16 De Crespigny Park, London SE5 8AB, UK
- Division of Psychiatry, University College London, Maple House, 149 Tottenham Ct Rd, London W1T 7BN, UK
- School of Psychology, University of Roehampton, Grove House, Roehampton Lane, London, SW15 5PJ, UK
| | - André Strydom
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, 16 De Crespigny Park, London SE5 8AB, UK
- Division of Psychiatry, University College London, Maple House, 149 Tottenham Ct Rd, London W1T 7BN, UK
| |
Collapse
|
18
|
Georgiadis K, Kalaganis FP, Riskos K, Matta E, Oikonomou VP, Yfantidou I, Chantziaras D, Pantouvakis K, Nikolopoulos S, Laskaris NA, Kompatsiaris I. NeuMa - the absolute Neuromarketing dataset en route to an holistic understanding of consumer behaviour. Sci Data 2023; 10:508. [PMID: 37537187 PMCID: PMC10400531 DOI: 10.1038/s41597-023-02392-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2023] [Accepted: 07/17/2023] [Indexed: 08/05/2023] Open
Abstract
Neuromarketing is a continuously evolving field that utilises neuroimaging technologies to explore consumers' behavioural responses to specific marketing-related stimulation, and furthermore introduces novel marketing tools that could complement the traditional ones like questionnaires. In this context, the present paper introduces a multimodal Neuromarketing dataset that encompasses the data from 42 individuals who participated in an advertising brochure-browsing scenario. In more detail, participants were exposed to a series of supermarket brochures (containing various products) and instructed to select the products they intended to buy. The data collected for each individual executing this protocol included: (i) encephalographic (EEG) recordings, (ii) eye tracking (ET) recordings, (iii) questionnaire responses (demographic, profiling and product related questions), and (iv) computer mouse data. NeuMa dataset has both dynamic and multimodal nature and, due to the narrow availability of open relevant datasets, provides new and unique opportunities for researchers in the field to attempt a more holistic approach to neuromarketing.
Collapse
Affiliation(s)
- Kostas Georgiadis
- Centre for Research & Technology Hellas, Information Technologies Institute (ITI), Thermi-Thessaloniki, Greece.
| | - Fotis P Kalaganis
- Centre for Research & Technology Hellas, Information Technologies Institute (ITI), Thermi-Thessaloniki, Greece
| | - Kyriakos Riskos
- Aristotle University of Thessaloniki, Department of Journalism and Mass Communications, Thessaloniki, Greece
- Erasmus University Rotterdam, Department of Media and Communication, Rotterdam, the Netherlands
| | | | - Vangelis P Oikonomou
- Centre for Research & Technology Hellas, Information Technologies Institute (ITI), Thermi-Thessaloniki, Greece
| | - Ioanna Yfantidou
- Aristotle University of Thessaloniki, Department of Journalism and Mass Communications, Thessaloniki, Greece
| | | | | | - Spiros Nikolopoulos
- Centre for Research & Technology Hellas, Information Technologies Institute (ITI), Thermi-Thessaloniki, Greece
| | - Nikos A Laskaris
- Artificial Intelligence & Information Analysis Lab, Department of Informatics, School of Sciences, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Ioannis Kompatsiaris
- Centre for Research & Technology Hellas, Information Technologies Institute (ITI), Thermi-Thessaloniki, Greece
| |
Collapse
|
19
|
Kaongoen N, Jo S. Adapting Artifact Subspace Reconstruction Method for SingleChannel EEG using Signal Decomposition Techniques . ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38083141 DOI: 10.1109/embc40787.2023.10340077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Artifact removal from electroencephalography (EEG) data is a crucial step in the analysis of neural signals. One method that has been gaining popularity in recent years is Artifact Subspace Reconstruction (ASR), which is highly effective in eliminating large amplitude and transient artifacts in EEG data. However, traditional ASR is not possible to use with single-channel EEG data. In this study, we propose incorporating signal decomposition techniques such as ensemble empirical mode decomposition (EEMD), wavelet transform (WT), and singular spectrum analysis (SSA) into ASR, to decompose single-channel data into multiple components. This allows the ASR process to be applied effectively to the data. Our results show that the proposed single-channel version of ASR outperforms its counterpart Independent Component Analysis (ICA) methods when tested on two open datasets. Our findings indicate that ASR has significant potential as a powerful tool for removing artifacts from EEG data analysis.Clinical Relevance- This provided artifact removal technique for single-channel EEG.
Collapse
|
20
|
Fernández-Rodríguez Á, Ron-Angevin R, Velasco-Álvarez F, Diaz-Pineda J, Letouzé T, André JM. Evaluation of Single-Trial Classification to Control a Visual ERP-BCI under a Situation Awareness Scenario. Brain Sci 2023; 13:886. [PMID: 37371365 DOI: 10.3390/brainsci13060886] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Revised: 05/15/2023] [Accepted: 05/29/2023] [Indexed: 06/29/2023] Open
Abstract
An event-related potential (ERP)-based brain-computer interface (BCI) can be used to monitor a user's cognitive state during a surveillance task in a situational awareness context. The present study explores the use of an ERP-BCI for detecting new planes in an air traffic controller (ATC). Two experiments were conducted to evaluate the impact of different visual factors on target detection. Experiment 1 validated the type of stimulus used and the effect of not knowing its appearance location in an ERP-BCI scenario. Experiment 2 evaluated the effect of the size of the target stimulus appearance area and the stimulus salience in an ATC scenario. The main results demonstrate that the size of the plane appearance area had a negative impact on the detection performance and on the amplitude of the P300 component. Future studies should address this issue to improve the performance of an ATC in stimulus detection using an ERP-BCI.
Collapse
Affiliation(s)
- Álvaro Fernández-Rodríguez
- Departamento de Tecnología Electrónica, Instituto Universitario de Investigación en Telecomunicación de la Universidad de Málaga (TELMA), Universidad de Málaga, 29071 Malaga, Spain
| | - Ricardo Ron-Angevin
- Departamento de Tecnología Electrónica, Instituto Universitario de Investigación en Telecomunicación de la Universidad de Málaga (TELMA), Universidad de Málaga, 29071 Malaga, Spain
| | - Francisco Velasco-Álvarez
- Departamento de Tecnología Electrónica, Instituto Universitario de Investigación en Telecomunicación de la Universidad de Málaga (TELMA), Universidad de Málaga, 29071 Malaga, Spain
| | | | - Théodore Letouzé
- Laboratoire IMS, CNRS UMR 5218, Cognitive Team, Bordeaux INP-ENSC, 33400 Talence, France
| | - Jean-Marc André
- Laboratoire IMS, CNRS UMR 5218, Cognitive Team, Bordeaux INP-ENSC, 33400 Talence, France
| |
Collapse
|
21
|
Wireless EEG: A survey of systems and studies. Neuroimage 2023; 269:119774. [PMID: 36566924 DOI: 10.1016/j.neuroimage.2022.119774] [Citation(s) in RCA: 34] [Impact Index Per Article: 34.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Revised: 11/18/2022] [Accepted: 11/27/2022] [Indexed: 12/24/2022] Open
Abstract
The popular brain monitoring method of electroencephalography (EEG) has seen a surge in commercial attention in recent years, focusing mostly on hardware miniaturization. This has led to a varied landscape of portable EEG devices with wireless capability, allowing them to be used by relatively unconstrained users in real-life conditions outside of the laboratory. The wide availability and relative affordability of these devices provide a low entry threshold for newcomers to the field of EEG research. The large device variety and the at times opaque communication from their manufacturers, however, can make it difficult to obtain an overview of this hardware landscape. Similarly, given the breadth of existing (wireless) EEG knowledge and research, it can be challenging to get started with novel ideas. Therefore, this paper first provides a list of 48 wireless EEG devices along with a number of important-sometimes difficult-to-obtain-features and characteristics to enable their side-by-side comparison, along with a brief introduction to each of these aspects and how they may influence one's decision. Secondly, we have surveyed previous literature and focused on 110 high-impact journal publications making use of wireless EEG, which we categorized by application and analyzed for device used, number of channels, sample size, and participant mobility. Together, these provide a basis for informed decision making with respect to hardware and experimental precedents when considering new, wireless EEG devices and research. At the same time, this paper provides background material and commentary about pitfalls and caveats regarding this increasingly accessible line of research.
Collapse
|
22
|
Wascher E, Reiser J, Rinkenauer G, Larrá M, Dreger FA, Schneider D, Karthaus M, Getzmann S, Gutberlet M, Arnau S. Neuroergonomics on the Go: An Evaluation of the Potential of Mobile EEG for Workplace Assessment and Design. HUMAN FACTORS 2023; 65:86-106. [PMID: 33861182 PMCID: PMC9846382 DOI: 10.1177/00187208211007707] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/15/2021] [Accepted: 03/13/2021] [Indexed: 06/12/2023]
Abstract
OBJECTIVE We demonstrate and discuss the use of mobile electroencephalogram (EEG) for neuroergonomics. Both technical state of the art as well as measures and cognitive concepts are systematically addressed. BACKGROUND Modern work is increasingly characterized by information processing. Therefore, the examination of mental states, mental load, or cognitive processing during work is becoming increasingly important for ergonomics. RESULTS Mobile EEG allows to measure mental states and processes under real live conditions. It can be used for various research questions in cognitive neuroergonomics. Besides measures in the frequency domain that have a long tradition in the investigation of mental fatigue, task load, and task engagement, new approaches-like blink-evoked potentials-render event-related analyses of the EEG possible also during unrestricted behavior. CONCLUSION Mobile EEG has become a valuable tool for evaluating mental states and mental processes on a highly objective level during work. The main advantage of this technique is that working environments don't have to be changed while systematically measuring brain functions at work. Moreover, the workflow is unaffected by such neuroergonomic approaches.
Collapse
Affiliation(s)
- Edmund Wascher
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Julian Reiser
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Gerhard Rinkenauer
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Mauro Larrá
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Felix A. Dreger
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Daniel Schneider
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Melanie Karthaus
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Stephan Getzmann
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | | | - Stefan Arnau
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| |
Collapse
|
23
|
Duan X, Xie S, Lv Y, Xie X, Obermayer K, Yan H. A transfer learning-based feedback training motivates the performance of SMR-BCI. J Neural Eng 2023; 20. [PMID: 36577144 DOI: 10.1088/1741-2552/acaee7] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2022] [Accepted: 12/28/2022] [Indexed: 12/29/2022]
Abstract
Objective. Feedback training is a practical approach to brain-computer interface (BCI) end-users learning to modulate their sensorimotor rhythms (SMRs). BCI self-regulation learning has been shown to be influenced by subjective psychological factors, such as motivation. However, few studies have taken into account the users' self-motivation as additional guidance for the cognitive process involved in BCI learning. In this study we tested a transfer learning (TL) feedback method designed to increase self-motivation by providing information about past performance.Approach. Electroencephalography (EEG) signals from the previous runs were affine transformed and displayed as points on the screen, along with the newly recorded EEG signals in the current run, giving the subjects a context for self-motivation. Subjects were asked to separate the feedback points for the current run under the display of the separability of prior training. We conducted a between-subject feedback training experiment, in which 24 healthy SMR-BCI naive subjects were trained to imagine left- and right-hand movements. The participants were provided with either TL feedback or typical cursor-bar (CB) feedback (control condition), for three sessions on separate days.Main results. The behavioral results showed an increased challenge and stable mastery confidence, suggesting that subjects' motivation grew as the feedback training went on. The EEG results showed favorable overall training effects with TL feedback in terms of the class distinctiveness and EEG discriminancy. Performance was 28.5% higher in the third session than in the first. About 41.7% of the subjects were 'learners' including not only low-performance subjects, but also good-performance subjects who might be affected by the ceiling effect. Subjects were able to control BCI with TL feedback with a higher performance of 60.5% during the last session compared to CB feedback.Significance. The present study demonstrated that the proposed TL feedback method boosted psychological engagement through the self-motivated context, and further allowed subjects to modulate SMR effectively. The proposed TL feedback method also provided an alternative to typical CB feedback.
Collapse
Affiliation(s)
- Xu Duan
- School of Electronics and Information, Northwestern Polytechnical University, Dongxiang Road 1, Xi'an 710129, People's Republic of China.,Key Laboratory for Artificial Intelligence and Cognitive Neuroscience of Language, Xi'an International Studies University, Wenyuan South Road, Xi'an 710128, People's Republic of China
| | - Songyun Xie
- School of Electronics and Information, Northwestern Polytechnical University, Dongxiang Road 1, Xi'an 710129, People's Republic of China
| | - Yanxia Lv
- School of Electronics and Information, Northwestern Polytechnical University, Dongxiang Road 1, Xi'an 710129, People's Republic of China
| | - Xinzhou Xie
- School of Electronics and Information, Northwestern Polytechnical University, Dongxiang Road 1, Xi'an 710129, People's Republic of China
| | - Klaus Obermayer
- Faculty of Electrical Engineering and Computer Science, Technical University Berlin, Marchstraße 23, Berlin 10587, Germany
| | - Hao Yan
- Key Laboratory for Artificial Intelligence and Cognitive Neuroscience of Language, Xi'an International Studies University, Wenyuan South Road, Xi'an 710128, People's Republic of China
| |
Collapse
|
24
|
Sato Y, Nishimaru H, Matsumoto J, Setogawa T, Nishijo H. Electroencephalographic Effective Connectivity Analysis of the Neural Networks during Gesture and Speech Production Planning in Young Adults. Brain Sci 2023; 13:brainsci13010100. [PMID: 36672081 PMCID: PMC9856316 DOI: 10.3390/brainsci13010100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2022] [Revised: 12/19/2022] [Accepted: 12/29/2022] [Indexed: 01/06/2023] Open
Abstract
Gestures and speech, as linked communicative expressions, form an integrated system. Previous functional magnetic resonance imaging studies have suggested that neural networks for gesture and spoken word production share similar brain regions consisting of fronto-temporo-parietal brain regions. However, information flow within the neural network may dynamically change during the planning of two communicative expressions and also differ between them. To investigate dynamic information flow in the neural network during the planning of gesture and spoken word generation in this study, participants were presented with spatial images and were required to plan the generation of gestures or spoken words to represent the same spatial situations. The evoked potentials in response to spatial images were recorded to analyze the effective connectivity within the neural network. An independent component analysis of the evoked potentials indicated 12 clusters of independent components, the dipoles of which were located in the bilateral fronto-temporo-parietal brain regions and on the medial wall of the frontal and parietal lobes. Comparison of effective connectivity indicated that information flow from the right middle cingulate gyrus (MCG) to the left supplementary motor area (SMA) and from the left SMA to the left precentral area increased during gesture planning compared with that of word planning. Furthermore, information flow from the right MCG to the left superior frontal gyrus also increased during gesture planning compared with that of word planning. These results suggest that information flow to the brain regions for hand praxis is more strongly activated during gesture planning than during word planning.
Collapse
Affiliation(s)
- Yohei Sato
- Department of System Emotional Science, Faculty of Medicine, University of Toyama, Toyama 930-0194, Japan
| | - Hiroshi Nishimaru
- Department of System Emotional Science, Faculty of Medicine, University of Toyama, Toyama 930-0194, Japan
- Research Center for Idling Brain Science (RCIBS), University of Toyama, Toyama 930-0194, Japan
| | - Jumpei Matsumoto
- Department of System Emotional Science, Faculty of Medicine, University of Toyama, Toyama 930-0194, Japan
- Research Center for Idling Brain Science (RCIBS), University of Toyama, Toyama 930-0194, Japan
| | - Tsuyoshi Setogawa
- Department of System Emotional Science, Faculty of Medicine, University of Toyama, Toyama 930-0194, Japan
- Research Center for Idling Brain Science (RCIBS), University of Toyama, Toyama 930-0194, Japan
| | - Hisao Nishijo
- Department of System Emotional Science, Faculty of Medicine, University of Toyama, Toyama 930-0194, Japan
- Research Center for Idling Brain Science (RCIBS), University of Toyama, Toyama 930-0194, Japan
- Correspondence:
| |
Collapse
|
25
|
Kim H, Miyakoshi M, Kim Y, Stapornchaisit S, Yoshimura N, Koike Y. Electroencephalography Reflects User Satisfaction in Controlling Robot Hand through Electromyographic Signals. SENSORS (BASEL, SWITZERLAND) 2022; 23:277. [PMID: 36616877 PMCID: PMC9823960 DOI: 10.3390/s23010277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 12/23/2022] [Accepted: 12/25/2022] [Indexed: 06/17/2023]
Abstract
This study addresses time intervals during robot control that dominate user satisfaction and factors of robot movement that induce satisfaction. We designed a robot control system using electromyography signals. In each trial, participants were exposed to different experiences as the cutoff frequencies of a low-pass filter were changed. The participants attempted to grab a bottle by controlling a robot. They were asked to evaluate four indicators (stability, imitation, response time, and movement speed) and indicate their satisfaction at the end of each trial by completing a questionnaire. The electroencephalography signals of the participants were recorded while they controlled the robot and responded to the questionnaire. Two independent component clusters in the precuneus and postcentral gyrus were the most sensitive to subjective evaluations. For the moment that dominated satisfaction, we observed that brain activity exhibited significant differences in satisfaction not immediately after feeding an input but during the later stage. The other indicators exhibited independently significant patterns in event-related spectral perturbations. Comparing these indicators in a low-frequency band related to the satisfaction with imitation and movement speed, which had significant differences, revealed that imitation covered significant intervals in satisfaction. This implies that imitation was the most important contributing factor among the four indicators. Our results reveal that regardless of subjective satisfaction, objective performance evaluation might more fully reflect user satisfaction.
Collapse
Affiliation(s)
- Hyeonseok Kim
- Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego, La Jolla, CA 92093, USA
| | - Makoto Miyakoshi
- Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego, La Jolla, CA 92093, USA
| | - Yeongdae Kim
- Department of Industrial Engineering and Economics, Tokyo Institute of Technology, Tokyo 152-8550, Japan
| | - Sorawit Stapornchaisit
- Department of Information and Communications Engineering, Tokyo Institute of Technology, Yokohama 226-0026, Japan
| | - Natsue Yoshimura
- Institute of Innovative Research, Tokyo Institute of Technology, Yokohama 226-0026, Japan
| | - Yasuharu Koike
- Institute of Innovative Research, Tokyo Institute of Technology, Yokohama 226-0026, Japan
| |
Collapse
|
26
|
Kim N, Grégoire L, Razavi M, Yan N, Ahn CR, Anderson BA. Virtual accident curb risk habituation in workers by restoring sensory responses to real-world warning. iScience 2022; 26:105827. [PMID: 36636343 PMCID: PMC9830218 DOI: 10.1016/j.isci.2022.105827] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 11/06/2022] [Accepted: 12/13/2022] [Indexed: 12/23/2022] Open
Abstract
In high-risk work environments, workers become habituated to hazards they frequently encounter, subsequently underestimating risk and engaging in unsafe behaviors. This phenomenon has been termed "risk habituation" and identified as a vital root cause of fatalities and injuries at workplaces. Providing an effective intervention that curbs workers' risk habituation is critical in preventing occupational injuries and fatalities. However, there exists no empirically supported intervention for curbing risk habituation. To this end, here we investigated how experiencing an accident in a virtual reality (VR) environment affects workers' risk habituation toward repeatedly exposed workplace hazards. We examined an underlying mechanism of risk habituation at the sensory level and evaluated the effect of the accident intervention through electroencephalography (EEG). The results of pre- and posttreatment analyses indicate experiencing the virtual accident effectively curbs risk habituation at both the behavioral and sensory level. The findings open new vistas for occupational safety training.
Collapse
Affiliation(s)
- Namgyun Kim
- Department of Civil and Environmental Engineering and Engineering Mechanics, University of Dayton, Dayton, OH, USA
| | - Laurent Grégoire
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, TX, USA
| | - Moein Razavi
- Department of Industrial and Systems Engineering, Texas A&M University, College Station, TX, USA
| | - Niya Yan
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, TX, USA
| | - Changbum R. Ahn
- Department of Architecture and Architectural Engineering, Seoul National University, Seoul, South Korea
- Corresponding author
| | - Brian A. Anderson
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, TX, USA
- Corresponding author
| |
Collapse
|
27
|
Bao Z, Frewen P. Sense of self in mind and body: an eLORETA-EEG study. Neurosci Conscious 2022; 2022:niac017. [PMID: 36530551 PMCID: PMC9748806 DOI: 10.1093/nc/niac017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2022] [Revised: 10/06/2022] [Accepted: 11/03/2022] [Indexed: 12/23/2022] Open
Abstract
The human brain engages the sense of self through both semantic and somatic self-referential processing (SRP). Alpha and theta oscillations have been found to underlie SRP but have not been compared with respect to semantic and somatic SRP. We recorded electroencephalography (EEG) from 50 participants during focused internal attention on life roles (e.g. "friend") and outer body (e.g. "arms") compared to resting state and an external attention memory task and localized the sources of on-scalp alpha (8-12 Hz) and theta (4-8 Hz) EEG signals with exact low-resolution tomography. Logarithm of F-ratios was calculated to compare differences in alpha and theta power between SRP conditions, resting state, and external attention. Results indicated that compared to resting state, semantic SRP induced lower theta in the frontal cortex and higher theta in the parietal cortex, whereas somatic SRP induced lower alpha in the frontal and insula cortex and higher alpha in the parietal cortex. Furthermore, results indicated that compared to external attention, both semantic and somatic SRP induced higher alpha in the dorsolateral prefrontal cortex with lateralized patterns based on task condition. Finally, an analysis directly comparing semantic and somatic SRP indicated frontal-parietal and left-right lateralization of SRP in the brain. Our results suggest the alpha and theta oscillations in the frontal, parietal, and the insula cortex may play crucial roles in semantic and somatic SRP.
Collapse
Affiliation(s)
| | - Paul Frewen
- *Correspondence address. Department of Psychiatry, Schulich School of Medicine and Dentistry, 339 Windermere Rd., London, ON N6A 5A5, Canada. Tel: +519 685 8500 E-mail:
| |
Collapse
|
28
|
Fernández-Rodríguez Á, Darves-Bornoz A, Velasco-Álvarez F, Ron-Angevin R. Effect of Stimulus Size in a Visual ERP-Based BCI under RSVP. SENSORS (BASEL, SWITZERLAND) 2022; 22:9505. [PMID: 36502205 PMCID: PMC9741214 DOI: 10.3390/s22239505] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Revised: 11/23/2022] [Accepted: 12/02/2022] [Indexed: 06/17/2023]
Abstract
Rapid serial visual presentation (RSVP) is currently one of the most suitable paradigms for use with a visual brain-computer interface based on event-related potentials (ERP-BCI) by patients with a lack of ocular motility. However, gaze-independent paradigms have not been studied as closely as gaze-dependent ones, and variables such as the sizes of the stimuli presented have not yet been explored under RSVP. Hence, the aim of the present work is to assess whether stimulus size has an impact on ERP-BCI performance under the RSVP paradigm. Twelve participants tested the ERP-BCI under RSVP using three different stimulus sizes: small (0.1 × 0.1 cm), medium (1.9 × 1.8 cm), and large (20.05 × 19.9 cm) at 60 cm. The results showed significant differences in accuracy between the conditions; the larger the stimulus, the better the accuracy obtained. It was also shown that these differences were not due to incorrect perception of the stimuli since there was no effect from the size in a perceptual discrimination task. The present work therefore shows that stimulus size has an impact on the performance of an ERP-BCI under RSVP. This finding should be considered by future ERP-BCI proposals aimed at users who need gaze-independent systems.
Collapse
|
29
|
Fuseda K, Watanabe H, Matsumoto A, Saito J, Naruse Y, Ihara AS. Impact of depressed state on attention and language processing during news broadcasts: EEG analysis and machine learning approach. Sci Rep 2022; 12:20492. [PMID: 36443392 PMCID: PMC9703439 DOI: 10.1038/s41598-022-24319-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Accepted: 11/14/2022] [Indexed: 11/29/2022] Open
Abstract
While information enriches daily life, it can also sometimes have a negative impact, depending on an individual's mental state. We recorded electroencephalogram (EEG) signals from depressed and non-depressed individuals classified based on the Beck Depression Inventory-II score while they listened to news to clarify differences in their attention to affective information and the impact of attentional bias on language processing. Results showed that depressed individuals are characterized by delayed attention to positive news and require a more increased load on language processing. The feasibility of detecting a depressed state using these EEG characteristics was evaluated by classifying individuals as depressed and non-depressed individuals. The area under the curve in the models trained by the EEG features used was 0.73. This result shows that individuals' mental states may be assessed based on EEG measured during daily activities like listening to news.
Collapse
Affiliation(s)
- Kohei Fuseda
- grid.136593.b0000 0004 0373 3971Center for Information and Neural Networks, Advanced ICT Research Institute, National Institute of Information and Communications Technology, and Osaka University, 588-2 Iwaoka, Iwaoka-cho, Nishi-ku, Kobe, Japan ,grid.443349.d0000 0004 1791 2356Present Address: Bunkyo Gakuin University, Fujimino, Saitama, Japan
| | - Hiroki Watanabe
- grid.136593.b0000 0004 0373 3971Center for Information and Neural Networks, Advanced ICT Research Institute, National Institute of Information and Communications Technology, and Osaka University, 588-2 Iwaoka, Iwaoka-cho, Nishi-ku, Kobe, Japan
| | - Atsushi Matsumoto
- grid.136593.b0000 0004 0373 3971Center for Information and Neural Networks, Advanced ICT Research Institute, National Institute of Information and Communications Technology, and Osaka University, 588-2 Iwaoka, Iwaoka-cho, Nishi-ku, Kobe, Japan ,grid.449555.c0000 0004 0569 1963Present Address: Kansai University of Welfare Sciences, Kashiwara, Osaka, Japan
| | - Junpei Saito
- grid.136593.b0000 0004 0373 3971Center for Information and Neural Networks, Advanced ICT Research Institute, National Institute of Information and Communications Technology, and Osaka University, 588-2 Iwaoka, Iwaoka-cho, Nishi-ku, Kobe, Japan
| | - Yasushi Naruse
- grid.136593.b0000 0004 0373 3971Center for Information and Neural Networks, Advanced ICT Research Institute, National Institute of Information and Communications Technology, and Osaka University, 588-2 Iwaoka, Iwaoka-cho, Nishi-ku, Kobe, Japan
| | - Aya S. Ihara
- grid.136593.b0000 0004 0373 3971Center for Information and Neural Networks, Advanced ICT Research Institute, National Institute of Information and Communications Technology, and Osaka University, 588-2 Iwaoka, Iwaoka-cho, Nishi-ku, Kobe, Japan
| |
Collapse
|
30
|
Mavros P, J Wälti M, Nazemi M, Ong CH, Hölscher C. A mobile EEG study on the psychophysiological effects of walking and crowding in indoor and outdoor urban environments. Sci Rep 2022; 12:18476. [PMID: 36323718 PMCID: PMC9628500 DOI: 10.1038/s41598-022-20649-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2021] [Accepted: 09/16/2022] [Indexed: 11/06/2022] Open
Abstract
Environmental psychologists have established multiple psychological benefits of interaction with natural, compared to urban, environments on emotion, cognition, and attention. Yet, given the increasing urbanisation worldwide, it is equally important to understand how differences within different urban environments influence human psychological experience. We developed a laboratory experiment to examine the psychophysiological effects of the physical (outdoor or indoor) and social (crowded versus uncrowded) environment in healthy young adults, and to validate the use of mobile electroencephalography (EEG) and electrodermal activity (EDA) measurements during active walking. Participants (N = 42) were randomly assigned into a walking or a standing group, and watched six 1-min walk-through videos of green, urban indoor and urban outdoor environments, depicting high or low levels of social density. Self-reported emotional states show that green spaces is perceived as more calm and positive, and reduce attentional demands. Further, the outdoor urban space is perceived more positively than the indoor environment. These findings are consistent with earlier studies on the psychological benefits of nature and confirm the effectiveness of our paradigm and stimuli. In addition, we hypothesised that even short-term exposure to crowded scenes would have negative psychological effects. We found that crowded scenes evoked higher self-reported arousal, more negative self-reported valence, and recruited more cognitive and attentional resources. However, in walking participants, they evoked higher frontal alpha asymmetry, suggesting more positive affective responses. Furthermore, we found that using recent signal-processing methods, the EEG data produced a comparable signal-to-noise ratio between walking and standing, and that despite differences between walking and standing, skin-conductance also captured effectively psychophysiological responses to stimuli. These results suggest that emotional responses to visually presented stimuli can be measured effectively using mobile EEG and EDA in ambulatory settings, and that there is complex interaction between active walking, the social density of urban spaces, and direct and indirect affective responses to such environments.
Collapse
Affiliation(s)
- Panagiotis Mavros
- Singapore-ETH Centre, Future Cities Laboratory, CREATE campus, 1 CREATE Way, #06-01 CREATE Tower, Singapore, 138602, Singapore.
| | - Michel J Wälti
- Singapore-ETH Centre, Future Cities Laboratory, CREATE campus, 1 CREATE Way, #06-01 CREATE Tower, Singapore, 138602, Singapore
| | - Mohsen Nazemi
- Singapore-ETH Centre, Future Cities Laboratory, CREATE campus, 1 CREATE Way, #06-01 CREATE Tower, Singapore, 138602, Singapore
| | - Crystal Huiyi Ong
- Singapore-ETH Centre, Future Cities Laboratory, CREATE campus, 1 CREATE Way, #06-01 CREATE Tower, Singapore, 138602, Singapore
- National University of Singapore, Singapore, Singapore
| | - Christoph Hölscher
- Singapore-ETH Centre, Future Cities Laboratory, CREATE campus, 1 CREATE Way, #06-01 CREATE Tower, Singapore, 138602, Singapore
- Chair of Cognitive Science, Department of Humanities, Social and Political Sciences, ETH Zürich, Zürich, 8092, Switzerland
| |
Collapse
|
31
|
Tsai BY, Diddi SVS, Ko LW, Wang SJ, Chang CY, Jung TP. Development of an Adaptive Artifact Subspace Reconstruction Based on Hebbian/Anti-Hebbian Learning Networks for Enhancing BCI Performance. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2022; PP:348-361. [PMID: 35714085 DOI: 10.1109/tnnls.2022.3174528] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Brain-computer interface (BCI) actively translates the brain signals into executable actions by establishing direct communication between the human brain and external devices. Recording brain activity through electroencephalography (EEG) is generally contaminated with both physiological and nonphysiological artifacts, which significantly hinders the BCI performance. Artifact subspace reconstruction (ASR) is a well-known statistical technique that automatically removes artifact components by determining the rejection threshold based on the initial reference EEG segment in multichannel EEG recordings. In real-world applications, the fixed threshold may limit the efficacy of the artifact correction, especially when the quality of the reference data is poor. This study proposes an adaptive online ASR technique by integrating the Hebbian/anti-Hebbian neural networks into the ASR algorithm, namely, principle subspace projection ASR (PSP-ASR) and principal subspace whitening ASR (PSW-ASR) that segmentwise self-organize the artifact subspace by updating the synaptic weights according to the Hebbian and anti-Hebbian learning rules. The effectiveness of the proposed algorithm is compared to the conventional ASR approaches on benchmark EEG dataset and three BCI frameworks, including steady-state visual evoked potential (SSVEP), rapid serial visual presentation (RSVP), and motor imagery (MI) by evaluating the root-mean-square error (RMSE), the signal-to-noise ratio (SNR), the Pearson correlation, and classification accuracy. The results demonstrated that the PSW-ASR algorithm effectively removed the EEG artifacts and retained the activity-specific brain signals compared to the PSP-ASR, standard ASR (Init-ASR), and moving-window ASR (MW-ASR) methods, thereby enhancing the SSVEP, RSVP, and MI BCI performances. Finally, our empirical results from the PSW-ASR algorithm suggested the choice of an aggressive cutoff range of c = 1-10 for activity-specific BCI applications and a moderate range of for the benchmark dataset and general BCI applications.
Collapse
|
32
|
Koshiyama D, Miyakoshi M, Tanaka-Koshiyama K, Sprock J, Light GA. High-power gamma-related delta phase alteration in schizophrenia patients at rest. Psychiatry Clin Neurosci 2022; 76:179-186. [PMID: 35037330 DOI: 10.1111/pcn.13331] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/06/2021] [Revised: 12/12/2021] [Accepted: 01/03/2022] [Indexed: 11/30/2022]
Abstract
AIM Information processing is supported by the cortico-cortical transmission of neural oscillations across brain regions. Recent studies have demonstrated that the rhythmic firing of neural populations is not random but is governed by interactions with other frequency bands. Specifically, the amplitude of gamma-band oscillations is associated with the phase of lower frequency oscillations in support of short and long-range communications among networks. This cross-frequency relation is thought to reflect the temporal coordination of neural communication. While schizophrenia patients show abnormal oscillatory responses across multiple frequencies at rest, it is unclear whether the functional relationships among frequency bands are intact. This study aimed to characterize the lower frequency (delta/theta, 1-8 Hz) phase and the amplitude of gamma oscillations in healthy subjects and schizophrenia patients at rest. METHODS Low frequency-phase (delta- and theta- band) angles and gamma-band amplitude relationships were assessed in 142 schizophrenia patients and 128 healthy subjects. RESULTS Significant low-frequency phase alteration related to high-power gamma was detected across broadly distributed scalp regions in both healthy subjects and patients. In patients, delta phase synchronization related to high-power gamma was significantly decreased at the frontocentral, right middle temporal, and left temporoparietal electrodes but significantly increased at the left parietal electrode. CONCLUSIONS High-power gamma-related delta phase alteration may reflect a core pathophysiologic abnormality in schizophrenia. Data-driven measures of functional relationships among frequency bands may prove useful in the development of novel therapeutics. Future studies are needed to determine whether these alterations are specific to schizophrenia or appear in other neuropsychiatric patient populations.
Collapse
Affiliation(s)
- Daisuke Koshiyama
- Department of Psychiatry, University of California San Diego, La Jolla, California, USA
| | - Makoto Miyakoshi
- Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego, La Jolla, California, USA
| | | | - Joyce Sprock
- Department of Psychiatry, University of California San Diego, La Jolla, California, USA.,VISN-22 Mental Illness, Research, Education and Clinical Center (MIRECC), VA San Diego Healthcare System, San Diego, California, USA
| | - Gregory A Light
- Department of Psychiatry, University of California San Diego, La Jolla, California, USA.,VISN-22 Mental Illness, Research, Education and Clinical Center (MIRECC), VA San Diego Healthcare System, San Diego, California, USA
| |
Collapse
|
33
|
Scanlon JEM, Jacobsen NSJ, Maack MC, Debener S. Stepping in time: Alpha-mu and beta oscillations during a walking synchronization task. Neuroimage 2022; 253:119099. [PMID: 35301131 DOI: 10.1016/j.neuroimage.2022.119099] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2021] [Revised: 02/18/2022] [Accepted: 03/13/2022] [Indexed: 11/25/2022] Open
Abstract
Interpersonal behavioral synchrony is referred to as temporal coordination of action between two or more individuals. Humans tend to synchronize their movements during repetitive movement tasks such as walking. Mobile EEG technology now allows us to examine how this happens during gait. 18 participants equipped with foot accelerometers and mobile EEG walked with an experimenter in three conditions: With their view of the experimenter blocked, walking naturally, and trying to synchronize their steps with the experimenter. The experimenter walked following a headphone metronome to keep their steps consistent for all conditions. Step behavior and synchronization between the experimenter and participant were compared between conditions. Additionally, event-related spectral perturbations (ERSPs) were time-warped to the gait cycle in order to analyze alpha-mu (7.5-12.5 Hz) and beta (16-32 Hz) rhythms over the whole gait cycle. Step synchronization was significantly higher in the synchrony condition than in the natural condition. Likewise regarding ERSPs, right parietal channel (C4, C6, CP4, CP6) alpha-mu and central channel (C1, Cz, C2) beta power were suppressed from baseline in the walking synchrony condition compared to the natural walking condition. The natural and blocked conditions were not found to be significantly different in behavioral or spectral comparisons. Our results are compatible with the view that intentional synchronization employs systems associated with social interaction as well as the central motor system.
Collapse
Affiliation(s)
- J E M Scanlon
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany.
| | - N S J Jacobsen
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany
| | - M C Maack
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany
| | - S Debener
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany; Cluster of Excellence Hearing4all, University of Oldenburg, Oldenburg, Germany; Center for Neurosensory Science and Systems, University of Oldenburg, Oldenburg, Germany
| |
Collapse
|
34
|
Gorjan D, Gramann K, De Pauw K, Marusic U. Removal of movement-induced EEG artifacts: current state of the art and guidelines. J Neural Eng 2022; 19. [PMID: 35147512 DOI: 10.1088/1741-2552/ac542c] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2021] [Accepted: 02/08/2022] [Indexed: 11/12/2022]
Abstract
Electroencephalography (EEG) is a non-invasive technique used to record cortical neurons' electrical activity using electrodes placed on the scalp. It has become a promising avenue for research beyond state-of-the-art EEG research that is conducted under static conditions. EEG signals are always contaminated by artifacts and other physiological signals. Artifact contamination increases with the intensity of movement. In the last decade (since 2010), researchers have started to implement EEG measurements in dynamic setups to increase the overall ecological validity of the studies. Many different methods are used to remove non-brain activity from the EEG signal, and there are no clear guidelines on which method should be used in dynamic setups and for specific movement intensities. Currently, the most common methods for removing artifacts in movement studies are methods based on independent component analysis (ICA). However, the choice of method for artifact removal depends on the type and intensity of movement, which affects the characteristics of the artifacts and the EEG parameters of interest. When dealing with EEG under non-static conditions, special care must be taken already in the designing period of an experiment. Software and hardware solutions must be combined to achieve sufficient removal of unwanted signals from EEG measurements. We have provided recommendations for the use of each method depending on the intensity of the movement and highlighted the advantages and disadvantages of the methods. However, due to the current gap in the literature, further development and evaluation of methods for artifact removal in EEG data during locomotion is needed.
Collapse
Affiliation(s)
- Dasa Gorjan
- Science and Research Centre Koper, Garibaldijeva 1, Koper, 6000, SLOVENIA
| | - Klaus Gramann
- Technische Universität Berlin, Fasanenstr. 1, Berlin, Berlin, 10623, GERMANY
| | - Kevin De Pauw
- Vrije Universiteit Brussel, Pleinlaan 2, Brussel, Brussel, 1050, BELGIUM
| | - Uros Marusic
- Science and Research Centre Koper, Garibaldijeva 1, Koper, 6000, SLOVENIA
| |
Collapse
|
35
|
Hölle D, Blum S, Kissner S, Debener S, Bleichner MG. Real-Time Audio Processing of Real-Life Soundscapes for EEG Analysis: ERPs Based on Natural Sound Onsets. FRONTIERS IN NEUROERGONOMICS 2022; 3:793061. [PMID: 38235458 PMCID: PMC10790832 DOI: 10.3389/fnrgo.2022.793061] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/11/2021] [Accepted: 01/03/2021] [Indexed: 01/19/2024]
Abstract
With smartphone-based mobile electroencephalography (EEG), we can investigate sound perception beyond the lab. To understand sound perception in the real world, we need to relate naturally occurring sounds to EEG data. For this, EEG and audio information need to be synchronized precisely, only then it is possible to capture fast and transient evoked neural responses and relate them to individual sounds. We have developed Android applications (AFEx and Record-a) that allow for the concurrent acquisition of EEG data and audio features, i.e., sound onsets, average signal power (RMS), and power spectral density (PSD) on smartphone. In this paper, we evaluate these apps by computing event-related potentials (ERPs) evoked by everyday sounds. One participant listened to piano notes (played live by a pianist) and to a home-office soundscape. Timing tests showed a stable lag and a small jitter (< 3 ms) indicating a high temporal precision of the system. We calculated ERPs to sound onsets and observed the typical P1-N1-P2 complex of auditory processing. Furthermore, we show how to relate information on loudness (RMS) and spectra (PSD) to brain activity. In future studies, we can use this system to study sound processing in everyday life.
Collapse
Affiliation(s)
- Daniel Hölle
- Neurophysiology of Everyday Life Group, Department of Psychology, University of Oldenburg, Oldenburg, Germany
| | - Sarah Blum
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany
- Cluster of Excellence Hearing4all, Oldenburg, Germany
| | - Sven Kissner
- Institute for Hearing Technology and Audiology, Jade University of Applied Sciences, Oldenburg, Germany
| | - Stefan Debener
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany
| | - Martin G. Bleichner
- Neurophysiology of Everyday Life Group, Department of Psychology, University of Oldenburg, Oldenburg, Germany
| |
Collapse
|
36
|
Simar C, Petit R, Bozga N, Leroy A, Cebolla AM, Petieau M, Bontempi G, Cheron G. Riemannian classification of single-trial surface EEG and sources during checkerboard and navigational images in humans. PLoS One 2022; 17:e0262417. [PMID: 35030232 PMCID: PMC8759639 DOI: 10.1371/journal.pone.0262417] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Accepted: 12/23/2021] [Indexed: 11/19/2022] Open
Abstract
OBJECTIVE Different visual stimuli are classically used for triggering visual evoked potentials comprising well-defined components linked to the content of the displayed image. These evoked components result from the average of ongoing EEG signals in which additive and oscillatory mechanisms contribute to the component morphology. The evoked related potentials often resulted from a mixed situation (power variation and phase-locking) making basic and clinical interpretations difficult. Besides, the grand average methodology produced artificial constructs that do not reflect individual peculiarities. This motivated new approaches based on single-trial analysis as recently used in the brain-computer interface field. APPROACH We hypothesize that EEG signals may include specific information about the visual features of the displayed image and that such distinctive traits can be identified by state-of-the-art classification algorithms based on Riemannian geometry. The same classification algorithms are also applied to the dipole sources estimated by sLORETA. MAIN RESULTS AND SIGNIFICANCE We show that our classification pipeline can effectively discriminate between the display of different visual items (Checkerboard versus 3D navigational image) in single EEG trials throughout multiple subjects. The present methodology reaches a single-trial classification accuracy of about 84% and 93% for inter-subject and intra-subject classification respectively using surface EEG. Interestingly, we note that the classification algorithms trained on sLORETA sources estimation fail to generalize among multiple subjects (63%), which may be due to either the average head model used by sLORETA or the subsequent spatial filtering failing to extract discriminative information, but reach an intra-subject classification accuracy of 82%.
Collapse
Affiliation(s)
- Cédric Simar
- Machine Learning Group, Computer Science Department, Faculty of Sciences, Université Libre de Bruxelles (ULB), Brussels, Belgium
| | - Robin Petit
- Machine Learning Group, Computer Science Department, Faculty of Sciences, Université Libre de Bruxelles (ULB), Brussels, Belgium
- Interuniversity Institute of Bioinformatics in Brussels, Université Libre de Bruxelles- Vrije Universiteit Brussel, Brussels, Belgium
| | - Nichita Bozga
- Machine Learning Group, Computer Science Department, Faculty of Sciences, Université Libre de Bruxelles (ULB), Brussels, Belgium
| | - Axelle Leroy
- Laboratory of Neurophysiology and Movement Biomechanics, Neuroscience Institute, Université Libre de Bruxelles (ULB), Brussels, Belgium
| | - Ana-Maria Cebolla
- Laboratory of Neurophysiology and Movement Biomechanics, Neuroscience Institute, Université Libre de Bruxelles (ULB), Brussels, Belgium
| | - Mathieu Petieau
- Laboratory of Neurophysiology and Movement Biomechanics, Neuroscience Institute, Université Libre de Bruxelles (ULB), Brussels, Belgium
| | - Gianluca Bontempi
- Machine Learning Group, Computer Science Department, Faculty of Sciences, Université Libre de Bruxelles (ULB), Brussels, Belgium
| | - Guy Cheron
- Laboratory of Neurophysiology and Movement Biomechanics, Neuroscience Institute, Université Libre de Bruxelles (ULB), Brussels, Belgium
- Laboratory of Electrophysiology, Université de Mons-Hainaut, Mons, Belgium
| |
Collapse
|
37
|
Kim H, Kim Y, Miyakoshi M, Stapornchaisit S, Yoshimura N, Koike Y. Brain Activity Reflects Subjective Response to Delayed Input When Using an Electromyography-Controlled Robot. Front Syst Neurosci 2021; 15:767477. [PMID: 34912195 PMCID: PMC8667890 DOI: 10.3389/fnsys.2021.767477] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2021] [Accepted: 10/18/2021] [Indexed: 11/26/2022] Open
Abstract
In various experimental settings, electromyography (EMG) signals have been used to control robots. EMG-based robot control requires intrinsic parameters for control, which makes it difficult for users to understand the input protocol. When a proper input is not provided, the response time of the system varies; as such, the user’s subjective delay should be investigated regardless of the actual delay. In this study, we investigated the influence of the subjective perception of delay on brain activation. Brain recordings were taken while subjects used EMG signals to control a robot hand, which requires a basic processing delay. We used muscle synergy for the grip command of the robot hand. After controlling the robot by grasping their hand, one of four additional delay durations (0 ms, 50 ms, 125 ms, and 250 ms) was applied in every trial, and subjects were instructed to answer whether the delay was natural, additional, or whether they were not sure. We compared brain activity based on responses (“sure” and “not sure”). Our results revealed a significant power difference in the theta band of the parietal lobe, and this time range included the interval in which the subjects could not feel the delay. Our study provides important insights that should be considered when constructing an adaptive system and evaluating its usability.
Collapse
Affiliation(s)
- Hyeonseok Kim
- Institute of Innovative Research, Tokyo Institute of Technology, Yokohama, Japan.,Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California, San Diego, San Diego, CA, United States
| | - Yeongdae Kim
- Department of Industrial Engineering and Economics, Tokyo Institute of Technology, Tokyo, Japan
| | - Makoto Miyakoshi
- Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California, San Diego, San Diego, CA, United States
| | | | - Natsue Yoshimura
- Institute of Innovative Research, Tokyo Institute of Technology, Yokohama, Japan
| | - Yasuharu Koike
- Institute of Innovative Research, Tokyo Institute of Technology, Yokohama, Japan
| |
Collapse
|
38
|
Miyakoshi M, Nariai H, Rajaraman RR, Bernardo D, Shrey DW, Lopour BA, Sim MS, Staba RJ, Hussain SA. Automated preprocessing and phase-amplitude coupling analysis of scalp EEG discriminates infantile spasms from controls during wakefulness. Epilepsy Res 2021; 178:106809. [PMID: 34823159 DOI: 10.1016/j.eplepsyres.2021.106809] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2021] [Revised: 10/26/2021] [Accepted: 11/02/2021] [Indexed: 10/19/2022]
Abstract
OBJECTIVE Delta-gamma phase-amplitude coupling in EEG is useful for localizing epileptic sources and to evaluate severity in children with infantile spasms. We (1) develop an automated EEG preprocessing pipeline to clean data using artifact subspace reconstruction (ASR) and independent component (IC) analysis (ICA) and (2) evaluate delta-gamma modulation index (MI) as a method to distinguish children with epileptic spasms (cases) from normal controls during sleep and awake. METHODS Using 400 scalp EEG datasets (200 sleep, 200 awake) from 100 subjects, we calculated MI after applying high-pass and line-noise filters (Clean 0), and after ASR followed by either conservative (Clean 1) or stringent (Clean 2) artifactual IC rejection. Classification of cases and controls using MI was evaluated with Receiver Operating Characteristics (ROC) to obtain area under curve (AUC). RESULTS The artifact rejection algorithm reduced raw signal variance by 29-45% and 38-60% for Clean 1 and Clean 2, respectively. MI derived from sleep data, with or without preprocessing, robustly classified the groups (all AUC > 0.98). In contrast, group classification using MI derived from awake data was successful only after Clean 2 (AUC = 0.85). CONCLUSIONS We have developed an automated EEG preprocessing pipeline to perform artifact rejection and quantify delta-gamma modulation index.
Collapse
Affiliation(s)
- Makoto Miyakoshi
- Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego, United States
| | - Hiroki Nariai
- David Geffen School of Medicine, Department of Pediatrics, University of California Los Angeles, United States.
| | - Rajsekar R Rajaraman
- David Geffen School of Medicine, Department of Pediatrics, University of California Los Angeles, United States
| | | | - Daniel W Shrey
- Children's Hospital of Orange County, Neurology, University of California, Irvine, Pediatrics, United States
| | - Beth A Lopour
- Henry Samueli School of Engineering, University of California Irvine, United States
| | - Myung Shin Sim
- Division of General Internal Medicine and Health Services Research, Department of Medicine Statistics Core, University of California Los Angeles, United States
| | - Richard J Staba
- David Geffen School of Medicine, Department of Neurology, University of California Los Angeles, United States
| | - Shaun A Hussain
- David Geffen School of Medicine, Department of Pediatrics, University of California Los Angeles, United States
| |
Collapse
|
39
|
Phyo Wai AA, Ern Tchen J, Guan C. A Study of Visual Search based Calibration Protocol for EEG Attention Detection. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:5792-5795. [PMID: 34892436 DOI: 10.1109/embc46164.2021.9631083] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Attention, a multi-faceted cognitive process, is essential in our daily lives. We can measure visual attention using an EEG Brain-Computer Interface for detecting different levels of attention in gaming, performance training, and clinical applications. In attention calibration, we use Flanker task to capture EEG data for attentive class. For EEG data belonging to inattentive class calibration, we instruct subject not focusing on a specific position on screen. We then classify attention levels using binary classifier trained with these surrogate ground-truth classes. However, subjects may not be in desirable attention conditions when performing repetitive boring activities over a long experiment duration. We propose attention calibration protocols in this paper that use simultaneous visual search with an audio directional change paradigm and static white noise as 'attentive' and 'inattentive' conditions, respectively. To compare the performance of proposed calibrations against baselines, we collected data from sixteen healthy subjects. For a fair comparison of classification performance; we used six basic EEG band-power features with a standard binary classifier. With the new calibration protocol, we achieved 74.37 ± 6.56% mean subject accuracy, which is about 3.73 ± 2.49% higher than the baseline, but there were no statistically significant differences. According to post-experiment survey results, new calibrations are more effective in inducing desired perceived attention levels. We will improve calibration protocols with reliable attention classifier modeling to enable better attention recognition based on these promising results.
Collapse
|
40
|
Noorbasha SK, Florence Sudha G. Novel approach to remove Electrical Shift and Linear Trend artifact from single channel EEG. Biomed Phys Eng Express 2021; 7. [PMID: 34584019 DOI: 10.1088/2057-1976/ac2aee] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Accepted: 09/28/2021] [Indexed: 11/12/2022]
Abstract
Electroencephalogram (EEG) signals are crucial to Brain-Computer Interfacing (BCI). However, these are vulnerable to a variety of unintended artifacts that could negatively impact the precise brain function assessment. This paper provides a new algorithm to eliminate Electrical Shift and Linear Trend artifact (ESLT) in EEG using Singular Spectrum Analysis (SSA) and Enhanced local Polynomial (LP) Approximation-based Total Variation (EPATV). The contaminated single channel EEG is subdivided into multiple bands of frequency components by SSA. In order to acquire all LP and TV components, EPATV filtering is applied over the contaminated component frequency band. Filtered sub-signal is collected by subtracting both the LP and TV components from the component contaminated frequency band. Then, the addition of filtered sub-signal and remaining SSA frequency band components yield the final denoised EEG signal. The effectiveness of the proposed method in this paper is evaluated using the data obtained from three databases and compared with the existing methods. From the extensive simulation results, it is inferred that the algorithm discussed in the paper is effective when compared the existing methods, exhibiting a highest averaged Correlation Coefficient (CC) of 0.9534, averaged Signal to Noise Ratio (SNR) of 10.2208dB, lowest averaged Relative Root Mean Square Error (RRMSE) value 0.2787 and averaged Mean absolute Error (MAE) inαband value of 0.0557. The algorithm presented in this paper may be a viable choice for extracting ESLT artifact from a small streaming section of the EEG without requirement of the initial calibration or enormous EEG data.
Collapse
Affiliation(s)
- Sayedu Khasim Noorbasha
- Department of Electronics and Communication Engineering, Pondicherry Engineering College, Puducherry-605014, India
| | - Gnanou Florence Sudha
- Department of Electronics and Communication Engineering, Pondicherry Engineering College, Puducherry-605014, India
| |
Collapse
|
41
|
Ranjan R, Chandra Sahana B, Kumar Bhandari A. Ocular artifact elimination from electroencephalography signals: A systematic review. Biocybern Biomed Eng 2021. [DOI: 10.1016/j.bbe.2021.06.007] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
|
42
|
Mumtaz W, Rasheed S, Irfan A. Review of challenges associated with the EEG artifact removal methods. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102741] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
43
|
Toma FM, Miyakoshi M. Left Frontal EEG Power Responds to Stock Price Changes in a Simulated Asset Bubble Market. Brain Sci 2021; 11:brainsci11060670. [PMID: 34063778 PMCID: PMC8223788 DOI: 10.3390/brainsci11060670] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Revised: 05/17/2021] [Accepted: 05/19/2021] [Indexed: 11/16/2022] Open
Abstract
Financial bubbles are a result of aggregate irrational behavior and cannot be explained by standard economic pricing theory. Research in neuroeconomics can improve our understanding of their causes. We conducted an experiment in which 28 healthy subjects traded in a simulated market bubble, while scalp EEG was recorded using a low-cost, BCI-friendly desktop device with 14 electrodes. Independent component (IC) analysis was performed to decompose brain signals and the obtained scalp topography was used to cluster the ICs. We computed single-trial time-frequency power relative to the onset of stock price display and estimated the correlation between EEG power and stock price across trials using a general linear model. We found that delta band (1-4 Hz) EEG power within the left frontal region negatively correlated with the trial-by-trial stock prices including the financial bubble. We interpreted the result as stimulus-preceding negativity (SPN) occurring as a dis-inhibition of the resting state network. We conclude that the combination between the desktop-BCI-friendly EEG, the simulated financial bubble and advanced signal processing and statistical approaches could successfully identify the neural correlate of the financial bubble. We add to the neuroeconomics literature a complementary EEG neurometric as a bubble predictor, which can further be explored in future decision-making experiments.
Collapse
Affiliation(s)
| | - Makoto Miyakoshi
- Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego, 9500 Gilman Drive, La Jolla, CA 92093-0559, USA
- Correspondence:
| |
Collapse
|
44
|
Koshiyama D, Miyakoshi M, Joshi YB, Nakanishi M, Tanaka-Koshiyama K, Sprock J, Light GA. Source decomposition of the frontocentral auditory steady-state gamma band response in schizophrenia patients and healthy subjects. Psychiatry Clin Neurosci 2021; 75:172-179. [PMID: 33470494 DOI: 10.1111/pcn.13201] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/07/2020] [Revised: 01/12/2021] [Accepted: 01/16/2021] [Indexed: 12/27/2022]
Abstract
AIM Gamma-band auditory steady-state response (ASSR) is a neurophysiologic index that is increasingly used as a translational biomarker in the development of treatments of neuropsychiatric disorders. While gamma-band ASSR is generated by distributed networks of highly interactive temporal and frontal cortical sources, the majority of human gamma-band ASSR studies using electroencephalography (EEG) highlight activity from only a single frontocentral scalp site, Fz, where responses tend to be largest and reductions in schizophrenia patients are most evident. However, no previous study has characterized the relative source contributions to Fz, which is a necessary step to improve the concordance of preclinical and clinical EEG studies. METHODS A novel method to back-project the contributions of independent cortical source components was applied to assess the independent sources and their proportional contributions to Fz as well as source-resolved responses in 432 schizophrenia patients and 294 healthy subjects. RESULTS Independent contributions of gamma-band ASSR to Fz were detected from orbitofrontal, bilateral superior/middle/inferior temporal, bilateral middle frontal, and posterior cingulate gyri in both groups. In contrast to expectations, the groups showed comparable source contribution weight to gamma-band ASSR at Fz. While gamma-band ASSR reductions at Fz were present in schizophrenia patients consistent with previous studies, no group differences in individual source-level responses to Fz were detected. CONCLUSION Small differences in multiple independent sources summate to produce scalp-level differences at Fz. The identification of independent source contributions to a single scalp sensor represents a promising methodology for measuring dissociable and homologous biomarker targets in future translational studies.
Collapse
Affiliation(s)
- Daisuke Koshiyama
- Department of Psychiatry, University of California San Diego, La Jolla, USA
| | - Makoto Miyakoshi
- Swartz Center for Neural Computation, University of California San Diego, La Jolla, USA
| | - Yash B Joshi
- Department of Psychiatry, University of California San Diego, La Jolla, USA.,VISN-22 Mental Illness, Research, Education and Clinical Center (MIRECC), VA San Diego Healthcare System, San Diego, USA
| | - Masaki Nakanishi
- Swartz Center for Neural Computation, University of California San Diego, La Jolla, USA
| | | | - Joyce Sprock
- Department of Psychiatry, University of California San Diego, La Jolla, USA.,VISN-22 Mental Illness, Research, Education and Clinical Center (MIRECC), VA San Diego Healthcare System, San Diego, USA
| | - Gregory A Light
- Department of Psychiatry, University of California San Diego, La Jolla, USA.,VISN-22 Mental Illness, Research, Education and Clinical Center (MIRECC), VA San Diego Healthcare System, San Diego, USA
| |
Collapse
|
45
|
Koshiyama D, Miyakoshi M, Tanaka-Koshiyama K, Joshi YB, Sprock J, Braff DL, Light GA. Abnormal phase discontinuity of alpha- and theta-frequency oscillations in schizophrenia. Schizophr Res 2021; 231:73-81. [PMID: 33780847 PMCID: PMC8222093 DOI: 10.1016/j.schres.2021.03.007] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/28/2020] [Revised: 12/25/2020] [Accepted: 03/10/2021] [Indexed: 12/27/2022]
Abstract
BACKGROUND Schizophrenia patients have abnormal electroencephalographic (EEG) power over multiple frequency bands, even at rest, though the primary neural generators and spatiotemporal dynamics of these abnormalities are largely unknown. Disturbances in the precise synchronization of oscillations within and across cortical sources may underlie abnormal resting-state EEG activity in schizophrenia patients. METHODS A novel assessment method was applied to identify the independent contributing sources of resting-state EEG and assess the phase discontinuity in schizophrenia patients (N = 148) and healthy subjects (N = 143). RESULTS A network of 11 primary contributing sources of scalp EEG was identified in both groups. Schizophrenia patients showed abnormal elevations of EEG power in the temporal region in the theta, beta, and gamma-bands, as well as the posterior cingulate gyrus in the delta, theta, alpha, and beta-bands. The higher theta-band power in the middle temporal gyrus was significantly correlated with verbal memory impairment in patients. The peak frequency of alpha was lower in patients in the cingulate and temporal regions. Furthermore, patients showed a higher rate of alpha phase discontinuity in the temporal region as well as a lower rate of theta phase discontinuity in the temporal and posterior cingulate regions. CONCLUSIONS Abnormal rates of phase discontinuity of alpha- and theta-band, abnormal elevations of EEG power in multiple bands, and a lower peak frequency of alpha were identified in schizophrenia patients at rest. Clarification of the mechanistic substrates of abnormal phase discontinuity may clarify core pathophysiologic abnormalities of schizophrenia and contribute to the development of novel biomarkers for therapeutic interventions.
Collapse
Affiliation(s)
- Daisuke Koshiyama
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA
| | - Makoto Miyakoshi
- Swartz Center for Neural Computation, University of California San Diego, La Jolla, CA, USA.
| | | | - Yash B. Joshi
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA,VISN-22 Mental Illness, Research, Education and Clinical Center (MIRECC), VA San Diego Healthcare System, San Diego, CA, USA
| | - Joyce Sprock
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA,VISN-22 Mental Illness, Research, Education and Clinical Center (MIRECC), VA San Diego Healthcare System, San Diego, CA, USA
| | - David L. Braff
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA,VISN-22 Mental Illness, Research, Education and Clinical Center (MIRECC), VA San Diego Healthcare System, San Diego, CA, USA
| | - Gregory A. Light
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA,VISN-22 Mental Illness, Research, Education and Clinical Center (MIRECC), VA San Diego Healthcare System, San Diego, CA, USA
| |
Collapse
|
46
|
Koshiyama D, Miyakoshi M, Joshi YB, Molina JL, Tanaka-Koshiyama K, Sprock J, Braff DL, Swerdlow NR, Light GA. Neural network dynamics underlying gamma synchronization deficits in schizophrenia. Prog Neuropsychopharmacol Biol Psychiatry 2021; 107:110224. [PMID: 33340619 PMCID: PMC8631608 DOI: 10.1016/j.pnpbp.2020.110224] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/20/2020] [Revised: 12/06/2020] [Accepted: 12/09/2020] [Indexed: 01/09/2023]
Abstract
Gamma-band (40-Hz) activity is critical for cortico-cortical transmission and the integration of information across neural networks during sensory and cognitive processing. Patients with schizophrenia show selective reductions in the capacity to support synchronized gamma-band oscillations in response to auditory stimulation presented 40-Hz. Despite widespread application of this 40-Hz auditory steady-state response (ASSR) as a translational electroencephalographic biomarker for therapeutic development for neuropsychiatric disorders, the spatiotemporal dynamics underlying the ASSR have not been fully characterized. In this study, a novel Granger causality analysis was applied to assess the propagation of gamma oscillations in response to 40-Hz steady-state stimulation across cortical sources in schizophrenia patients (n = 426) and healthy comparison subjects (n = 293). Both groups showed multiple ASSR source interactions that were broadly distributed across brain regions. Schizophrenia patients showed distinct, hierarchically sequenced connectivity abnormalities. During the response onset interval, patients exhibited abnormal increased connectivity from the inferior frontal gyrus to the superior temporal gyrus, followed by decreased connectivity from the superior temporal to the middle cingulate gyrus. In the later portion of the ASSR response (300-500 ms), patients showed significantly increased connectivity from the superior temporal to the middle frontal gyrus followed by decreased connectivity from the left superior frontal gyrus to the right superior and middle frontal gyri. These findings highlight both the orchestration of distributed multiple sources in response to simple gamma-frequency stimulation in healthy subjects as well as the patterns of deficits in the generation and maintenance of gamma-band oscillations across the temporo-frontal sources in schizophrenia patients.
Collapse
Affiliation(s)
- Daisuke Koshiyama
- Department of Psychiatry, University of California San Diego, La Jolla, CA 92093-0804, USA
| | - Makoto Miyakoshi
- Swartz Center for Neural Computation, University of California San Diego, La Jolla, CA 92093-0559, USA.
| | - Yash B. Joshi
- Department of Psychiatry, University of California San Diego, La Jolla, CA 92093-0804, USA,VISN-22 Mental Illness, Research, Education and Clinical Center (MIRECC), VA San Diego Healthcare System, San Diego, CA 92161, USA
| | - Juan L. Molina
- Department of Psychiatry, University of California San Diego, La Jolla, CA 92093-0804, USA,VISN-22 Mental Illness, Research, Education and Clinical Center (MIRECC), VA San Diego Healthcare System, San Diego, CA 92161, USA
| | | | - Joyce Sprock
- Department of Psychiatry, University of California San Diego, La Jolla, CA 92093-0804, USA,VISN-22 Mental Illness, Research, Education and Clinical Center (MIRECC), VA San Diego Healthcare System, San Diego, CA 92161, USA
| | - David L. Braff
- Department of Psychiatry, University of California San Diego, La Jolla, CA 92093-0804, USA,VISN-22 Mental Illness, Research, Education and Clinical Center (MIRECC), VA San Diego Healthcare System, San Diego, CA 92161, USA
| | - Neal R. Swerdlow
- Department of Psychiatry, University of California San Diego, La Jolla, CA 92093-0804, USA
| | - Gregory A. Light
- Department of Psychiatry, University of California San Diego, La Jolla, CA 92093-0804, USA,VISN-22 Mental Illness, Research, Education and Clinical Center (MIRECC), VA San Diego Healthcare System, San Diego, CA 92161, USA
| |
Collapse
|
47
|
Jurgiel J, Miyakoshi M, Dillon A, Piacentini J, Makeig S, Loo SK. Inhibitory control in children with tic disorder: aberrant fronto-parietal network activity and connectivity. Brain Commun 2021; 3:fcab067. [PMID: 33977267 PMCID: PMC8093924 DOI: 10.1093/braincomms/fcab067] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Revised: 02/23/2021] [Accepted: 02/26/2021] [Indexed: 12/03/2022] Open
Abstract
Chronic tic disorders, including Tourette syndrome, are typically thought to have deficits in cognitive inhibition and top down cognitive control due to the frequent and repetitive occurrence of tics, yet studies reporting task performance results have been equivocal. Despite similar behavioural performance, individuals with chronic tic disorder have exhibited aberrant patterns of neural activation in multiple frontal and parietal regions relative to healthy controls during inhibitory control paradigms. In addition to these top down attentional control regions, widespread alterations in brain activity across multiple neural networks have been reported. There is a dearth, however, of studies examining event-related connectivity during cognitive inhibitory paradigms among affected individuals. The goal of this study was to characterize neural oscillatory activity and effective connectivity, using a case–control design, among children with and without chronic tic disorder during performance of a cognitive inhibition task. Electroencephalogram data were recorded in a cohort of children aged 8–12 years old (60 with chronic tic disorder, 35 typically developing controls) while they performed a flanker task. While task accuracy did not differ by diagnosis, children with chronic tic disorder displayed significant cortical source-level, event-related spectral power differences during incongruent flanker trials, which required inhibitory control. Specifically, attenuated broad band oscillatory power modulation within the anterior cingulate cortex was observed relative to controls. Whole brain effective connectivity analyses indicated that children with chronic tic disorder exhibit greater information flow between the anterior cingulate and other fronto-parietal network hubs (midcingulate cortex and precuneus) relative to controls, who instead showed stronger connectivity between central and posterior nodes. Spectral power within the anterior cingulate was not significantly correlated with any connectivity edges, suggesting lower power and higher connectivity are independent (versus resultant) neural mechanisms. Significant correlations between clinical features, task performance and anterior cingulate spectral power and connectivity suggest this region is associated with tic impairment (r = −0.31, P = 0.03) and flanker task incongruent trial accuracy (r’s = −0.27 to −0.42, P’s = 0.0008–0.04). Attenuated activation of the anterior cingulate along with dysregulated information flow between and among nodes within the fronto-parietal attention network may be neural adaptations that result from frequent engagement of neural pathways needed for inhibitory control in chronic tic disorder.
Collapse
Affiliation(s)
- Joseph Jurgiel
- Semel Institute for Neuroscience and Human Behavior, University of California, Los Angeles, Los Angeles, CA 90095, USA
| | - Makoto Miyakoshi
- Swartz Center for Neural Computation, University of California, San Diego, La Jolla, CA 92093, USA
| | - Andrea Dillon
- Semel Institute for Neuroscience and Human Behavior, University of California, Los Angeles, Los Angeles, CA 90095, USA
| | - John Piacentini
- Semel Institute for Neuroscience and Human Behavior, University of California, Los Angeles, Los Angeles, CA 90095, USA
| | - Scott Makeig
- Swartz Center for Neural Computation, University of California, San Diego, La Jolla, CA 92093, USA
| | - Sandra K Loo
- Semel Institute for Neuroscience and Human Behavior, University of California, Los Angeles, Los Angeles, CA 90095, USA
| |
Collapse
|
48
|
Abstract
Most research investigating auditory perception is conducted in controlled laboratory settings, potentially restricting its generalizability to the complex acoustic environment outside the lab. The present study, in contrast, investigated auditory attention with long-term recordings (> 6 h) beyond the lab using a fully mobile, smartphone-based ear-centered electroencephalography (EEG) setup with minimal restrictions for participants. Twelve participants completed iterations of two variants of an oddball task where they had to react to target tones and to ignore standard tones. A rapid variant of the task (tones every 2 s, 5 min total time) was performed seated and with full focus in the morning, around noon and in the afternoon under controlled conditions. A sporadic variant (tones every minute, 160 min total time) was performed once in the morning and once in the afternoon while participants followed their normal office day routine. EEG data, behavioral data, and movement data (with a gyroscope) were recorded and analyzed. The expected increased amplitude of the P3 component in response to the target tone was observed for both the rapid and the sporadic oddball. Miss rates were lower and reaction times were faster in the rapid oddball compared to the sporadic one. The movement data indicated that participants spent most of their office day at relative rest. Overall, this study demonstrated that it is feasible to study auditory perception in everyday life with long-term ear-EEG.
Collapse
|
49
|
Shahbakhti M, Rodrigues AS, Augustyniak P, Broniec-Wójcik A, Sološenko A, Beiramvand M, Marozas V. SWT-kurtosis based algorithm for elimination of electrical shift and linear trend from EEG signals. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2020.102373] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
50
|
Koshiyama D, Miyakoshi M, Thomas ML, Joshi YB, Molina JL, Tanaka-Koshiyama K, Sprock J, Braff DL, Swerdlow NR, Light GA. Unique contributions of sensory discrimination and gamma synchronization deficits to cognitive, clinical, and psychosocial functional impairments in schizophrenia. Schizophr Res 2021; 228:280-287. [PMID: 33493776 DOI: 10.1016/j.schres.2020.12.042] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/04/2020] [Revised: 10/08/2020] [Accepted: 12/31/2020] [Indexed: 12/12/2022]
Abstract
BACKGROUND Schizophrenia patients show widespread deficits in neurocognitive, clinical, and psychosocial functioning. Mismatch negativity (MMN) and gamma-band auditory steady-state response (ASSR) are robust translational biomarkers associated with schizophrenia and associated with cognitive dysfunction, negative symptom severity, and psychosocial disability. Although these biomarkers are conceptually linked as measures of early auditory information processing, it is unclear whether MMN and gamma-band ASSR account for shared vs. non-shared variance in cognitive, clinical, and psychosocial functioning. METHODS Multiple regression analyses with MMN, gamma-band ASSR, and clinical measures were performed in large cohorts of schizophrenia outpatients (N = 428) and healthy comparison subjects (N = 283). RESULTS Reduced MMN (d = 0.67), gamma-band ASSR (d = -0.40), and lower cognitive function were confirmed in schizophrenia patients. Regression analyses revealed that reduced MMN amplitude showed unique associations with lower verbal learning and negative symptoms, reduced gamma-band ASSR showed a unique association with working memory deficits, and both reduced MMN amplitude and reduced gamma-band ASSR showed an association with daily functioning impairment in schizophrenia patients. CONCLUSION MMN and ASSR measures are non-redundant and complementary measures of early auditory information processing that are associated with important domains of functioning. Studies are needed to clarify the neural substrates of MMN and gamma-band ASSR to improve our understanding of the pathophysiology of schizophrenia and accelerate their use in the development of novel therapeutic interventions.
Collapse
Affiliation(s)
- Daisuke Koshiyama
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA.
| | - Makoto Miyakoshi
- Swartz Center for Neural Computation, University of California San Diego, La Jolla, CA, USA
| | - Michael L Thomas
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA; Department of Psychology, Colorado State University, Fort Collins, CO, USA
| | - Yash B Joshi
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA; VISN-22 Mental Illness, Research, Education and Clinical Center (MIRECC), VA San Diego Healthcare System, San Diego, CA, USA
| | - Juan L Molina
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA
| | | | - Joyce Sprock
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA
| | - David L Braff
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA
| | - Neal R Swerdlow
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA
| | - Gregory A Light
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA; VISN-22 Mental Illness, Research, Education and Clinical Center (MIRECC), VA San Diego Healthcare System, San Diego, CA, USA
| |
Collapse
|