A multi-channel approach for cortical stimulation artefact suppression in depth EEG signals using time-frequency and spatial filtering

Artificial intelligence based multimodal language decoding from brain activity: A review

Decoding brain activity is conducive to the breakthrough of brain-computer interface (BCI) technology. The development of artificial intelligence (AI) continually promotes the progress of brain language decoding technology. Existent research has mainly focused on a single modality and paid insufficient attention to AI methods. Therefore, our objective is to provide an overview of relevant decoding research from the perspective of different modalities and methodologies. The modalities involve text, speech, image, and video, whereas the core method is using AI-built decoders to translate brain signals induced by multimodal stimuli into text or vocal language. The semantic information of brain activity can be successfully decoded into a language at various levels, ranging from words through sentences to discourses. However, the decoding effect is affected by various factors, such as the decoding model, vector representation model, and brain regions. Challenges and future directions are also discussed. The advances in brain language decoding and BCI technology will potentially assist patients with clinical aphasia in regaining the ability to communicate.

Automatic diagnosis of COVID-19 with MCA-inspired TQWT-based classification of chest X-ray images

In this era of Coronavirus disease 2019 (COVID-19), an accurate method of diagnosis with less diagnosis time and cost can effectively help in controlling the disease spread with the new variants taking birth from time to time. In order to achieve this, a two-dimensional (2D) tunable Q-wavelet transform (TQWT) based on a memristive crossbar array (MCA) is introduced in this work for the decomposition of chest X-ray images of two different datasets. TQWT has resulted in promising values of peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) at the optimum values of its parameters namely quality factor (Q) of 4, and oversampling rate (r) of 3 and at a decomposition level (J) of 2. The MCA-based model is used to process decomposed images for further classification with efficient storage. These images have been further used for the classification of COVID-19 and non-COVID-19 images using ResNet50 and AlexNet convolutional neural network (CNN) models. The average accuracy values achieved for the processed chest X-ray images classification in the small and large datasets are 98.82% and 94.64%, respectively which are higher than the reported conventional methods based on different models of deep learning techniques. The average accuracy of detection of COVID-19 via the proposed method of image classification has also been achieved with less complexity, energy, power, and area consumption along with lower cost estimation as compared to CMOS-based technology.

Single-trial motor imagery electroencephalogram intention recognition by optimal discriminant hyperplane and interpretable discriminative rectangle mixture model

Spatial filtering is widely used in brain-computer interface (BCI) systems to augmented signal characteristics of electroencephalogram (EEG) signals. In this study, a spatial domain filtering based EEG feature extraction method, optimal discriminant hyperplane-common spatial subspace decomposition (ODH-CSSD) is proposed. Specifically, the multi-dimensional EEG features were extracted from the original EEG signals by common space subspace decomposition (CSSD) algorithm, and the optimal feature criterion was established to find the multi-dimensional optimal projection space. A classic method of data dimension optimizing is using the eigenvectors of a lumped covariance matrix corresponding to the maximum eigenvalues. Then, the cost function is defined as the extreme value of the discriminant criterion, and the orthogonal N discriminant vectors corresponding to the N extreme value of the criterion are solved and constructed into the N-dimensional optimal feature space. Finally, the multi-dimensional EEG features are projected into the N-dimensional optimal projection space to obtain the optimal N-dimensional EEG features. Moreover, this study involves the extraction of two-dimensional and three-dimensional optimal EEG features from motor imagery EEG datasets, and the optimal EEG features are identified using the interpretable discriminative rectangular mixture model (DRMM). Experimental results show that the accuracy of DRMM to identify two-dimensional optimal features is more than 0.91, and the highest accuracy even reaches 0.975. Meanwhile, DRMM has the most stable recognition accuracy for two-dimensional optimal features, and its average clustering accuracy reaches 0.942, the gap between the accuracy of the DRMM with the accuracy of the FCM and K-means can reach 0.26. And the optimal three-dimensional features, for most subjects, the clustering accuracy of DRMM is higher than that of FCM and K-means. In general, the decision rectangle obtained by DRMM can clearly explain the difference of each cluster, notably, the optimization of multidimensional EEG features by optimal projection is superior to Fisher's ratio, and this method provides an alternative for the application of BCI.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11571-021-09768-w.

Automated detection and removal of flat line segments and large amplitude fluctuations in neonatal electroencephalography

Background

Artefact removal in neonatal electroencephalography (EEG) by visual inspection generally depends on the expertise of the operator, is time consuming and is not a consistent pre-processing step to the pipeline for the automated EEG analysis. Therefore, there is the need for the automated detection and removal of artefacts in neonatal EEG, especially of distinct and predominant artefacts such as flat line segments (mainly caused by instrumental error where contact between electrodes and head box is lost) and large amplitude fluctuations (related to neonatal movements).

Method

A threshold-based algorithm for the automated detection and removal of flat line segments and large amplitude fluctuations in neonatal EEG of infants at term-equivalent age is developed. The algorithm applies thresholds to the absolute second difference, absolute amplitude, absolute first difference and the ratio between the frequency content above 50 Hz and the frequency content across all frequencies.

Results

The algorithm reaches a median accuracy of 0.91, a median hit rate of 0.91 and a median false discovery rate of 0.37. Also, a significant improvement (≈10%) in the performance of a four-stage sleep classifier is observed after artefact removal with the proposed algorithm as compared to before its application.

Significance

An automated artefact removal method contributes to the pipeline of automated EEG analysis. The proposed algorithm has shown to have good performance and to be effective in neonatal EEG applications.

Two-Stage Intelligent Multi-Type Artifact Removal for Single-Channel EEG Settings: A GRU Autoencoder based Approach

OBJECTIVE

The wearable and portable Electroencephalogram (EEG) sensing systems are deeply interfered by unavoidable physiological artifacts due to the limited recording resources. In this work, an intelligent artifact removal system that handles single-channel EEG signals in the presence of mixed multi-type artifacts is investigated.

METHODS

The basic idea is to represent the mixed artifacts in contaminated varying EEG signals with the unchanged latent pattern features, and then employ the adaptive artifact removal scheme to separate the contamination and clean EEG signals in the encoded feature domain. To minimize the risks of corrupting clean signals and keeping artifacts by mistake, the artifact removal is formulated as an identification-removal two-stage minimization problem, and an attention based adaptive feature concentration mechanism is designed to improve the removal utility and reduce the calculation consumption.

RESULTS

In the real implementation on open real-world dataset, this study achieves the artifact identification accuracy of 98.52% and average correlation coefficient of 0.73 for the removal of strong mixed multi-type artifacts.

CONCLUSION

This study can deal with single-channel EEG signals contaminated by mixed multi-type artifacts with high accuracy and low overhead, and is more effective and stable than traditional schemes with fixed criteria.

SIGNIFICANCE

This study can significantly improve the signal quality acquired by simplified EEG sensing systems, and may extend the application of wearable and portable EEG sensing systems to medical diagnosis, cognitive science research and other applications requiring clinical setups.

Neural Decoding of Chinese Sign Language With Machine Learning for Brain-Computer Interfaces

Limb motion decoding is an important part of brain-computer interface (BCI) research. Among the limb motion, sign language not only contains rich semantic information and abundant maneuverable actions but also provides different executable commands. However, many researchers focus on decoding the gross motor skills, such as the decoding of ordinary motor imagery or simple upper limb movements. Here we explored the neural features and decoding of Chinese sign language from electroencephalograph (EEG) signal with motor imagery and motor execution. Sign language not only contains rich semantic information, but also has abundant maneuverable actions, and provides us with more different executable commands. In this paper, twenty subjects were instructed to perform movement execution and movement imagery based on Chinese sign language. Seven classifiers are employed to classify the selected features of sign language EEG. L1 regularization is used to learn and select features that contain more information from the mean, power spectral density, sample entropy, and brain network connectivity. The best average classification accuracy of the classifier is 89.90% (imagery sign language is 83.40%). These results have shown the feasibility of decoding between different sign languages. The source location reveals that the neural circuits involved in sign language are related to the visual contact area and the pre-movement area. Experimental evaluation shows that the proposed decoding strategy based on sign language can obtain outstanding classification results, which provides a certain reference value for the subsequent research of limb decoding based on sign language.

Automated Detection and Removal of Cardiac and Pulse Interferences from Neonatal EEG Signals

Electrical cardiac and pulsatile interference is very difficult to remove from electroencephalographic (EEG) signals, especially if recorded in neonates, for which a small number of EEG channels is used. Several methods were proposed, including Blind Source Separation (BSS) methods that required the use of artificial cardiac-related signals to improve the separation of artefactual components. To optimize the separation of cardiac-related artefactual components, we propose a method based on Independent Component Analysis (ICA) that exploits specific features of the real electrocardiographic (ECG) signals that were simultaneously recorded with the neonatal EEG. A total of forty EEG segments from 19-channel neonatal EEG recordings with and without seizures were used to test and validate the performance of our method. We observed a significant reduction in the number of independent components (ICs) containing cardiac-related interferences, with a consequent improvement in the automated classification of the separated ICs. The comparison with the expert labeling of the ICs separately containing electrical cardiac and pulsatile interference led to an accuracy = 0.99, a false omission rate = 0.01 and a sensitivity = 0.93, outperforming existing methods. Furthermore, we verified that true brain activity was preserved in neonatal EEG signals reconstructed after the removal of artefactual ICs, demonstrating the effectiveness of our method and its safe applicability in a clinical context.