Support vector machines to detect physiological patterns for EEG and EMG-based human-computer interaction: a review

Artificial intelligence based BCI using SSVEP signals with single channel EEG

BACKGROUND

Brain-Computer Interfaces (BCIs) enable direct communication between the brain and external devices. Steady-state visual-evoked potentials (SSVEPs) are particularly useful in BCIs because of their rapid communication capabilities and minimal calibration requirements. Although SSVEP-based BCIs are highly effective, traditional classification methods face challenges in maintaining high accuracy with minimal EEG channels, especially in real-world applications. There is a growing need for improved classification techniques to enhance performance and efficiency.

OBJECTIVE

The aim of this research is to improve the classification of SSVEP signals using machine-learning algorithms. This involves extracting dominant frequency features from SSVEP data and applying classifiers such as Decision Tree (DT), Linear Discriminant Analysis (LDA), and Support Vector Machine (SVM) to achieve high accuracy while reducing the number of EEG channels required, making the method practical for BCI applications.

METHODS

SSVEP data were collected from the Benchmark Dataset at Tsinghua BCI Lab using 64 EEG channels per subject. The Oz channel was selected as the dominant channel for analysis. Wavelet decomposition (db4) was used to extract frequency features in the range 7.8 Hz to 15.6 Hz. The frequency of the maximum amplitude within a 5-s window was extracted as the key feature, and machine learning models (DT, LDA, and SVM) were applied to classify these features.

RESULTS

The proposed method achieved a high classification accuracy, with 95.8% for DT and 96.7% for both LDA and SVM. These results show significant improvement over existing methods, indicating the potential of this approach for BCI applications.

CONCLUSION

This study demonstrates that SSVEP classification using machine-learning models improves accuracy and efficiency. The use of wavelet decomposition for feature extraction and machine learning for classification offers a robust method for SSVEP-based BCIs. This method is promising for assistive technologies and other BCI applications.

Machine learning allows expert level classification of intraoperative motor evoked potentials during neurosurgical procedures

OBJECTIVE

To develop and evaluate machine learning (ML) approaches for muscle identification using intraoperative motor evoked potentials (MEPs), and to compare their performance to human experts.

BACKGROUND

There is an unseized opportunity to apply ML analytic techniques to the world of intraoperative neuromonitoring (IOM). MEPs are the ideal candidates given the importance of their correct interpretation during a surgical operation to the brain or the spine. In this work, we develop and test a set of different ML models for muscle identification using intraoperative MEPs and compare their performance to human experts. In addition, we provide a review of the available literature on current ML applications to IOM data in neurosurgery.

METHODS

We trained and tested five different ML classifiers on a MEP database developed from six different muscles in patients who underwent brain or spinal cord surgery. MEPs were obtained by both transcranial (TES) and direct cortical stimulation (DCS) protocols. The models were evaluated within a single patient and on previously unseen patients, considering signals from TES and DCS both independently and mixed. Ten expert neurophysiologists classified a set of 50 randomly selected MEPs, and their performance was compared to the best performing model.

RESULTS

A total of 25.423 MEPs were included in the study. Random Forest proved to be the best performing model with 99 % accuracy in the single patient dataset task and a 78 %-94 % accuracy range on previously unseen patients. The model performance was maximized by representing MEPs as a set of features typically employed in signal processing compared to traditional neurophysiological parameters. The classification ability of the Random Forest model between six different muscles and across different MEP acquisition modalities (79 %) significantly exceeded that of human experts (mean 48 %).

CONCLUSIONS

Carefully selected ML models proved to have reliable capacity of extracting meaningful information to classify intraoperative MEPs using a limited number of features, proving robustness across patients and signal acquisition modalities, outperforming human experts, and with the potential to act as decision support systems to the IOM team. Such encouraging results lay the path to further explore the underlying nature of clinically important signals, with the aim to continue to produce useful applications to make surgeries safer and more efficient.

Modeling the Impact of Ergonomic Interventions and Occupational Factors on Work-Related Musculoskeletal Disorders in the Neck of Office Workers with Machine Learning Methods

BACKGROUND

Modeling with methods based on machine learning (ML) and artificial intelligence can help understand the complex relationships between ergonomic risk factors and employee health. The aim of this study was to use ML methods to estimate the effect of individual factors, ergonomic interventions, quality of work life (QWL), and productivity on work-related musculoskeletal disorders (WMSDs) in the neck area of office workers. Study Design: A quasi-randomized control trial.

METHODS

To measure the impact of interventions, modeling with the ML method was performed on the data of a quasi-randomized control trial. The data included the information of 311 office workers (aged 32.04±5.34). Method neighborhood component analysis (NCA) was used to measure the effect of factors affecting WMSDs, and then support vector machines (SVMs) and decision tree algorithms were utilized to classify the decrease or increase of disorders.

RESULTS

Three classified models were designed according to the follow-up times of the field study, with accuracies of 86.5%, 80.3%, and 69%, respectively. These models could estimate most influencer factors with acceptable sensitivity. The main factors included age, body mass index, interventions, QWL, some subscales, and several psychological factors. Models predicted that relative absenteeism and presenteeism were not related to the outputs.

CONCLUSION

In this study, the focus was on disorders in the neck, and the obtained models revealed that individual and management interventions can be the main factors in reducing WMSDs in the neck. Modeling with ML methods can create a new understanding of the relationships between variables affecting WMSDs.

Estimating infant age from skull X-ray images using deep learning

This study constructed deep learning models using plain skull radiograph images to predict the accurate postnatal age of infants under 12 months. Utilizing the results of the trained deep learning models, it aimed to evaluate the feasibility of employing major changes visible in skull X-ray images for assessing postnatal cranial development through gradient-weighted class activation mapping. We developed DenseNet-121 and EfficientNet-v2-M convolutional neural network models to analyze 4933 skull X-ray images collected from 1343 infants. Notably, allowing for a ± 1 month error margin, DenseNet-121 reached a maximum corrected accuracy of 79.4% for anteroposterior (AP) views (average: 78.0 ± 1.5%) and 84.2% for lateral views (average: 81.1 ± 2.9%). EfficientNet-v2-M reached a maximum corrected accuracy 79.1% for AP views (average: 77.0 ± 2.3%) and 87.3% for lateral views (average: 85.1 ± 2.5%). Saliency maps identified critical discriminative areas in skull radiographs, including the coronal, sagittal, and metopic sutures in AP skull X-ray images, and the lambdoid suture and cortical bone density in lateral images, marking them as indicators for evaluating cranial development. These findings highlight the precision of deep learning in estimating infant age through non-invasive methods, offering the progress for clinical diagnostics and developmental assessment tools.

Loading Recognition for Lumbar Exoskeleton Based on Multi-Channel Surface Electromyography From Low Back Muscles

Lumbar exoskeleton is an assistive robot, which can reduce the risk of injury and pain in low back muscles when lifting heavy objects. An important challenge it faces involves enhancing assistance with minimal muscle energy consumption. One of the viable solutions is to adjust the force or torque of assistance in response to changes in the load on the low back muscles. It requires accurate loading recognition, which has yet to yield satisfactory outcomes due to the limitations of available measurement tools and load classification methods. This study aimed to precisely identify muscle loading using a multi-channel surface electromyographic (sEMG) electrode array on the low back muscles, combined with a participant-specific load classification method. Ten healthy participants performed a stoop lifting task with objects of varying weights, while sEMG data was collected from the low back muscles using a 3x7 electrode array. Nineteen time segments of the lifting phase were identified, and time-domain sEMG features were extracted from each segment. Participant-specific classifiers were built using four classification algorithms to determine the object weight in each time segment, and the classification performance was evaluated using a 5-fold cross-validation method. The artificial neural network classifier achieved an impressive accuracy of up to 96%, consistently improving as the lifting phase progressed, peaking towards the end of the lifting movement. This study successfully achieves accurate recognition of load on low back muscles during the object lifting task. The obtained results hold significant potential in effectively reducing muscle energy consumption when wearing a lumbar exoskeleton.

Decomposing Task-Relevant Information From Surface Electromyogram for User-Generic Dexterous Finger Force Decoding

Existing electromyographic (EMG) based motor intent detection algorithms are typically user-specific, and a generic model that can quickly adapt to new users is highly desirable. However, establishing such a model remains a challenge due to high inter-person variability and external interference with EMG signals. In this study, we present a feature disentanglement approach, implemented by an autoencoder-like architecture, designed to decompose user-invariant, motor-task-sensitive high-level representations from user-sensitive, task-irrelevant representations in EMG amplitude features. Our method is user-generic and can be applied to unseen users for continuous multi-finger force predictions. We evaluated our approach on eight subjects, predicting the force of three fingers (index, middle, and ring-pinky) concurrently. We assessed the decoder's performance through a rigorous leave-one-subject-out validation. Our developed approach consistently outperformed both the conventional EMG amplitude method and a commonly used feature projection approach, principal component analysis (PCA), with a lower force prediction error (RMSE: 6.91 ± 0.45 % MVC; R2: 0.835 ± 0.026) and a higher finger classification accuracy (83.0 ± 4.5%). The comparison with the state-of-the-art neural networks further demonstrated the superior performance of our method in user-generic force predictions. Overall, our methods provide novel insights into the development of user-generic and accurate neural decoding for myoelectric control of assistive robotic hands.

Understanding the influence of confounding factors in myoelectric control for discrete gesture recognition

Discrete myoelectric control-based gesture recognition has recently gained interest as a possible input modality for many emerging ubiquitous computing applications. Unlike the continuous control commonly employed in powered prostheses, discrete systems seek to recognize the dynamic sequences associated with gestures to generate event-based inputs. More akin to those used in general-purpose human-computer interaction, these could include, for example, a flick of the wrist to dismiss a phone call or a double tap of the index finger and thumb to silence an alarm. Moelectric control systems have been shown to achieve near-perfect classification accuracy, but in highly constrained offline settings. Real-world, online systems are subject to 'confounding factors' (i.e. factors that hinder the real-world robustness of myoelectric control that are not accounted for during typical offline analyses), which inevitably degrade system performance, limiting their practical use. Although these factors have been widely studied in continuous prosthesis control, there has been little exploration of their impacts on discrete myoelectric control systems for emerging applications and use cases. Correspondingly, this work examines, for the first time, three confounding factors and their effect on the robustness of discrete myoelectric control: (1)limb position variability, (2)cross-day use, and a newly identified confound faced by discrete systems (3)gesture elicitation speed. Results from four different discrete myoelectric control architectures: (1) Majority Vote LDA, (2) Dynamic Time Warping, (3) an LSTM network trained with Cross Entropy, and (4) an LSTM network trained with Contrastive Learning, show that classification accuracy is significantly degraded (p<0.05) as a result of each of these confounds. This work establishes that confounding factors are a critical barrier that must be addressed to enable the real-world adoption of discrete myoelectric control for robust and reliable gesture recognition.

Machine learning enables non-Gaussian investigation of changes to peripheral nerves related to electrical stimulation

Electrical stimulation of the peripheral nervous system (PNS) is becoming increasingly important for the therapeutic treatment of numerous disorders. Thus, as peripheral nerves are increasingly the target of electrical stimulation, it is critical to determine how, and when, electrical stimulation results in anatomical changes in neural tissue. We introduce here a convolutional neural network and support vector machines for cell segmentation and analysis of histological samples of the sciatic nerve of rats stimulated with varying current intensities. We describe the methodologies and present results that highlight the validity of the approach: machine learning enabled highly efficient nerve measurement collection, while multivariate analysis revealed notable changes to nerves' anatomy, even when subjected to levels of stimulation thought to be safe according to the Shannon current limits.

Application and Development of EEG Acquisition and Feedback Technology: A Review

This review focuses on electroencephalogram (EEG) acquisition and feedback technology and its core elements, including the composition and principles of the acquisition devices, a wide range of applications, and commonly used EEG signal classification algorithms. First, we describe the construction of EEG acquisition and feedback devices encompassing EEG electrodes, signal processing, and control and feedback systems, which collaborate to measure faint EEG signals from the scalp, convert them into interpretable data, and accomplish practical applications using control feedback systems. Subsequently, we examine the diverse applications of EEG acquisition and feedback across various domains. In the medical field, EEG signals are employed for epilepsy diagnosis, brain injury monitoring, and sleep disorder research. EEG acquisition has revealed associations between brain functionality, cognition, and emotions, providing essential insights for psychologists and neuroscientists. Brain-computer interface technology utilizes EEG signals for human-computer interaction, driving innovation in the medical, engineering, and rehabilitation domains. Finally, we introduce commonly used EEG signal classification algorithms. These classification tasks can identify different cognitive states, emotional states, brain disorders, and brain-computer interface control and promote further development and application of EEG technology. In conclusion, EEG acquisition technology can deepen the understanding of EEG signals while simultaneously promoting developments across multiple domains, such as medicine, science, and engineering.

AutoEER: automatic EEG-based emotion recognition with neural architecture search

Objective.Emotion recognition based on electroencephalography (EEG) is garnering increasing attention among researchers due to its wide-ranging applications and the rise of portable devices. Deep learning-based models have demonstrated impressive progress in EEG-based emotion recognition, thanks to their exceptional feature extraction capabilities. However, the manual design of deep networks is time-consuming and labour-intensive. Moreover, the inherent variability of EEG signals necessitates extensive customization of models, exacerbating these challenges. Neural architecture search (NAS) methods can alleviate the need for excessive manual involvement by automatically discovering the optimal network structure for EEG-based emotion recognition.Approach.In this regard, we propose AutoEER (AutomaticEEG-basedEmotionRecognition), a framework that leverages tailored NAS to automatically discover the optimal network structure for EEG-based emotion recognition. We carefully design a customized search space specifically for EEG signals, incorporating operators that effectively capture both temporal and spatial properties of EEG. Additionally, we employ a novel parameterization strategy to derive the optimal network structure from the proposed search space.Main results.Extensive experimentation on emotion classification tasks using two benchmark datasets, DEAP and SEED, has demonstrated that AutoEER outperforms state-of-the-art manual deep and NAS models. Specifically, compared to the optimal model WangNAS on the accuracy (ACC) metric, AutoEER improves its average accuracy on all datasets by 0.93%. Similarly, compared to the optimal model LiNAS on the F1 Ssore (F1) metric, AutoEER improves its average F1 score on all datasets by 4.51%. Furthermore, the architectures generated by AutoEER exhibit superior transferability compared to alternative methods.Significance.AutoEER represents a novel approach to EEG analysis, utilizing a specialized search space to design models tailored to individual subjects. This approach significantly reduces the labour and time costs associated with manual model construction in EEG research, holding great promise for advancing the field and streamlining research practices.

Robust neural decoding for dexterous control of robotic hand kinematics

BACKGROUND

Manual dexterity is a fundamental motor skill that allows us to perform complex daily tasks. Neuromuscular injuries, however, can lead to the loss of hand dexterity. Although numerous advanced assistive robotic hands have been developed, we still lack dexterous and continuous control of multiple degrees of freedom in real-time. In this study, we developed an efficient and robust neural decoding approach that can continuously decode intended finger dynamic movements for real-time control of a prosthetic hand.

METHODS

High-density electromyogram (HD-EMG) signals were obtained from the extrinsic finger flexor and extensor muscles, while participants performed either single-finger or multi-finger flexion-extension movements. We implemented a deep learning-based neural network approach to learn the mapping from HD-EMG features to finger-specific population motoneuron firing frequency (i.e., neural-drive signals). The neural-drive signals reflected motor commands specific to individual fingers. The predicted neural-drive signals were then used to continuously control the fingers (index, middle, and ring) of a prosthetic hand in real-time.

RESULTS

Our developed neural-drive decoder could consistently and accurately predict joint angles with significantly lower prediction errors across single-finger and multi-finger tasks, compared with a deep learning model directly trained on finger force signals and the conventional EMG-amplitude estimate. The decoder performance was stable over time and was robust to variations of the EMG signals. The decoder also demonstrated a substantially better finger separation with minimal predicted error of joint angle in the unintended fingers.

CONCLUSIONS

This neural decoding technique offers a novel and efficient neural-machine interface that can consistently predict robotic finger kinematics with high accuracy, which can enable dexterous control of assistive robotic hands.

Two-channel EEG based diagnosis of panic disorder and major depressive disorder using machine learning and non-linear dynamical methods

The current study aimed to investigate the possibility of rapid and accurate diagnoses of Panic disorder (PD) and Major depressive disorder (MDD) using machine learning. The support vector machine method was applied to 2-channel EEG signals from the frontal lobes (Fp1 and Fp2) of 149 participants to classify PD and MDD patients from healthy individuals using non-linear measures as features. We found significantly lower correlation dimension and Lempel-Ziv complexity in PD patients and MDD patients in the left hemisphere compared to healthy subjects at rest. Most importantly, we obtained a 90% accuracy in classifying MDD patients vs. healthy individuals, a 68% accuracy in classifying PD patients vs. controls, and a 59% classification accuracy between PD and MDD patients. In addition to demonstrating classification performance in a simplified setting, the observed differences in EEG complexity between subject groups suggest altered cortical processing present in the frontal lobes of PD patients that can be captured through non-linear measures. Overall, this study suggests that machine learning and non-linear measures using only 2-channel frontal EEGs are useful for aiding the rapid diagnosis of panic disorder and major depressive disorder.

A comparative study of machine learning methods for classifying ERP scalp distribution

Objective. Machine learning (ML) methods are used in different fields for classification and regression purposes with different applications. These methods are also used with various non-invasive brain signals, including Electroencephalography (EEG) signals to detect some patterns in the brain signals. ML methods are considered critical tools for EEG analysis since could overcome some of the limitations in the traditional methods of EEG analysis such as Event-related potentials (ERPs) analysis. The goal of this paper was to apply ML classification methods on ERP scalp distribution to investigate the performance of these methods in identifying numerical information carried in different finger-numeral configurations (FNCs). FNCs in their three forms of montring, counting, and non-canonical counting are used for communication, counting, and doing arithmetic across the world between children and even adults. Studies have shown the relationship between perceptual and semantic processing of FNCs, and neural differences in visually identifying different types of FNCs.Approach.A publicly available 32-channel EEG dataset recorded for 38 participants while they were shown a picture of an FNC (i.e., three categories and four numbers of 1,2,3, and 4) was used. EEG data were pre-processed and ERP scalp distribution of different FNCs was classified across time by six ML methods, including support vector machine, linear discriminant analysis, naïve Bayes, decision tree, K-nearest neighbor, and neural network. The classification was conducted in two conditions: classifying all FNCs together (i.e., 12 classes) and classifying FNCs of each category separately (i.e., 4 classes).Results.The support vector machine had the highest classification accuracy for both conditions. For classifying all FNCs together, the K-nearest neighbor was the next in line; however, the neural network could retrieve numerical information from the FNCs for category-specific classification.Significance.The significance of this study is in exploring the application of multiple ML methods in recognizing numerical information contained in ERP scalp distribution of different finger-numeral configurations.

Tensor factorization approach for ERP-based assessment of schizotypy in a novel auditory oddball task on perceived family stress

Objective. Schizotypy, a potential phenotype for schizophrenia, is a personality trait that depicts psychosis-like signs in the normal range of psychosis continuum. Family communication may affect the social functioning of people with schizotypy. Greater family stress, such as irritability, criticism and less praise, is perceived at a higher level of schizotypy. This study aims to determine the differences between people with high and low levels of schizotypy using electroencephalography (EEG) during criticism, praise and neutral comments. EEGs were recorded from 29 participants in the general community who varied from low schizotypy to high schizotypy (HS) during a novel emotional auditory oddball task.Approach. We consider the difference in event-related potential parameters, namely the amplitude and latency of P300 subcomponents (P3a and P3b), between pairs of target words (standard, positive, negative and neutral). A model based on tensor factorization is then proposed to detect these components from the EEG using the CANDECOMP/PARAFAC decomposition technique. Finally, we employ the mutual information estimation method to select influential features for classification.Main results.The highest classification accuracy, sensitivity, and specificity of 93.1%, 94.73%, and 90% are obtained via leave-one-out cross validation.Significance. This is the first attempt to investigate the identification of individuals with psychometrically-defined HS from brain responses that are specifically associated with perceiving family stress and schizotypy. By measuring these brain responses to social stress, we achieve the goal of improving the accuracy in detection of early episodes of psychosis.

A Novel Methodology for Classifying EMG Movements Based on SVM and Genetic Algorithms

Electromyography (EMG) processing is a fundamental part of medical research. It offers the possibility of developing new devices and techniques for the diagnosis, treatment, care, and rehabilitation of patients, in most cases non-invasively. However, EMG signals are random, non-stationary, and non-linear, making their classification difficult. Due to this, it is of vital importance to define which factors are helpful for the classification process. In order to improve this process, it is possible to apply algorithms capable of identifying which features are most important in the categorization process. Algorithms based on metaheuristic methods have demonstrated an ability to search for suitable subsets of features for optimization problems. Therefore, this work proposes a methodology based on genetic algorithms for feature selection to find the parameter space that offers the slightest classification error in 250 ms signal segments. For classification, a support vector machine is used. For this work, two databases were used, the first corresponding to the right upper extremity and the second formed by movements of the right lower extremity. For both databases, a feature space reduction of over 65% was obtained, with a higher average classification efficiency of 91% for the best subset of parameters. In addition, particle swarm optimization (PSO) was applied based on right upper extremity data, obtaining an 88% average error and a 46% reduction for the best subset of parameters. Finally, a sensitivity analysis was applied to the characteristics selected by PSO and genetic algorithms for the database of the right upper extremity, obtaining that the parameters determined by the genetic algorithms show greater sensitivity for the classification process.

Virtual/Augmented Reality for Rehabilitation Applications Using Electromyography as Control/Biofeedback: Systematic Literature Review

Virtual reality (VR) and augmented reality (AR) are engaging interfaces that can be of benefit for rehabilitation therapy. However, they are still not widely used, and the use of surface electromyography (sEMG) signals is not established for them. Our goal is to explore whether there is a standardized protocol towards therapeutic applications since there are not many methodological reviews that focus on sEMG control/feedback. A systematic literature review using the PRISMA (preferred reporting items for systematic reviews and meta-analyses) methodology is conducted. A Boolean search in databases was performed applying inclusion/exclusion criteria; articles older than 5 years and repeated were excluded. A total of 393 articles were selected for screening, of which 66.15% were excluded, 131 records were eligible, 69.46% use neither VR/AR interfaces nor sEMG control; 40 articles remained. Categories are, application: neurological motor rehabilitation (70%), prosthesis training (30%); processing algorithm: artificial intelligence (40%), direct control (20%); hardware: Myo Armband (22.5%), Delsys (10%), proprietary (17.5%); VR/AR interface: training scene model (25%), videogame (47.5%), first-person (20%). Finally, applications are focused on motor neurorehabilitation after stroke/amputation; however, there is no consensus regarding signal processing or classification criteria. Future work should deal with proposing guidelines to standardize these technologies for their adoption in clinical practice.

Stockwell transform and semi-supervised feature selection from deep features for classification of BCI signals

Over the past few years, the processing of motor imagery (MI) electroencephalography (EEG) signals has been attracted for developing brain-computer interface (BCI) applications, since feature extraction and classification of these signals are extremely difficult due to the inherent complexity and tendency to artifact properties of them. The BCI systems can provide a direct interaction pathway/channel between the brain and a peripheral device, hence the MI EEG-based BCI systems seem crucial to control external devices for patients suffering from motor disabilities. The current study presents a semi-supervised model based on three-stage feature extraction and machine learning algorithms for MI EEG signal classification in order to improve the classification accuracy with smaller number of deep features for distinguishing right- and left-hand MI tasks. Stockwell transform is employed at the first phase of the proposed feature extraction method to generate two-dimensional time-frequency maps (TFMs) from one-dimensional EEG signals. Next, the convolutional neural network (CNN) is applied to find deep feature sets from TFMs. Then, the semi-supervised discriminant analysis (SDA) is utilized to minimize the number of descriptors. Finally, the performance of five classifiers, including support vector machine, discriminant analysis, k-nearest neighbor, decision tree, random forest, and the fusion of them are compared. The hyperparameters of SDA and mentioned classifiers are optimized by Bayesian optimization to maximize the accuracy. The presented model is validated using BCI competition II dataset III and BCI competition IV dataset 2b. The performance metrics of the proposed method indicate its efficiency for classifying MI EEG signals.

Predicting hydration status using machine learning models from physiological and sweat biomarkers during endurance exercise: a single case study

Improper hydration routines can reduce athletic performance. Recent studies show that data from noninvasive biomarker recordings can help to evaluate the hydration status of subjects during endurance exercise. These studies are usually carried out on multiple subjects. In this work, we present the first study on predicting hydration status using machine learning models from single-subject experiments, which involve 32 exercise sessions of constant moderate intensity performed with and without fluid intake. During exercise, we measured four noninvasive physiological and sweat biomarkers including heart rate, core temperature, sweat sodium concentration, and whole-body sweat rate. Sweat sodium concentration was measured from six body regions using absorbent patches. We used three machine learning models to determine the percentage of body weight loss as an indicator of dehydration with these biomarkers and compared the prediction accuracy. The results on this single subject show that these models gave similar mean absolute errors, while in general the nonlinear models slightly outperformed the linear model in most of the experiments. The prediction accuracy of using the whole-body sweat rate or heart rate was higher than using core temperature or sweat sodium concentration. In addition, the model trained on the sweat sodium concentration collected from the arms gave slightly better accuracy than from the other five body regions. This exploratory work paves the way for the use of these machine learning models to develop personalized health monitoring together with emerging, noninvasive wearable sensor devices.

Machine Learning for Detection of Muscular Activity from Surface EMG Signals

Background: Muscular-activity timing is useful information that is extractable from surface EMG signals (sEMG). However, a reference method is not available yet. The aim of this study is to investigate the reliability of a novel machine-learning-based approach (DEMANN) in detecting the onset/offset timing of muscle activation from sEMG signals. Methods: A dataset of 2880 simulated sEMG signals, stratified for signal-to-noise ratio (SNR) and time support, was generated to train a hidden single-layer fully-connected neural network. DEMANN’s performance was evaluated on simulated sEMG signals and two different datasets of real sEMG signals. DEMANN was validated against different reference algorithms, including the acknowledged double-threshold statistical algorithm (DT). Results: DEMANN provided a reliable prediction of muscle onset/offset in simulated and real sEMG signals, being minimally affected by SNR variability. When directly compared with state-of-the-art algorithms, DEMANN introduced relevant improvements in prediction performances. Conclusions: These outcomes support DEMANN’s reliability in assessing onset/offset events in different motor tasks and the condition of signal quality (different SNR), improving reference-algorithm performances. Unlike other works, DEMANN’s adopts a machine learning approach where a neural network is trained by only simulated sEMG signals, avoiding the possible complications and costs associated with a typical experimental procedure, making this approach suitable to clinical practice.

Stacking classifier to improve the classification of shoulder motion in transhumeral amputees

In recent years surface electromyography signals-based machine learning models are rapidly establishing. The efficacy of prosthetic arm growth for transhumeral amputees is aided by efficient classifiers. The paper aims to propose a stacking classifier-based classification system for sEMG shoulder movements. It presents the possibility of various shoulder motions classification of transhumeral amputees. To improve the system performance, adaptive threshold method and wavelet transformation have been applied for features extraction. Six different classifiers Support Vector Machines (SVM), Tree, Random Forest (RF), K-Nearest Neighbour (KNN), AdaBoost and Naïve Bayes (NB) are designed to extract the sEMG data classification accuracy. With cross-validation, the accuracy of RF, Tree and Ada Boost is 97%, 92% and 92% respectively. Stacking classifiers provides an accuracy as 99.4% after combining the best predicted multiple classifiers.

Application of Augmented Reality Technology in Children's Picture Books Based on Educational Psychology

To cultivate children's imagination, observation, thinking ability, and aesthetic consciousness, the questionnaire survey is adopted to analyze the design strategies and principles of children's picture books based on augmented reality (AR). Primarily, the related concepts and theories are expounded for the research content. Children in preschool aged 4-5 years are invited as primary participants in this work, and the psychological characteristics of the invited children are analyzed in depth. Then, a study is carried out on the existing AR children's picture books. The problems existing in the design of AR children's picture books are found, and then, related solutions are put forward based on the results of the questionnaire survey. Besides, a design is made on the strategies and interactive design principles of AR children's picture books on mobile terminals that are more in line with the needs of children. The results show that 41.07% of parents do not understand AR technology, and 37.5% of preschool children indicate that they do not operate mobile devices independently. However, they need the assistance of parents to use this kind of picture book. A total of 44.64% of parents believe that the main problem of AR picture books in the current market is the lack of interesting interaction. Given the above problems, five principles are proposed for the design of AR children's picture books based on mobile terminals, namely, easy operation principle, interesting principle, guiding principle, timely feedback principle, and safety principle. A set of universally applicable design methods are proposed for AR children's picture books based on mobile terminals, which provides certain theoretical guidance for the development of related types of products.

The inclusion of augmented intelligence in medicine: A framework for successful implementation

Artificial intelligence (AI) algorithms are being applied across a large spectrum of everyday life activities. The implementation of AI algorithms in clinical practice has been met with some skepticism and concern, mainly because of the uneasiness that stems, in part, from a lack of understanding of how AI operates, together with the role of physicians and patients in the decision-making process; uncertainties regarding the reliability of the data and the outcomes; as well as concerns regarding the transparency, accountability, liability, handling of personal data, and monitoring and system upgrades. In this viewpoint, we take these issues into consideration and offer an integrated regulatory framework to AI developers, clinicians, researchers, and regulators, aiming to facilitate the adoption of AI that rests within the FDA’s pathway, in research, development, and clinical medicine.

•

Concerns hamper the implementation of augmented intelligence in clinical practice

•

Transparency and external validation increase trust in developed algorithms

•

A regulatory framework is needed for adoption of augmented intelligence in medicine

Enhanced Recognition of Amputated Wrist and Hand Movements by Deep Learning Method Using Multimodal Fusion of Electromyography and Electroencephalography

Motion classification can be performed using biometric signals recorded by electroencephalography (EEG) or electromyography (EMG) with noninvasive surface electrodes for the control of prosthetic arms. However, current single-modal EEG and EMG based motion classification techniques are limited owing to the complexity and noise of EEG signals, and the electrode placement bias, and low-resolution of EMG signals. We herein propose a novel system of two-dimensional (2D) input image feature multimodal fusion based on an EEG/EMG-signal transfer learning (TL) paradigm for detection of hand movements in transforearm amputees. A feature extraction method in the frequency domain of the EEG and EMG signals was adopted to establish a 2D image. The input images were used for training on a model based on the convolutional neural network algorithm and TL, which requires 2D images as input data. For the purpose of data acquisition, five transforearm amputees and nine healthy controls were recruited. Compared with the conventional single-modal EEG signal trained models, the proposed multimodal fusion method significantly improved classification accuracy in both the control and patient groups. When the two signals were combined and used in the pretrained model for EEG TL, the classification accuracy increased by 4.18-4.35% in the control group, and by 2.51-3.00% in the patient group.

An adversarial discriminative temporal convolutional network for EEG-based cross-domain emotion recognition

Domain adaptation (DA) tackles the problem where data from the source domain and target domain have different underlying distributions. In cross-domain (cross-subject or cross-dataset) emotion recognition based on EEG signals, traditional classification methods lack domain adaptation capabilities and have low performance. To address this problem, we proposed a novel domain adaptation strategy called adversarial discriminative-temporal convolutional networks (AD-TCNs) in this study, which can ensure the invariance of the representation of feature graphs in different domains and fill in the differences between different domains. For EEG data with specific temporal attributes, the temporal model TCN is used as the feature encoder. In the cross-subject experiment, our AD-TCN method achieved the highest accuracies of the valence and arousal dimensions in both the DREAMER and DEAP datasets. In the cross-dataset experiment, two of the eight task groups showed accuracies of 62.65% and 62.36%. Compared with the state-of-the-art performance in the same protocol, experimental results demonstrated that our method is an effective extension to realize EEG-based cross-domain emotion recognition.

Classification of alcoholic EEG signals using wavelet scattering transform-based features

Following the research question and the relevant dataset, feature extraction is the most important component of machine learning and data science pipelines. The wavelet scattering transform (WST) is a recently developed knowledge-based feature extraction technique and is structurally like a convolutional neural network (CNN). It preserves information in high-frequency, is insensitive to signal deformations, and generates low variance features of real-valued signals generally required in classification tasks. With data from a publicly-available UCI database, we investigated the ability of WST-based features extracted from multichannel electroencephalogram (EEG) signals to discriminate 1.0-s EEG records of 20 male subjects with alcoholism and 20 male healthy subjects. Using record-wise 10-fold cross-validation, we found that WST-based features, inputted to a support vector machine (SVM) classifier, were able to correctly classify all alcoholic and normal EEG records. Similar performances were achieved with 1D CNN. In contrast, the highest independent-subject-wise mean 10-fold cross-validation performance was achieved with WST-based features fed to a linear discriminant (LDA) classifier. The results achieved with two 10-fold cross-validation approaches suggest that the WST together with a conventional classifier is an alternative to CNN for classification of alcoholic and normal EEGs. WST-based features from occipital and parietal regions were the most informative at discriminating between alcoholic and normal EEG records.

Pattern recognition of EMG signals for low level grip force classification

Grasping of the objects is the most frequent activity performed by the human upper limb. The amputations of the upper limb results in the need for prosthetic devices. The myoelectric prosthetic devices use muscle signals and apply control techniques for identification of different levels of hand gesture and force levels. In this study; a different level force contraction experiment was performed in which Electromyography (EMGs) signals and fingertip force signals were acquired. Using this experimental data; a two-step feature selection process is applied for the designing of a pattern recognition algorithm for the classification of different force levels. The two step feature selection process consist of generalized feature ranking using ReliefF, followed by personalized feature selection using Neighborhood Component Analysis (NCA) from the shortlisted features by earlier technique. The classification algorithms applied in this study were Support Vector Machines (SVM) and Random Forest (RF). Besides feature selection; optimization of the number of muscles during classification of force levels was also performed using designed algorithm. Based on this algorithm; the maximum classification accuracy using SVM classifier and two muscle set was achieved as high as 99%. The optimal feature set consisted features such as Auto Regressive coefficients, Willison Amplitude and Slope Sign Change. The mean classification accuracy for different subjects, achieved using SVM and RF was 94.5% and 91.7% respectively.

Detection of subclinical rheumatic heart disease in children using a deep learning algorithm on digital stethoscope: a study protocol

INTRODUCTION

Rheumatic heart diseases (RHDs) contribute significant morbidity and mortality globally. To reduce the burden of RHD, timely initiation of secondary prophylaxis is important. The objectives of this study are to determine the frequency of subclinical RHD and to train a deep learning (DL) algorithm using waveform data from the digital auscultatory stethoscope (DAS) in predicting subclinical RHD.

METHODS AND ANALYSIS

We aim to recruit 1700 children from a group of schools serving the underprivileged over a 12-month period in Karachi (Pakistan). All consenting students within the age of 5-15 years with no underlying congenital heart disease will be eligible for the study. We will gather information regarding sociodemographics, anthropometric data, history of symptoms or diagnosis of rheumatic fever, phonocardiogram (PCG) and electrocardiography (ECG) data obtained from DAS. Handheld echocardiogram will be performed on each study participant to assess the presence of a mitral regurgitation (MR) jet (>1.5 cm), or the presence of aortic regurgitation (AR) in any view. If any of these findings are present, a confirmatory standard echocardiogram using the World Heart Federation (WHF) will be performed to confirm the diagnosis of subclinical RHD. The auscultatory data from digital stethoscope will be used to train the deep neural network for the automatic identification of patients with subclinical RHD. The proposed neural network will be trained in a supervised manner using labels from standard echocardiogram of the participants. Once trained, the neural network will be able to automatically classify the DAS data in one of the three major categories-patient with definite RHD, patient with borderline RHD and normal subject. The significance of the results will be confirmed by standard statistical methods for hypothesis testing.

ETHICS AND DISSEMINATION

Ethics approval has been taken from the Aga Khan University, Pakistan. Findings will be disseminated through scientific publications and to collaborators.

ARTICLE FOCUS

This study focuses on determining the frequency of subclinical RHD in school-going children in Karachi, Pakistan and developing a DL algorithm to screen for this condition using a digital stethoscope.

Using Reinforcement Learning to Estimate Human Joint Moments From Electromyography or Joint Kinematics: An Alternative Solution to Musculoskeletal-Based Biomechanics

Reinforcement learning (RL) has potential to provide innovative solutions to existing challenges in estimating joint moments in motion analysis, such as kinematic or electromyography (EMG) noise and unknown model parameters. Here, we explore feasibility of RL to assist joint moment estimation for biomechanical applications. Forearm and hand kinematics and forearm EMGs from four muscles during free finger and wrist movement were collected from six healthy subjects. Using the proximal policy optimization approach, we trained two types of RL agents that estimated joint moment based on measured kinematics or measured EMGs, respectively. To quantify the performance of trained RL agents, the estimated joint moment was used to drive a forward dynamic model for estimating kinematics, which was then compared with measured kinematics using Pearson correlation coefficient. The results demonstrated that both trained RL agents are feasible to estimate joint moment for wrist and metacarpophalangeal (MCP) joint motion prediction. The correlation coefficients between predicted and measured kinematics, derived from the kinematics-driven agent and subject-specific EMG-driven agents, were 98% ± 1% and 94% ± 3% for the wrist, respectively, and were 95% ± 2% and 84% ± 6% for the metacarpophalangeal joint, respectively. In addition, a biomechanically reasonable joint moment-angle-EMG relationship (i.e., dependence of joint moment on joint angle and EMG) was predicted using only 15 s of collected data. In conclusion, this study illustrates that an RL approach can be an alternative technique to conventional inverse dynamic analysis in human biomechanics study and EMG-driven human-machine interfacing applications.

Human Posture Detection Method Based on Wearable Devices

The dynamic detection of human motion is important, which is widely applied in the fields of motion state capture and rehabilitation engineering. In this study, based on multimodal information of surface electromyography (sEMG) signals of upper limb and triaxial acceleration and plantar pressure signals of lower limb, the effective virtual driving control and gait recognition methods were proposed. The effective way of wearable human posture detection was also constructed. Firstly, the moving average window and threshold comparison were used to segment the sEMG signals of the upper limb. The standard deviation and singular values of wavelet coefficients were extracted as the features. After the training and classification by optimized support vector machine (SVM) algorithm, the real-time detection and analysis of three virtual driving actions were performed. The average identification accuracy was 90.90%. Secondly, the mean, standard deviation, variance, and wavelet energy spectrum of triaxial acceleration were extracted, and these parameters were combined with plantar pressure as the gait features. The optimized SVM was selected for the gait identification, and the average accuracy was 90.48%. The experimental results showed that, through different combinations of wearable sensors on the upper and lower limbs, the motion posture information could be dynamically detected, which could be used in the design of virtual rehabilitation system and walking auxiliary system.

Prediction of age and sex from paranasal sinus images using a deep learning network

This study was conducted to develop a convolutional neural network (CNN)-based model to predict the sex and age of patients by identifying unique unknown features from paranasal sinus (PNS) X-ray images.We employed a retrospective study design and used anonymized patient imaging data. Two CNN models, adopting ResNet-152 and DenseNet-169 architectures, were trained to predict sex and age groups (20-39, 40-59, 60+ years). The area under the curve (AUC), algorithm accuracy, sensitivity, and specificity were assessed. Class-activation map (CAM) was used to detect deterministic areas. A total of 4160 PNS X-ray images were collected from 4160 patients. The PNS X-ray images of patients aged ≥20 years were retrieved from the picture archiving and communication database system of our institution. The classification performances in predicting the sex (male vs female) and 3 age groups (20-39, 40-59, 60+ years) for each established CNN model were evaluated.For sex prediction, ResNet-152 performed slightly better (accuracy = 98.0%, sensitivity = 96.9%, specificity = 98.7%, and AUC = 0.939) than DenseNet-169. CAM indicated that maxillary sinuses (males) and ethmoid sinuses (females) were major factors in identifying sex. Meanwhile, for age prediction, the DenseNet-169 model was slightly more accurate in predicting age groups (77.6 ± 1.5% vs 76.3 ± 1.1%). CAM suggested that the maxillary sinus and the periodontal area were primary factors in identifying age groups.Our deep learning model could predict sex and age based on PNS X-ray images. Therefore, it can assist in reducing the risk of patient misidentification in clinics.

A Machine Learning-Based Investigation of Gender-Specific Prognosis of Lung Cancers

Background and Objective: Primary lung cancer is a lethal and rapidly-developing cancer type and is one of the most leading causes of cancer deaths. Materials and Methods: Statistical methods such as Cox regression are usually used to detect the prognosis factors of a disease. This study investigated survival prediction using machine learning algorithms. The clinical data of 28,458 patients with primary lung cancers were collected from the Surveillance, Epidemiology, and End Results (SEER) database. Results: This study indicated that the survival rate of women with primary lung cancer was often higher than that of men (p < 0.001). Seven popular machine learning algorithms were utilized to evaluate one-year, three-year, and five-year survival prediction The two classifiers extreme gradient boosting (XGB) and logistic regression (LR) achieved the best prediction accuracies. The importance variable of the trained XGB models suggested that surgical removal (feature “Surgery”) made the largest contribution to the one-year survival prediction models, while the metastatic status (feature “N” stage) of the regional lymph nodes was the most important contributor to three-year and five-year survival prediction. The female patients’ three-year prognosis model achieved a prediction accuracy of 0.8297 on the independent future samples, while the male model only achieved the accuracy 0.7329. Conclusions: This data suggested that male patients may have more complicated factors in lung cancer than females, and it is necessary to develop gender-specific diagnosis and prognosis models.

Motor imagery EEG classification based on ensemble support vector learning

BACKGROUND AND OBJECTIVE

Brain-computer interfaces build a communication pathway from the human brain to a computer. Motor imagery-based electroencephalogram (EEG) classification is a widely applied paradigm in brain-computer interfaces. The common spatial pattern, based on the event-related desynchronization (ERD)/event-related synchronization (ERS) phenomenon, is one of the most popular algorithms for motor imagery-based EEG classification. Moreover, the spatiotemporal discrepancy feature based on the event-related potential phenomenon has been demonstrated to provide complementary information to ERD/ERS-based features. In this paper, aiming to improve the performance of motor imagery-based EEG classification in a few-channel situation, an ensemble support vector learning (ESVL)-based approach is proposed to combine the advantages of the ERD/ERS-based features and the event-related potential-based features in motor imagery-based EEG classification.

METHODS

ESVL is an ensemble learning algorithm based on support vector machine classifier. Specifically, the decision boundary with the largest interclass margin is obtained using the support vector machine algorithm, and the distances between sample points and the decision boundary are mapped to posterior probabilities. The probabilities obtained from different support vector machine classifiers are combined to make prediction. Thus, ESVL leverages the advantages of multiple trained support vector machine classifiers and makes a better prediction based on the posterior probabilities. The class discrepancy-guided sub-band-based common spatial pattern and the spatiotemporal discrepancy feature are applied to extract discriminative features, and then, the extracted features are used to train the ESVL classifier and make predictions.

RESULTS

The BCI Competition IV datasets 2a and 2b are employed to evaluate the performance of the proposed ESVL algorithm. Experimental comparisons with the state-of-the-art methods are performed, and the proposed ESVL-based approach achieves an average max kappa value of 0.60 and 0.71 on BCI Competition IV datasets 2a and 2b respectively. The results show that the proposed ESVL-based approach improves the performance of motor imagery-based brain-computer interfaces.

CONCLUSION

The proposed ESVL classifier could use the posterior probabilities to realize ensemble learning and the ESVL-based motor imagery classification approach takes advantage of the merits of ERD/ERS based feature and event-related potential based feature to improve the experimental performance.

Decoding multiclass motor imagery EEG from the same upper limb by combining Riemannian geometry features and partial least squares regression

OBJECTIVE

Due to low spatial resolution and poor signal-to-noise ratio of electroencephalogram (EEG), high accuracy classifications still suffer from lots of obstacles in the context of motor imagery (MI)-based brain-machine interface (BMI) systems. Particularly, it is extremely challenging to decode multiclass MI EEG from the same upper limb. This research proposes a novel feature learning approach to address the classification problem of 6-class MI tasks, including imaginary elbow flexion/extension, wrist supination/pronation, and hand close/open within the unilateral upper limb.

APPROACH

Instead of the traditional common spatial pattern (CSP) or filter-bank CSP (FBCSP) manner, the Riemannian geometry (RG) framework involving Riemannian distance and Riemannian mean was directly adopted to extract tangent space (TS) features from spatial covariance matrices of the MI EEG trials. Subsequently, to reduce the dimensionality of the TS features, the algorithm of partial least squares regression was applied to obtain more separable and compact feature representations.

MAIN RESULTS

The performance of the learned RG feature representations was validated by a linear discriminative analysis and support vector machine classifier, with an average accuracy of 80.50% and 79.70% on EEG dataset collected from 12 participants, respectively.

SIGNIFICANCE

These results demonstrate that compared with CSP and FBCSP features, the proposed approach can significantly increase the decoding accuracy for multiclass MI tasks from the same upper limb. This approach is promising and could potentially be applied in the context of MI-based BMI control of a robotic arm or a neural prosthesis for motor disabled patients with highly impaired upper limb.

Machine learning versus conventional clinical methods in guiding management of heart failure patients-a systematic review

Machine learning (ML) algorithms “learn” information directly from data, and their performance improves proportionally with the number of high-quality samples. The aim of our systematic review is to present the state of the art regarding the implementation of ML techniques in the management of heart failure (HF) patients. We manually searched MEDLINE and Cochrane databases as well the reference lists of the relevant review studies and included studies. Our search retrieved 122 relevant studies. These studies mainly refer to (a) the role of ML in the classification of HF patients into distinct categories which may require a different treatment strategy, (b) discrimination of HF patients from the healthy population or other diseases, (c) prediction of HF outcomes, (d) identification of HF patients from electronic records and identification of HF patients with similar characteristics who may benefit form a similar treatment strategy, (e) supporting the extraction of important data from clinical notes, and (f) prediction of outcomes in HF populations with implantable devices (left ventricular assist device, cardiac resynchronization therapy). We concluded that ML techniques may play an important role for the efficient construction of methodologies for diagnosis, management, and prediction of outcomes in HF patients.

Supervised Machine Learning Applied to Wearable Sensor Data Can Accurately Classify Functional Fitness Exercises Within a Continuous Workout

Observing, classifying and assessing human movements is important in many applied fields, including human-computer interface, clinical assessment, activity monitoring and sports performance. The redundancy of options in planning and implementing motor programmes, the inter- and intra-individual variability in movement execution, and the time-continuous, high-dimensional nature of motion data make segmenting sequential movements into a smaller set of discrete classes of actions non-trivial. We aimed to develop and validate a method for the automatic classification of four popular functional fitness drills, which are commonly performed in current circuit training routines. Five inertial measurement units were located on the upper and lower limb, and on the trunk of fourteen participants. Positions were chosen by keeping into account the dynamics of the movement and the positions where commercially-available smart technologies are typically secured. Accelerations and angular velocities were acquired continuously from the units and used to train and test different supervised learning models, including k-Nearest Neighbors (kNN) and support-vector machine (SVM) algorithms. The use of different kernel functions, as well as different strategies to segment continuous inertial data were explored. Classification performance was assessed from both the training dataset (k-fold cross-validation), and a test dataset (leave-one-subject-out validation). Classification from different subsets of the measurement units was also evaluated (1-sensor and 2-sensor data). SVM with a cubic kernel and fed with data from 600 ms windows with a 10% overlap gave the best classification performances, yielding to an overall accuracy of 97.8%. This approach did not misclassify any functional fitness movement for another, but confused relatively frequently (2.8-18.9%) a fitness movement phase with the transition between subsequent repetitions of the same task or different drills. Among 1-sensor configurations, the upper arm achieved the best classification performance (96.4% accuracy), whereas combining the upper arm and the thigh sensors obtained the highest level of accuracy (97.6%) from 2-sensors movement tracking. We found that supervised learning can successfully classify complex sequential movements such as those of functional fitness workouts. Our approach, which could exploit technologies currently available in the consumer market, demonstrated exciting potential for future on-field applications including unstructured training.

Bacomics: a comprehensive cross area originating in the studies of various brain-apparatus conversations

The brain is the most important organ of the human body, and the conversations between the brain and an apparatus can not only reveal a normally functioning or a dysfunctional brain but also can modulate the brain. Here, the apparatus may be a nonbiological instrument, such as a computer, and the consequent brain-computer interface is now a very popular research area with various applications. The apparatus may also be a biological organ or system, such as the gut and muscle, and their efficient conversations with the brain are vital for a healthy life. Are there any common bases that bind these different scenarios? Here, we propose a new comprehensive cross area: Bacomics, which comes from brain-apparatus conversations (BAC) + omics. We take Bacomics to cover at least three situations: (1) The brain is normal, but the conversation channel is disabled, as in amyotrophic lateral sclerosis. The task is to reconstruct or open up new channels to reactivate the brain function. (2) The brain is in disorder, such as in Parkinson's disease, and the work is to utilize existing or open up new channels to intervene, repair and modulate the brain by medications or stimulation. (3) Both the brain and channels are in order, and the goal is to enhance coordinated development between the brain and apparatus. In this paper, we elaborate the connotation of BAC into three aspects according to the information flow: the issue of output to the outside (BAC-1), the issue of input to the brain (BAC-2) and the issue of unity of brain and apparatus (BAC-3). More importantly, there are no less than five principles that may be taken as the cornerstones of Bacomics, such as feedforward and feedback control, brain plasticity, harmony, the unity of opposites and systems principles. Clearly, Bacomics integrates these seemingly disparate domains, but more importantly, opens a much wider door for the research and development of the brain, and the principles further provide the general framework in which to realize or optimize these various conversations.

sEMG-Based Trunk Compensation Detection in Rehabilitation Training

Stroke patients often use trunk to compensate for impaired upper limb motor function during upper limb rehabilitation training, which results in a reduced rehabilitation training effect. Detecting trunk compensations can improve the effect of rehabilitation training. This study investigates the feasibility of a surface electromyography-based trunk compensation detection (sEMG-bTCD) method. Five healthy subjects and nine stroke subjects with cognitive and comprehension skills were recruited to participate in the experiments. The sEMG signals from nine superficial trunk muscles were collected during three rehabilitation training tasks (reach-forward-back, reach-side-to-side, and reach-up-to-down motions) without compensation and with three common trunk compensations [lean-forward (LF), trunk rotation (TR), and shoulder elevation (SE)]. Preprocessing like filtering, active segment detection was performed and five time domain features (root mean square, variance, mean absolute value (MAV), waveform length, and the fourth order autoregressive model coefficient) were extracted from the collected sEMG signals. Excellent TCD performance was achieved in healthy participants by using support vector machine (SVM) classifier (LF: accuracy = 94.0%, AUC = 0.97, F1 = 0.94; TR: accuracy = 95.8%, AUC = 0.99, F1 = 0.96; SE: accuracy = 100.0%, AUC = 1.00, F1 = 1.00). By using SVM classifier, TCD performance in stroke participants was also obtained (LF: accuracy = 74.8%, AUC = 0.90, F1 = 0.73; TR: accuracy = 67.1%, AUC = 0.85, F1 = 0.71; SE: accuracy = 91.3%, AUC = 0.98, F1 = 0.90). Compared with the methods based on cameras or inertial sensors, better detection performance was obtained in both healthy and stroke participants. The results demonstrated the feasibility of the sEMG-bTCD method, and it helps to prompt the stroke patients to correct their incorrect posture, thereby improving the effectiveness of rehabilitation training.

Selection of Features and Classifiers for EMG-EEG-Based Upper Limb Assistive Devices-A Review

Bio-signals are distinctive factors in the design of human-machine interface, essentially useful for prosthesis, orthosis, and exoskeletons. Despite the progress in the analysis of pattern recognition based devices; the acceptance of these devices is still questionable. One reason is the lack of information to identify the possible combinations of features and classifiers. Besides; there is also a need for optimal selection of various sensors for sensations such as touch, force, texture, along with EMGs/EEGs. This article reviews the two bio-signal techniques, named as electromyography and electroencephalography. The details of the features and the classifiers used in the data processing for upper limb assist devices are summarised here. Various features and their sets are surveyed and different classifiers for feature sets are discussed on the basis of the classification rate. The review was carried out on the basis of the last 10-12 years of published research in this area. This article also outlines the influence of modality of EMGs and EEGs with other sensors on classifications. Also, other bio-signals used in upper limb devices and future aspects are considered.

A review and experimental study on the application of classifiers and evolutionary algorithms in EEG-based brain-machine interface systems

OBJECTIVE

Considering the importance and the near-future development of noninvasive brain-machine interface (BMI) systems, this paper presents a comprehensive theoretical-experimental survey on the classification and evolutionary methods for BMI-based systems in which EEG signals are used.

APPROACH

The paper is divided into two main parts. In the first part, a wide range of different types of the base and combinatorial classifiers including boosting and bagging classifiers and evolutionary algorithms are reviewed and investigated. In the second part, these classifiers and evolutionary algorithms are assessed and compared based on two types of relatively widely used BMI systems, sensory motor rhythm-BMI and event-related potentials-BMI. Moreover, in the second part, some of the improved evolutionary algorithms as well as bi-objective algorithms are experimentally assessed and compared.

MAIN RESULTS

In this study two databases are used, and cross-validation accuracy (CVA) and stability to data volume (SDV) are considered as the evaluation criteria for the classifiers. According to the experimental results on both databases, regarding the base classifiers, linear discriminant analysis and support vector machines with respect to CVA evaluation metric, and naive Bayes with respect to SDV demonstrated the best performances. Among the combinatorial classifiers, four classifiers, Bagg-DT (bagging decision tree), LogitBoost, and GentleBoost with respect to CVA, and Bagging-LR (bagging logistic regression) and AdaBoost (adaptive boosting) with respect to SDV had the best performances. Finally, regarding the evolutionary algorithms, single-objective invasive weed optimization (IWO) and bi-objective nondominated sorting IWO algorithms demonstrated the best performances.

SIGNIFICANCE

We present a general survey on the base and the combinatorial classification methods for EEG signals (sensory motor rhythm and event-related potentials) as well as their optimization methods through the evolutionary algorithms. In addition, experimental and statistical significance tests are carried out to study the applicability and effectiveness of the reviewed methods.

Percept-related EEG classification using machine learning approach and features of functional brain connectivity

Machine learning is a promising approach for electroencephalographic (EEG) trials classification. Its efficiency is largely determined by the feature extraction and selection techniques reducing the dimensionality of input data. Dimensionality reduction is usually implemented via the mathematical approaches (e.g., principal component analysis, linear discriminant analysis, etc.) regardless of the origin of analyzed data. We hypothesize that since EEG features are determined by certain neurophysiological processes, they should have distinctive characteristics in spatiotemporal domain. If so, it is possible to specify the set of EEG principal features based on the prior knowledge about underlying neurophysiological processes. To test this hypothesis, we consider the classification of EEG trials related to the perception of ambiguous visual stimuli. We observe that EEG features, underlying the different ambiguous stimuli interpretations, are defined by the network properties of neuronal activity. Having analyzed functional neural interactions, we specify the brain area in which neural network architecture exhibits differences for different classes of EEG trials. We optimize the feedforward multilayer perceptron and develop a strategy for the training set selection to maximize the classification accuracy, being 85% when all channels are used. The revealed localization of the percept-related features allows about 95% accuracy, when the number of channels is reduced up to 90%. Obtained results can be used for classification of EEG trials associated with more complex cognitive tasks. Taking into account that cognitive activity is subserved by a distributed functional cortical network, its topological properties have to be considered when selecting optimal features for EEG trial classification.

Decoding electroencephalographic signals for direction in brain-computer interface using echo state network and Gaussian readouts

BACKGROUND

Noninvasive brain-computer interfaces (BCI) for movement control via an electroencephalogram (EEG) have been extensively investigated. However, most previous studies decoded user intention for movement directions based on sensorimotor rhythms during motor imagery. BCI systems based on mapping imagery movement of body parts (e.g., left or right hands) to movement directions (left or right directional movement of a machine or cursor) are less intuitive and less convenient due to the complex training procedures. Thus, direct decoding methods for detecting user intention about movement directions are urgently needed.

METHODS

Here, we describe a novel direct decoding method for user intention about the movement directions using the echo state network and Gaussian readouts. Importantly parameters in the network were optimized using the genetic algorithm method to achieve better decoding performance. We tested the decoding performance of this method with four healthy subjects and an inexpensive wireless EEG system containing 14 channels and then compared the performance outcome with that of a conventional machine learning method.

RESULTS

We showed that this decoding method successfully classified eight directions of intended movement (approximately 95% of an accuracy).

CONCLUSIONS

We suggest that the echo state network and Gaussian readouts can be a useful decoding method to directly read user intention of movement directions even using an inexpensive and portable EEG system.

Class discrepancy-guided sub-band filter-based common spatial pattern for motor imagery classification

BACKGROUND

Motor imagery classification, an important branch of brain-computer interface (BCI), recognizes the intention of subjects to control external auxiliary equipment. Therefore, EEG-based motor imagery classification has received increasing attention in the fields of neuroscience. The common spatial pattern (CSP) algorithm has recently achieved great success in motor imagery classification. However, varying discriminative frequency bands and few-channel EEG limit the performance of CSP.

NEW METHOD

A class discrepancy-guided sub-band filter-based CSP (CDFCSP) algorithm is proposed to automatically recognize and augment the discriminative frequency bands for CSP algorithms. Specifically, a priori knowledge and templates obtained from the training set were applied as the design guidelines of the class discrepancy-guided sub-band filter (CDF). Second, a filter bank CSP was used to extract features from EEG traces filtered by the CDF. Finally, the CSP features of multiple frequency bands were leveraged to train linear support vector machine classifier and generate prediction.

RESULTS

BCI competition IV datasets 2a and 2b, which include EEGs from 18 subjects, were used to validate the performance improvement provided by the CDF. Student's t-tests of the CDFCSP versus the filter bank CSP without the CDF showed that the performance improvement was significant (i.e., p-values of 0.040 and 0.032 for the ratio and normalization mode CDFCSP, respectively).

COMPARISON WITH EXISTING METHOD(S)

The experiments show that the proposed CDFCSP improves the CSP algorithm and outperforms the other state-of-the-art algorithms evaluated in this paper.

CONCLUSIONS

The increased performance of the proposed CDFCSP algorithm can promote the application of BCI systems.

Neurophysiological predictors and spectro-spatial discriminative features for enhancing SMR-BCI

Neural engineering research is actively engaged in optimizing the robustness of sensorimotor rhythms (SMR)-brain-computer interface (BCI) to boost its potential real-world use.

OBJECTIVE

This paper investigates two vital factors in efficient and robust SMR-BCI design-algorithms that address subject-variability of optimal features and neurophysiological factors that correlate with BCI performance. Existing SMR-BCI research using electroencephalogram (EEG) to classify bilateral motor imagery (MI) focus on identifying subject-specific frequency bands with most discriminative motor patterns localized to sensorimotor region.

APPROACH

A novel strategy to further optimize BCI performance by taking into account the variability of discriminative spectral regions across various EEG channels is proposed in this paper.

MAIN RESULTS

The proposed technique results in a significant ([Formula: see text]) increase in average ([Formula: see text]) classification accuracy by [Formula: see text] accompanied by a considerable reduction in number of channels and bands. The session-to-session transfer variation in spectro-spatial patterns using proposed algorithm is investigated offline and classification performance of the optimized BCI model is successfully evaluated in an online SMR-BCI. Further, the effective prediction of SMR-BCI performance with physiological indicators derived from multi-channel resting-state EEG is demonstrated. The results indicate that the resting state activation patterns such as entropy and gamma power from pre-motor (fronto-central) and posterior (parietal and centro-parietal) areas, and beta power from posterior (centro-parietal) areas estimate BCI performance with minimum error. These patterns, strongly related to BCI performance, may represent certain cognitive states during rest.

SIGNIFICANCE

Findings reported in this paper imply the need for subject-specific modelling of BCI and the prediction of BCI performance using multi-channel rest-state parameters, to ensure enhanced BCI performance.

A Decoding Scheme for Incomplete Motor Imagery EEG With Deep Belief Network

High accuracy decoding of electroencephalogram (EEG) signal is still a major challenge that can hardly be solved in the design of an effective motor imagery-based brain-computer interface (BCI), especially when the signal contains various extreme artifacts and outliers arose from data loss. The conventional process to avoid such cases is to directly reject the entire severely contaminated EEG segments, which leads to a drawback that the BCI has no decoding results during that certain period. In this study, a novel decoding scheme based on the combination of Lomb-Scargle periodogram (LSP) and deep belief network (DBN) was proposed to recognize the incomplete motor imagery EEG. Particularly, instead of discarding the entire segment, two forms of data removal were adopted to eliminate the EEG portions with extreme artifacts and data loss. The LSP was utilized to steadily extract the power spectral density (PSD) features from the incomplete EEG constructed by the remaining portions. A DBN structure based on the restricted Boltzmann machine (RBM) was exploited and optimized to perform the classification task. Various comparative experiments were conducted and evaluated on simulated signal and real incomplete motor imagery EEG, including the comparison of three PSD extraction methods (fast Fourier transform, Welch and LSP) and two classifiers (DBN and support vector machine, SVM). The results demonstrate that the LSP can estimate relative robust PSD features and the proposed scheme can significantly improve the decoding performance for the incomplete motor imagery EEG. This scheme can provide an alternative decoding solution for the motor imagery EEG contaminated by extreme artifacts and data loss. It can be beneficial to promote the stability, smoothness and maintain consecutive outputs without interruption for a BCI system that is suitable for the online and long-term application.

Frontal Alpha Asymmetry and Theta Oscillations Associated With Information Sharing Intention

Social media has gained increasing importance in many aspects of everyday life, from building relationships to establishing collaborative networks between individuals worldwide. Sharing behavior is an essential part of maintaining these dynamic networks. However, the precise neural factors that could be related to sharing behavior in online communities remain unclear. In this study, we recorded electroencephalographic (EEG) oscillations of human subjects while they were watching short videos. The subjects were later asked to evaluate the videos based on how much they liked them and whether they would share them. We found that, at the population level, subjects watching videos that would not be shared had higher power spectral density (PSD) amplitudes in the theta band (4-8 Hz), primarily over the frontal and parietal sites of the right hemisphere, than subjects watching videos that would be shared. Previous studies have associated task disengagement with an increase in scalp-wide theta activation, which can be interpreted as a mind-wandering effect. This might suggest that the decision to not share the video may lead to a more automatic/effortless neural pattern. We also found that watching videos that would be shared was associated with lower PSD amplitudes in the alpha band (8-12 Hz) over the central and right frontal sites, and with more negative scores of frontal alpha asymmetry (FAA) index scores. These results may be related to previous work linking right-sided frontal EEG asymmetry to the pursuit of social conformity and avoidance of negative outcomes, such as social isolation. Finally, using support vector machine (SVM) algorithms, we show that these EEG parameters and preference rating scores can be used to improve the predictability of sharing information behavior. The information sharing-related EEG pattern described here could therefore improve our understanding of the neural markers associated with sharing behavior and contribute to studies about stimuli propagation.