APPLICATION OF COMPETITIVE HOPFIELD NEURAL NETWORK TO BRAIN-COMPUTER INTERFACE SYSTEMS

Fractal Geometry Meets Computational Intelligence: Future Perspectives

Characterizations in terms of fractals are typically employed for systems with complex and multiscale descriptions. A prominent example of such systems is provided by the human brain, which can be idealized as a complex dynamical system made of many interacting subunits. The human brain can be modeled in terms of observable variables together with their spatio-temporal-functional relations. Computational intelligence is a research field bridging many nature-inspired computational methods, such as artificial neural networks, fuzzy systems, and evolutionary and swarm intelligence optimization techniques. Typical problems faced by means of computational intelligence methods include those of recognition, such as classification and prediction. Although historically conceived to operate in some vector space, such methods have been recently extended to the so-called nongeometric spaces, considering labeled graphs as the most general example of such patterns. Here, we suggest that fractal analysis and computational intelligence methods can be exploited together in neuroscience research. Fractal characterizations can be used to (i) assess scale-invariant properties and (ii) offer numeric, feature-based representations to complement the usually more complex pattern structures encountered in neurosciences. Computational intelligence methods could be used to exploit such fractal characterizations, considering also the possibility to perform data-driven analysis of nongeometric input spaces, therby overcoming the intrinsic limits related to Euclidean geometry.

Assembling A Multi-Feature EEG Classifier for Left–Right Motor Imagery Data Using Wavelet-Based Fuzzy Approximate Entropy for Improved Accuracy

An EEG classifier is proposed for application in the analysis of motor imagery (MI) EEG data from a brain–computer interface (BCI) competition in this study. Applying subject-action-related brainwave data acquired from the sensorimotor cortices, the system primarily consists of artifact and background removal, feature extraction, feature selection and classification. In addition to background noise, the electrooculographic (EOG) artifacts are also automatically removed to further improve the analysis of EEG signals. Several potential features, including amplitude modulation, spectral power and asymmetry ratio, adaptive autoregressive model, and wavelet fuzzy approximate entropy (wfApEn) that can measure and quantify the complexity or irregularity of EEG signals, are then extracted for subsequent classification. Finally, the significant sub-features are selected from feature combination by quantum-behaved particle swarm optimization and then classified by support vector machine (SVM). Compared with feature extraction without wfApEn on MI data from two data sets for nine subjects, the results indicate that the proposed system including wfApEn obtains better performance in average classification accuracy of 88.2% and average number of commands per minute of 12.1, which is promising in the BCI work applications.

Neuronal Entropy-Rate Feature of Entopeduncular Nucleus in Rat Model of Parkinson's Disease

The function of the nigro-striatal pathway on neuronal entropy in the basal ganglia (BG) output nucleus, i.e. the entopeduncular nucleus (EPN) was investigated in the unilaterally 6-hyroxydopamine (6-OHDA)-lesioned rat model of Parkinson's disease (PD). In both control subjects and subjects with 6-OHDA lesion of dopamine (DA) the nigro-striatal pathway, a histological hallmark for parkinsonism, neuronal entropy in EPN was maximal in neurons with firing rates ranging between 15 and 25 Hz. In 6-OHDA lesioned rats, neuronal entropy in the EPN was specifically higher in neurons with firing rates above 25 Hz. Our data establishes that the nigro-striatal pathway controls neuronal entropy in motor circuitry and that the parkinsonian condition is associated with abnormal relationship between firing rate and neuronal entropy in BG output nuclei. The neuronal firing rates and entropy relationship provide putative relevant electrophysiological information to investigate the sensory-motor processing in normal condition and conditions such as movement disorders.

Enhancing the performance of motor imagery EEG classification using phase features

An electroencephalogram recognition system considering phase features is proposed to enhance the performance of motor imagery classification in this study. It mainly consists of feature extraction, feature selection and classification. Surface Laplacian filter is used for background removal. Several potential features, including phase features, are then extracted to enhance the classification accuracy. Next, genetic algorithm is used to select sub-features from feature combination. Finally, selected features are classified by extreme learning machine. Compared with "without phase features" and linear discriminant analysis on motor imagery data from 2 data sets, the results denote that the proposed system achieves enhanced performance, which is suitable for the brain-computer interface applications.

Artificial bee colony algorithm for single-trial electroencephalogram analysis

In this study, we propose an analysis system combined with feature selection to further improve the classification accuracy of single-trial electroencephalogram (EEG) data. Acquiring event-related brain potential data from the sensorimotor cortices, the system comprises artifact and background noise removal, feature extraction, feature selection, and feature classification. First, the artifacts and background noise are removed automatically by means of independent component analysis and surface Laplacian filter, respectively. Several potential features, such as band power, autoregressive model, and coherence and phase-locking value, are then extracted for subsequent classification. Next, artificial bee colony (ABC) algorithm is used to select features from the aforementioned feature combination. Finally, selected subfeatures are classified by support vector machine. Comparing with and without artifact removal and feature selection, using a genetic algorithm on single-trial EEG data for 6 subjects, the results indicate that the proposed system is promising and suitable for brain-computer interface applications.

A P300 brain-computer interface based on a modification of the mismatch negativity paradigm

The P300-based brain-computer interface (BCI) is an extension of the oddball paradigm, and can facilitate communication for people with severe neuromuscular disorders. It has been shown that, in addition to the P300, other event-related potential (ERP) components have been shown to contribute to successful operation of the P300 BCI. Incorporating these components into the classification algorithm can improve the classification accuracy and information transfer rate (ITR). In this paper, a single character presentation paradigm was compared to a presentation paradigm that is based on the visual mismatch negativity. The mismatch negativity paradigm showed significantly higher classification accuracy and ITRs than a single character presentation paradigm. In addition, the mismatch paradigm elicited larger N200 and N400 components than the single character paradigm. The components elicited by the presentation method were consistent with what would be expected from a mismatch paradigm and a typical P300 was also observed. The results show that increasing the signal-to-noise ratio by increasing the amplitude of ERP components can significantly improve BCI speed and accuracy. The mismatch presentation paradigm may be considered a viable option to the traditional P300 BCI paradigm.

Water Drop Algorithms

This article presents a review of a novel nature-inspired adaptive optimization algorithm known as Water Drop Algorithm (WDA) which imitates the dynamics of river systems and the behavior of water drops when they are moving in a river system such as the variation of velocity, the change of sediment/soil in the river bed, the change of direction of the flow, and so on. Recent improved, modified, and adaptive WDAs are examined in this paper. Various applications of WDA are described briefly including the vehicle routing problem, economic load dispatch problem, economic and emission dispatch problem, optimal data aggregation tree in wireless networks, reactive power dispatch problem service selection, and reservoir operation.

AN ERP-BASED BCI USING AN ODDBALL PARADIGM WITH DIFFERENT FACES AND REDUCED ERRORS IN CRITICAL FUNCTIONS

Recent research has shown that a new face paradigm is superior to the conventional "flash only" approach that has dominated P300 brain–computer interfaces (BCIs) for over 20 years. However, these face paradigms did not study the repetition effects and the stability of evoked event related potentials (ERPs), which would decrease the performance of P300 BCI. In this paper, we explored whether a new "multi-faces (MF)" approach would yield more distinct ERPs than the conventional "single face (SF)" approach. To decrease the repetition effects and evoke large ERPs, we introduced a new stimulus approach called the "MF" approach, which shows different familiar faces randomly. Fifteen subjects participated in runs using this new approach and an established "SF" approach. The result showed that the MF pattern enlarged the N200 and N400 components, evoked stable P300 and N400, and yielded better BCI performance than the SF pattern. The MF pattern can evoke larger N200 and N400 components and more stable P300 and N400, which increase the classification accuracy compared to the face pattern.

STRUCTURALLY ENHANCED INCREMENTAL NEURAL LEARNING FOR IMAGE CLASSIFICATION WITH SUBGRAPH EXTRACTION

In this paper, a structurally enhanced incremental neural learning technique is proposed to learn a discriminative codebook representation of images for effective image classification applications. In order to accommodate the relationships such as structures and distributions among visual words into the codebook learning process, we develop an online codebook graph learning method based on a novel structurally enhanced incremental learning technique, called as "visualization-induced self-organized incremental neural network (ViSOINN)". The hidden structural information in the images is embedded into the graph representation evolving dynamically with the adaptive and competitive learning mechanism. Afterwards, image features can be coded using a sub-graph extraction process based on the learned codebook graph, and a classifier is subsequently used to complete the image classification task. Compared with other codebook learning algorithms originated from the classical Bag-of-Features (BoF) model, ViSOINN holds the following advantages: (1) it learns codebook efficiently and effectively from a small training set; (2) it models the relationships among visual words in metric scaling fashion, so preserving high discriminative power; (3) it automatically learns the codebook without a fixed pre-defined size; and (4) it enhances and preserves better the structure of the data. These characteristics help to improve image classification performance and make it more suitable for handling large-scale image classification tasks. Experimental results on the widely used Caltech-101 and Caltech-256 benchmark datasets demonstrate that ViSOINN achieves markedly improved performance and reduces the computational cost considerably.

Retrieval of noisy fingerprint patterns using metric attractor networks

This work experimentally analyzes the learning and retrieval capabilities of the diluted metric attractor neural network when applied to collections of fingerprint images. The computational cost of the network decreases with the dilution, so we can increase the region of interest to cover almost the complete fingerprint. The network retrieval was successfully tested for different noisy configurations of the fingerprints, and proved to be robust with a large basin of attraction. We showed that network topologies with a 2D-Grid arrangement adapt better to the fingerprints spatial structure, outperforming the typical 1D-Ring configuration. An optimal ratio of local connections to random shortcuts that better represent the intrinsic spatial structure of the fingerprints was found, and its influence on the retrieval quality was characterized in a phase diagram. Since the present model is a set of nonlinear equations, it is possible to go beyond the naïve static solution (consisting in matching two fingerprints using a fixed distance threshold value), and a crossing evolution of similarities was shown, leading to the retrieval of the right fingerprint from an apparently more distant candidate. This feature could be very useful for fingerprint verification to discriminate between fingerprints pairs.

Improving classification accuracy of motor imagery EEG using genetic feature selection

In this study, an electroencephalogram (EEG) analysis system combined with feature selection, is proposed to enhance the classification of motor imagery (MI) data. It principally comprises feature extraction, feature selection, and classification. First, several features, including adaptive autoregressive (AAR) parameters, spectral power, asymmetry ratio, coherence and phase-locking value are extracted for subsequent classification. A genetic algorithm is then used to select features from the combination of the aforementioned features. Finally, the selected features are classified by support vector machine (SVM). Compared with "without feature selection" and back-propagation neural network (BPNN) on MI data from 2 data sets, the proposed system achieves better classification accuracy and is suitable for the applications of brain-computer interface (BCI).

A high-speed brain speller using steady-state visual evoked potentials

Implementing a complex spelling program using a steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) remains a challenge due to difficulties in stimulus presentation and target identification. This study aims to explore the feasibility of mixed frequency and phase coding in building a high-speed SSVEP speller with a computer monitor. A frequency and phase approximation approach was developed to eliminate the limitation of the number of targets caused by the monitor refresh rate, resulting in a speller comprising 32 flickers specified by eight frequencies (8-15 Hz with a 1 Hz interval) and four phases (0°, 90°, 180°, and 270°). A multi-channel approach incorporating Canonical Correlation Analysis (CCA) and SSVEP training data was proposed for target identification. In a simulated online experiment, at a spelling rate of 40 characters per minute, the system obtained an averaged information transfer rate (ITR) of 166.91 bits/min across 13 subjects with a maximum individual ITR of 192.26 bits/min, the highest ITR ever reported in electroencephalogram (EEG)-based BCIs. The results of this study demonstrate great potential of a high-speed SSVEP-based BCI in real-life applications.

A GENETIC GRAPH-BASED APPROACH FOR PARTITIONAL CLUSTERING

Clustering is one of the most versatile tools for data analysis. In the recent years, clustering that seeks the continuity of data (in opposition to classical centroid-based approaches) has attracted an increasing research interest. It is a challenging problem with a remarkable practical interest. The most popular continuity clustering method is the spectral clustering (SC) algorithm, which is based on graph cut: It initially generates a similarity graph using a distance measure and then studies its graph spectrum to find the best cut. This approach is sensitive to the parameters of the metric, and a correct parameter choice is critical to the quality of the cluster. This work proposes a new algorithm, inspired by SC, that reduces the parameter dependency while maintaining the quality of the solution. The new algorithm, named genetic graph-based clustering (GGC), takes an evolutionary approach introducing a genetic algorithm (GA) to cluster the similarity graph. The experimental validation shows that GGC increases robustness of SC and has competitive performance in comparison with classical clustering methods, at least, in the synthetic and real dataset used in the experiments.

SELF-SUPERVISED MRI TISSUE SEGMENTATION BY DISCRIMINATIVE CLUSTERING

The study of brain lesions can benefit from a clear identification of transitions between healthy and pathological tissues, through the analysis of brain imaging data. Current signal processing methods, able to address these issues, often rely on strong prior information. In this article, a new method for tissue segmentation is proposed. It is based on a discriminative strategy, in a self-supervised machine learning approach. This method avoids the use of prior information, which makes it very versatile, and able to cope with different tissue types. It also returns tissue probabilities for each voxel, crucial for a good characterization of the evolution of brain lesions. Simulated as well as real benchmark data were used to validate the accuracy of the method and compare it against other segmentation algorithms.

Embedded grey relation theory in Hopfield neural network: application to motor imagery EEG recognition

In this study, grey-based Hopfield neural network (GHNN), is proposed for the unsupervised analysis of motor imagery (MI) electroencephalogram (EEG) data. Combined with segment selection and feature extraction, GHNN is used for the recognition of left and right MI data. A Gaussian-like filter is proposed to reduce noise, to further enhance performance of active segment selection. Features are extracted by coherence from wavelet data, and then discriminated by GHNN, which is an unsupervised approach suitable for the online classification of nonstationary biomedical signals. Compared to EEG data without segment selection, several usual features, and classifiers, the proposed system is potentially an analytic approach in brain-computer interface (BCI) applications.

Application of quantum-behaved particle swarm optimization to motor imagery EEG classification

In this study, we propose a recognition system for single-trial analysis of motor imagery (MI) electroencephalogram (EEG) data. Applying event-related brain potential (ERP) data acquired from the sensorimotor cortices, the system chiefly consists of automatic artifact elimination, feature extraction, feature selection and classification. In addition to the use of independent component analysis, a similarity measure is proposed to further remove the electrooculographic (EOG) artifacts automatically. Several potential features, such as wavelet-fractal features, are then extracted for subsequent classification. Next, quantum-behaved particle swarm optimization (QPSO) is used to select features from the feature combination. Finally, selected sub-features are classified by support vector machine (SVM). Compared with without artifact elimination, feature selection using a genetic algorithm (GA) and feature classification with Fisher's linear discriminant (FLD) on MI data from two data sets for eight subjects, the results indicate that the proposed method is promising in brain-computer interface (BCI) applications.

A Practical Approach Based on Analytic Deformable Algorithm for Scenic Image Registration

Background

Image registration is to produce an entire scene by aligning all the acquired image sequences. A registration algorithm is necessary to tolerance as much as possible for intensity and geometric variation among images. However, captured image views of real scene usually produce unexpected distortions. They are generally derived from the optic characteristics of image sensors or caused by the specific scenes and objects.

Methods and Findings

An analytic registration algorithm considering the deformation is proposed for scenic image applications in this study. After extracting important features by the wavelet-based edge correlation method, an analytic registration approach is then proposed to achieve deformable and accurate matching of point sets. Finally, the registration accuracy is further refined to obtain subpixel precision by a feature-based Levenberg-Marquardt (FLM) method. It converges evidently faster than most other methods because of its feature-based characteristic.

Conclusions

We validate the performance of proposed method by testing with synthetic and real image sequences acquired by a hand-held digital still camera (DSC) and in comparison with an optical flow-based motion technique in terms of the squared sum of intensity differences (SSD) and correlation coefficient (CC). The results indicate that the proposed method is satisfactory in the registration accuracy and quality of DSC images.

A novel approach for lie detection based on F-score and extreme learning machine

A new machine learning method referred to as F-score_ELM was proposed to classify the lying and truth-telling using the electroencephalogram (EEG) signals from 28 guilty and innocent subjects. Thirty-one features were extracted from the probe responses from these subjects. Then, a recently-developed classifier called extreme learning machine (ELM) was combined with F-score, a simple but effective feature selection method, to jointly optimize the number of the hidden nodes of ELM and the feature subset by a grid-searching training procedure. The method was compared to two classification models combining principal component analysis with back-propagation network and support vector machine classifiers. We thoroughly assessed the performance of these classification models including the training and testing time, sensitivity and specificity from the training and testing sets, as well as network size. The experimental results showed that the number of the hidden nodes can be effectively optimized by the proposed method. Also, F-score_ELM obtained the best classification accuracy and required the shortest training and testing time.

A SINGLE-SWITCH BCI BASED ON PASSIVE AND IMAGINED MOVEMENTS: TOWARD RESTORING COMMUNICATION IN MINIMALLY CONSCIOUS PATIENTS

We investigate whether an electroencephalography technique could be used for yes/no communication with auditory scanning. To be usable by the target group, i.e. minimally conscious individuals, such a brain-computer interface (BCI) has to be very simple and robust. This leads to the concept of a single-switch BCI (ssBCI). With an ssBCI it is possible to reliably detect one certain, individually trained, brain pattern of the individual, and use it to control all kinds of applications using yes/no responses. A total of 10 healthy volunteers (20–27 years) participated in an initial cue-based session with a motor imagery (MI) task after brisk passive feet/hand movement. Four of them reached MI classification accuracies above 70% and, thus, fulfilled the inclusion criterion for participation in the 2nd session. In the 2nd session, MI was used to communicate yes/no answers to a series of questions in an auditory scanning mode. Two of the three participants of the 2nd session were able to reliably communicate their intent with 90% or above correct and 0% false responses. This work showed, for the 1st time, the use of a ssBCI based on passive and imagined movements for communication in auditory scanning mode.

SINGLE-TRIAL MOTOR IMAGERY CLASSIFICATION USING ASYMMETRY RATIO, PHASE RELATION, WAVELET-BASED FRACTAL, AND THEIR SELECTED COMBINATION

An electroencephalogram (EEG) analysis system is proposed for single-trial classification of motor imagery (MI) data in this study. Applying event-related brain potential (ERP) data acquired from the sensorimotor cortices, the system mainly consists of enhanced active segment selection, feature extraction, feature selection and classification. In addition to the original use of continuous wavelet transform (CWT) and Student's two-sample t-statistics, the 2D anisotropic Gaussian filter is proposed to further refine the selection of active segments. We then extract several features, including spectral power and asymmetry ratio, coherence and phase-locking value, and multiresolution fractal feature vector, for subsequent classification. Next, genetic algorithm (GA) is used to select features from the combination of above-mentioned features. Finally, support vector machine (SVM) is used for classification. Compared with "without enhanced active segment selection," several potential features and linear discriminant analysis (LDA) on MI data from two data sets for 10 subjects, the results indicate that the proposed method achieves 86.7% average classification accuracy, which is promising in BCI applications.

Independent component analysis and multiresolution asymmetry ratio for brain-computer interface

This study proposes a brain-computer interface (BCI) system for the recognition of single-trial electroencephalogram (EEG) data. With the combination of independent component analysis (ICA) and multiresolution asymmetry ratio, a support vector machine (SVM) is used to classify left and right finger lifting or motor imagery. First, ICA and similarity measures are proposed to eliminate the electrooculography (EOG) artifacts automatically. The features are then extracted from the wavelet data by means of an asymmetry ratio. Finally, the SVM classifier is used to discriminate between the features. Compared to the EEG data without EOG artifact removal, band power, and adoptive autoregressive (AAR) parameter features, the proposed system achieves promising results in BCI applications.

Embedded prediction in feature extraction: application to single-trial EEG discrimination

In this study, an analysis system embedding neuron-fuzzy prediction in feature extraction is proposed for brain-computer interface (BCI) applications. Wavelet-fractal features combined with neuro-fuzzy predictions are applied for feature extraction in motor imagery (MI) discrimination. The features are extracted from the electroencephalography (EEG) signals recorded from participants performing left and right MI. Time-series predictions are performed by training 2 adaptive neuro-fuzzy inference systems (ANFIS) for respective left and right MI data. Features are then calculated from the difference in multi-resolution fractal feature vector (MFFV) between the predicted and actual signals through a window of EEG signals. Finally, the support vector machine is used for classification. The proposed method estimates its performance in comparison with the linear adaptive autoregressive (AAR) model and the AAR time-series prediction of 6 participants from 2 data sets. The results indicate that the proposed method is promising in MI classification.

MULTICHANNEL DECODING FOR PHASE-CODED SSVEP BRAIN–COMPUTER INTERFACE

We propose a complex-valued multilayer feedforward neural network classifier for decoding of phase-coded information from steady-state visual evoked potentials. To optimize the performance of the classifier we supply it with two filter-based feature selection strategies. The proposed approaches could be used for a phase-coded brain–computer interface, enabling to encode several targets using only one stimulation frequency. The proposed classifier is a multichannel one, which distinguishes our approach from the existing single-channel ones. We show that the proposed approach outperforms others in terms of accuracy and length of the data segments used for decoding. We show that the decoding based on one optimally selected channel yields an inferior performance compared to the one based on several features, which supports our argument for a multichannel approach.

Registration accuracy and quality of real-life images

Background

A common registration problem for the application of consumer device is to align all the acquired image sequences into a complete scene. Image alignment requires a registration algorithm that will compensate as much as possible for geometric variability among images. However, images captured views from a real scene usually produce different distortions. Some are derived from the optic characteristics of image sensors, and others are caused by the specific scenes and objects.

Methodology/Principal Findings

An image registration algorithm considering the perspective projection is proposed for the application of consumer devices in this study. It exploits a multiresolution wavelet-based method to extract significant features. An analytic differential approach is then proposed to achieve fast convergence of point matching. Finally, the registration accuracy is further refined to obtain subpixel precision by a feature-based modified Levenberg-Marquardt method. Due to its feature-based and nonlinear characteristic, it converges considerably faster than most other methods. In addition, vignette compensation and color difference adjustment are also performed to further improve the quality of registration results.

Conclusions/Significance

The performance of the proposed method is evaluated by testing the synthetic and real images acquired by a hand-held digital still camera and in comparison with two registration techniques in terms of the squared sum of intensity differences (SSD) and correlation coefficient (CC). The results indicate that the proposed method is promising in registration accuracy and quality, which are statistically significantly better than other two approaches.

Enhanced active segment selection for single-trial EEG classification

In this study, an electroencephalogram (EEG) analysis system is proposed for single-trial classification of both motor imagery (MI) and finger-lifting EEG data. Applying event-related brain potential (ERP) data acquired from the sensorimotor cortices, the system mainly consists of three procedures; enhanced active segment selection, feature extraction, and classification. In addition to the original use of continuous wavelet transform (CWT) and Student 2-sample t statistics, the two-dimensional (2D) anisotropic Gaussian filter further refines the selection of active segments. The multiresolution fractal features are then extracted from wavelet data by using proposed modified fractal dimension. Finally, the support vector machine (SVM) is used for classification. Compared to original active segment selection, with several popular features and classifier on both the MI and finger-lifting data from 2 data sets, the results indicate that the proposed method is promising in EEG classification.