Feasibility of local interpretable model-agnostic explanations (LIME) algorithm as an effective and interpretable feature selection method: comparative fNIRS study

Many feature selection methods have been evaluated in functional near-infrared spectroscopy (fNIRS)-related studies. The local interpretable model-agnostic explanation (LIME) algorithm is a feature selection method for fNIRS datasets that has not yet been validated; the demand for its validation is increasing. To this end, we assessed the feature selection performance of LIME for fNIRS datasets in terms of classification accuracy. A comparative analysis was conducted for the benchmark (classification accuracy obtained without applying any feature selection method), LIME, two filter-based methods (minimum-redundancy maximum-relevance and t-test), and one wrapper-based method (sequential forward selection). To ensure the fairness and reliability of the performance evaluation, several open-access fNIRS datasets were used. The analysis revealed that LIME greatly outperformed the other feature selection methods in most cases and could achieve a statistically significantly better classification accuracy than that of the benchmark methods. These findings implied the effectiveness of LIME as a feature selection approach for fNIRS datasets.

Driving drowsiness detection using spectral signatures of EEG-based neurophysiology

Introduction: Drowsy driving is a significant factor causing dire road crashes and casualties around the world. Detecting it earlier and more effectively can significantly reduce the lethal aftereffects and increase road safety. As physiological conditions originate from the human brain, so neurophysiological signatures in drowsy and alert states may be investigated for this purpose. In this preface, A passive brain-computer interface (pBCI) scheme using multichannel electroencephalography (EEG) brain signals is developed for spatially localized and accurate detection of human drowsiness during driving tasks.

Methods: This pBCI modality acquired electrophysiological patterns of 12 healthy subjects from the prefrontal (PFC), frontal (FC), and occipital cortices (OC) of the brain. Neurological states are recorded using six EEG channels spread over the right and left hemispheres in the PFC, FC, and OC of the sleep-deprived subjects during simulated driving tasks. In post-hoc analysis, spectral signatures of the δ, θ, α, and β rhythms are extracted in terms of spectral band powers and their ratios with a temporal correlation over the complete span of the experiment. Minimum redundancy maximum relevance, Chi-square, and ReliefF feature selection methods are used and aggregated with a Z-score based approach for global feature ranking. The extracted drowsiness attributes are classified using decision trees, discriminant analysis, logistic regression, naïve Bayes, support vector machines, k-nearest neighbors, and ensemble classifiers. The binary classification results are reported with confusion matrix-based performance assessment metrics.

Results: In inter-classifier comparison, the optimized ensemble model achieved the best results of drowsiness classification with 85.6% accuracy and precision, 89.7% recall, 87.6% F1-score, 80% specificity, 70.3% Matthews correlation coefficient, 70.2% Cohen’s kappa score, and 91% area under the receiver operating characteristic curve with 76-ms execution time. In inter-channel comparison, the best results were obtained at the F8 electrode position in the right FC of the brain. The significance of all the results was validated with a p-value of less than 0.05 using statistical hypothesis testing methods.

Conclusions: The proposed scheme has achieved better results for driving drowsiness detection with the accomplishment of multiple objectives. The predictor importance approach has reduced the feature extraction cost and computational complexity is minimized with the use of conventional machine learning classifiers resulting in low-cost hardware and software requirements. The channel selection approach has spatially localized the most promising brain region for drowsiness detection with only a single EEG channel (F8) which reduces the physical intrusiveness in normal driving operation. This pBCI scheme has a good potential for practical applications requiring earlier, more accurate, and less disruptive drowsiness detection using the spectral information of EEG biosignals.

Single-leg stance on a challenging surface can enhance cortical activation in the right hemisphere - A case study

Maintaining body balance, whether static or dynamic, is critical in performing everyday activities and developing and optimizing basic motor skills. This study investigates how a professional alpine skier's brain activates on the contralateral side during a single-leg stance. Continuous-wave functional near-infrared spectroscopy (fNIRS) signals were recorded with sixteen sources and detectors over the motor cortex to investigate brain hemodynamics. Three different tasks were performed: barefooted walk (BFW), right-leg stance (RLS), and left-leg stance (LLS). The signal processing pipeline includes channel rejection, the conversation of raw intensities into hemoglobin concentration changes using modified Beer-Lambert law, baseline zero-adjustments, z-normalization, and temporal filtration. The hemodynamic brain signal was estimated using a general linear model with a 2-gamma function. Measured activations (t-values) with p-value <0.05 were only considered as statistically significant active channels. Compared to all other conditions, BFW has the lowest brain activation. LLS is associated with more contralateral brain activation than RLS. During LLS, higher brain activation was observed across all brain regions. The right hemisphere has comparatively more activated regions-of-interest. Higher ΔHbO demands in the dorsolateral prefrontal, pre-motor, supplementary motor cortex, and primary motor cortex were observed in the right hemisphere relative to the left which explains higher energy demands for balancing during LLS. Broca's temporal lobe was also activated during both LLS and RLS. Comparing the results with BFW- which is considered the most realistic walking condition-, it is concluded that higher demands of ΔHbO predict higher motor control demands for balancing. The participant struggled with balance during the LLS, showing higher ΔHbO in both hemispheres compared to two other conditions, which indicates the higher requirement for motor control to maintain balance. A post-physiotherapy exercise program is expected to improve balance during LLS, leading to fewer changes to ΔHbO.

Involvement of the Rostromedial Prefrontal Cortex in Human-Robot Interaction: fNIRS Evidence From a Robot-Assisted Motor Task

Assistive exoskeleton robots are being widely applied in neurorehabilitation to improve upper-limb motor and somatosensory functions. During robot-assisted exercises, the central nervous system appears to highly attend to external information-processing (IP) to efficiently interact with robotic assistance. However, the neural mechanisms underlying this process remain unclear. The rostromedial prefrontal cortex (rmPFC) may be the core of the executive resource allocation that generates biases in the allocation of processing resources toward an external IP according to current behavioral demands. Here, we used functional near-infrared spectroscopy to investigate the cortical activation associated with executive resource allocation during a robot-assisted motor task. During data acquisition, participants performed a right-arm motor task using elbow flexion-extension movements in three different loading conditions: robotic assistive loading (ROB), resistive loading (RES), and non-loading (NON). Participants were asked to strive for kinematic consistency in their movements. A one-way repeated measures analysis of variance and general linear model-based methods were employed to examine task-related activity. We demonstrated that hemodynamic responses in the ventral and dorsal rmPFC were higher during ROB than during NON. Moreover, greater hemodynamic responses in the ventral rmPFC were observed during ROB than during RES. Increased activation in ventral and dorsal rmPFC subregions may be involved in the executive resource allocation that prioritizes external IP during human-robot interactions. In conclusion, these findings provide novel insights regarding the involvement of executive control during a robot-assisted motor task.

Identifying Individuals by fNIRS-Based Brain Functional Network Fingerprints

Individual identification based on brain functional network (BFN) has attracted a lot of research interest in recent years, since it provides a novel biometric for identity authentication, as well as a feasible way of exploring the brain at an individual level. Previous studies have shown that an individual can be identified by its BFN fingerprint estimated from functional magnetic resonance imaging, electroencephalogram, or magnetoencephalography data. Functional near-infrared spectroscopy (fNIRS) is an emerging imaging technique that, by measuring the changes in blood oxygen concentration, can respond to cerebral activities; in this paper, we investigate whether fNIRS-based BFN could be used as a “fingerprint” to identify individuals. In particular, Pearson's correlation is first used to calculate BFN based on the preprocessed fNIRS signals, and then the nearest neighbor scheme is used to match the estimated BFNs between different individuals. Through the experiments on an open-access fNIRS dataset, we have two main findings: (1) under the cases of cross-task (i.e., resting, right-handed, left-handed finger tapping, and foot tapping), the BFN fingerprints generally work well for the individual identification, and, more interestingly, (2) the accuracy under cross-task is well above the accuracy under cross-view (i.e., oxyhemoglobin and de-oxyhemoglobin). These findings indicate that fNIRS-based BFN fingerprint is a potential biometric for identifying individual.

Prefrontal Cortex Brain Activation During Texting and Walking: A Functional Near-Infrared Spectroscopy Feasibility Study

Texting while walking is an increasingly common, potentially dangerous task but its functional brain correlates have yet to be reported. Therefore, we evaluated prefrontal cortex (PFC) activation patterns during single- and dual-task texting and walking in healthy adults. Thirteen participants (29–49 years) walked under single- and dual-task conditions involving mobile phone texting or a serial-7s subtraction task, while measuring PFC activation (functional near-infrared spectroscopy) and behavioral task performance (inertial sensors, mobile application). Head lowering during texting increased PFC activation. Texting further increased PFC activation, and decreased gait performance similarly to serial-7 subtraction. Our results support the key role of executive control in texting while walking.

Prefrontal Cortex Activation During Motor Sequence Learning Under Interleaved and Repetitive Practice: A Two-Channel Near-Infrared Spectroscopy Study

Training under high interference conditions through interleaved practice (IP) results in performance suppression during training but enhances long-term performance relative to repetitive practice (RP) involving low interference. Previous neuroimaging work addressing this contextual interference effect of motor learning has relied heavily on the blood-oxygen-level-dependent (BOLD) response using functional magnetic resonance imaging (fMRI) methodology resulting in mixed reports of prefrontal cortex (PFC) recruitment under IP and RP conditions. We sought to clarify these equivocal findings by imaging bilateral PFC recruitment using functional near-infrared spectroscopy (fNIRS) while discrete key pressing sequences were trained under IP and RP schedules and subsequently tested following a 24-h delay. An advantage of fNIRS over the fMRI BOLD response is that the former measures oxygenated and deoxygenated hemoglobin changes independently allowing for assessment of cortical hemodynamics even when there is neurovascular decoupling. Despite slower sequence performance durations under IP, bilateral PFC oxygenated and deoxygenated hemoglobin values did not differ between practice conditions. During test, however, slower performance from those previously trained under RP coincided with hemispheric asymmetry in PFC recruitment. Specifically, following RP, test deoxygenated hemoglobin values were significantly lower in the right PFC. The present findings contrast with previous behavioral demonstrations of increased cognitive demand under IP to illustrate a more complex involvement of the PFC in the contextual interference effect. IP and RP incur similar levels of bilateral PFC recruitment, but the processes underlying the recruitment are dissimilar. PFC recruitment during IP supports action reconstruction and memory elaboration while RP relies on PFC recruitment to maintain task variation information in working memory from trial to trial. While PFC recruitment under RP serves to enhance immediate performance, it does not support long-term performance.

Vector Phase Analysis Approach for Sleep Stage Classification: A Functional Near-Infrared Spectroscopy-Based Passive Brain-Computer Interface

A passive brain-computer interface (BCI) based upon functional near-infrared spectroscopy (fNIRS) brain signals is used for earlier detection of human drowsiness during driving tasks. This BCI modality acquired hemodynamic signals of 13 healthy subjects from the right dorsolateral prefrontal cortex (DPFC) of the brain. Drowsiness activity is recorded using a continuous-wave fNIRS system and eight channels over the right DPFC. During the experiment, sleep-deprived subjects drove a vehicle in a driving simulator while their cerebral oxygen regulation (CORE) state was continuously measured. Vector phase analysis (VPA) was used as a classifier to detect drowsiness state along with sleep stage-based threshold criteria. Extensive training and testing with various feature sets and classifiers are done to justify the adaptation of threshold criteria for any subject without requiring recalibration. Three statistical features (mean oxyhemoglobin, signal peak, and the sum of peaks) along with six VPA features (trajectory slopes of VPA indices) were used. The average accuracies for the five classifiers are 90.9% for discriminant analysis, 92.5% for support vector machines, 92.3% for nearest neighbors, 92.4% for both decision trees, and ensembles over all subjects' data. Trajectory slopes of CORE vector magnitude and angle: m(|R|) and m(∠R) are the best-performing features, along with ensemble classifier with the highest accuracy of 95.3% and minimum computation time of 40 ms. The statistical significance of the results is validated with a p-value of less than 0.05. The proposed passive BCI scheme demonstrates a promising technique for online drowsiness detection using VPA along with sleep stage classification.

Comparing different pre-processing routines for infant fNIRS data

Functional Near Infrared Spectroscopy (fNIRS) is an important neuroimaging technique in cognitive developmental neuroscience. Nevertheless, there is no general consensus yet about best pre-processing practices. This issue is highly relevant, especially since the development and variability of the infant hemodynamic response (HRF) is not fully known. Systematic comparisons between analysis methods are thus necessary. We investigated the performance of five different pipelines, selected on the basis of a systematic search of the infant NIRS literature, in two experiments. In Experiment 1, we used synthetic data to compare the recovered HRFs with the true HRF and to assess the robustness of each method against increasing levels of noise. In Experiment 2, we analyzed experimental data from a published study, which assessed the neural correlates of artificial grammar processing in newborns. We found that with motion artifact correction (as opposed to rejection) a larger number of trials were retained, but HRF amplitude was often strongly reduced. By contrast, artifact rejection resulted in a high exclusion rate but preserved adequately the characteristics of the HRF. We also found that the performance of all pipelines declined as the noise increased, but significantly less so than if no pre-processing was applied. Finally, we found no difference between running the pre-processing on optical density or concentration change data. These results suggest that pre-processing should thus be optimized as a function of the specific quality issues a give dataset exhibits.

Decoding of Walking Imagery and Idle State Using Sparse Representation Based on fNIRS

Objectives

Brain-computer interface (BCI) based on functional near-infrared spectroscopy (fNIRS) is expected to provide an optional active rehabilitation training method for patients with walking dysfunction, which will affect their quality of life seriously. Sparse representation classification (SRC) oxyhemoglobin (HbO) concentration was used to decode walking imagery and idle state to construct fNIRS-BCI based on walking imagery.

Methods

15 subjects were recruited and fNIRS signals were collected during walking imagery and idle state. Firstly, band-pass filtering and baseline drift correction for HbO signal were carried out, and then the mean value, peak value, and root mean square (RMS) of HbO and their combinations were extracted as classification features; SRC was used to identify the extracted features and the result of SRC was compared with those of support vector machine (SVM), K-Nearest Neighbor (KNN), linear discriminant analysis (LDA), and logistic regression (LR).

Results

The experimental results showed that the average classification accuracy for walking imagery and idle state by SRC using three features combination was 91.55±3.30%, which was significantly higher than those of SVM, KNN, LDA, and LR (86.37±4.42%, 85.65±5.01%, 86.43±4.41%, and 76.14±5.32%, respectively), and the classification accuracy of other combined features was higher than that of single feature.

Conclusions

The study showed that introducing SRC into fNIRS-BCI can effectively identify walking imagery and idle state. It also showed that different time windows for feature extraction have an impact on the classification results, and the time window of 2–8 s achieved a better classification accuracy (94.33±2.60%) than other time windows. Significance. The study was expected to provide a new and optional active rehabilitation training method for patients with walking dysfunction. In addition, the experiment was also a rare study based on fNIRS-BCI using SRC to decode walking imagery and idle state.

Enhancing Classification Performance of fNIRS-BCI by Identifying Cortically Active Channels Using the z-Score Method

A state-of-the-art brain–computer interface (BCI) system includes brain signal acquisition, noise removal, channel selection, feature extraction, classification, and an application interface. In functional near-infrared spectroscopy-based BCI (fNIRS-BCI) channel selection may enhance classification performance by identifying suitable brain regions that contain brain activity. In this study, the z-score method for channel selection is proposed to improve fNIRS-BCI performance. The proposed method uses cross-correlation to match the similarity between desired and recorded brain activity signals, followed by forming a vector of each channel’s correlation coefficients’ maximum values. After that, the z-score is calculated for each value of that vector. A channel is selected based on a positive z-score value. The proposed method is applied to an open-access dataset containing mental arithmetic (MA) and motor imagery (MI) tasks for twenty-nine subjects. The proposed method is compared with the conventional t-value method and with no channel selected, i.e., using all channels. The z-score method yielded significantly improved (p < 0.0167) classification accuracies of 87.2 ± 7.0%, 88.4 ± 6.2%, and 88.1 ± 6.9% for left motor imagery (LMI) vs. rest, right motor imagery (RMI) vs. rest, and mental arithmetic (MA) vs. rest, respectively. The proposed method is also validated on an open-access database of 17 subjects, containing right-hand finger tapping (RFT), left-hand finger tapping (LFT), and dominant side foot tapping (FT) tasks.The study shows an enhanced performance of the z-score method over the t-value method as an advancement in efforts to improve state-of-the-art fNIRS-BCI systems’ performance.