Classification of Individual Finger Movements from Right Hand Using fNIRS Signals

Changes in temporal lobe activation during a sound stimulation task in patients with sensorineural tinnitus: a multi-channel near-infrared spectroscopy study

BACKGROUND

The subjective sign of a serious pandemic in human work and life is mathematical neural tinnitus. fNIRS (functional near-infrared spectroscopy) is a new non-invasive brain imaging technology for studying the neurological activity of the human cerebral cortex. It is based on neural coupling effects. This research uses the fNIRS approach to detect differences in the neurological activity of the cerebral skin in the sound stimulation mission in order to better discriminate between the sensational neurological tinnitus.

METHODS

In the fNIRS brain imaging method, 14 sensorineural tinnitus sufferers and 14 healthy controls listened to varied noise and quiet for fNIRS data collection. Linear fitting was employed in MATLAB to eliminate slow drifts during preprocessing and event-related design analysis. The false discovery rate (FDR) procedure was applied in IBM SPSS Statistics 26.0 to control the false positive rate in multiple comparison analyses.

RESULTS

When the ill group and the healthy control group were stimulated by pink noise, there was a significant difference in blood oxygen concentration (P < 0.05), and the healthy control group exhibited a high activation, according to the fNIRS measurement data. The blood oxygen concentration level in the patient group was dramatically enhanced after one month of acupuncture therapy under the identical stimulation task settings, and it was favorably connected with the levels of THI and TEQ scales.

CONCLUSIONS

Using sensorineural tinnitus illness as an example, fNIRS technology has the potential to disclose future pathological study on subjective diseases throughout time. Other clinical disorders involving the temporal lobe and adjacent brain areas may also be examined, in addition to tinnitus-related brain alterations.

Exploratory insights into prefrontal cortex activity in continuous glucose monitoring: findings from a portable wearable functional near-infrared spectroscopy system

The escalating global prevalence of diabetes highlights an urgent need for advancements in continuous glucose monitoring (CGM) technologies that are non-invasive, accurate, and user-friendly. Here, we introduce a groundbreaking portable wearable functional near-infrared spectroscopy (fNIRS) system designed to monitor glucose levels by assessing prefrontal cortex (PFC) activity. Our study delineates the development and application of this novel fNIRS system, emphasizing its potential to revolutionize diabetes management by providing a non-invasive, real-time monitoring solution. Fifteen healthy university students participated in a controlled study, where we monitored their PFC activity and blood glucose levels under fasting and glucose-loaded conditions. Our findings reveal a significant correlation between PFC activity, as measured by our fNIRS system, and blood glucose levels, suggesting the feasibility of fNIRS technology for CGM. The portable nature of our system overcomes the mobility limitations of traditional setups, enabling continuous, real-time monitoring in everyday settings. We identified 10 critical features related to blood glucose levels from extensive fNIRS data and successfully correlated PFC function with blood glucose levels by constructing predictive models. Results show a positive association between fNIRS data and blood glucose levels, with the PFC exhibiting a clear response to blood glucose. Furthermore, the improved regressive rule principal component analysis (PCA) method outperforms traditional PCA in model prediction. We propose a model validation approach based on leave-one-out cross-validation, demonstrating the unique advantages of K-nearest neighbor (KNN) models. Comparative analysis with existing CGM methods reveals that our paper's KNN model exhibits lower RMSE and MARD at 0.11 and 8.96%, respectively, and the fNIRS data were highly significant positive correlation with actual blood glucose levels (r = 0.995, p < 0.000). This study provides valuable insights into the relationship between metabolic states and brain activity, laying the foundation for innovative CGM solutions. Our portable wearable fNIRS system represents a significant advancement in effective diabetes management, offering a promising alternative to current technologies and paving the way for future advancements in health monitoring and personalized medicine.

Algorithm design of a combinatorial mathematical model for computer random signals

To improve the processing effect of computer random signals, the manuscript employs the intelligent signal recognition algorithm to design a combinatorial mathematical model for computer random signals, and studies the parameter estimation of conventional frequency hopping signal (FHS) based on optimizing kernel function (KF). First, the mathematical form and graphical representation of the ambiguity function of the conventional FHS are explored. Furthermore, a new KF is presented according to its fuzzy function (FF) and the parameters of conventional FHSs are estimated according to the time-frequency distribution corresponding to the KF. Then, simulation experiments are carried out in different types of interference noise environments. The proposed combinatorial mathematical model for computer random signals shows a practical impact, and can effectively improve the effect of random signal combination.

Unleashing the potential of fNIRS with machine learning: classification of fine anatomical movements to empower future brain-computer interface

In this study, we explore the potential of using functional near-infrared spectroscopy (fNIRS) signals in conjunction with modern machine-learning techniques to classify specific anatomical movements to increase the number of control commands for a possible fNIRS-based brain-computer interface (BCI) applications. The study focuses on novel individual finger-tapping, a well-known task in fNIRS and fMRI studies, but limited to left/right or few fingers. Twenty-four right-handed participants performed the individual finger-tapping task. Data were recorded by using sixteen sources and detectors placed over the motor cortex according to the 10-10 international system. The event's average oxygenated Δ HbO and deoxygenated Δ HbR hemoglobin data were utilized as features to assess the performance of diverse machine learning (ML) models in a challenging multi-class classification setting. These methods include LDA, QDA, MNLR, XGBoost, and RF. A new DL-based model named "Hemo-Net" has been proposed which consists of multiple parallel convolution layers with different filters to extract the features. This paper aims to explore the efficacy of using fNRIS along with ML/DL methods in a multi-class classification task. Complex models like RF, XGBoost, and Hemo-Net produce relatively higher test set accuracy when compared to LDA, MNLR, and QDA. Hemo-Net has depicted a superior performance achieving the highest test set accuracy of 76%, however, in this work, we do not aim at improving the accuracies of models rather we are interested in exploring if fNIRS has the neural signatures to help modern ML/DL methods in multi-class classification which can lead to applications like brain-computer interfaces. Multi-class classification of fine anatomical movements, such as individual finger movements, is difficult to classify with fNIRS data. Traditional ML models like MNLR and LDA show inferior performance compared to the ensemble-based methods of RF and XGBoost. DL-based method Hemo-Net outperforms all methods evaluated in this study and demonstrates a promising future for fNIRS-based BCI applications.

Research on Emotion Recognition Method of Cerebral Blood Oxygen Signal Based on CNN-Transformer Network

In recent years, research on emotion recognition has become more and more popular, but there are few studies on emotion recognition based on cerebral blood oxygen signals. Since the electroencephalogram (EEG) is easily disturbed by eye movement and the portability is not high, this study uses a more comfortable and convenient functional near-infrared spectroscopy (fNIRS) system to record brain signals from participants while watching three different types of video clips. During the experiment, the changes in cerebral blood oxygen concentration in the 8 channels of the prefrontal cortex of the brain were collected and analyzed. We processed and divided the collected cerebral blood oxygen data, and used multiple classifiers to realize the identification of the three emotional states of joy, neutrality, and sadness. Since the classification accuracy of the convolutional neural network (CNN) in this research is not significantly superior to that of the XGBoost algorithm, this paper proposes a CNN-Transformer network based on the characteristics of time series data to improve the classification accuracy of ternary emotions. The network first uses convolution operations to extract channel features from multi-channel time series, then the features and the output information of the fully connected layer are input to the Transformer netork structure, and its multi-head attention mechanism is used to focus on different channel domain information, which has better spatiality. The experimental results show that the CNN-Transformer network can achieve 86.7% classification accuracy for ternary emotions, which is about 5% higher than the accuracy of CNN, and this provides some help for other research in the field of emotion recognition based on time series data such as fNIRS.

Implementation of artificial intelligence and machine learning-based methods in brain-computer interaction

Brain-computer interfaces are used for direct two-way communication between the human brain and the computer. Brain signals contain valuable information about the mental state and brain activity of the examined subject. However, due to their non-stationarity and susceptibility to various types of interference, their processing, analysis and interpretation are challenging. For these reasons, the research in the field of brain-computer interfaces is focused on the implementation of artificial intelligence, especially in five main areas: calibration, noise suppression, communication, mental condition estimation, and motor imagery. The use of algorithms based on artificial intelligence and machine learning has proven to be very promising in these application domains, especially due to their ability to predict and learn from previous experience. Therefore, their implementation within medical technologies can contribute to more accurate information about the mental state of subjects, alleviate the consequences of serious diseases or improve the quality of life of disabled patients.

Deep learning in fNIRS: a review

Significance: Optical neuroimaging has become a well-established clinical and research tool to monitor cortical activations in the human brain. It is notable that outcomes of functional near-infrared spectroscopy (fNIRS) studies depend heavily on the data processing pipeline and classification model employed. Recently, deep learning (DL) methodologies have demonstrated fast and accurate performances in data processing and classification tasks across many biomedical fields. Aim: We aim to review the emerging DL applications in fNIRS studies. Approach: We first introduce some of the commonly used DL techniques. Then, the review summarizes current DL work in some of the most active areas of this field, including brain-computer interface, neuro-impairment diagnosis, and neuroscience discovery. Results: Of the 63 papers considered in this review, 32 report a comparative study of DL techniques to traditional machine learning techniques where 26 have been shown outperforming the latter in terms of the classification accuracy. In addition, eight studies also utilize DL to reduce the amount of preprocessing typically done with fNIRS data or increase the amount of data via data augmentation. Conclusions: The application of DL techniques to fNIRS studies has shown to mitigate many of the hurdles present in fNIRS studies such as lengthy data preprocessing or small sample sizes while achieving comparable or improved classification accuracy.

Moving towards intelligent telemedicine: Computer vision measurement of human movement

Background:

Telemedicine video consultations are rapidly increasing globally, accelerated by the COVID-19 pandemic. This presents opportunities to use computer vision technologies to augment clinician visual judgement because video cameras are so ubiquitous in personal devices and new techniques, such as DeepLabCut (DLC) can precisely measure human movement from smartphone videos. However, the accuracy of DLC to track human movements in videos obtained from laptop cameras, which have a much lower FPS, has never been investigated; this is a critical gap because patients use laptops for most telemedicine consultations.

Objectives:

To determine the validity and reliability of DLC applied to laptop videos to measure finger tapping, a validated test of human movement.

Method:

Sixteen adults completed finger-tapping tests at 0.5 Hz, 1 Hz, 2 Hz, 3 Hz and at maximal speed. Hand movements were recorded simultaneously by a laptop camera at 30 frames per second (FPS) and by Optotrak, a 3D motion analysis system at 250 FPS. Eight DLC neural network architectures (ResNet50, ResNet101, ResNet152, MobileNetV1, MobileNetV2, EfficientNetB0, EfficientNetB3, EfficientNetB6) were applied to the laptop video and extracted movement features were compared to the ground truth Optotrak motion tracking.

Results:

Over 96% (529/552) of DLC measures were within +/−0.5 Hz of the Optotrak measures. At tapping frequencies >4 Hz, there was progressive decline in accuracy, attributed to motion blur associated with the laptop camera’s low FPS. Computer vision methods hold potential for moving us towards intelligent telemedicine by providing human movement analysis during consultations. However, further developments are required to accurately measure the fastest movements.