Optical fiber sensors for posture monitoring, ulcer detection and control in a wheelchair: a state-of-the-art

BACKGROUND

In the last ten years, the design and implementation of Optical Fiber Sensors (OFS) in biomedical applications have been discussed, with a focus on different subareas, such as body parameter monitoring and control of assistive devices.

MATERIALS AND METHODS

A scoping review was performed including scientific literature (PubMed/Scopus, IEEE and Web of Science), patents (WIPO/Google Scholar), and commercial information.

RESULTS

The main applications of OFS in the rehabilitation field for preventing future postural diseases and applying them in device controllers were discussed in this review. Physical characteristics of OFS, different uses, and applications of Polymer Optical Fiber pressure sensors are mentioned. The main postures used for posture monitoring analysis when the user is sitting are normal position, crooked back, high lumbar pressure, sitting on the edge of the chair, and crooked back, left position, and right position. Additionally, it is possible to use Machine Learning (ML) algorithms for posture classification, and device control such as Support Vector Machine, k-Nearest Neighbors, etc., obtaining accuracies above 97%. Moreover, the literature mentions wheelchair controllers and Graphical User Interfaces using pressure maps to provide feedback to the user.

CONCLUSIONS

OFS have been used in several healthcare applications as well as postural and preventive applications. The literature showed an effort to implement and design accessible devices for people with disabilities and people with specific diseases. Alternatively, ML algorithms are widely used in this direction, leaving the door open for further studies that allow the application of real-time systems for posture monitoring and wheelchairs control.

Evaluation of temporal, spatial and spectral filtering in CSP-based methods for decoding pedaling-based motor tasks using EEG signals

Stroke is a neurological syndrome that usually causes a loss of voluntary control of lower/upper body movements, making it difficult for affected individuals to perform Activities of Daily Living (ADLs). Brain-Computer Interfaces (BCIs) combined with robotic systems, such as Motorized Mini Exercise Bikes (MMEB), have enabled the rehabilitation of people with disabilities by decoding their actions and executing a motor task. However, Electroencephalography (EEG)-based BCIs are affected by the presence of physiological and non-physiological artifacts. Thus, movement discrimination using EEG become challenging, even in pedaling tasks, which have not been well explored in the literature. In this study, Common Spatial Patterns (CSP)-based methods were proposed to classify pedaling motor tasks. To address this, Filter Bank Common Spatial Patterns (FBCSP) and Filter Bank Common Spatial-Spectral Patterns (FBCSSP) were implemented with different spatial filtering configurations by varying the time segment with different filter bank combinations for the three methods to decode pedaling tasks. An in-house EEG dataset during pedaling tasks was registered for 8 participants. As results, the best configuration corresponds to a filter bank with two filters (8-19 Hz and 19-30 Hz) using a time window between 1.5 and 2.5 s after the cue and implementing two spatial filters, which provide accuracy of approximately 0.81, False Positive Rates lower than 0.19, andKappaindex of 0.61. This work implies that EEG oscillatory patterns during pedaling can be accurately classified using machine learning. Therefore, our method can be applied in the rehabilitation context, such as MMEB-based BCIs, in the future.

EEG changes during passive movements improve the motor imagery feature extraction in BCIs-based sensory feedback calibration

Objective.This work proposes a method for two calibration schemes based on sensory feedback to extract reliable motor imagery (MI) features, and provide classification outputs more correlated to the user's intention.Method.After filtering the raw electroencephalogram (EEG), a two-step method for spatial feature extraction by using the Riemannian covariance matrices (RCM) method and common spatial patterns is proposed here. It uses EEG data from trials providing feedback, in an intermediate step composed of bothkth nearest neighbors and probability analyses, to find periods of time in which the user probably performed well the MI task without feedback. These periods are then used to extract features with better separability, and train a classifier for MI recognition. For evaluation, an in-house dataset with eight healthy volunteers and two post-stroke patients that performed lower-limb MI, and consequently received passive movements as feedback was used. Other popular public EEG datasets (such as BCI Competition IV dataset IIb, among others) from healthy subjects that executed upper-and lower-limbs MI tasks under continuous visual sensory feedback were further used.Results.The proposed system based on the Riemannian geometry method in two-steps (RCM-RCM) outperformed significantly baseline methods, reaching average accuracy up to 82.29%. These findings show that EEG data on periods providing passive movement can be used to contribute greatly during MI feature extraction.Significance.Unconscious brain responses elicited over the sensorimotor areas may be avoided or greatly reduced by applying our approach in MI-based brain-computer interfaces (BCIs). Therefore, BCI's outputs more correlated to the user's intention can be obtained.

Effects of the concentration level, eye fatigue and coffee consumption on the performance of a BCI system based on visual ERP-P300

BACKGROUND

A widely used paradigm for Brain-Computer Interfaces (BCI) is based on detecting P300 Event-Related Potentials (ERPs) in response to stimulation and concentration tasks. An open challenge corresponds to maximizing the performance of a BCI by considering artifacts arising from the user's cognitive and physical conditions during task execution.

NEW METHOD

In this study, an analysis of the performance of a visual BCI-P300 system was performed under the metrics of Sensitivity (Sen), Specificity (Spe), Accuracy (Acc), and Area-Under the ROC Curve (AUC), considering the main reported factors affecting the neurophysiological behavior of the P300 signal: Concentration Level, Eye Fatigue, and Coffee Consumption.

COMPARISON WITH EXISTING METHODS

We compared the performance of three P300 signal detection methods (MA-LDA, CCA-RLR, and MA+CCA-RLR) using a public database (GigaScience) in different groups. Data were segmented according to three factors of interest: high and low levels of concentration, high and low eye fatigue, and coffee consumption at different times.

RESULTS

The results showed a significant improvement between 3% and 6% for the metrics evaluated for identifying the P300 signal in relation to concentration levels and coffee consumption.

CONCLUSION

P300 signal can be influenced by physical and mental factors during the execution of ERPs evocation tasks, which could be controlled to maximize the interface's capacity to detect the individual's intention.

Towards Multimodal Equipment to Help in the Diagnosis of COVID-19 Using Machine Learning Algorithms

COVID-19 occurs due to infection through respiratory droplets containing the SARS-CoV-2 virus, which are released when someone sneezes, coughs, or talks. The gold-standard exam to detect the virus is Real-Time Polymerase Chain Reaction (RT-PCR); however, this is an expensive test and may require up to 3 days after infection for a reliable result, and if there is high demand, the labs could be overwhelmed, which can cause significant delays in providing results. Biomedical data (oxygen saturation level—SpO2, body temperature, heart rate, and cough) are acquired from individuals and are used to help infer infection by COVID-19, using machine learning algorithms. The goal of this study is to introduce the Integrated Portable Medical Assistant (IPMA), which is a multimodal piece of equipment that can collect biomedical data, such as oxygen saturation level, body temperature, heart rate, and cough sound, and helps infer the diagnosis of COVID-19 through machine learning algorithms. The IPMA has the capacity to store the biomedical data for continuous studies and can be used to infer other respiratory diseases. Quadratic kernel-free non-linear Support Vector Machine (QSVM) and Decision Tree (DT) were applied on three datasets with data of cough, speech, body temperature, heart rate, and SpO2, obtaining an Accuracy rate (ACC) and Area Under the Curve (AUC) of approximately up to 88.0% and 0.85, respectively, as well as an ACC up to 99% and AUC = 0.94, respectively, for COVID-19 infection inference. When applied to the data acquired with the IMPA, these algorithms achieved 100% accuracy. Regarding the easiness of using the equipment, 36 volunteers reported that the IPMA has a high usability, according to results from two metrics used for evaluation: System Usability Scale (SUS) and Post Study System Usability Questionnaire (PSSUQ), with scores of 85.5 and 1.41, respectively. In light of the worldwide needs for smart equipment to help fight the COVID-19 pandemic, this new equipment may help with the screening of COVID-19 through data collected from biomedical signals and cough sounds, as well as the use of machine learning algorithms.

Wheelchair prototype controlled by position, speed and orientation using head movement

A prototype that simulates a wheelchair was built using electronic commercial devices and software implementation with the aim to operate the prototype using head movement and analyzing the system response. The controllers were simulated using MATLAB® toolbox and Python™ libraries. The mean time response of the system with manual control was 37,8 s. The mean orientation control response with constant speed was 36,5 s and the mean orientation control response with variable speed was 44,2 s in a specific route. The variable speed response is slower than constant speed due to head motion error. The system was rated such as" very good" by 10 participants using a System Usability Scale (SUS).

Design and Implementation of a Position, Speed and Orientation Fuzzy Controller Using a Motion Capture System to Operate a Wheelchair Prototype

The design and implementation of an electronic system that involves head movements to operate a prototype that can simulate future movements of a wheelchair was developed here. The controller design collects head-movements data through a MEMS sensor-based motion capture system. The research was divided into four stages: First, the instrumentation of the system using hardware and software; second, the mathematical modeling using the theory of dynamic systems; third, the automatic control of position, speed, and orientation with constant and variable speed; finally, system verification using both an electronic controller test protocol and user experience. The system involved a graphical interface for the user to interact with it by executing all the controllers in real time. Through the System Usability Scale (SUS), a score of 78 out of 100 points was obtained from the qualification of 10 users who validated the system, giving a connotation of “very good”. Users accepted the system with the recommendation to improve safety by using laser sensors instead of ultrasonic range modules to enhance obstacle detection.

Sleeve for Knee Angle Monitoring: An IMU-POF Sensor Fusion System

The knee flexion-extension angle is an important variable to be monitored in various clinical scenarios, for example, during physical rehabilitation assessment. The purpose of this work is to develop and validate a sensor fusion system based on a knee sleeve for monitoring of physical therapy. The system consists of merging data from two inertial measurement units (IMUs) and an intensity-variation based Polymer Optical Fiber (POF) curvature sensor using a quaternion-based Multiplicative Extended Kalman Filter (MEKF). The proposed data fusion method is magnetometer-free and deals with sensors' uncertainties through reliability intervals defined during gait. Walking trials were performed by twelve healthy participants using our knee sleeve system and results were validated against a gold standard motion capture system. Additionally, a comparison with other three knee angle estimation methods, which are exclusively based on IMUs, was carried out. The proposed system presented better performance (mean RMSE 3.3 ^°, LFM coefficients, a₁ = 0.99 ± 0.04, a₀ = 0.70 ± 2.29, R² = 0.98 ± 0.01 and ρ_C 0.99) when compared to the other evaluated methods. Experimental results demonstrate the usability and feasibility of our system to estimate knee motion with high accuracy, repeatability, and reproducibility. This wearable system may be suitable for motion assessment in rehabilitation labs in future studies.

Trends in Compressive Sensing for EEG Signal Processing Applications

The tremendous progress of big data acquisition and processing in the field of neural engineering has enabled a better understanding of the patient's brain disorders with their neural rehabilitation, restoration, detection, and diagnosis. An integration of compressive sensing (CS) and neural engineering emerges as a new research area, aiming to deal with a large volume of neurological data for fast speed, long-term, and energy-saving purposes. Furthermore, electroencephalography (EEG) signals for brain-computer interfaces (BCIs) have shown to be very promising, with diverse neuroscience applications. In this review, we focused on EEG-based approaches which have benefited from CS in achieving fast and energy-saving solutions. In particular, we examine the current practices, scientific opportunities, and challenges of CS in the growing field of BCIs. We emphasized on summarizing major CS reconstruction algorithms, the sparse basis, and the measurement matrix used in CS to process the EEG signal. This literature review suggests that the selection of a suitable reconstruction algorithm, sparse basis, and measurement matrix can help to improve the performance of current CS-based EEG studies. In this paper, we also aim at providing an overview of the reconstruction free CS approach and the related literature in the field. Finally, we discuss the opportunities and challenges that arise from pushing the integration of the CS framework for BCI applications.

A Low-Cost Lower-Limb Brain-Machine Interface Triggered by Pedaling Motor Imagery for Post-Stroke Patients Rehabilitation

A low-cost Brain-Machine Interface (BMI) based on electroencephalography for lower-limb motor recovery of post-stroke patients is proposed here, which provides passive pedaling as feedback, when patients trigger a Mini-Motorized Exercise Bike (MMEB) by executing pedaling motor imagery (MI). This system was validated in an On-line phase by eight healthy subjects and two post-stroke patients, which felt a closed-loop commanding the MMEB due to the fast response of our BMI. It was developed using methods of low-computational cost, such as Riemannian geometry for feature extraction, Pair-Wise Feature Proximity (PWFP) for feature selection, and Linear Discriminant Analysis (LDA) for pedaling imagery recognition. The On-line phase was composed of two sessions, where each participant completed a total of 12 trials per session executing pedaling MI for triggering the MMEB. As a result, the MMEB was successfully triggered by healthy subjects for almost all trials (ACC up to 100%), while the two post-stroke patients, PS1 and PS2, achieved their best performance (ACC of 41.67% and 91.67%, respectively) in Session #2. These patients improved their latency (2.03 ± 0.42 s and 1.99 ± 0.35 s, respectively) when triggering the MMEB, and their performance suggests the hypothesis that our system may be used with chronic stroke patients for lower-limb recovery, providing neural relearning and enhancing neuroplasticity.

Adaptive Spatial Filter Based on Similarity Indices to Preserve the Neural Information on EEG Signals during On-Line Processing

This work presents a new on-line adaptive filter, which is based on a similarity analysis between standard electrode locations, in order to reduce artifacts and common interferences throughout electroencephalography (EEG) signals, but preserving the useful information. Standard deviation and Concordance Correlation Coefficient (CCC) between target electrodes and its correspondent neighbor electrodes are analyzed on sliding windows to select those neighbors that are highly correlated. Afterwards, a model based on CCC is applied to provide higher values of weight to those correlated electrodes with lower similarity to the target electrode. The approach was applied to brain computer-interfaces (BCIs) based on Canonical Correlation Analysis (CCA) to recognize 40 targets of steady-state visual evoked potential (SSVEP), providing an accuracy (ACC) of 86.44 ± 2.81%. In addition, also using this approach, features of low frequency were selected in the pre-processing stage of another BCI to recognize gait planning. In this case, the recognition was significantly (p<0.01) improved for most of the subjects (ACC≥74.79%), when compared with other BCIs based on Common Spatial Pattern, Filter Bank-Common Spatial Pattern, and Riemannian Geometry.

A New Controller for a Smart Walker Based on Human-Robot Formation

This paper presents the development of a smart walker that uses a formation controller in its displacements. Encoders, a laser range finder and ultrasound are the sensors used in the walker. The control actions are based on the user (human) location, who is the actual formation leader. There is neither a sensor attached to the user’s body nor force sensors attached to the arm supports of the walker, and thus, the control algorithm projects the measurements taken from the laser sensor into the user reference and, then, calculates the linear and angular walker’s velocity to keep the formation (distance and angle) in relation to the user. An algorithm was developed to detect the user’s legs, whose distances from the laser sensor provide the information necessary to the controller. The controller was theoretically analyzed regarding its stability, simulated and validated with real users, showing accurate performance in all experiments. In addition, safety rules are used to check both the user and the device conditions, in order to guarantee that the user will not have any risks when using the smart walker. The applicability of this device is for helping people with lower limb mobility impairments.

Knee motion pattern classification from trunk muscle based on sEMG signals

A prominent change is being carried out in the fields of rehabilitation and assistive exoskeletons in order to actively aid or restore legged locomotion for individuals suffering from muscular impairments, muscle weakness, neurologic injury, or disabilities that affect the lower limbs. This paper presents a characterization of knee motion patterns from Surface Electromyography (sEMG) signals, measured in the Erector spinae (ES) muscle. Feature extraction (mean absolute value, waveform length and auto-regressive model) and pattern classification methods (Linear Discrimination Analysis, K-Nearest Neighborhood and Support Vector Machine) are applied for recognition of eight-movement classes. Additionally, several channels setup are analyzed to obtain a suitable electrodes array. The results were evaluated based on signals measured from lower limb using quantitative metric such as error rate, sensitivity, specificity and predictive positive value. A high accuracy (> 95%) was obtained, which suggest that it is possible to detect the knee motion intention from ES muscle, as well as to reduce the electrode number (from 2 to 3 channels) to obtain an optimal electrodes array. This implementation can be applied for myoelectric control of lower limb active exoskeletons.

Comparison between wire and wireless EEG acquisition systems based on SSVEP in an Independent-BCI

This paper presents a comparison between two different technologies of acquisition systems (BrainNet36 and Emotiv Epoc) for an Independent-BCI based on Steady-State Visual Evoked Potential (SSVEP). Two stimuli separated by a viewing angle <; 1° were used. Multivariate Synchronization Index (MSI) technique was used as feature extractor and five subjects participated in the experiments. The class is obtained through a criterion of maxima. The left and right flicker stimuli were modulated at frequencies of 8.0 and 13.0 Hz, respectively. Acquisition via BrainNet system showed better results, obtaining the highest value for accuracy (100%) and the highest ITR (35.18 bits/min). This Independent-BCI is based on covert attention.

Feature extraction and classification of sEMG signals applied to a virtual hand prosthesis

This paper presents the classification of motor tasks, using surface electromyography (sEMG) to control a virtual prosthetic hand for rehabilitation of amputees. Two types of classifiers are compared: k-Nearest Neighbor (k-NN) and Bayesian (Discriminant Analysis). Motor tasks are divided into four groups correlated. The volunteers were people without amputation and several analyzes of each of the signals were conducted. The online simulations use the sliding window technique and for feature extraction RMS (Root Mean Square), VAR (Variance) and WL (Waveform Length) values were used. A model is proposed for reclassification using cross-validation in order to validate the classification, and a visualization in Sammon Maps is provided in order to observe the separation of the classes for each set of motor tasks. Finally, the proposed method can be implemented in a computer interface providing a visual feedback through an virtual hand prosthetic developed in Visual C++ and MATLAB commands.

A new mobile robot control approach via fusion of control signals

This paper proposes an alternative approach to address the problem of coordinating behaviors in mobile robot navigation: fusion of control signals. Such approach is based on a set of two decentralized information filters, which accomplish the data fusion involved. Besides these two fusion engines, control architectures designed according to this approach also embed a set of different controllers that generate reference signals for the robot linear and angular speeds. Such signals are delivered to the two decentralized information filters, which estimate suitable overall reference signals for the robot linear and angular speeds, respectively. Thus, the background for designing such control architectures is provided by the nonlinear systems theory, which makes this approach different from any other yet proposed. This background also allows checking control architectures designed according to the proposed approach for stability. Such analysis is carried out in the paper, and shows that the robot always reaches its final destination, in spite of either obstacles along its path or the environment layout. As an example, a control architecture is designed to guide a mobile robot in an experiment, whose results allows checking the good performance of the control architecture and validating the design approach proposed as well.