Multi-channel electromyography-based mapping of spontaneous smiles

Semi automatic quantification of REM sleep without atonia in natural sleep environment

Polysomnography, the gold standard diagnostic tool in sleep medicine, is performed in an artificial environment. This might alter sleep and may not accurately reflect typical sleep patterns. While macro-structures are sensitive to environmental effects, micro-structures remain more stable. In this study we applied semi-automated algorithms to capture REM sleep without atonia (RSWA) and sleep spindles, comparing lab and home measurements. We analyzed 107 full-night recordings from 55 subjects: 24 healthy adults, 28 Parkinson's disease patients (15 RBD), and three with isolated Rem sleep behavior disorder (RBD). Sessions were manually scored. An automatic algorithm for quantifying RSWA was developed and tested against manual scoring. RSWAi showed a 60% correlation between home and lab. RBD detection achieved 83% sensitivity, 79% specificity, and 81% balanced accuracy. The algorithm accurately quantified RSWA, enabling the detection of RBD patients. These findings could facilitate more accessible sleep testing, and provide a possible alternative for screening RBD.

Wireless high-resolution surface facial electromyography mask for discrimination of standardized facial expressions in healthy adults

Wired high resolution surface electromyography (sEMG) using gelled electrodes is a standard method for psycho-physiological, neurological and medical research. Despite its widespread use electrode placement is elaborative, time-consuming, and the overall experimental setting is prone to mechanical artifacts and thus offers little flexibility. Wireless and easy-to-apply technologies would facilitate more accessible examination in a realistic setting. To address this, a novel smart skin technology consisting of wireless dry 16-electrodes was tested. The soft electrode arrays were attached to the right hemiface of 37 healthy adult participants (60% female; 20 to 57 years). The participants performed three runs of a standard set of different facial expression exercises. Linear mixed-effects models utilizing the sEMG amplitudes as outcome measure were used to evaluate differences between the facial movement tasks and runs (separately for every task). The smart electrodes showed specific activation patterns for each of the exercises. 82% of the exercises could be differentiated from each other with very high precision when using the average muscle action of all electrodes. The effects were consistent during the 3 runs. Thus, it appears that wireless high-resolution sEMG analysis with smart skin technology successfully discriminates standard facial expressions in research and clinical settings.

Soft electrodes for simultaneous bio-potential and bio-impedance study of the face

The human body's vascular system is a finely regulated network: blood vessels can change in shape (i.e. constrict, or dilate), their elastic response may shift and they may undergo temporary and partial blockages due to pressure applied by skeletal muscles in their immediate vicinity. Simultaneous measurement of muscle activation and the corresponding changes in vessel diameter, in particular at anatomical regions such as the face, is challenging, and how muscle activation constricts blood vessels has been experimentally largely overlooked. Here we report on a new electronic skin technology for facial investigations to address this challenge. The technology consists of screen-printed dry carbon electrodes on soft polyurethane substrate. Two dry electrode arrays were placed on the face: One array for bio-potential measurements to capture muscle activity and a second array for bio-impedance. For the bio-potential signals, independent component analysis (ICA) was used to differentiate different muscle activations. Four-contact bio-impedance measurements were used to extract changes (related to artery volume change), as well as beats per minute (BPM). We performed concurrent bio-potential and bio-impedance measurements in the face. From the simultaneous measurements we successfully captured fluctuations in the superficial temporal artery diameter in response to facial muscle activity, which ultimately changes blood flow. The observed changes in the face, following muscle activation, were consistent with measurements in the forearm and were found to be notably more intricate. Both at the arm and the face, a clear increase in the baseline impedance was recorded during muscle activation (artery narrowing), while the impedance changes signifying the pulse had a clear repetitive trend only at the forearm. These results reveal the direct connection between muscle activation and the blood vessels in their vicinity and start to unveil the complex mechanisms through which facial muscles might modulate blood flow and possibly affect human physiology.

Facial electromyography during exercise using soft electrode array: A feasibility study

The use of wearable sensors for real-time monitoring of exercise-related measures has been extensively studied in recent years (e.g., performance enhancement, optimizing athlete's training, and preventing injuries). Surface electromyography (sEMG), which measures muscle activity, is a widely researched technology in exercise monitoring. However, due to their cumbersome nature, traditional sEMG electrodes are limited. In particular, facial EMG (fEMG) studies in physical training have been limited, with some scarce evidence suggesting that fEMG may be used to monitor exercise-related measurements. Altogether, sEMG recordings from facial muscles in the context of exercise have been examined relatively inadequately. In this feasibility study, we assessed the ability of a new wearable sEMG technology to measure facial muscle activity during exercise. Six young, healthy, and recreationally active participants (5 females), performed an incremental cycling exercise test until exhaustion, while facial sEMG and vastus lateralis (VL) EMG were measured. Facial sEMG signals from both natural expressions and voluntary smiles were successfully recorded. Stable recordings and high-resolution facial muscle activity mapping were achieved during different exercise intensities until exhaustion. Strong correlations were found between VL and multiple facial muscles' activity during voluntary smiles during exercise, with statistically significant coefficients ranging from 0.80 to 0.95 (p<0.05). This study demonstrates the feasibility of monitoring facial muscle activity during exercise, with potential implications for sports medicine and exercise physiology, particularly in monitoring exercise intensity and fatigue.

Wireless facial biosensing system for monitoring facial palsy with flexible microneedle electrode arrays

Facial palsy (FP) profoundly influences interpersonal communication and emotional expression, necessitating precise diagnostic and monitoring tools for optimal care. However, current electromyography (EMG) systems are limited by their bulky nature, complex setups, and dependence on skilled technicians. Here we report an innovative biosensing approach that utilizes a PEDOT:PSS-modified flexible microneedle electrode array (P-FMNEA) to overcome the limitations of existing EMG devices. Supple system-level mechanics ensure excellent conformality to the facial curvilinear regions, enabling the detection of targeted muscular ensemble movements for facial paralysis assessment. Moreover, our apparatus adeptly captures each electrical impulse in response to real-time direct nerve stimulation during neurosurgical procedures. The wireless conveyance of EMG signals to medical facilities via a server augments access to patient follow-up evaluation data, fostering prompt treatment suggestions and enabling the access of multiple facial EMG datasets during typical 6-month follow-ups. Furthermore, the device's soft mechanics alleviate issues of spatial intricacy, diminish pain, and minimize soft tissue hematomas associated with traditional needle electrode positioning. This groundbreaking biosensing strategy has the potential to transform FP management by providing an efficient, user-friendly, and less invasive alternative to the prevailing EMG devices. This pioneering technology enables more informed decision-making in FP-management and therapeutic intervention.

Advancements in Wearable EEG Technology for Improved Home-Based Sleep Monitoring and Assessment: A Review

Sleep is a fundamental aspect of daily life, profoundly impacting mental and emotional well-being. Optimal sleep quality is vital for overall health and quality of life, yet many individuals struggle with sleep-related difficulties. In the past, polysomnography (PSG) has served as the gold standard for assessing sleep, but its bulky nature, cost, and the need for expertise has made it cumbersome for widespread use. By recognizing the need for a more accessible and user-friendly approach, wearable home monitoring systems have emerged. EEG technology plays a pivotal role in sleep monitoring, as it captures crucial brain activity data during sleep and serves as a primary indicator of sleep stages and disorders. This review provides an overview of the most recent advancements in wearable sleep monitoring leveraging EEG technology. We summarize the latest EEG devices and systems available in the scientific literature, highlighting their design, form factors, materials, and methods of sleep assessment. By exploring these developments, we aim to offer insights into cutting-edge technologies, shedding light on wearable EEG sensors for advanced at-home sleep monitoring and assessment. This comprehensive review contributes to a broader perspective on enhancing sleep quality and overall health using wearable EEG sensors.

Monitoring sleep stages with a soft electrode array: Comparison against vPSG and home-based detection of REM sleep without atonia

Sleep disorders are symptomatic hallmarks of a variety of medical conditions. Accurately identifying the specific stage in which these disorders occur is particularly important for the correct diagnosis of non-rapid eye movement and rapid eye movement parasomnias. In-lab polysomnography suffers from limited availability and does not reflect habitual sleep conditions, which is especially important in older adults and those with neurodegenerative diseases. We aimed to explore the feasibility and validity of a new wearable system for accurately measuring sleep at home. The system core technology is soft, printed dry electrode arrays and a miniature data acquisition unit with a cloud-based data storage for offline analysis. The positions of the electrodes allow manual scoring following the American Association of Sleep Medicine guidelines. Fifty participants (21 healthy subjects, mean age 56.6 ± 8.4 years; and 29 patients with Parkinson's disease, 65.4 ± 7.6 years) underwent a polysomnography evaluation with parallel recording with the wearable system. Total agreement between the two systems reached Cohen's kappa (k) of 0.688 with agreement in each stage of: wake k = 0.701; N1 = 0.224; N2 = 0.584; N3 = 0.410; and rapid eye movement = 0.723. Moreover, the system reliably detected rapid eye movement sleep without atonia with a sensitivity of 85.7%. Additionally, a comparison between sleep as measured in the sleep lab with data collected from a night at home showed significantly lower wake after sleep onset at home. The results demonstrate that the system is valid, accurate and allows for the exploration of sleep at home. This new system offers an opportunity to help detect sleep disorders on a larger scale than possible today, fostering better care.

Bio-potential noise of dry printed electrodes: physiology versus the skin-electrode impedance

Objective. To explore noise characteristics and the effect physiological activity has on the link between impedance and noise.Approach. Dry-printed electrodes are emerging as a new and exciting technology for skin electro-physiology. Such electrode arrays offer many advantages including user convenience, quick placement, and high resolution. Here we analyze extensive electro-physiological data recorded from the arm and the face to study and quantify the noise of dry electrodes, and to characterize the link between noise and impedance. In particular, we studied the effect of the physiological state of the subject (e.g. rapid eye movement sleep) on noise.Main results. We show that baseline noise values extracted from dry electrodes in the arm are in agreement with the Nyquist equation. In the face, on the other hand, the measured noise values were higher than the values predicted by the Nyquist equation. In addition, we studied how different electrode properties affect performances, including electrode size, shape, and material properties.Significance. Altogether, the results presented here provide a basis for understanding dry electrode performances and substantiate their great potential in electro-physiological investigations.

A robust HD-sEMG sensor suitable for convenient acquisition of muscle activity in clinical post-stroke dysphagia

Objective.A flexible high-density surface electromyography (HD-sEMG) sensor combined with an adaptive algorithm was used to collect and analyze the swallowing activities of patients with Post-stroke dysphagia.Approach.The electrode frame, modified electrode, and bonded substrate of the sensor were fabricated using a flexible printed circuit process, controlled drop coating, and molding, respectively. The adaptation algorithm was achieved by using Laplace and Teager-Kaiser energy operators to extract active segments, a cross-correlation coefficient matrix (CCCM) to evaluate synergy, and multi-frame real-time dynamic root mean square (RMS) to visualize spatiotemporal information to screen lesions and level of dysphagia. Finally, support vector machines (SVM) were adopted to explore the classification accuracy of sex, age, and lesion location with small sample sizes.Main results.The sensor not only has a basic low contact impedance (0.262 kΩ) and high signal-to-noise ratio (37.284 ± 1.088 dB) but also achieves other characteristics suitable for clinical applications, such as flexibility (747.67 kPa) and durability (1000 times) balance, simple operation (including initial, repeated, and replacement use), and low cost ($ 15.2). The three conclusions are as follows. CCCM can be used as a criterion for judging the unbalanced muscle region of the patient's neck and can accurately locate unbalanced muscles. The RMS cloud map provides the time consumption, swallowing times, and unbalanced areas. When the lesion location involves the left and right hemispheres simultaneously, it can be used as an evidence of relatively severely unbalanced areas. The classification accuracy of SVM in terms of sex, age, and lesion location was as high as 100%.Significance.The HD-sEMG sensor in this study and the adaptation algorithm will contribute to the establishment of a larger-scale database in the future to establish more detailed and accurate quantitative standards, which will be the basis for developing more optimized screening mechanisms and rehabilitation assessment methods.

Customizable, reconfigurable, and anatomically coordinated large-area, high-density electromyography from drawn-on-skin electrode arrays

Accurate anatomical matching for patient-specific electromyographic (EMG) mapping is crucial yet technically challenging in various medical disciplines. The fixed electrode construction of multielectrode arrays (MEAs) makes it nearly impossible to match an individual's unique muscle anatomy. This mismatch between the MEAs and target muscles leads to missing relevant muscle activity, highly redundant data, complicated electrode placement optimization, and inaccuracies in classification algorithms. Here, we present customizable and reconfigurable drawn-on-skin (DoS) MEAs as the first demonstration of high-density EMG mapping from in situ-fabricated electrodes with tunable configurations adapted to subject-specific muscle anatomy. The DoS MEAs show uniform electrical properties and can map EMG activity with high fidelity under skin deformation-induced motion, which stems from the unique and robust skin-electrode interface. They can be used to localize innervation zones (IZs), detect motor unit propagation, and capture EMG signals with consistent quality during large muscle movements. Reconfiguring the electrode arrangement of DoS MEAs to match and extend the coverage of the forearm flexors enables localization of the muscle activity and prevents missed information such as IZs. In addition, DoS MEAs customized to the specific anatomy of subjects produce highly informative data, leading to accurate finger gesture detection and prosthetic control compared with conventional technology.

High-resolution surface electromyographic activities of facial muscles during mimic movements in healthy adults: A prospective observational study

Objectives

Surface electromyography (sEMG) is a standard tool in clinical routine and clinical or psychosocial experiments also including speech research and orthodontics to measure the activity of selected facial muscles to objectify facial movements during specific facial exercises or experiments with emotional expressions. Such muscle-specific approaches neglect that facial muscles act more as an interconnected network than as single facial muscles for specific movements. What is missing is an optimal sEMG setting allowing a synchronous measurement of the activity of all facial muscles as a whole.

Methods

A total of 36 healthy adult participants (53% women, 18-67 years) were included. Electromyograms were recorded from both sides of the face using an arrangement of electrodes oriented by the underlying topography of the facial muscles (Fridlund scheme) and simultaneously by a geometric and symmetrical arrangement on the face (Kuramoto scheme). The participants performed a standard set of different facial movement tasks. Linear mixed-effects models and adjustment for multiple comparisons were used to evaluate differences between the facial movement tasks, separately for both applied schemes. Data analysis utilized sEMG amplitudes and also their maximum-normalized values to account for amplitude differences between the different facial movements.

Results

Surface electromyography activation characteristics showed systematic regional distribution patterns of facial muscle activation for both schemes with very low interindividual variability. The statistical significance to discriminate between the different sEMG patterns was good for both schemes (significant comparisons for sEMG amplitudes: 87.3%, both schemes, normalized values: 90.9%, Fridlund scheme, 94.5% Kuramoto scheme), but the Kuramoto scheme performed considerably superior.

Conclusion

Facial movement tasks evoke specific patterns in the complex network of facial muscles rather than activating single muscles. A geometric and symmetrical sEMG recording from the entire face seems to allow more specific detection of facial muscle activity patterns during facial movement tasks. Such sEMG patterns should be explored in more clinical and psychological experiments in the future.

Automated detection of smiles as discrete episodes

BACKGROUND

Patients seeking restorative and orthodontic treatment expect an improvement in their smiles and oral health-related quality of life. Nonetheless, the qualitative and quantitative characteristics of dynamic smiles are yet to be understood.

OBJECTIVE

To develop, validate, and introduce open-access software for automated analysis of smiles in terms of their frequency, genuineness, duration, and intensity.

MATERIALS AND METHODS

A software script was developed using the Facial Action Coding System (FACS) and artificial intelligence to assess activations of (1) cheek raiser, a marker of smile genuineness; (2) lip corner puller, a marker of smile intensity; and (3) perioral lip muscles, a marker of lips apart. Thirty study participants were asked to view a series of amusing videos. A full-face video was recorded using a webcam. The onset and cessation of smile episodes were identified by two examiners trained with FACS coding. A Receiver Operating Characteristic (ROC) curve was then used to assess detection accuracy and optimise thresholding. The videos of participants were then analysed off-line to automatedly assess the features of smiles.

RESULTS

The area under the ROC curve for smile detection was 0.94, with a sensitivity of 82.9% and a specificity of 89.7%. The software correctly identified 90.0% of smile episodes. While watching the amusing videos, study participants smiled 1.6 (±0.8) times per minute.

CONCLUSIONS

Features of smiles such as frequency, duration, genuineness, and intensity can be automatedly assessed with an acceptable level of accuracy. The software can be used to investigate the impact of oral conditions and their rehabilitation on smiles.

Similarities and disparities between visual analysis and high-resolution electromyography of facial expressions

Computer vision (CV) is widely used in the investigation of facial expressions. Applications range from psychological evaluation to neurology, to name just two examples. CV for identifying facial expressions may suffer from several shortcomings: CV provides indirect information about muscle activation, it is insensitive to activations that do not involve visible deformations, such as jaw clenching. Moreover, it relies on high-resolution and unobstructed visuals. High density surface electromyography (sEMG) recordings with soft electrode array is an alternative approach which provides direct information about muscle activation, even from freely behaving humans. In this investigation, we compare CV and sEMG analysis of facial muscle activation. We used independent component analysis (ICA) and multiple linear regression (MLR) to quantify the similarity and disparity between the two approaches for posed muscle activations. The comparison reveals similarity in event detection, but discrepancies and inconsistencies in source identification. Specifically, the correspondence between sEMG and action unit (AU)-based analyses, the most widely used basis of CV muscle activation prediction, appears to vary between participants and sessions. We also show a comparison between AU and sEMG data of spontaneous smiles, highlighting the differences between the two approaches. The data presented in this paper suggests that the use of AU-based analysis should consider its limited ability to reliably compare between different sessions and individuals and highlight the advantages of high-resolution sEMG for facial expression analysis.

Lie to my face: An electromyography approach to the study of deceptive behavior

BACKGROUND

Deception is present in all walks of life, from social interactions to matters of homeland security. Nevertheless, reliable indicators of deceptive behavior in real-life scenarios remain elusive.

METHODS

By integrating electrophysiological and communicative approaches, we demonstrate a new and objective detection approach to identify participant-specific indicators of deceptive behavior in an interactive scenario of a two-person deception task. We recorded participants' facial muscle activity using novel dry screen-printed electrode arrays and applied machine-learning algorithms to identify lies based on brief facial responses.

RESULTS

With an average accuracy of 73%, we identified two groups of participants: Those who revealed their lies by activating their cheek muscles and those who activated their eyebrows. We found that the participants lied more often with time, with some switching their telltale muscle groups. Moreover, while the automated classifier, reported here, outperformed untrained human detectors, their performance was correlated, suggesting reliance on shared features.

CONCLUSIONS

Our findings demonstrate the feasibility of using wearable electrode arrays in detecting human lies in a social setting and set the stage for future research on individual differences in deception expression.

MuscleNET: mapping electromyography to kinematic and dynamic biomechanical variables by machine learning

Objective.This paper proposes machine learning models for mapping surface electromyography (sEMG) signals to regression of joint angle, joint velocity, joint acceleration, joint torque, and activation torque.Approach.The regression models, collectively known as MuscleNET, take one of four forms: ANN (forward artificial neural network), RNN (recurrent neural network), CNN (convolutional neural network), and RCNN (recurrent convolutional neural network). Inspired by conventional biomechanical muscle models, delayed kinematic signals were used along with sEMG signals as the machine learning model's input; specifically, the CNN and RCNN were modeled with novel configurations for these input conditions. The models' inputs contain either raw or filtered sEMG signals, which allowed evaluation of the filtering capabilities of the models. The models were trained using human experimental data and evaluated with different individual data.Main results.Results were compared in terms of regression error (using the root-mean-square) and model computation delay. The results indicate that the RNN (with filtered sEMG signals) and RCNN (with raw sEMG signals) models, both with delayed kinematic data, can extract underlying motor control information (such as joint activation torque or joint angle) from sEMG signals in pick-and-place tasks. The CNNs and RCNNs were able to filter raw sEMG signals.Significance.All forms of MuscleNET were found to map sEMG signals within 2 ms, fast enough for real-time applications such as the control of exoskeletons or active prostheses. The RNN model with filtered sEMG and delayed kinematic signals is particularly appropriate for applications in musculoskeletal simulation and biomechatronic device control.