Hearables: Feasibility and Validation of In-Ear Electrocardiogram

The Deep-Match Framework: R-Peak Detection in Ear-ECG

The Ear-ECG provides a continuous Lead I like electrocardiogram (ECG) by measuring the potential difference related to heart activity by electrodes which are embedded within earphones. However, the significant increase in wearability and comfort enabled by Ear-ECG is often accompanied by a degradation in signal quality - an obstacle that is shared by the majority of wearable technologies. We aim to resolve this issue by introducing a Deep Matched Filter (Deep-MF) for the highly accurate detection of R-peaks in wearable ECG, thus enhancing the utility of Ear-ECG in real-world scenarios. The Deep-MF consists of an encoder stage, partially initialised with an ECG template, and an R-peak classifier stage. Through its operation as a Matched Filter, the encoder searches for matches with an ECG template in the input signal, prior to filtering these matches with the subsequent convolutional layers and selecting peaks corresponding to the ground-truth ECG. The latent representation of R-peak information is then fed into a R-peak classifier, of which the output provides precise R-peak locations. The proposed Deep Matched Filter is evaluated using leave-one-subject-out cross-validation over 36 subjects with an age range of 18-75, with the Deep-MF outperforming existing algorithms for R-peak detection in noisy ECG. The Deep-MF achieves a median R-peak recall of 94.9% and a median precision of 91.2% across subjects when evaluated with leave-one-subject-out cross validation. Overall, this Deep-Match framework serves as a valuable step forward for the real-world functionality of Ear-ECG and, through its interpretable operation, the acceptance of deep learning models in e-Health.

From Scalp to Ear-EEG: A Generalizable Transfer Learning Model for Automatic Sleep Scoring in Older People

OBJECTIVE

Sleep monitoring has extensively utilized electroencephalogram (EEG) data collected from the scalp, yielding very large data repositories and well-trained analysis models. Yet, this wealth of data is lacking for emerging, less intrusive modalities, such as ear-EEG.

METHODS AND PROCEDURES

The current study seeks to harness the abundance of open-source scalp EEG datasets by applying models pre-trained on data, either directly or with minimal fine-tuning; this is achieved in the context of effective sleep analysis from ear-EEG data that was recorded using a single in-ear electrode, referenced to the ipsilateral mastoid, and developed in-house as described in our previous work. Unlike previous studies, our research uniquely focuses on an older cohort (17 subjects aged 65-83, mean age 71.8 years, some with health conditions), and employs LightGBM for transfer learning, diverging from previous deep learning approaches.

RESULTS

Results show that the initial accuracy of the pre-trained model on ear-EEG was 70.1%, but fine-tuning the model with ear-EEG data improved its classification accuracy to 73.7%. The fine-tuned model exhibited a statistically significant improvement (p < 0.05, dependent t-test) for 10 out of the 13 participants, as reflected by an enhanced average Cohen's kappa score (a statistical measure of inter-rater agreement for categorical items) of 0.639, indicating a stronger agreement between automated and expert classifications of sleep stages. Comparative SHAP value analysis revealed a shift in feature importance for the N3 sleep stage, underscoring the effectiveness of the fine-tuning process.

CONCLUSION

Our findings underscore the potential of fine-tuning pre-trained scalp EEG models on ear-EEG data to enhance classification accuracy, particularly within an older population and using feature-based methods for transfer learning. This approach presents a promising avenue for ear-EEG analysis in sleep studies, offering new insights into the applicability of transfer learning across different populations and computational techniques.

CLINICAL IMPACT

An enhanced ear-EEG method could be pivotal in remote monitoring settings, allowing for continuous, non-invasive sleep quality assessment in elderly patients with conditions like dementia or sleep apnea.

Multi-Channel Soft Dry Electrodes for Electrocardiography Acquisition in the Ear Region

In-ear acquisition of physiological signals, such as electromyography (EMG), electrooculography (EOG), electroencephalography (EEG), and electrocardiography (ECG), is a promising approach to mobile health (mHealth) due to its non-invasive and user-friendly nature. By providing a convenient and comfortable means of physiological signal monitoring, in-ear signal acquisition could potentially increase patient compliance and engagement with mHealth applications. The development of reliable and comfortable soft dry in-ear electrode systems could, therefore, have significant implications for both mHealth and human-machine interface (HMI) applications. This research evaluates the quality of the ECG signal obtained with soft dry electrodes inserted in the ear canal. An earplug with six soft dry electrodes distributed around its perimeter was designed for this study, allowing for the analysis of the signal coming from each electrode independently with respect to a common reference placed at different positions on the body of the participants. An analysis of the signals in comparison with a reference signal measured on the upper right chest (RA) and lower left chest (LL) was performed. The results show three typical behaviors for the in-ear electrodes. Some electrodes have a high correlation with the reference signal directly after inserting the earplug, other electrodes need a settling time of typically 1-3 min, and finally, others never have a high correlation. The SoftPulseTM electrodes used in this research have been proven to be perfectly capable of measuring physiological signals, paving the way for their use in mHealth or HMI applications. The use of multiple electrodes distributed in the ear canal has the advantage of allowing a more reliable acquisition by intelligently selecting the signal acquisition locations or allowing a better spatial resolution for certain applications by processing these signals independently.

Hearables: feasibility of recording cardiac rhythms from single in-ear locations

The ear is well positioned to accommodate both brain and vital signs monitoring, via so-called hearable devices. Consequently, ear-based electroencephalography has recently garnered great interest. However, despite the considerable potential of hearable based cardiac monitoring, the biophysics and characteristic cardiac rhythm of ear-based electrocardiography (ECG) are not yet well understood. To this end, we map the cardiac potential on the ear through volume conductor modelling and measurements on multiple subjects. In addition, in order to demonstrate real-world feasibility of in-ear ECG, measurements are conducted throughout a long-time simulated driving task. As a means of evaluation, the correspondence between the cardiac rhythms obtained via the ear-based and standard Lead I measurements, with respect to the shape and timing of the cardiac rhythm, is verified through three measures of similarity: the Pearson correlation, and measures of amplitude and timing deviations. A high correspondence between the cardiac rhythms obtained via the ear-based and Lead I measurements is rigorously confirmed through agreement between simulation and measurement, while the real-world feasibility was conclusively demonstrated through efficacious cardiac rhythm monitoring during prolonged driving. This work opens new avenues for seamless, hearable-based cardiac monitoring that extends beyond heart rate detection to offer cardiac rhythm examination in the community.

Design and Implementation of an Atrial Fibrillation Detection Algorithm on the ARM Cortex-M4 Microcontroller

At present, a medium-level microcontroller is capable of performing edge computing and can handle the computation of neural network kernel functions. This makes it possible to implement a complete end-to-end solution incorporating signal acquisition, digital signal processing, and machine learning for the classification of cardiac arrhythmias on a small wearable device. In this work, we describe the design and implementation of several classifiers for atrial fibrillation detection on a general-purpose ARM Cortex-M4 microcontroller. We used the CMSIS-DSP library, which supports Naïve Bayes and Support Vector Machine classifiers, with different kernel functions. We also developed Python scripts to automatically transfer the Python model (trained in Scikit-learn) to the C environment. To train and evaluate the models, we used part of the data from the PhysioNet/Computing in Cardiology Challenge 2020 and performed simple classification of atrial fibrillation based on heart-rate irregularity. The performance of the classifiers was tested on a general-purpose ARM Cortex-M4 microcontroller (STM32WB55RG). Our study reveals that among the tested classifiers, the SVM classifier with RBF kernel function achieves the highest accuracy of 96.9%, sensitivity of 98.4%, and specificity of 95.8%. The execution time of this classifier was 720 μs per recording. We also discuss the advantages of moving computing tasks to edge devices, including increased power efficiency of the system, improved patient data privacy and security, and reduced overall system operation costs. In addition, we highlight a problem with false-positive detection and unclear significance of device-detected atrial fibrillation.

The Principles of Hearable Photoplethysmography Analysis and Applications in Physiological Monitoring-A Review

Not long ago, hearables paved the way for biosensing, fitness, and healthcare monitoring. Smart earbuds today are not only producing sound but also monitoring vital signs. Reliable determination of cardiovascular and pulmonary system information can explore the use of hearables for physiological monitoring. Recent research shows that photoplethysmography (PPG) signals not only contain details on oxygen saturation level (SPO2) but also carry more physiological information including pulse rate, respiration rate, blood pressure, and arterial-related information. The analysis of the PPG signal from the ear has proven to be reliable and accurate in the research setting. (1) Background: The present integrative review explores the existing literature on an in-ear PPG signal and its application. This review aims to identify the current technology and usage of in-ear PPG and existing evidence on in-ear PPG in physiological monitoring. This review also analyzes in-ear (PPG) measurement configuration and principle, waveform characteristics, processing technology, and feature extraction characteristics. (2) Methods: We performed a comprehensive search to discover relevant in-ear PPG articles published until December 2022. The following electronic databases: Institute of Electrical and Electronics Engineers (IEEE), ScienceDirect, Scopus, Web of Science, and PubMed were utilized to conduct the studies addressing the evidence of in-ear PPG in physiological monitoring. (3) Results: Fourteen studies were identified but nine studies were finalized. Eight studies were on different principles and configurations of hearable PPG, and eight studies were on processing technology and feature extraction and its evidence in in-ear physiological monitoring. We also highlighted the limitations and challenges of using in-ear PPG in physiological monitoring. (4) Conclusions: The available evidence has revealed the future of in-ear PPG in physiological monitoring. We have also analyzed the potential limitation and challenges that in-ear PPG will face in processing the signal.

Hearables: Automatic Sleep Scoring from Single-Channel Ear-EEG in Older Adults

Sleep disorders are a prevalent problem among older adults, yet obtaining an accurate and reliable assessment of sleep quality can be challenging. Traditional polysomnography (PSG) is the gold standard for sleep staging, but is obtrusive, expensive, and requires expert assistance. To this end, we propose a minimally invasive single-channel single ear-EEG automatic sleep staging method for older adults. The method employs features from the frequency, time, and structural complexity domains, which provide a robust classification of sleep stages from a standardised viscoelastic earpiece. Our method is verified on a dataset of older adults and achieves a kappa value of at least 0.61, indicating substantial agreement. This paves the way for a non-invasive, cost-effective, and portable alternative to traditional PSG for sleep staging.

Hearables: Heart Rate Variability from Ear Electrocardiogram and Ear Photoplethysmogram (Ear-ECG and Ear-PPG)

This work aims to classify physiological states using heart rate variability (HRV) features extracted from electrocardiograms recorded in the ears (ear-ECG). The physiological states considered in this work are: (a) normal breathing, (b) controlled slow breathing, and (c) mental exercises. Since both (b) and (c) cause higher variance in heartbeat intervals, breathing-related features (SpO2 and mean breathing interval) from the ear Photoplethysmogram (ear-PPG) are used to facilitate classification. This work: 1) proposes a scheme that, after initialization, automatically extracts R-peaks from low signal-to-noise ratio ear-ECG; 2) verifies the feasibility of extracting meaningful HRV features from ear-ECG; 3) quantitatively compares several ear-ECG sites; and 4) discusses the benefits of combining ear-ECG and ear-PPG features.

An In-Ear PPG-Based Blood Glucose Monitor: A Proof-of-Concept Study

Monitoring diabetes saves lives. To this end, we introduce a novel, unobtrusive, and readily deployable in-ear device for the continuous and non-invasive measurement of blood glucose levels (BGLs). The device is equipped with a low-cost commercially available pulse oximeter whose infrared wavelength (880 nm) is used for the acquisition of photoplethysmography (PPG). For rigor, we considered a full range of diabetic conditions (non-diabetic, pre-diabetic, type I diabetic, and type II diabetic). Recordings spanned nine different days, starting in the morning while fasting, up to a minimum of a two-hour period after eating a carbohydrate-rich breakfast. The BGLs from PPG were estimated using a suite of regression-based machine learning models, which were trained on characteristic features of PPG cycles pertaining to high and low BGLs. The analysis shows that, as desired, an average of 82% of the BGLs estimated from PPG lie in region A of the Clarke error grid (CEG) plot, with 100% of the estimated BGLs in the clinically acceptable CEG regions A and B. These results demonstrate the potential of the ear canal as a site for non-invasive blood glucose monitoring.

Recent Progress in Long-Term Sleep Monitoring Technology

Sleep is an essential physiological activity, accounting for about one-third of our lives, which significantly impacts our memory, mood, health, and children's growth. Especially after the COVID-19 epidemic, sleep health issues have attracted more attention. In recent years, with the development of wearable electronic devices, there have been more and more studies, products, or solutions related to sleep monitoring. Many mature technologies, such as polysomnography, have been applied to clinical practice. However, it is urgent to develop wearable or non-contacting electronic devices suitable for household continuous sleep monitoring. This paper first introduces the basic knowledge of sleep and the significance of sleep monitoring. Then, according to the types of physiological signals monitored, this paper describes the research progress of bioelectrical signals, biomechanical signals, and biochemical signals used for sleep monitoring. However, it is not ideal to monitor the sleep quality for the whole night based on only one signal. Therefore, this paper reviews the research on multi-signal monitoring and introduces systematic sleep monitoring schemes. Finally, a conclusion and discussion of sleep monitoring are presented to propose potential future directions and prospects for sleep monitoring.

Health-Related Indicators Measured Using Earable Devices: Systematic Review

BACKGROUND

Earable devices are novel, wearable Internet of Things devices that are user-friendly and have potential applications in mobile health care. The position of the ear is advantageous for assessing vital status and detecting diseases through reliable and comfortable sensing devices.

OBJECTIVE

Our study aimed to review the utility of health-related indicators derived from earable devices and propose an improved definition of disease prevention. We also proposed future directions for research on the health care applications of earable devices.

METHODS

A systematic review was conducted of the PubMed, Embase, and Web of Science databases. Keywords were used to identify studies on earable devices published between 2015 and 2020. The earable devices were described in terms of target health outcomes, biomarkers, sensor types and positions, and their utility for disease prevention.

RESULTS

A total of 51 articles met the inclusion criteria and were reviewed, and the frequency of 5 health-related characteristics of earable devices was described. The most frequent target health outcomes were diet-related outcomes (9/51, 18%), brain status (7/51, 14%), and cardiovascular disease (CVD) and central nervous system disease (5/51, 10% each). The most frequent biomarkers were electroencephalography (11/51, 22%), body movements (6/51, 12%), and body temperature (5/51, 10%). As for sensor types and sensor positions, electrical sensors (19/51, 37%) and the ear canal (26/51, 51%) were the most common, respectively. Moreover, the most frequent prevention stages were secondary prevention (35/51, 69%), primary prevention (12/51, 24%), and tertiary prevention (4/51, 8%). Combinations of ≥2 target health outcomes were the most frequent in secondary prevention (8/35, 23%) followed by brain status and CVD (5/35, 14% each) and by central nervous system disease and head injury (4/35, 11% each).

CONCLUSIONS

Earable devices can provide biomarkers for various health outcomes. Brain status, healthy diet status, and CVDs were the most frequently targeted outcomes among the studies. Earable devices were mostly used for secondary prevention via monitoring of health or disease status. The potential utility of earable devices for primary and tertiary prevention needs to be investigated further. Earable devices connected to smartphones or tablets through cloud servers will guarantee user access to personal health information and facilitate comfortable wearing.

Wearable In-Ear PPG: Detailed Respiratory Variations Enable Classification of COPD

An ability to extract detailed spirometry-like breath-ing waveforms from wearable sensors promises to greatly improve respiratory health monitoring. Photoplethysmography (PPG) has been researched in depth for estimation of respiration rate, given that it varies with respiration through overall intensity, pulse amplitude and pulse interval. We compare and contrast the extraction of these three respiratory modes from both the ear canal and finger and show a marked improvement in the respiratory power for respiration induced intensity variations and pulse amplitude variations when recording from the ear canal. We next employ a data driven multi-scale method, noise assisted multivariate empirical mode decomposition (NA-MEMD), which allows for simultaneous analysis of all three respiratory modes to extract detailed respiratory waveforms from in-ear PPG. For rigour, we considered in-ear PPG recordings from healthy subjects, both older and young, patients with chronic obstructive pulmonary disease (COPD) and idiopathic pulmonary fibrosis (IPF) and healthy subjects with artificially obstructed breathing. Specific in-ear PPG waveform changes are observed for COPD, such as a decreased inspiratory duty cycle and an increased inspiratory magnitude, when compared with expiratory magnitude. These differences are used to classify COPD from healthy and IPF waveforms with a sensitivity of 87% and an overall accuracy of 92%. Our findings indicate the promise of in-ear PPG for COPD screening and unobtrusive respiratory monitoring in ambulatory scenarios and in consumer wearables.

Hearables, in-ear sensing devices for bio-signal acquisition: a narrative review

INTRODUCTION

Hearables are ear devices used for multiple purposes including ubiquitous/remote monitoring of vital signals. This can support early detection, prevention, and management of urgent/non-urgent healthcare needs. This review therefore seeks to analyse the challenges and capabilities of hearables used to monitor human physiological signals.

AREAS COVERED

Studies were identified via search (Medline, Embase, Web of Science, Cochrane Library, Scopus) and conducted in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses. Bias assessment used the Mixed Methods Appraisal Tool 2018 and Quality Assessment of Diagnostic Accuracy Studies 2nd Edition. 92/631 studies met the inclusion criteria and were qualitatively analysed. The outcomes, applications, advantages and limitations were discussed according to the vital signal measured. The bias risk ranged from low to high, with most studies facing moderate to high risk in subject selection due to small sample sizes.

EXPERT OPINION

: Most studies reported good outcomes for ear signal acquisition compared to reference devices. To improve practicability and implementation, wireless connectivity, battery life, impact of motion/environmental artifacts and comfort need to be addressed going forward. Hearable technologies have also shown potential synergies with hearing aids. In future, multimodal ear-sensing devices opens the possibility of comprehensive health monitoring within daily life.

Hearables: Making Sense from Motion Artefacts in Ear-EEG for Real-Life Human Activity Classification

Ear-worn devices are rapidly gaining popularity as they provide the means for measuring vital signals in an unobtrusive, 24/7 wearable and discrete fashion. Naturally, these devices are prone to motion artefacts when used in out-of-lab environments, various movements and activities cause relative movement between user's skin and the electrodes. Historically, these artefacts are seen as nuisance resulting in discarding the segments of signal wherever such artefacts are present. In this work, we make use of such artefacts to classify different daily activities that include sitting, speaking aloud, chewing and walking. To this end, multiple classification techniques are employed to identify these activities using 8 features calculated from the electrode and microphone signal embedded in a generic multimodal in-ear sensor. The results show an overall training accuracy of 93% and 90% and a testing accuracy of 85% and 80% when using a KNN and a 2-layer neural network respectively, thus providing a much needed, simple and reliable framework for real-life human activity classification.