Analysis of the photoplethysmographic signal by means of the decomposition in principal components

A novel diversity method for smartphone camera-based heart rhythm signals in the presence of motion and noise artifacts

The advent of smartphones has advanced the use of embedded sensors to acquire various physiological information. For example, smartphone camera sensors and accelerometers can provide heart rhythm signals to the subjects, while microphones can give respiratory signals. However, the acquired smartphone-based physiological signals are more vulnerable to motion and noise artifacts (MNAs) compared to using medical devices, since subjects need to hold the smartphone with proper contact to the smartphone camera and lens stably and tightly for a duration of time without any movement in the hand or finger. This results in more MNA than traditional methods, such as placing a finger inside a tightly enclosed pulse oximeter to get PPG signals, which provides stable contact between the sensor and the subject's finger. Moreover, a smartphone lens does not block ambient light in an effective way, while pulse oximeters are designed to block the ambient light effectively. In this paper, we propose a novel diversity method for smartphone signals that reduces the effect of MNAs during heart rhythm signal detection by 1) acquiring two heterogeneous signals from a color intensity signal and a fingertip movement signal, and 2) selecting the less MNA-corrupted signal of the two signals. The proposed method has advantages in that 1) diversity gain can be obtained from the two heterogeneous signals when one signal is clean while the other signal is corrupted, and 2) acquisition of the two heterogeneous signals does not double the acquisition procedure but maintains a single acquisition procedure, since two heterogeneous signals can be obtained from a single smartphone camera recording. In our diversity method, we propose to choose the better signal based on the signal quality indices (SQIs), i.e., standard deviation of instantaneous heart rate (STD-HR), root mean square of the successive differences of peak-to-peak time intervals (RMSSD-T), and standard deviation of peak values (STD-PV). As a performance metric evaluating the proposed diversity method, the ratio of usable period is considered. Experimental results show that our diversity method increases the usable period 19.53% and 6.25% compared to the color intensity or the fingertip movement signals only, respectively.

A Novel Personalized Motion and Noise Artifact (MNA) Detection Method for Smartphone Photoplethysmograph (PPG) Signals

Photoplethysmography (PPG) is a technique to detect blood volume changes in an optical way. Representative PPG applications are the measurements of oxygen saturation, heart rate, and respiratory rate. However, PPG signals are sensitive to motion and noise artifacts (MNAs) especially when they are obtained from smartphone cameras. Moreover, PPG signals are different among users and each individual's PPG signal has a unique characteristic. Hence, an effective MNA detection and reduction method for smartphone PPG signals, which adapts itself to each user in a personalized way, is highly demanded. Here, a concept of the probabilistic neural network (PNN) is introduced to be used with the proposed extracted parameters. The signal amplitude, standard deviation of peak to peak time intervals and amplitudes, along with the mean of moving standard deviation, signal slope changes, and the optimal autoregressive (AR) model order are proposed for effective MNA detection. Accordingly, the performance of the proposed personalized algorithm is compared with conventional MNA detection algorithms. As performance metrics, we considered accuracy, sensitivity, and specificity. The results show that the overall performance of the personalized MNA detection is enhanced compared to the generalized algorithm. The average values of the accuracy, sensitivity and specificity of the personalized one are 98.07%, 92.6%, and 99.78%, respectively, while these are 89.92%, 84.21%, and 93.63% for the general one.

Evaluation of key design parameters for mitigating motion artefact in the mobile reflectance PPG signal to improve estimation of arterial oxygenation

OBJECTIVE

Pulse oximetry, a widely accepted method for non-invasive estimation of arterial oxygen saturation (SpO₂) and pulse rate (PR), is increasingly being adapted for mobile applications. Previous work in mitigating motion artefact, which corrupts the photoplethysmogram (PPG) used in pulse oximetry, has focused on reducing noise using signal processing algorithms or through sensor design that controlled only one variable at a time. In this work, we have investigated the effect of several variables such as sensor weight, relative motion, placement, and contact force against the skin that can impact motion artefact independently or by interacting with each other.

APPROACH

We have identified a unique combination of these variables that is most optimal in reducing motion artefacts using a full factorial design of experiments methodology and evaluated the effect of these factors on PPG readings with and without motion.

MAIN RESULTS

Data collected on 10 diverse subjects showed that placement (p  =  0.03), contact force (p  =  0.004), and sensor-to-skin adhesion or relative motion when combined with force (p  <  0.001) had the most significant effect on reducing the motion artefact signal. Sensor weight (p  =  0.822) by itself had no significant effect, however when combined with sensor adhesion (p  <  0.001) had a significant impact.

SIGNIFICANCE

This lays the foundation for future development of more robust sensors that can significantly reduce the effect of motion artefacts in reflectance-based pulse oximetry and could have great clinical value due to significant reduction of SpO₂ errors and false alarms associated with motion artefact, making wearable pulse oximetry more reliable in mobile applications.

Motion and Noise Artifact-Resilient Atrial Fibrillation Detection using a Smartphone

We have recently found that our previously-developed atrial fibrillation (AF) detection algorithm for smartphones can give false positives when subjects' fingers or hands move, as we rely on proper finger placement over the smartphone camera to collect the signal of interest. Specifically, smartphone camera pulsatile signals that are obtained from normal sinus rhythm (NSR) subjects but are corrupted by motion and noise artifacts (MNAs) are frequently detected as AF. AF and motion-corrupted episodes have the similar characteristic that pulse-to-pulse intervals (PPIs) are irregular. We have developed an MNA-resilient smartphone-based AF detection algorithm that first discriminates and eliminates MNA-corrupted episodes in smartphone camera recordings, and then detects AF in MNA-free recordings. We found that MNA-corrupted episodes have highly-varying pulse slope, large turning point ratio, or large kurtosis values in smartphone signals compared to MNA-free AF and NSR episodes. We first use these three metrics for MNA discrimination and exclusion. Then, AF is detected in MNA-free signals using our previous algorithm. The capability to discriminate MNAs and AFs separately in smartphone signals increases the specificity of AF detection. To evaluate the performance of the proposed MNA-resilient AF algorithm, 99 subjects, including 88 study participants with AF at baseline and in NSR after electrical cardioversion as well as 11 participants with MNA-corrupted NSR, were recruited. Using iPhone 4S, 5S, and 6S models, we collected 2-minute pulsatile time series from each subject. The clinical results show that the accuracy, sensitivity and specificity of the proposed AF algorithm are 0.97, 0.98, 0.97, respectively, which are higher than those of the previous AF algorithm.

A Wearable System for Real-Time Continuous Monitoring of Physical Activity

Over the last decades, wearable systems have gained interest for monitoring of physiological variables, promoting health, and improving exercise adherence in different populations ranging from elite athletes to patients. In this paper, we present a wearable system for the continuous real-time monitoring of respiratory frequency (f_R), heart rate (HR), and movement cadence during physical activity. The system has been experimentally tested in the laboratory (by simulating the breathing pattern with a mechanical ventilator) and by collecting data from one healthy volunteer. Results show the feasibility of the proposed device for real-time continuous monitoring of f_R, HR, and movement cadence both in resting condition and during activity. Finally, different synchronization techniques have been investigated to enable simultaneous data collection from different wearable modules.

Motion robust remote photoplethysmography in CIELab color space

Remote photoplethysmography (rPPG) is attractive for tracking a subject’s physiological parameters without wearing a device. However, rPPG is known to be prone to body movement-induced artifacts, making it unreliable in realistic situations. Here we report a method to minimize the movement-induced artifacts. The method selects an optimal region of interest (ROI) automatically, prunes frames in which the ROI is not clearly captured (e.g., subject moves out of the view), and analyzes rPPG using an algorithm in CIELab color space, rather than the widely used RGB color space. We show that body movement primarily affects image intensity, rather than chromaticity, and separating chromaticity from intensity in CIELab color space thus helps achieve effective reduction of the movement-induced artifacts. We validate the method by performing a pilot study including 17 people with diverse skin tones.

A Robust Motion Artifact Detection Algorithm for Accurate Detection of Heart Rates From Photoplethysmographic Signals Using Time-Frequency Spectral Features

Motion and noise artifacts (MNAs) impose limits on the usability of the photoplethysmogram (PPG), particularly in the context of ambulatory monitoring. MNAs can distort PPG, causing erroneous estimation of physiological parameters such as heart rate (HR) and arterial oxygen saturation (SpO2). In this study, we present a novel approach, "TifMA," based on using the time-frequency spectrum of PPG to first detect the MNA-corrupted data and next discard the nonusable part of the corrupted data. The term "nonusable" refers to segments of PPG data from which the HR signal cannot be recovered accurately. Two sequential classification procedures were included in the TifMA algorithm. The first classifier distinguishes between MNA-corrupted and MNA-free PPG data. Once a segment of data is deemed MNA-corrupted, the next classifier determines whether the HR can be recovered from the corrupted segment or not. A support vector machine (SVM) classifier was used to build a decision boundary for the first classification task using data segments from a training dataset. Features from time-frequency spectra of PPG were extracted to build the detection model. Five datasets were considered for evaluating TifMA performance: (1) and (2) were laboratory-controlled PPG recordings from forehead and finger pulse oximeter sensors with subjects making random movements, (3) and (4) were actual patient PPG recordings from UMass Memorial Medical Center with random free movements and (5) was a laboratory-controlled PPG recording dataset measured at the forehead while the subjects ran on a treadmill. The first dataset was used to analyze the noise sensitivity of the algorithm. Datasets 2-4 were used to evaluate the MNA detection phase of the algorithm. The results from the first phase of the algorithm (MNA detection) were compared to results from three existing MNA detection algorithms: the Hjorth, kurtosis-Shannon entropy, and time-domain variability-SVM approaches. This last is an approach recently developed in our laboratory. The proposed TifMA algorithm consistently provided higher detection rates than the other three methods, with accuracies greater than 95% for all data. Moreover, our algorithm was able to pinpoint the start and end times of the MNA with an error of less than 1 s in duration, whereas the next-best algorithm had a detection error of more than 2.2 s. The final, most challenging, dataset was collected to verify the performance of the algorithm in discriminating between corrupted data that were usable for accurate HR estimations and data that were nonusable. It was found that on average 48% of the data segments were found to have MNA, and of these, 38% could be used to provide reliable HR estimation.

Improving Pulse Rate Measurements during Random Motion Using a Wearable Multichannel Reflectance Photoplethysmograph

Photoplethysmographic (PPG) waveforms are used to acquire pulse rate (PR) measurements from pulsatile arterial blood volume. PPG waveforms are highly susceptible to motion artifacts (MA), limiting the implementation of PR measurements in mobile physiological monitoring devices. Previous studies have shown that multichannel photoplethysmograms can successfully acquire diverse signal information during simple, repetitive motion, leading to differences in motion tolerance across channels. In this paper, we investigate the performance of a custom-built multichannel forehead-mounted photoplethysmographic sensor under a variety of intense motion artifacts. We introduce an advanced multichannel template-matching algorithm that chooses the channel with the least motion artifact to calculate PR for each time instant. We show that for a wide variety of random motion, channels respond differently to motion artifacts, and the multichannel estimate outperforms single-channel estimates in terms of motion tolerance, signal quality, and PR errors. We have acquired 31 data sets consisting of PPG waveforms corrupted by random motion and show that the accuracy of PR measurements achieved was increased by up to 2.7 bpm when the multichannel-switching algorithm was compared to individual channels. The percentage of PR measurements with error ≤ 5 bpm during motion increased by 18.9% when the multichannel switching algorithm was compared to the mean PR from all channels. Moreover, our algorithm enables automatic selection of the best signal fidelity channel at each time point among the multichannel PPG data.

An Algorithm for Real-Time Pulse Waveform Segmentation and Artifact Detection in Photoplethysmograms

Photoplethysmography has been used in a wide range of medical devices for measuring oxygen saturation, cardiac output, assessing autonomic function, and detecting peripheral vascular disease. Artifacts can render the photoplethysmogram (PPG) useless. Thus, algorithms capable of identifying artifacts are critically important. However, the published PPG algorithms are limited in algorithm and study design. Therefore, the authors developed a novel embedded algorithm for real-time pulse waveform (PWF) segmentation and artifact detection based on a contour analysis in the time domain. This paper provides an overview about PWF and artifact classifications, presents the developed PWF analysis, and demonstrates the implementation on a 32-bit ARM core microcontroller. The PWF analysis was validated with data records from 63 subjects acquired in a sleep laboratory, ergometry laboratory, and intensive care unit in equal parts. The output of the algorithm was compared with harmonized experts' annotations of the PPG with a total duration of 31.5 h. The algorithm achieved a beat-to-beat comparison sensitivity of 99.6%, specificity of 90.5%, precision of 98.5%, and accuracy of 98.3%. The interrater agreement expressed as Cohen's kappa coefficient was 0.927 and as F-measure was 0.990. In conclusion, the PWF analysis seems to be a suitable method for PPG signal quality determination, real-time annotation, data compression, and calculation of additional pulse wave metrics such as amplitude, duration, and rise time.

Photoplethysmograph signal reconstruction based on a novel hybrid motion artifact detection-reduction approach. Part I: Motion and noise artifact detection

Motion and noise artifacts (MNA) are a serious obstacle in utilizing photoplethysmogram (PPG) signals for real-time monitoring of vital signs. We present a MNA detection method which can provide a clean vs. corrupted decision on each successive PPG segment. For motion artifact detection, we compute four time-domain parameters: (1) standard deviation of peak-to-peak intervals (2) standard deviation of peak-to-peak amplitudes (3) standard deviation of systolic and diastolic interval ratios, and (4) mean standard deviation of pulse shape. We have adopted a support vector machine (SVM) which takes these parameters from clean and corrupted PPG signals and builds a decision boundary to classify them. We apply several distinct features of the PPG data to enhance classification performance. The algorithm we developed was verified on PPG data segments recorded by simulation, laboratory-controlled and walking/stair-climbing experiments, respectively, and we compared several well-established MNA detection methods to our proposed algorithm. All compared detection algorithms were evaluated in terms of motion artifact detection accuracy, heart rate (HR) error, and oxygen saturation (SpO2) error. For laboratory controlled finger, forehead recorded PPG data and daily-activity movement data, our proposed algorithm gives 94.4, 93.4, and 93.7% accuracies, respectively. Significant reductions in HR and SpO2 errors (2.3 bpm and 2.7%) were noted when the artifacts that were identified by SVM-MNA were removed from the original signal than without (17.3 bpm and 5.4%). The accuracy and error values of our proposed method were significantly higher and lower, respectively, than all other detection methods. Another advantage of our method is its ability to provide highly accurate onset and offset detection times of MNAs. This capability is important for an automated approach to signal reconstruction of only those data points that need to be reconstructed, which is the subject of the companion paper to this article. Finally, our MNA detection algorithm is real-time realizable as the computational speed on the 7-s PPG data segment was found to be only 7 ms with a Matlab code.

Artifacts in wearable photoplethysmographs during daily life motions and their reduction with least mean square based active noise cancellation method

Signal distortion of photoplethysmographs (PPGs) due to motion artifacts has been a limitation for developing real-time, wearable health monitoring devices. The artifacts in PPG signals are analyzed by comparing the frequency of the PPG with a reference pulse and daily life motions, including typing, writing, tapping, gesturing, walking, and running. Periodical motions in the range of pulse frequency, such as walking and running, cause motion artifacts. To reduce these artifacts in real-time devices, a least mean square based active noise cancellation method is applied to the accelerometer data. Experiments show that the proposed method recovers pulse from PPGs efficiently.

Photoplethysmography and its application in clinical physiological measurement

Photoplethysmography (PPG) is a simple and low-cost optical technique that can be used to detect blood volume changes in the microvascular bed of tissue. It is often used non-invasively to make measurements at the skin surface. The PPG waveform comprises a pulsatile ('AC') physiological waveform attributed to cardiac synchronous changes in the blood volume with each heart beat, and is superimposed on a slowly varying ('DC') baseline with various lower frequency components attributed to respiration, sympathetic nervous system activity and thermoregulation. Although the origins of the components of the PPG signal are not fully understood, it is generally accepted that they can provide valuable information about the cardiovascular system. There has been a resurgence of interest in the technique in recent years, driven by the demand for low cost, simple and portable technology for the primary care and community based clinical settings, the wide availability of low cost and small semiconductor components, and the advancement of computer-based pulse wave analysis techniques. The PPG technology has been used in a wide range of commercially available medical devices for measuring oxygen saturation, blood pressure and cardiac output, assessing autonomic function and also detecting peripheral vascular disease. The introductory sections of the topical review describe the basic principle of operation and interaction of light with tissue, early and recent history of PPG, instrumentation, measurement protocol, and pulse wave analysis. The review then focuses on the applications of PPG in clinical physiological measurements, including clinical physiological monitoring, vascular assessment and autonomic function.