Recommendations for determining the validity of consumer wearable heart rate devices: expert statement and checklist of the INTERLIVE Network

Comparison of motion sensor and heart rate monitor for assessment of physical activity intensity in stroke outpatient rehabilitation sessions: an observational study

OBJECTIVE

To compare the estimation of time spent on 4 categories of physical activity intensity (sedentary behaviour, light physical activity, moderate physical activity, and vigorous physical activity) between a motion sensor and a heart rate monitor during a stroke outpatient rehabilitation session.

DESIGN

A multicentre cross-sectional observational study.

SUBJECTS/PATIENTS

Participants with stroke (> 6 months) undergoing outpatient rehabilitation sessions.

METHODS

Participants wore the SenseWear Armband motion sensor and the Polar H10 heart rate monitor during 2 rehabilitation sessions. The times estimated by each device were compared using a generalized linear mixed model and post-hoc tests.

RESULTS

Ninety-nine participants from 29 clinics were recruited and data from 146 sessions were included in the analysis. The estimated times depended on the devices and the physical activity intensity category (F = 135, p < 0.05). The motion sensor estimated more time spent in sedentary behaviour and less time spent in moderate physical activity and vigorous physical activity than the heart rate monitor.

CONCLUSION

The motion sensor and heart rate monitor provide different estimates of physical activity intensity during stroke rehabilitation. Further research is needed to establish the most appropriate device for each physical activity category.

Breaking down the Digital Fortress: The Unseen Challenges in Healthcare Technology-Lessons Learned from 10 Years of Research

Healthcare is undergoing a fundamental shift in which digital health tools are becoming ubiquitous, with the promise of improved outcomes, reduced costs, and greater efficiency. Healthcare professionals, patients, and the wider public are faced with a paradox of choice regarding technologies across multiple domains. Research is continuing to look for methods and tools to further revolutionise all aspects of health from prediction, diagnosis, treatment, and monitoring. However, despite its promise, the reality of implementing digital health tools in practice, and the scalability of innovations, remains stunted. Digital health is approaching a crossroads where we need to shift our focus away from simply looking at developing new innovations to seriously considering how we overcome the barriers that currently limit its impact. This paper summarises over 10 years of digital health experiences from a group of researchers with backgrounds in physical therapy-in order to highlight and discuss some of these key lessons-in the areas of validity, patient and public involvement, privacy, reimbursement, and interoperability. Practical learnings from this collective experience across patient cohorts are leveraged to propose a list of recommendations to enable researchers to bridge the gap between the development and implementation of digital health tools.

Validity of resting heart rate derived from contact-based smartphone photoplethysmography compared with electrocardiography: a scoping review and checklist for optimal acquisition and reporting

Background

With the rise of smartphone ownership and increasing evidence to support the suitability of smartphone usage in healthcare, the light source and smartphone camera could be utilized to perform photoplethysmography (PPG) for the assessment of vital signs, such as heart rate (HR). However, until rigorous validity assessment has been conducted, PPG will have limited use in clinical settings.

Objective

We aimed to conduct a scoping review assessing the validity of resting heart rate (RHR) acquisition from PPG utilizing contact-based smartphone devices. Our four specific objectives of this scoping review were to (1) conduct a systematic search of the published literature concerning contact-based smartphone device-derived PPG, (2) map study characteristics and methodologies, (3) identify if methodological and technological advancements have been made, and (4) provide recommendations for the advancement of the investigative area.

Methods

ScienceDirect, PubMed and SPORTDiscus were searched for relevant studies between January 1st, 2007, and November 6th, 2022. Filters were applied to ensure only literature written in English were included. Reference lists of included studies were manually searched for additional eligible studies.

Results

In total 10 articles were included. Articles varied in terms of methodology including study characteristics, index measurement characteristics, criterion measurement characteristics, and experimental procedure. Additionally, there were variations in reporting details including primary outcome measure and measure of validity. However, all studies reached the same conclusion, with agreement ranging between good to very strong and correlations ranging from r = .98 to 1.

Conclusions

Smartphone applications measuring RHR derived from contact-based smartphone PPG appear to agree with gold standard electrocardiography (ECG) in healthy subjects. However, agreement was established under highly controlled conditions. Future research could investigate their validity and consider effective approaches that transfer these methods from laboratory conditions into the "real-world", in both healthy and clinical populations.

Promises and Perils of Consumer Mobile Technologies in Cardiovascular Care: JACC Scientific Statement

Direct-to-consumer (D2C) wearables are becoming increasingly popular in cardiovascular health management because of their affordability and capability to capture diverse health data. Wearables may enable continuous health care provider-patient partnerships and reduce the volume of episodic clinic-based care (thereby reducing health care costs). However, challenges arise from the unregulated use of these devices, including questionable data reliability, potential misinterpretation of information, unintended psychological impacts, and an influx of clinically nonactionable data that may overburden the health care system. Further, these technologies could exacerbate, rather than mitigate, health disparities. Experience with wearables in atrial fibrillation underscores these challenges. The prevalent use of D2C wearables necessitates a collaborative approach among stakeholders to ensure effective integration into cardiovascular care. Wearables are heralding innovative disease screening, diagnosis, and management paradigms, expanding therapeutic avenues, and anchoring personalized medicine.

A Preliminary Investigation about the Influence of WIMU PROTM Location on Heart Rate Accuracy: A Comparative Study in Cycle Ergometer

Technological development has boosted the use of multi-sensor devices to monitor athletes' performance, but the location and connectivity between devices have been shown to affect data reliability. This preliminary study aimed to determine whether the placement of a multi-sensor device (WIMU PROTM) could affect the heart rate signal reception (GARMINTM chest strap) and, therefore, data accuracy. Thirty-two physical education students (20 men and 12 women) performed 20 min of exercise in a cycle ergometer based on the warm-up of the Function Threshold Power 20 test in laboratory conditions, carrying two WIMU PROTM devices (Back: inter-scapula; Bicycle: bicycle's handlebar-20 cm from the chest) and two GARMINTM chest straps. A one-dimensional statistical parametric mapping test found full agreement between the two situations (inter-scapula vs. bicycle's handlebar). Excellent intra-class correlation values were obtained during the warm-up (ICC = 0.99, [1.00-1.00], p < 0.001), the time trial test (ICC = 0.99, [1.00-1.00], p < 0.001) and the cool-down (ICC = 0.99, [1.00-1.00], p < 0.001). The Bland-Altman plots confirmed the total agreement with a bias value of 0.00 ± 0.1 bpm. The interscapular back placement of the WIMU PROTM device does not affect heart rate measurement accuracy with a GARMINTM chest strap during cycling exercise in laboratory conditions.

Evaluation of Wrist-Worn Photoplethysmography Trackers with an Electrocardiogram in Patients with Ischemic Heart Disease: A Validation Study

PURPOSE

Photoplethysmography measurement of heart rate with wrist-worn trackers has been introduced in healthy individuals. However, additional consideration is necessary for patients with ischemic heart disease, and the available evidence is limited. The study aims to evaluate the validity and reliability of heart rate measures by a wrist-worn photoplethysmography (PPG) tracker compared to an electrocardiogram (ECG) during incremental treadmill exercise among patients with ischemic heart disease.

METHODS

Fifty-one participants performed the standard incremental treadmill exercise in a controlled laboratory setting with 12-lead ECG attached to the patient's body and wearing wrist-worn PPG trackers.

RESULTS

At each stage, the absolute percentage error of the PPG was within 10% of the standard acceptable range. Further analysis using a linear mixed model, which accounts for individual variations, revealed that PPG yielded the best performance at the baseline low-intensity exercise. As the stages progressed, heart rate validity decreased but was regained during recovery. The reliability was moderate to excellent.

CONCLUSIONS

Low-cost trackers AMAZFIT Cor and Bip validity and reliability were within acceptable ranges, especially during low-intensity exercise among patients with ischemic heart disease recovering from cardiac procedures. Though using the tracker as part of the diagnosis tool still requires more supporting studies, it can potentially be used as a self-monitoring tool with precautions.

Assessment of Heart Rate Monitoring During Exercise With Smart Wristbands and a Heart Rhythm Patch: Validation and Comparison Study

BACKGROUND

The integration of wearable devices into fitness routines, particularly in military settings, necessitates a rigorous assessment of their accuracy. This study evaluates the precision of heart rate measurements by locally manufactured wristbands, increasingly used in military academies, to inform future device selection for military training activities.

OBJECTIVE

This research aims to assess the reliability of heart rate monitoring in chest straps versus wearable wristbands.

METHODS

Data on heart rate and acceleration were collected using the Q-Band Q-69 smart wristband (Mobile Action Technology Inc) and compared against the Zephyr Bioharness standard measuring device. The Lin concordance correlation coefficient, Pearson product moment correlation coefficient, and intraclass correlation coefficient were used for reliability analysis.

RESULTS

Participants from a Northern Taiwanese medical school were enrolled (January 1-June 31, 2021). The Q-Band Q-69 demonstrated that the mean absolute percentage error (MAPE) of women was observed to be 13.35 (SD 13.47). Comparatively, men exhibited a lower MAPE of 8.54 (SD 10.49). The walking state MAPE was 7.79 for women and 10.65 for men. The wristband's accuracy generally remained below 10% MAPE in other activities. Pearson product moment correlation coefficient analysis indicated gender-based performance differences, with overall coefficients of 0.625 for women and 0.808 for men, varying across walking, running, and cooldown phases.

CONCLUSIONS

This study highlights significant gender and activity-dependent variations in the accuracy of the MobileAction Q-Band Q-69 smart wristband. Reduced accuracy was notably observed during running. Occasional extreme errors point to the necessity of caution in relying on such devices for exercise monitoring. The findings emphasize the limitations and potential inaccuracies of wearable technology, especially in high-intensity physical activities.

Accuracy of heart rate measured by military-grade wearable ECG monitor compared with reference and commercial monitors

INTRODUCTION

Physiological monitoring of soldiers can indicate combat readiness and performance. Despite demonstrated use of wearable devices for HR monitoring, commercial options lack desired military features. A newly developed OMNI monitor includes desired features such as long-range secure data transmission. This study investigated the accuracy of the OMNI to measure HR via accuracy of R-R interval duration relative to research-grade ECG and commercial products.

METHODS

54 healthy individuals (male/female=37/17, age=22.2±3.6 years, height=173.0±9.1 cm, weight=70.1±11.2 kg) completed a submaximal exercise test while wearing a reference ECG (Biopac) and a randomly assigned chest-based monitor (OMNI, Polar H10, Equivital EQ-02, Zephyr Bioharness 3). All participants also wore two wrist-based photoplethysmography (PPG) devices, Garmin fēnix 6 and Empatica E4. Bland-Altman analyses of agreement, concordance correlation coefficient (CCC) and root-mean-squared error (RMSE) were used to determine accuracy of the OMNI and commercial devices relative to Biopac. Additionally, a linear mixed-effects model evaluated the effects of device and exercise intensity on agreement.

RESULTS

Chest-based devices showed superior agreement with Biopac for measuring R-R interval compared with wrist-based ones in terms of mean bias, CCC and RMSE, with OMNI demonstrating the best scores on all metrics. Linear mixed-effects model showed no significant main or interaction effects for the chest-based devices. However, significant effects were found for Garmin and Empatica devices (p<0.001) as well as the interaction effects between both Garmin and Empatica and exercise intensity (p<0.001).

CONCLUSIONS

Chest-based ECG devices are preferred to wrist-based PPG devices due to superior HR accuracy over a range of exercise intensities, with the OMNI device demonstrating equal, if not superior, performance to other commercial ECG monitors. Additionally, wrist-based PPG devices are significantly affected by exercise intensity as they underestimate HR at low intensities and overestimate HR at high intensities.

Diagnostic Accuracy of Single-Lead Electrocardiograms Using the Kardia Mobile App and the Apple Watch 4: Validation Study

BACKGROUND

To date, the 12-lead electrocardiogram (ECG) is the gold standard for cardiological diagnosis in clinical settings. With the advancements in technology, a growing number of smartphone apps and gadgets for recording, visualizing, and evaluating physical performance as well as health data is available. Although this new smart technology is innovative and time- and cost-efficient, less is known about its diagnostic accuracy and reliability.

OBJECTIVE

This study aimed to examine the agreement between the mobile single-lead ECG measurements of the Kardia Mobile App and the Apple Watch 4 compared to the 12-lead gold standard ECG in healthy adults under laboratory conditions. Furthermore, it assessed whether the measurement error of the devices increases with an increasing heart rate.

METHODS

This study was designed as a prospective quasi-experimental 1-sample measurement, in which no randomization of the sampling was carried out. In total, ECGs at rest from 81 participants (average age 24.89, SD 8.58 years; n=58, 72% male) were recorded and statistically analyzed. Bland-Altman plots were created to graphically illustrate measurement differences. To analyze the agreement between the single-lead ECGs and the 12-lead ECG, Pearson correlation coefficient (r) and Lin concordance correlation coefficient (CCCLin) were calculated.

RESULTS

The results showed a higher agreement for the Apple Watch (mean deviation QT: 6.85%; QT interval corrected for heart rate using Fridericia formula [QTcF]: 7.43%) than Kardia Mobile (mean deviation QT: 9.53%; QTcF: 9.78%) even if both tend to underestimate QT and QTcF intervals. For Kardia Mobile, the QT and QTcF intervals correlated significantly with the gold standard (rQT=0.857 and rQTcF=0.727; P<.001). CCCLin corresponded to an almost complete heuristic agreement for the QT interval (0.835), whereas the QTcF interval was in the range of strong agreement (0.682). Further, for the Apple Watch, Pearson correlations were highly significant and in the range of a large effect (rQT=0.793 and rQTcF=0.649; P<.001). CCCLin corresponded to a strong heuristic agreement for both the QT (0.779) and QTcF (0.615) intervals. A small negative correlation between the measurement error and increasing heart rate could be found of each the devices and the reference.

CONCLUSIONS

Smart technology seems to be a promising and reliable approach for nonclinical health monitoring. Further research is needed to broaden the evidence regarding its validity and usability in different target groups.

Cardiorespiratory dynamics during respiratory maneuver in athletes

Introduction: The modern practice of sports medicine and medical rehabilitation requires the search for subtle criteria for the development of conditions and recovery of the body after diseases, which would have a prognostic value for the prevention of negative effects of training and rehabilitation tools, and also testify to the development and course of mechanisms for counteracting pathogenetic processes in the body. The purpose of this study was to determine the informative directions of the cardiorespiratory system parameters dynamics during the performing a maneuver with a change in breathing rate, which may indicate the body functional state violation.

Methods: The results of the study of 183 healthy men aged 21.2 ± 2.3 years who regularly engaged in various sports were analyzed. The procedure for studying the cardiorespiratory system included conducting combined measurements of indicators of activity of the respiratory and cardiovascular systems in a sitting position using a spiroarteriocardiograph device. The duration of the study was 6 min and involved the sequential registration of three measurements with a change in breathing rate (spontaneous breathing, breathing at 0.1 Hz and 0.25 Hz).

Results: Performing a breathing maneuver at breathing 0.1 Hz and breathing 0.25 Hz in comparison with spontaneous breathing leads to multidirectional significant changes in heart rate variability indicators–TP (ms2), LF (ms2), LFHF (ms2/ms2); of blood pressure variability indicators–TPDBP (mmHg2), LFSBP (mmHg2), LFDBP (mmHg2), HFSBP (mmHg2); of volume respiration variability indicators - LFR, (L×min-1)2; HFR, (L×min-1)2; LFHFR, (L×min-1)2/(L×min-1)2; of arterial baroreflex sensitivity indicators - BRLF (ms×mmHg-1), BRHF (ms×mmHg-1). Differences in indicators of systemic hemodynamics and indicators of cardiovascular and respiratory systems synchronization were also informative.

Conclusion: According to the results of the study, it is shown that during performing a breathing maneuver with a change in the rate of breathing, there are significant changes in cardiorespiratory parameters, the analysis of which the increments made it possible to determine of the changes directions dynamics, their absolute values and informative limits regarding the possible occurrence of the cardiorespiratory interactions dysregulation.

Cardiorespiratory dynamics during respiratory maneuver in athletes

Introduction: The modern practice of sports medicine and medical rehabilitation requires the search for subtle criteria for the development of conditions and recovery of the body after diseases, which would have a prognostic value for the prevention of negative effects of training and rehabilitation tools, and also testify to the development and course of mechanisms for counteracting pathogenetic processes in the body. The purpose of this study was to determine the informative directions of the cardiorespiratory system parameters dynamics during the performing a maneuver with a change in breathing rate, which may indicate the body functional state violation. Methods: The results of the study of 183 healthy men aged 21.2 ± 2.3 years who regularly engaged in various sports were analyzed. The procedure for studying the cardiorespiratory system included conducting combined measurements of indicators of activity of the respiratory and cardiovascular systems in a sitting position using a spiroarteriocardiograph device. The duration of the study was 6 min and involved the sequential registration of three measurements with a change in breathing rate (spontaneous breathing, breathing at 0.1 Hz and 0.25 Hz). Results: Performing a breathing maneuver at breathing 0.1 Hz and breathing 0.25 Hz in comparison with spontaneous breathing leads to multidirectional significant changes in heart rate variability indicators-TP (ms2), LF (ms2), LFHF (ms2/ms2); of blood pressure variability indicators-TPDBP (mmHg2), LFSBP (mmHg2), LFDBP (mmHg2), HFSBP (mmHg2); of volume respiration variability indicators - LFR, (L×min-1)2; HFR, (L×min-1)2; LFHFR, (L×min-1)2/(L×min-1)2; of arterial baroreflex sensitivity indicators - BRLF (ms×mmHg-1), BRHF (ms×mmHg-1). Differences in indicators of systemic hemodynamics and indicators of cardiovascular and respiratory systems synchronization were also informative. Conclusion: According to the results of the study, it is shown that during performing a breathing maneuver with a change in the rate of breathing, there are significant changes in cardiorespiratory parameters, the analysis of which the increments made it possible to determine of the changes directions dynamics, their absolute values and informative limits regarding the possible occurrence of the cardiorespiratory interactions dysregulation.

Heart rate processing algorithms and exercise duration on reliability and validity decisions in biceps-worn Polar Verity Sense and OH1 wearables

Consumer wearable technology use is widespread and there is a need to validate measures obtained in uncontrolled settings. Because no standard exists for the treatment of heart rate data during exercise, the effect of different approaches on reliability (Coefficient of Variation [CV], Intraclass Correlation Coefficient [ICC]) and validity (Mean Absolute Percent Error [MAPE], Lin's Concordance Correlation Coefficient [CCC)] were determined in the Polar Verity Sense and OH1 during trail running. The Verity Sense met the reliability (CV < 5%, ICC > 0.7) and validity thresholds (MAPE < 5%, CCC > 0.9) in all cases. The OH1 met reliability thresholds in all cases except entire session average (ICC = 0.57). The OH1 met the validity MAPE threshold in all cases (3.3-4.1%), but not CCC (0.6-0.86). Despite various heart rate data processing methods, the approach may not affect reliability and validity interpretation provided adequate data points are obtained. It is also possible that a large volume of data will artificially inflate metrics.

Wearable and Portable Devices for Acquisition of Cardiac Signals while Practicing Sport: A Scoping Review

Wearable and portable devices capable of acquiring cardiac signals are at the frontier of the sport industry. They are becoming increasingly popular for monitoring physiological parameters while practicing sport, given the advances in miniaturized technologies, powerful data, and signal processing applications. Data and signals acquired by these devices are increasingly used to monitor athletes' performances and thus to define risk indices for sport-related cardiac diseases, such as sudden cardiac death. This scoping review investigated commercial wearable and portable devices employed for cardiac signal monitoring during sport activity. A systematic search of the literature was conducted on PubMed, Scopus, and Web of Science. After study selection, a total of 35 studies were included in the review. The studies were categorized based on the application of wearable or portable devices in (1) validation studies, (2) clinical studies, and (3) development studies. The analysis revealed that standardized protocols for validating these technologies are necessary. Indeed, results obtained from the validation studies turned out to be heterogeneous and scarcely comparable, since the metrological characteristics reported were different. Moreover, the validation of several devices was carried out during different sport activities. Finally, results from clinical studies highlighted that wearable devices are crucial to improve athletes' performance and to prevent adverse cardiovascular events.

Validity of Two Consumer Multisport Activity Tracker and One Accelerometer against Polysomnography for Measuring Sleep Parameters and Vital Data in a Laboratory Setting in Sleep Patients

Two commercial multisport activity trackers (Garmin Forerunner 945 and Polar Ignite) and the accelerometer ActiGraph GT9X were evaluated in measuring vital data, sleep stages and sleep/wake patterns against polysomnography (PSG). Forty-nine adult patients with suspected sleep disorders (30 males/19 females) completed a one-night PSG sleep examination followed by a multiple sleep latency test (MSLT). Sleep parameters, time in bed (TIB), total sleep time (TST), wake after sleep onset (WASO), sleep onset latency (SOL), awake time (WASO + SOL), sleep stages (light, deep, REM sleep) and the number of sleep cycles were compared. Both commercial trackers showed high accuracy in measuring vital data (HR, HRV, SpO2, respiratory rate), r > 0.92. For TIB and TST, all three trackers showed medium to high correlation, r > 0.42. Garmin had significant overestimation of TST, with MAE of 84.63 min and MAPE of 25.32%. Polar also had an overestimation of TST, with MAE of 45.08 min and MAPE of 13.80%. ActiGraph GT9X results were inconspicuous. The trackers significantly underestimated awake times (WASO + SOL) with weak correlation, r = 0.11−0.57. The highest MAE was 50.35 min and the highest MAPE was 83.02% for WASO for Garmin and ActiGraph GT9X; Polar had the highest MAE of 21.17 min and the highest MAPE of 141.61% for SOL. Garmin showed significant deviations for sleep stages (p < 0.045), while Polar only showed significant deviations for sleep cycle (p = 0.000), r < 0.50. Garmin and Polar overestimated light sleep and underestimated deep sleep, Garmin significantly, with MAE up to 64.94 min and MAPE up to 116.50%. Both commercial trackers Garmin and Polar did not detect any daytime sleep at all during the MSLT test. The use of the multisport activity trackers for sleep analysis can only be recommended for general daily use and for research purposes. If precise data on sleep stages and parameters are required, their use is limited. The accuracy of the vital data measurement was adequate. Further studies are needed to evaluate their use for medical purposes, inside and outside of the sleep laboratory. The accelerometer ActiGraph GT9X showed overall suitable accuracy in detecting sleep/wake patterns.

Agreement between two photoplethysmography-based wearable devices for monitoring heart rate during different physical activity situations: a new analysis methodology

Wearables are being increasingly used to monitor heart rate (HR). However, their usefulness for analyzing continuous HR in research or at clinical level is questionable. The aim of this study is to analyze the level of agreement between different wearables in the measurement of HR based on photoplethysmography, according to different body positions and physical activity levels, and compared to a gold-standard ECG. The proposed method measures agreement among several time scales since different wearables obtain HR at different sampling rates. Eighteen university students (10 men, 8 women; 22 ± 2.45 years old) participated in a laboratory study. Participants simultaneously wore an Apple Watch and a Polar Vantage watch. ECG was measured using a BIOPAC system. HR was recorded continuously and simultaneously by the three devices, for consecutive 5-min periods in 4 different situations: lying supine, sitting, standing and walking at 4 km/h on a treadmill. HR estimations were obtained with the maximum precision offered by the software of each device and compared by averaging in several time scales, since the wearables obtained HR at different sampling rates, although results are more detailed for 5 s and 30 s epochs. Bland–Altman (B-A) plots show that there is no noticeable difference between data from the ECG and any of the smartwatches while participants were lying down. In this position, the bias is low when averaging in both 5 s and 30 s. Differently, B-A plots show that there are differences when the situation involves some level of physical activity, especially for shorter epochs. That is, the discrepancy between devices and the ECG was greater when walking on the treadmill and during short time scales. The device showing the biggest discrepancy was the Polar Watch, and the one with the best results was the Apple Watch. We conclude that photoplethysmography-based wearable devices are suitable for monitoring HR averages at regular intervals, especially at rest, but their feasibility is debatable for a continuous analysis of HR for research or clinical purposes, especially when involving some level of physical activity. An important contribution of this work is a new methodology to synchronize and measure the agreement against a gold standard of two or more devices measuring HR at different and not necessarily even paces.

Validity of the activPAL monitor to measure stepping activity and activity intensity: A systematic review

BACKGROUND

Accumulating step counts and engaging in moderate-to-vigorous intensity physical activity is positively associated with numerous health benefits. The activPAL is a thigh-worn monitor that is frequently used to measure physical activity.

RESEARCH QUESTION

Can the activPAL accurately measure stepping activity and identify physical activity intensity?

METHODS

We systematically reviewed validation studies examining the accuracy of activPAL physical activity outcomes relative to a criterion measure in adults (>18 years). Citations were not restricted to language or date of publication. Sources were searched up to May 16, 2021 and included Scopus, EMBASE, MEDLINE, CINAHL, and Academic Search Premier. The study was pre-registered in Prospero (ID# CRD42021248240). Study quality was determined using a modified Hagströmer Bowles checklist.

RESULTS

Thirty-nine studies (20 laboratory arms, 17 semi-structured arms, 11 uncontrolled protocol arms; 1272 total participants) met the inclusion criteria. Most studies demonstrated a high validity of the activPAL to measure steps across laboratory (12/15 arms), semi-structured (10/13 arms) and uncontrolled conditions (5/7 arms). Studies that demonstrated low validity were generally conducted in unhealthy populations, included slower walking speeds, and/or short walking distances. Few studies indicated that the activPAL accurately measured physical activity intensity across laboratory (0/6 arms), semi-structured (0/5 arms) and uncontrolled conditions (2/5 arms). Using the default settings, the activPAL overestimates light-intensity activity but underestimates moderate-to-vigorous intensity activity. The overall study quality was 11.5 ± 2.0 out of 19.

CONCLUSION

Despite heterogeneous methodological and statistical approaches, the included studies generally provide supporting evidence that the activPAL can accurately detect stepping activity but not physical activity intensity. Strategies that use alternative data processing methods have been developed to better characterize physical activity intensity, but all methods still underestimate vigorous-intensity activity.

Validity of the Polar H10 Sensor for Heart Rate Variability Analysis during Resting State and Incremental Exercise in Recreational Men and Women

Heart rate variability (HRV) is frequently applied in sport-specific settings. The rising use of freely accessible applications for its recording requires validation processes to ensure accurate data. It is the aim of this study to compare the HRV data obtained by the Polar H10 sensor chest strap device and an electrocardiogram (ECG) with the focus on RR intervals and short-term scaling exponent alpha 1 of Detrended Fluctuation Analysis (DFA a1) as non-linear metric of HRV analysis. A group of 25 participants performed an exhaustive cycling ramp with measurements of HRV with both recording systems. Average time between heartbeats (RR), heart rate (HR) and DFA a1 were recorded before (PRE), during, and after (POST) the exercise test. High correlations were found for the resting conditions (PRE: r = 0.95, rc = 0.95, ICC3,1 = 0.95, POST: r = 0.86, rc = 0.84, ICC3,1 = 0.85) and for the incremental exercise (r > 0.93, rc > 0.93, ICC3,1 > 0.93). While PRE and POST comparisons revealed no differences, significant bias could be found during the exercise test for all variables (p < 0.001). For RR and HR, bias and limits of agreement (LoA) in the Bland−Altman analysis were minimal (RR: bias of 0.7 to 0.4 ms with LoA of 4.3 to −2.8 ms during low intensity and 1.3 to −0.5 ms during high intensity, HR: bias of −0.1 to −0.2 ms with LoA of 0.3 to −0.5 ms during low intensity and 0.4 to −0.7 ms during high intensity). DFA a1 showed wider bias and LoAs (bias of 0.9 to 8.6% with LoA of 11.6 to −9.9% during low intensity and 58.1 to −40.9% during high intensity). Linear HRV measurements derived from the Polar H10 chest strap device show strong agreement and small bias compared with ECG recordings and can be recommended for practitioners. However, with respect to DFA a1, values in the uncorrelated range and during higher exercise intensities tend to elicit higher bias and wider LoA.

Detecting beats in the photoplethysmogram: benchmarking open-source algorithms

The photoplethysmogram (PPG) signal is widely used in pulse oximeters and smartwatches. A fundamental step in analysing the PPG is the detection of heartbeats. Several PPG beat detection algorithms have been proposed, although it is not clear which performs best.

OBJECTIVE

This study aimed to: (i) develop a framework with which to design and test PPG beat detectors; (ii) assess the performance of PPG beat detectors in different use cases; and (iii) investigate how their performance is affected by patient demographics and physiology.

APPROACH

Fifteen beat detectors were assessed against electrocardiogram-derived heartbeats using data from eight datasets. Performance was assessed using the F1 score, which combines sensitivity and positive predictive value.

MAIN RESULTS

Eight beat detectors performed well in the absence of movement, with F1 scores of ≥90\% on hospital data and wearable data collected at rest. Their performance was poorer during exercise, with F1 scores of 55-91\%; poorer in neonates than adults with F1 scores of 84-96\% in neonates compared to 98-99\% in adults; and poorer in atrial fibrillation (AF), with F1 scores of 92-97\% in AF, compared to 99-100\% in normal sinus rhythm.

SIGNIFICANCE

Two PPG beat detectors denoted 'MSPTD' and 'qppg' performed best, with complementary performance characteristics. This evidence can be used to inform the choice of PPG beat detector algorithm. The algorithms, datasets, and assessment framework are freely available.

Estimation of Heart Rate and Energy Expenditure Using a Smart Bracelet during Different Exercise Intensities: A Reliability and Validity Study

Background. With wrist-worn wearables becoming increasingly available, it is important to understand their reliability and validity in different conditions. The primary objective of this study was to examine the reliability and validity of the Lexin Mio smart bracelet in measuring heart rate (HR) and energy expenditure (EE) in people with different physical activity levels exercising at different intensities. Methods. A total of 65 participants completed one maximal oxygen uptake test and two running exercise tests wearing the Mio smart bracelet, the Polar H10 HR band, and a gas-analysis system. Results. In terms of HR measurement reliability, the Mio smart bracelet showed good reliability in a left versus right test and good test−retest reliability (p > 0.05; mean absolute percentage error (MAPE) < 10%; intraclass correlation coefficient (ICC) > 0.4). For EE measurement, the Mio smart bracelet showed good reliability in a left versus right test, good test−retest reliability on the right (p > 0.05; MAPE > 10%; ICC > 0.4), and low test−retest reliability on the left (p > 0.05; MAPE > 10%; ICC < 0.4). Regarding validity, the Mio smart bracelet showed good validity for HR measurement (p > 0.05; MAPE < 10%; ICC > 0.4) and low validity for EE measurement (p < 0.05; MAPE > 10%; ICC < 0.4). Conclusion. The Lexin Mio smart bracelet showed good reliability and validity for HR measurement among people with different physical activity levels exercising at various exercise intensities in a laboratory setting. However, the smart bracelet showed good reliability and low validity for the estimation of EE.

Quality Evaluation of Free-living Validation Studies for the Assessment of 24-Hour Physical Behavior in Adults via Wearables: Systematic Review

Background

Wearable technology is a leading fitness trend in the growing commercial industry and an established method for collecting 24-hour physical behavior data in research studies. High-quality free-living validation studies are required to enable both researchers and consumers to make guided decisions on which study to rely on and which device to use. However, reviews focusing on the quality of free-living validation studies in adults are lacking.

Objective

This study aimed to raise researchers’ and consumers’ attention to the quality of published validation protocols while aiming to identify and compare specific consistencies or inconsistencies between protocols. We aimed to provide a comprehensive and historical overview of which wearable devices have been validated for which purpose and whether they show promise for use in further studies.

Methods

Peer-reviewed validation studies from electronic databases, as well as backward and forward citation searches (1970 to July 2021), with the following, required indicators were included: protocol must include real-life conditions, outcome must belong to one dimension of the 24-hour physical behavior construct (intensity, posture or activity type, and biological state), the protocol must include a criterion measure, and study results must be published in English-language journals. The risk of bias was evaluated using the Quality Assessment of Diagnostic Accuracy Studies-2 tool with 9 questions separated into 4 domains (patient selection or study design, index measure, criterion measure, and flow and time).

Results

Of the 13,285 unique search results, 222 (1.67%) articles were included. Most studies (153/237, 64.6%) validated an intensity measure outcome such as energy expenditure. However, only 19.8% (47/237) validated biological state and 15.6% (37/237) validated posture or activity-type outcomes. Across all studies, 163 different wearables were identified. Of these, 58.9% (96/163) were validated only once. ActiGraph GT3X/GT3X+ (36/163, 22.1%), Fitbit Flex (20/163, 12.3%), and ActivPAL (12/163, 7.4%) were used most often in the included studies. The percentage of participants meeting the quality criteria ranged from 38.8% (92/237) to 92.4% (219/237). On the basis of our classification tree to evaluate the overall study quality, 4.6% (11/237) of studies were classified as low risk. Furthermore, 16% (38/237) of studies were classified as having some concerns, and 72.9% (173/237) of studies were classified as high risk.

Conclusions

Overall, free-living validation studies of wearables are characterized by low methodological quality, large variability in design, and focus on intensity. Future research should strongly aim at biological state and posture or activity outcomes and strive for standardized protocols embedded in a validation framework. Standardized protocols for free-living validation embedded in a framework are urgently needed to inform and guide stakeholders (eg, manufacturers, scientists, and consumers) in selecting wearables for self-tracking purposes, applying wearables in health studies, and fostering innovation to achieve improved validity.

Assessment of 24-hour physical behaviour in children and adolescents via wearables: a systematic review of free-living validation studies

Objectives

Studies that assess all three dimensions of the integrative 24-hour physical behaviour (PB) construct, namely, intensity, posture/activity type and biological state, are on the rise. However, reviews on validation studies that cover intensity, posture/activity type and biological state assessed via wearables are missing.

Design

Systematic review. The risk of bias was evaluated by using the QUADAS-2 tool with nine signalling questions separated into four domains (ie, patient selection/study design, index measure, criterion measure, flow and time).

Data sources

Peer-reviewed validation studies from electronic databases as well as backward and forward citation searches (1970–July 2021).

Eligibility criteria for selecting studies

Wearable validation studies with children and adolescents (age <18 years). Required indicators: (1) study protocol must include real-life conditions; (2) validated device outcome must belong to one dimension of the 24-hour PB construct; (3) the study protocol must include a criterion measure; (4) study results must be published in peer-reviewed English language journals.

Results

Out of 13 285 unique search results, 76 articles with 51 different wearables were included and reviewed. Most studies (68.4%) validated an intensity measure outcome such as energy expenditure, but only 15.9% of studies validated biological state outcomes, while 15.8% of studies validated posture/activity type outcomes. We identified six wearables that had been used to validate outcomes from two different dimensions and only two wearables (ie, ActiGraph GT1M and ActiGraph GT3X+) that validated outcomes from all three dimensions. The percentage of studies meeting a given quality criterion ranged from 44.7% to 92.1%. Only 18 studies were classified as ‘low risk’ or ‘some concerns’.

Summary

Validation studies on biological state and posture/activity outcomes are rare in children and adolescents. Most studies did not meet published quality principles. Standardised protocols embedded in a validation framework are needed.

PROSPERO registration number

CRD42021230894.

Establishing best practices in photoplethysmography signal acquisition and processing

Photoplethysmography is now widely utilised by clinical devices such as pulse oximeters, and wearable devices such as smartwatches. It holds great promise for health monitoring in daily life. This editorial considers whether it would be possible and beneficial to establish best practices for photoplethysmography signal acquisition and processing. It reports progress made towards this, balanced with the challenges of working with a diverse range of photoplethysmography device designs and intended applications, each of which could benefit from different approaches to signal acquisition and processing. It concludes that there are several potential benefits to establishing best practices. However, it is not yet clear whether it is possible to establish best practices which hold across the range of photoplethysmography device designs and applications.

Wearable activity trackers-advanced technology or advanced marketing?

Wearable devices represent one of the most popular trends in health and fitness. Rapid advances in wearable technology present a dizzying display of possible functions: from thermometers and barometers, magnetometers and accelerometers, to oximeters and calorimeters. Consumers and practitioners utilize wearable devices to track outcomes, such as energy expenditure, training load, step count, and heart rate. While some rely on these devices in tandem with more established tools, others lean on wearable technology for health-related outcomes, such as heart rhythm analysis, peripheral oxygen saturation, sleep quality, and caloric expenditure. Given the increasing popularity of wearable devices for both recreation and health initiatives, understanding the strengths and limitations of these technologies is increasingly relevant. Need exists for continued evaluation of the efficacy of wearable devices to accurately and reliably measure purported outcomes. The purposes of this review are (1) to assess the current state of wearable devices using recent research on validity and reliability, (2) to describe existing gaps between physiology and technology, and (3) to offer expert interpretation for the lay and professional audience on how best to approach wearable technology and employ it in the pursuit of health and fitness. Current literature demonstrates inconsistent validity and reliability for various metrics, with algorithms not publicly available or lacking high-quality validation studies. Advancements in wearable technology should consider standardizing validation metrics, providing transparency in used algorithms, and improving how technology can be tailored to individuals. Until then, it is prudent to exercise caution when interpreting metrics reported from consumer-wearable devices.

Wearable Photoplethysmography for Cardiovascular Monitoring

Smart wearables provide an opportunity to monitor health in daily life and are emerging as potential tools for detecting cardiovascular disease (CVD). Wearables such as fitness bands and smartwatches routinely monitor the photoplethysmogram signal, an optical measure of the arterial pulse wave that is strongly influenced by the heart and blood vessels. In this survey, we summarize the fundamentals of wearable photoplethysmography and its analysis, identify its potential clinical applications, and outline pressing directions for future research in order to realize its full potential for tackling CVD.

The Movesense Medical Sensor Chest Belt Device as Single Channel ECG for RR Interval Detection and HRV Analysis during Resting State and Incremental Exercise: A Cross-Sectional Validation Study

The value of heart rate variability (HRV) in the fields of health, disease, and exercise science has been established through numerous investigations. The typical mobile-based HRV device simply records interbeat intervals, without differentiation between noise or arrythmia as can be done with an electrocardiogram (ECG). The intent of this report is to validate a new single channel ECG device, the Movesense Medical sensor, against a conventional 12 channel ECG. A heterogeneous group of 21 participants performed an incremental cycling ramp to failure with measurements of HRV, before (PRE), during (EX), and after (POST). Results showed excellent correlations between devices for linear indexes with Pearson's r between 0.98 to 1.0 for meanRR, SDNN, RMSSD, and 0.95 to 0.97 for the non-linear index DFA a1 during PRE, EX, and POST. There was no significant difference in device specific meanRR during PRE and POST. Bland-Altman analysis showed high agreement between devices (PRE and POST: meanRR bias of 0.0 and 0.4 ms, LOA of 1.9 to -1.8 ms and 2.3 to -1.5; EX: meanRR bias of 11.2 to 6.0 ms; LOA of 29.8 to -7.4 ms during low intensity exercise and 8.5 to 3.5 ms during high intensity exercise). The Movesense Medical device can be used in lieu of a reference ECG for the calculation of HRV with the potential to differentiate noise from atrial fibrillation and represents a significant advance in both a HR and HRV recording device in a chest belt form factor for lab-based or remote field-application.

Validity of Estimating the Maximal Oxygen Consumption by Consumer Wearables: A Systematic Review with Meta-analysis and Expert Statement of the INTERLIVE Network

Background

Technological advances have recently made possible the estimation of maximal oxygen consumption (VO_2max) by consumer wearables. However, the validity of such estimations has not been systematically summarized using meta-analytic methods and there are no standards guiding the validation protocols.

Objective

The aim was to (1) quantitatively summarize previous studies investigating the validity of the VO_2max estimated by consumer wearables and (2) provide best-practice recommendations for future validation studies.

Methods

First, we conducted a systematic review and meta-analysis of studies validating the estimation of VO_2max by wearables. Second, based on the state of knowledge (derived from the systematic review) combined with the expert discussion between the members of the Towards Intelligent Health and Well-Being Network of Physical Activity Assessment (INTERLIVE) consortium, we provided a set of best-practice recommendations for validation protocols.

Results

Fourteen validation studies were included in the systematic review and meta-analysis. Meta-analysis results revealed that wearables using resting condition information in their algorithms significantly overestimated VO_2max (bias 2.17 ml·kg⁻¹·min⁻¹; limits of agreement − 13.07 to 17.41 ml·kg⁻¹·min⁻¹), while devices using exercise-based information in their algorithms showed a lower systematic and random error (bias − 0.09 ml·kg⁻¹·min⁻¹; limits of agreement − 9.92 to 9.74 ml·kg⁻¹·min⁻¹). The INTERLIVE consortium proposed six key domains to be considered for validating wearable devices estimating VO_2max, concerning the following: the target population, reference standard, index measure, testing conditions, data processing, and statistical analysis.

Conclusions

Our meta-analysis suggests that the estimations of VO_2max by wearables that use exercise-based algorithms provide higher accuracy than those based on resting conditions. The exercise-based estimation seems to be optimal for measuring VO_2max at the population level, yet the estimation error at the individual level is large, and, therefore, for sport/clinical purposes these methods still need improvement. The INTERLIVE network hereby provides best-practice recommendations to be used in future protocols to move towards a more accurate, transparent and comparable validation of VO_2max derived from wearables.

PROSPERO ID

CRD42021246192.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40279-021-01639-y.

Caveats and Recommendations to Assess the Validity and Reliability of Cycling Power Meters: A Systematic Scoping Review

A large number of power meters have become commercially available during the last decades to provide power output (PO) measurement. Some of these power meters were evaluated for validity in the literature. This study aimed to perform a review of the available literature on the validity of cycling power meters. PubMed, SPORTDiscus, and Google Scholar have been explored with PRISMA methodology. A total of 74 studies have been extracted for the reviewing process. Validity is a general quality of the measurement determined by the assessment of different metrological properties: Accuracy, sensitivity, repeatability, reproducibility, and robustness. Accuracy was most often studied from the metrological property (74 studies). Reproducibility was the second most studied (40 studies) property. Finally, repeatability, sensitivity, and robustness were considerably less studied with only 7, 5, and 5 studies, respectively. The SRM power meter is the most used as a gold standard in the studies. Moreover, the number of participants was very different among them, from 0 (when using a calibration rig) to 56 participants. The PO tested was up to 1700 W, whereas the pedalling cadence ranged between 40 and 180 rpm, including submaximal and maximal exercises. Other exercise conditions were tested, such as torque, position, temperature, and vibrations. This review provides some caveats and recommendations when testing the validity of a cycling power meter, including all of the metrological properties (accuracy, sensitivity, repeatability, reproducibility, and robustness) and some exercise conditions (PO range, sprint, pedalling cadence, torque, position, participant, temperature, vibration, and field test).

Recommendations for Determining the Validity of Consumer Wearables and Smartphones for the Estimation of Energy Expenditure: Expert Statement and Checklist of the INTERLIVE Network

BACKGROUND

Consumer wearables and smartphone devices commonly offer an estimate of energy expenditure (EE) to assist in the objective monitoring of physical activity to the general population. Alongside consumers, healthcare professionals and researchers are seeking to utilise these devices for the monitoring of training and improving human health. However, the methods of validation and reporting of EE estimation in these devices lacks rigour, negatively impacting on the ability to make comparisons between devices and provide transparent accuracy.

OBJECTIVES

The Towards Intelligent Health and Well-Being Network of Physical Activity Assessment (INTERLIVE) is a joint European initiative of six universities and one industrial partner. The network was founded in 2019 and strives towards developing best-practice recommendations for evaluating the validity of consumer wearables and smartphones. This expert statement presents a best-practice validation protocol for consumer wearables and smartphones in the estimation of EE.

METHODS

The recommendations were developed through (1) a systematic literature review; (2) an unstructured review of the wider literature discussing the potential factors that may introduce bias during validation studies; and (3) evidence-informed expert opinions from members of the INTERLIVE network.

RESULTS

The systematic literature review process identified 1645 potential articles, of which 62 were deemed eligible for the final dataset. Based on these studies and the wider literature search, a validation framework is proposed encompassing six key domains for validation: the target population, criterion measure, index measure, testing conditions, data processing and the statistical analysis.

CONCLUSIONS

The INTERLIVE network recommends that the proposed protocol, and checklists provided, are used to standardise the testing and reporting of the validation of any consumer wearable or smartphone device to estimate EE. This in turn will maximise the potential utility of these technologies for clinicians, researchers, consumers, and manufacturers/developers, while ensuring transparency, comparability, and replicability in validation.

TRIAL REGISTRATION

PROSPERO ID: CRD42021223508.

Heart Rate and Distance Measurement of Two Multisport Activity Trackers and a Cellphone App in Different Sports: A Cross-Sectional Validation and Comparison Field Study

Options for monitoring sports have been continuously developed by using activity trackers to determine almost all vital and movement parameters. The aim of this study was to validate heart rate and distance measurements of two activity trackers (Polar Ignite; Garmin Forerunner 945) and a cellphone app (Polar Beat app using iPhone 7 as a hardware platform) in a cross-sectional field study. Thirty-six moderate endurance-trained adults (20 males/16 females) completed a test battery consisting of walking and running 3 km, a 1.6 km interval run (standard 400 m outdoor stadium), 3 km forest run (outdoor), 500/1000 m swim and 4.3/31.5 km cycling tests. Heart rate was recorded via a Polar H10 chest strap and distance was controlled via a map, 400 m stadium or 50 m pool. For all tests except swimming, strong correlation values of r > 0.90 were calculated with moderate exercise intensity and a mean absolute percentage error of 2.85%. During the interval run, several significant deviations (p < 0.049) were observed. The swim disciplines showed significant differences (p < 0.001), with the 500 m test having a mean absolute percentage error of 8.61%, and the 1000 m test of 55.32%. In most tests, significant deviations (p < 0.001) were calculated for distance measurement. However, a maximum mean absolute percentage error of 4.74% and small mean absolute error based on the total route lengths were calculated. This study showed that the accuracy of heart rate measurements could be rated as good, except for rapid changing heart rate during interval training and swimming. Distance measurement differences were rated as non-relevant in practice for use in sports.

Monitoring Physical Activity Intensity During Pregnancy

For apparently healthy pregnant women, regular physical activity is recommended. The American College of Obstetricians and Gynecologists (ACOG) created recommendations for physical activity and exercise during pregnancy in 1985. At that time, pregnant women were advised to not exceed a heart rate of 140 beats per minute with physical activity. The heart rate recommendation was subsequently removed with the recommendations published in 1994, 2002, and 2015. In 2020, the ACOG updated its recommendations on physical activity for pregnant and postpartum women. The recommendation included exercising at a "fairly light to somewhat hard" perceived intensity and at less than 60-80% of age-predicted maximum heart rate, usually not exceeding a heart rate of 140 beats per minute. Women often seek advice from healthcare providers on physical activity during pregnancy, yet providers report concern about giving appropriate physical activity guidance. This paper summarizes the key scientific literature on monitoring absolute and relative exercise intensity in relation to the current ACOG recommendations, providing background on intensity-related concepts used in the recommendation. This paper also provides practical guidance to assist healthcare providers in relaying this information to pregnant women.

Establishing a Global Standard for Wearable Devices in Sport and Exercise Medicine: Perspectives from Academic and Industry Stakeholders

Millions of consumer sport and fitness wearables (CSFWs) are used worldwide, and millions of datapoints are generated by each device. Moreover, these numbers are rapidly growing, and they contain a heterogeneity of devices, data types, and contexts for data collection. Companies and consumers would benefit from guiding standards on device quality and data formats. To address this growing need, we convened a virtual panel of industry and academic stakeholders, and this manuscript summarizes the outcomes of the discussion. Our objectives were to identify (1) key facilitators of and barriers to participation by CSFW manufacturers in guiding standards and (2) stakeholder priorities. The venues were the Yale Center for Biomedical Data Science Digital Health Monthly Seminar Series (62 participants) and the New England Chapter of the American College of Sports Medicine Annual Meeting (59 participants). In the discussion, stakeholders outlined both facilitators of (e.g., commercial return on investment in device quality, lucrative research partnerships, and transparent and multilevel evaluation of device quality) and barriers (e.g., competitive advantage conflict, lack of flexibility in previously developed devices) to participation in guiding standards. There was general agreement to adopt Keadle et al.'s standard pathway for testing devices (i.e., benchtop, laboratory, field-based, implementation) without consensus on the prioritization of these steps. Overall, there was enthusiasm not to add prescriptive or regulatory steps, but instead create a networking hub that connects companies to consumers and researchers for flexible guidance navigating the heterogeneity, multi-tiered development, dynamicity, and nebulousness of the CSFW field.

Validation of Gazepoint low-cost eye-tracking and psychophysiology bundle

Eye-tracking and recording of physiological signals are increasingly used in research within cognitive science and human–computer interaction. For example, gaze position and measures of autonomic arousal, including pupil dilation, skin conductance (SC), and heart rate (HR), provide an indicator of cognitive and physiological processes. The growing popularity of these techniques is partially driven by the emergence of low-cost recording equipment and the proliferation of open-source software for data collection and analysis of such signals. However, the use of new technology requires investigation of its reliability and validation with respect to real-world usage and against established technologies. Accordingly, in two experiments (total N = 69), we assessed the Gazepoint GP3-HD eye-tracker and Gazepoint Biometrics (GPB) system from Gazepoint. We show that the accuracy, precision, and robustness of the eye-tracker are comparable to competing systems. While fixation and saccade events can be reliably extracted, the study of saccade kinematics is affected by the low sampling rate. The GP3-HD is also able to capture psychological effects on pupil dilation in addition to the well-defined pupillary light reflex. Finally, moderate-to-strong correlations between physiological recordings and derived metrics of SC and HR between the GPB and the well-established BIOPAC MP160 support its validity. However, low amplitude of the SC signal obtained from the GPB may reduce sensitivity when separating phasic and tonic components. Similarly, data loss in pulse monitoring may pose difficulties for certain HR variability analyses.

HRS White Paper on Clinical Utilization of Digital Health Technology

This collaborative statement from the Digital Health Committee of the Heart Rhythm Society provides everyday clinical scenarios in which wearables may be utilized by patients for cardiovascular health and arrhythmia management. We describe herein the spectrum of wearables that are commercially available for patients, and their benefits, shortcomings and areas for technological improvement. Although wearables for rhythm diagnosis and management have not been examined in large randomized clinical trials, undoubtedly the usage of wearables has quickly escalated in clinical practice. This document is the first of a planned series in which we will update information on wearables as they are revised and released to consumers.

Measurement of Heart Rate Using the Polar OH1 and Fitbit Charge 3 Wearable Devices in Healthy Adults During Light, Moderate, Vigorous, and Sprint-Based Exercise: Validation Study

Background

Accurate, continuous heart rate measurements are important for health assessment, physical activity, and sporting performance, and the integration of heart rate measurements into wearable devices has extended its accessibility. Although the use of photoplethysmography technology is not new, the available data relating to the validity of measurement are limited, and the range of activities being performed is often restricted to one exercise domain and/or limited intensities.

Objective

The primary objective of this study was to assess the validity of the Polar OH1 and Fitbit Charge 3 devices for measuring heart rate during rest, light, moderate, vigorous, and sprint-type exercise.

Methods

A total of 20 healthy adults (9 female; height: mean 1.73 [SD 0.1] m; body mass: mean 71.6 [SD 11.0] kg; and age: mean 40 [SD 10] years) volunteered and provided written informed consent to participate in the study consisting of 2 trials. Trial 1 was split into 3 components: 15-minute sedentary activities, 10-minute cycling on a bicycle ergometer, and incremental exercise test to exhaustion on a motorized treadmill (18-42 minutes). Trial 2 was split into 2 components: 4 × 15-second maximal sprints on a cycle ergometer and 4 × 30- to 50-m sprints on a nonmotorized resistance treadmill. Data from the 3 devices were time-aligned, and the validity of Polar OH1 and Fitbit Charge 3 was assessed against Polar H10 (criterion device). Validity was evaluated using the Bland and Altman analysis, Pearson moment correlation coefficient, and mean absolute percentage error.

Results

Overall, there was a very good correlation between the Polar OH1 and Polar H10 devices (r=0.95), with a mean bias of −1 beats·min^-1 and limits of agreement of −20 to 19 beats·min^-1. The Fitbit Charge 3 device underestimated heart rate by 7 beats·min^-1 compared with Polar H10, with a limit of agreement of −46 to 33 beats·min^-1 and poor correlation (r=0.8). The mean absolute percentage error for both devices was deemed acceptable (<5%). Polar OH1 performed well across each phase of trial 1; however, validity was worse for trial 2 activities. Fitbit Charge 3 performed well only during rest and nonsprint-based treadmill activities.

Conclusions

Compared with our criterion device, Polar OH1 was accurate at assessing heart rate, but the accuracy of Fitbit Charge 3 was generally poor. Polar OH1 performed worse during trial 2 compared with the activities in trial 1, and the validity of the Fitbit Charge 3 device was particularly poor during our cycling exercises.