Accuracy of the ActivPAL and Fitbit Charge 2 in measuring step count in Cystic Fibrosis

Open-Source, Step-Counting Algorithm for Smartphone Data Collected in Clinical and Nonclinical Settings: Algorithm Development and Validation Study

BACKGROUND

Step counts are increasingly used in public health and clinical research to assess well-being, lifestyle, and health status. However, estimating step counts using commercial activity trackers has several limitations, including a lack of reproducibility, generalizability, and scalability. Smartphones are a potentially promising alternative, but their step-counting algorithms require robust validation that accounts for temporal sensor body location, individual gait characteristics, and heterogeneous health states.

OBJECTIVE

Our goal was to evaluate an open-source, step-counting method for smartphones under various measurement conditions against step counts estimated from data collected simultaneously from different body locations ("cross-body" validation), manually ascertained ground truth ("visually assessed" validation), and step counts from a commercial activity tracker (Fitbit Charge 2) in patients with advanced cancer ("commercial wearable" validation).

METHODS

We used 8 independent data sets collected in controlled, semicontrolled, and free-living environments with different devices (primarily Android smartphones and wearable accelerometers) carried at typical body locations. A total of 5 data sets (n=103) were used for cross-body validation, 2 data sets (n=107) for visually assessed validation, and 1 data set (n=45) was used for commercial wearable validation. In each scenario, step counts were estimated using a previously published step-counting method for smartphones that uses raw subsecond-level accelerometer data. We calculated the mean bias and limits of agreement (LoA) between step count estimates and validation criteria using Bland-Altman analysis.

RESULTS

In the cross-body validation data sets, participants performed 751.7 (SD 581.2) steps, and the mean bias was -7.2 (LoA -47.6, 33.3) steps, or -0.5%. In the visually assessed validation data sets, the ground truth step count was 367.4 (SD 359.4) steps, while the mean bias was -0.4 (LoA -75.2, 74.3) steps, or 0.1%. In the commercial wearable validation data set, Fitbit devices indicated mean step counts of 1931.2 (SD 2338.4), while the calculated bias was equal to -67.1 (LoA -603.8, 469.7) steps, or a difference of 3.4%.

CONCLUSIONS

This study demonstrates that our open-source, step-counting method for smartphone data provides reliable step counts across sensor locations, measurement scenarios, and populations, including healthy adults and patients with cancer.

Validation of an open-source smartphone step counting algorithm in clinical and non-clinical settings

Background

Step counts are increasingly used in public health and clinical research to assess wellbeing, lifestyle, and health status. However, estimating step counts using commercial activity trackers has several limitations, including a lack of reproducibility, generalizability, and scalability. Smartphones are a potentially promising alternative, but their step-counting algorithms require robust validation that accounts for temporal sensor body location, individual gait characteristics, and heterogeneous health states.

Objective

Our goal was to evaluate an open-source step-counting method for smartphones under various measurement conditions against step counts estimated from data collected simultaneously from different body locations ("internal" validation), manually ascertained ground truth ("manual" validation), and step counts from a commercial activity tracker (Fitbit Charge 2) in patients with advanced cancer ("wearable" validation).

Methods

We used eight independent datasets collected in controlled, semi-controlled, and free-living environments with different devices (primarily Android smartphones and wearable accelerometers) carried at typical body locations. Five datasets (N=103) were used for internal validation, two datasets (N=107) for manual validation, and one dataset (N=45) used for wearable validation. In each scenario, step counts were estimated using a previously published step-counting method for smartphones that uses raw sub-second level accelerometer data. We calculated mean bias and limits of agreement (LoA) between step count estimates and validation criteria using Bland-Altman analysis.

Results

In the internal validation datasets, participants performed 751.7±581.2 (mean±SD) steps, and the mean bias was -7.2 steps (LoA -47.6, 33.3) or -0.5%. In the manual validation datasets, the ground truth step count was 367.4±359.4 steps while the mean bias was -0.4 steps (LoA -75.2, 74.3) or 0.1 %. In the wearable validation dataset, Fitbit devices indicated mean step counts of 1931.2±2338.4, while the calculated bias was equal to -67.1 steps (LoA -603.8, 469.7) or a difference of 0.3 %.

Conclusions

This study demonstrates that our open-source step counting method for smartphone data provides reliable step counts across sensor locations, measurement scenarios, and populations, including healthy adults and patients with cancer.

Reference Values for Wristband Accelerometry Data in Children Aged 6-11 Years of Age

OBJECTIVES

Wristband activity trackers (accelerometers) could serve as a convenient monitoring tool to continuously quantify physical activity throughout the day. We aim to provide reference values for the use of these devices in healthy children.

METHODS

Children were recruited at a local school and provided with activity trackers (Fitbit Charge 2). Pupils were instructed to wear devices during all normal daytime activities over a period of 11-15 days. Demographic data, total number of daily steps and heart rate were recorded. In addition, all children/parents were asked to complete a questionnaire providing information about daily physical routine (mode of transport to school, sporting activities as well as sport club memberships).

RESULTS

Three hundred two children (54.6% boys; median age 8.7 years) participated in this prospective study. Median wearing time of the device was 12.1 h/day. Overall, the median daily total step count was 12,095. Median step counts/day were significantly higher in boys compared to girls (13,015 vs. 11,305 steps/day; p < 0.0001). In addition, step counts were significantly higher during the week, compared to weekend days. The effect of age on daily step count was found to be non-linear: the total daily step count increased from 6 to 8.5 years of age, while older children (aged >8.5 years) had lower step counts compared to the younger children. Significant predictors of the daily step count were male gender (+1,324.9 steps, p = 0.0008), mode of transportation to school (walking, bicycle, scooter: +865.5 steps p = 0.049), active membership in a sports club (+1,324.9 steps/day, p = 0.0008), and number of structured units of physical exercise performed (+336.5/per 45 min, p < 0.0001). Severe obesity was associated with a significant reduction in total daily step count (-3037.7 steps/day, p = 0.015).

CONCLUSION

Our prospective cohort study of healthy school children provides reference values for wristband accelerometers in normal individuals. In addition, it clarifies the effect of age, body weight and lifestyle on normal daily step counts in school children. This data should be helpful to judge the degree of physical limitation of patients compared to healthy peers.