Balancing best practice and reality in behavioral intervention development: A survey of principal investigators funded by the National Institutes of Health

Preliminary studies play a prominent role in the development of large-scale behavioral interventions. Though recommendations exist to guide the execution and interpretation of preliminary studies, these assume optimal scenarios which may clash with realities faced by researchers. The purpose of this study was to explore how principal investigators (PIs) balance expectations when conducting preliminary studies. We surveyed PIs funded by the National Institutes of Health to conduct preliminary behavioral interventions between 2000 and 2020. Four hundred thirty-one PIs (19% response rate) completed the survey (November 2021 to January 2022, 72% female, mean 21 years post-terminal degree). Most PIs were aware of translational models and believed preliminary studies should precede larger trials but also believed a single preliminary study provided sufficient evidence to scale. When asked about the relative importance of preliminary efficacy (i.e. changes in outcomes) and feasibility (i.e. recruitment, acceptance/adherence) responses varied. Preliminary studies were perceived as necessary to successfully compete for research funding, but among PIs who had peer-reviewed federal-level grants applications (n = 343 [80%]), responses varied about what should be presented to secure funding. Confusion surrounding the definition of a successful, informative preliminary study poses a significant challenge when developing behavior interventions. This may be due to a mismatch between expectations surrounding preliminary studies and the realities of the research enterprise in which they are conducted. To improve the quality of preliminary studies and advance the field of behavioral interventions, additional funding opportunities, more transparent criteria in grant reviews, and additional training for grant reviewers are suggested.

Consolidated guidance for behavioral intervention pilot and feasibility studies

BACKGROUND

In the behavioral sciences, conducting pilot and/or feasibility studies (PFS) is a key step that provides essential information used to inform the design, conduct, and implementation of a larger-scale trial. There are more than 160 published guidelines, reporting checklists, frameworks, and recommendations related to PFS. All of these publications offer some form of guidance on PFS, but many focus on one or a few topics. This makes it difficult for researchers wanting to gain a broader understanding of all the relevant and important aspects of PFS and requires them to seek out multiple sources of information, which increases the risk of missing key considerations to incorporate into their PFS. The purpose of this study was to develop a consolidated set of considerations for the design, conduct, implementation, and reporting of PFS for interventions conducted in the behavioral sciences.

METHODS

To develop this consolidation, we undertook a review of the published guidance on PFS in combination with expert consensus (via a Delphi study) from the authors who wrote such guidance to inform the identified considerations. A total of 161 PFS-related guidelines, checklists, frameworks, and recommendations were identified via a review of recently published behavioral intervention PFS and backward/forward citation tracking of a well-known PFS literature (e.g., CONSORT Ext. for PFS). Authors of all 161 PFS publications were invited to complete a three-round Delphi survey, which was used to guide the creation of a consolidated list of considerations to guide the design, conduct, and reporting of PFS conducted by researchers in the behavioral sciences.

RESULTS

A total of 496 authors were invited to take part in the three-round Delphi survey (round 1, N = 46; round 2, N = 24; round 3, N = 22). A set of twenty considerations, broadly categorized into six themes (intervention design, study design, conduct of trial, implementation of intervention, statistical analysis, and reporting) were generated from a review of the 161 PFS-related publications as well as a synthesis of feedback from the three-round Delphi process. These 20 considerations are presented alongside a supporting narrative for each consideration as well as a crosswalk of all 161 publications aligned with each consideration for further reading.

CONCLUSION

We leveraged expert opinion from researchers who have published PFS-related guidelines, checklists, frameworks, and recommendations on a wide range of topics and distilled this knowledge into a valuable and universal resource for researchers conducting PFS. Researchers may use these considerations alongside the previously published literature to guide decisions about all aspects of PFS, with the hope of creating and disseminating interventions with broad public health impact.

The Day-Level Association Between Child Care Attendance and 24-Hour Movement Behaviors in Preschool-Aged Children

BACKGROUND

Twenty-four hour movement behaviors (ie, physical activity [PA], screen time [ST], and sleep) are associated with children's health outcomes. Identifying day-level contextual factors, such as child care, that positively influence children's movement behaviors may help identify potential intervention targets, like improving access to child care programs. This study aimed to examine the between- and within-person effects of child care on preschoolers' 24-hour movement behaviors.

METHODS

Children (N = 74, 4.7 [0.9] y, 48.9% girls, 63.3% White) wore an Axivity AX3 accelerometer on their nondominant wrist 24 hours per day for 14 days to measure PA and sleep. Parents completed surveys each night about their child's ST and child care attendance that day. Linear mixed effects models predicted day-level 24-hour movement behaviors from hours spent in child care.

RESULTS

Children spent an average of 5.0 (2.9) hours per day in child care. For every additional hour of child care above their average, children had 0.3 hours (95% CI, -0.3 to -0.2) less ST that day. Between-person effects showed that compared with children who attended fewer overall hours of child care, children who attended more hours had less overall ST (B = -0.2 h; 95% CI, -0.4 to 0.0). Child care was not significantly associated with PA or sleep.

CONCLUSIONS

Child care attendance was not associated with 24-hour PA or sleep; however, it was associated with less ST. More research utilizing objective measures of ST and more robust measures of daily schedules or structure is necessary to better understand how existing infrastructure may influence preschool-aged children's 24-hour movement behaviors. In addition, future research should consider how access to child care may influence child care attendance.

Understanding Accelerated Summer Body Mass Index Gain by Tracking Changes in Children's Height, Weight, and Body Mass Index Throughout the Year

Background: Drivers of summer body mass index (BMI) gain in children remain unclear. The Circadian and Circannual Rhythm Model (CCRM) posits summer BMI gain is biologically driven, while the Structured Days Hypothesis (SDH) proposes it is driven by reduced structure. Objectives: Identify the mechanisms driving children's seasonal BMI gain through the CCRM and SDH. Methods: Children's (N = 147, mean age = 8.2 years) height and weight were measured monthly during the school year, and once in summer (July-August). BMI z-score (zBMI) was calculated using CDC growth charts. Behaviors were measured once per season. Mixed methods regression estimated monthly percent change in children's height (%HΔ), weight (%WΔ), and monthly zBMI for school year vs. summer vacation, seasonally, and during school months with no breaks vs. school months with a break ≥1 week. Results: School year vs. summer vacation analyses showed accelerations in children's %WΔ (Δ = 0.9, Standard Error (SE) = 0.1 vs. Δ = 1.4, SE = 0.1) and zBMI (Δ = -0.01, SE = 0.01 vs. Δ = 0.04, SE = 0.3) during summer vacation, but %HΔ remained relatively constant during summer vacation compared with school (Δ = 0.3, SE = 0.0 vs. Δ = 0.4, SE = 0.1). Seasonal analyses showed summer had the greatest %WΔ (Δ = 1.8, SE = 0.4) and zBMI change (Δ = 0.05, SE = 0.03) while %HΔ was relatively constant across seasons. Compared with school months without a break, months with a break showed higher %WΔ (Δ = 0.7, SE = 0.1 vs. Δ = 1.6, SE = 0.2) and zBMI change (Δ = -0.03, SE = 0.01 vs. Δ = 0.04, SE = 0.01), but %HΔ was constant (Δ = 0.4, SE = 0.0 vs. Δ = 0.3, SE = 0.1). Fluctuations in sleep timing and screen time may explain these changes. Conclusions: Evidence for both the CCRM and SDH was identified but the SDH may more fully explain BMI gain. Interventions targeting consistent sleep and reduced screen time during breaks from school may be warranted no matter the season.

Comparison of raw accelerometry data from ActiGraph, Apple Watch, Garmin, and Fitbit using a mechanical shaker table

The purpose of this study was to evaluate the reliability and validity of the raw accelerometry output from research-grade and consumer wearable devices compared to accelerations produced by a mechanical shaker table. Raw accelerometry data from a total of 40 devices (i.e., n = 10 ActiGraph wGT3X-BT, n = 10 Apple Watch Series 7, n = 10 Garmin Vivoactive 4S, and n = 10 Fitbit Sense) were compared to reference accelerations produced by an orbital shaker table at speeds ranging from 0.6 Hz (4.4 milligravity-mg) to 3.2 Hz (124.7mg). Two-way random effects absolute intraclass correlation coefficients (ICC) tested inter-device reliability. Pearson product moment, Lin's concordance correlation coefficient (CCC), absolute error, mean bias, and equivalence testing were calculated to assess the validity between the raw estimates from the devices and the reference metric. Estimates from Apple, ActiGraph, Garmin, and Fitbit were reliable, with ICCs = 0.99, 0.97, 0.88, and 0.88, respectively. Estimates from ActiGraph, Apple, and Fitbit devices exhibited excellent concordance with the reference CCCs = 0.88, 0.83, and 0.85, respectively, while estimates from Garmin exhibited moderate concordance CCC = 0.59 based on the mean aggregation method. ActiGraph, Apple, and Fitbit produced similar absolute errors = 16.9mg, 21.6mg, and 22.0mg, respectively, while Garmin produced higher absolute error = 32.5mg compared to the reference. ActiGraph produced the lowest mean bias 0.0mg (95%CI = -40.0, 41.0). Equivalence testing revealed raw accelerometry data from all devices were not statistically significantly within the equivalence bounds of the shaker speed. Findings from this study provide evidence that raw accelerometry data from Apple, Garmin, and Fitbit devices can be used to reliably estimate movement; however, no estimates were statistically significantly equivalent to the reference. Future studies could explore device-agnostic and harmonization methods for estimating physical activity using the raw accelerometry signals from the consumer wearables studied herein.

Are the Risk of Generalizability Biases Generalizable? A Meta-Epidemiological Study

Background Preliminary studies (e.g., pilot/feasibility studies) can result in misleading evidence that an intervention is ready to be evaluated in a large-scale trial when it is not. Risk of Generalizability Biases (RGBs, a set of external validity biases) represent study features that influence estimates of effectiveness, often inflating estimates in preliminary studies which are not replicated in larger-scale trials. While RGBs have been empirically established in interventions targeting obesity, the extent to which RGBs generalize to other health areas is unknown. Understanding the relevance of RGBs across health behavior intervention research can inform organized efforts to reduce their prevalence. Purpose The purpose of our study was to examine whether RGBs generalize outside of obesity-related interventions. Methods A systematic review identified health behavior interventions across four behaviors unrelated to obesity that follow a similar intervention development framework of preliminary studies informing larger-scale trials (i.e., tobacco use disorder, alcohol use disorder, interpersonal violence, and behaviors related to increased sexually transmitted infections). To be included, published interventions had to be tested in a preliminary study followed by testing in a larger trial (the two studies thus comprising a study pair). We extracted health-related outcomes and coded the presence/absence of RGBs. We used meta-regression models to estimate the impact of RGBs on the change in standardized mean difference (ΔSMD) between the preliminary study and larger trial. Results We identified sixty-nine study pairs, of which forty-seven were eligible for inclusion in the analysis (k = 156 effects), with RGBs identified for each behavior. For pairs where the RGB was present in the preliminary study but removed in the larger trial the treatment effect decreased by an average of ΔSMD=-0.38 (range - 0.69 to -0.21). This provides evidence of larger drop in effectiveness for studies containing RGBs relative to study pairs with no RGBs present (treatment effect decreased by an average of ΔSMD =-0.24, range - 0.19 to -0.27). Conclusion RGBs may be associated with higher effect estimates across diverse areas of health intervention research. These findings suggest commonalities shared across health behavior intervention fields may facilitate introduction of RGBs within preliminary studies, rather than RGBs being isolated to a single health behavior field.

The utility of behavioral biometrics in user authentication and demographic characteristic detection: a scoping review

BACKGROUND

Objective measures of screen time are necessary to better understand the complex relationship between screen time and health outcomes. However, current objective measures of screen time (e.g., passive sensing applications) are limited in identifying the user of the mobile device, a critical limitation in children's screen time research where devices are often shared across a family. Behavioral biometrics, a technology that uses embedded sensors on modern mobile devices to continuously authenticate users, could be used to address this limitation.

OBJECTIVE

The purpose of this scoping review was to summarize the current state of behavioral biometric authentication and synthesize these findings within the scope of applying behavioral biometric technology to screen time measurement.

METHODS

We systematically searched five databases (Web of Science Core Collection, Inspec in Engineering Village, Applied Science & Technology Source, IEEE Xplore, PubMed), with the last search in September of 2022. Eligible studies were on the authentication of the user or the detection of demographic characteristics (age, gender) using built-in sensors on mobile devices (e.g., smartphone, tablet). Studies were required to use the following methods for authentication: motion behavior, touch, keystroke dynamics, and/or behavior profiling. We extracted study characteristics (sample size, age, gender), data collection methods, data stream, model evaluation metrics, and performance of models, and additionally performed a study quality assessment. Summary characteristics were tabulated and compiled in Excel. We synthesized the extracted information using a narrative approach.

RESULTS

Of the 14,179 articles screened, 122 were included in this scoping review. Of the 122 included studies, the most highly used biometric methods were touch gestures (n = 76) and movement (n = 63), with 30 studies using keystroke dynamics and 6 studies using behavior profiling. Of the studies that reported age (47), most were performed exclusively in adult populations (n = 34). The overall study quality was low, with an average score of 5.5/14.

CONCLUSION

The field of behavioral biometrics is limited by the low overall quality of studies. Behavioral biometric technology has the potential to be used in a public health context to address the limitations of current measures of screen time; however, more rigorous research must be performed in child populations first.

SYSTEMATIC REVIEW REGISTRATION

The protocol has been pre-registered in the Open Science Framework database ( https://doi.org/10.17605/OSF.IO/92YCT ).

A Device Agnostic Approach to Predict Children's Activity from Consumer Wearable Accelerometer Data: A Proof-of-Concept Study

INTRODUCTION

This study examined the potential of a device agnostic approach for predicting physical activity from consumer wearable accelerometry compared with a research-grade accelerometry.

METHODS

Seventy-five 5- to 12-year-olds (58% male, 63% White) participated in a 60-min protocol. Children wore wrist-placed consumer wearables (Apple Watch Series 7 and Garmin Vivoactive 4) and a research-grade device (ActiGraph GT9X) concurrently with an indirect calorimeter (COSMED K5). Activity intensities (i.e., inactive, light, moderate-to-vigorous physical activity) were estimated via indirect calorimetry (criterion), and the Hildebrand thresholds were applied to the raw accelerometer data from the consumer wearables and research-grade device. Epoch-by-epoch (e.g., weighted sensitivity, specificity) and discrepancy (e.g., mean bias, absolute error) analyses evaluated agreement between accelerometry-derived and criterion estimates. Equivalence testing evaluated the equivalence of estimates produced by the consumer wearables and ActiGraph.

RESULTS

Estimates produced by the raw accelerometry data from ActiGraph, Apple, and Garmin produced similar criterion agreement with weighted sensitivity = 68.2% (95% confidence interval (CI), 67.1%-69.3%), 73.0% (95% CI, 71.8%-74.3%), and 66.6% (95% CI, 65.7%-67.5%), respectively, and weighted specificity = 84.4% (95% CI, 83.6%-85.2%), 82.0% (95% CI, 80.6%-83.4%), and 75.3% (95% CI, 74.7%-75.9%), respectively. Apple Watch produced the lowest mean bias (inactive, -4.0 ± 4.5; light activity, 2.1 ± 4.0) and absolute error (inactive, 4.9 ± 3.4; light activity, 3.6 ± 2.7) for inactive and light physical activity minutes. For moderate-to-vigorous physical activity, ActiGraph produced the lowest mean bias (1.0 ± 2.9) and absolute error (2.8 ± 2.4). No ActiGraph and consumer wearable device estimates were statistically significantly equivalent.

CONCLUSIONS

Raw accelerometry estimated inactive and light activity from wrist-placed consumer wearables performed similarly to, if not better than, a research-grade device, when compared with indirect calorimetry. This proof-of-concept study highlights the potential of device-agnostic methods for quantifying physical activity intensity via consumer wearables.

A comparison of perceived barriers to optimal child sleep among families with low and high income

OBJECTIVE

Families with low-income experience suboptimal sleep compared to families with higher-income. Unique drivers likely contribute to these disparities, along with factors that universally impede sleep patterns, despite income level. To inform intervention tailoring, this mixed-methods study gathered parent's perceptions about child sleep challenges to identify similarities/differences in families with lower-income and higher-income.

METHODS

Parents who experienced difficulties with their child (ages 2-4years) sleep were categorized as lower income (n = 15; $30,000 ± 17,845/year) or higher income (n = 15; $142,400 ± 61,373/year). Parents completed a survey and semistructured interview to explore barriers and facilitators for child sleep. Two coders independently evaluated transcripts for lower-income and higher-income groups using inductive analyses. Constant-comparison methods generated themes and characterized similarities/differences by income group.

RESULTS

Groups were similar in themes related to diverse bedtime routines, nighttime struggles with child sleep, parent strategies to reduce night wakings, parent effort to provide a sleep-promoting environment, and presence of electronic rules. Groups differed in themes related to factors influencing routine setting (eg, lower income: external factors influencing routines; higher income: personal attributes for structure), parent appraisal of child sleep (eg, higher income: ambivalence; lower income: mostly negative appraisal), nap timing and duration (eg, lower income: longer naps), and strategy utilization and pursuit of resources (eg, higher income: more parents tried various strategies and accessed online/print resources).

CONCLUSIONS

Parents experienced many similar barriers to child sleep, with a few distinct differences by income group. These findings can inform future intervention components for all families, as well as customized components to address the unique needs of families across income levels.

Estimating Physical Activity and Sleep using the Combination of Movement and Heart Rate: A Systematic Review and Meta-Analysis

The purpose of this meta-analysis was to quantify the difference in physical activity and sleep estimates assessed via 1) movement, 2) heart rate (HR), or 3) the combination of movement and HR (MOVE+HR) compared to criterion indicators of the outcomes. Searches in four electronic databases were executed September 21-24 of 2021. Weighted mean was calculated from standardized group-level estimates of mean percent error (MPE) and mean absolute percent error (MAPE) of the proxy signal compared to the criterion measurement method for physical activity, HR, or sleep. Standardized mean difference (SMD) effect sizes between the proxy and criterion estimates were calculated for each study across all outcomes, and meta-regression analyses were conducted. Two-One-Sided-Tests method were conducted to metaanalytically evaluate the equivalence of the proxy and criterion. Thirty-nine studies (physical activity k = 29 and sleep k = 10) were identified for data extraction. Sample size weighted means for MPE were -38.0%, 7.8%, -1.4%, and -0.6% for physical activity movement only, HR only, MOVE+HR, and sleep MOVE+HR, respectively. Sample size weighted means for MAPE were 41.4%, 32.6%, 13.3%, and 10.8% for physical activity movement only, HR only, MOVE+HR, and sleep MOVE+HR, respectively. Few estimates were statistically equivalent at a SMD of 0.8. Estimates of physical activity from MOVE+HR were not statistically significantly different from estimates based on movement or HR only. For sleep, included studies based their estimates solely on the combination of MOVE+HR, so it was impossible to determine if the combination produced significantly different estimates than either method alone.

Expert Perspectives on Pilot and Feasibility Studies: A Delphi Study and Consolidation of Considerations for Behavioral Interventions

Background

In the behavioral sciences, conducting pilot and/or feasibility studies (PFS) is a key step that provides essential information used to inform the design, conduct, and implementation of a larger-scale trial. There are more than 160 published guidelines, reporting checklists, frameworks, and recommendations related to PFS. All of these publications offer some form of guidance on PFS, but many focus on one or a few topics. This makes it difficult for researchers wanting to gain a broader understanding of all the relevant and important aspects of PFS and requires them to seek out multiple sources of information, which increases the risk of missing key considerations to incorporate into their PFS. The purpose of this study was to develop a consolidated set of considerations for the design, conduct, implementation, and reporting of PFS for interventions conducted in the behavioral sciences.

Methods

To develop this consolidation, we undertook a review of the published guidance on PFS in combination with expert consensus (via a Delphi study) from the authors who wrote such guidance to inform the identified considerations. A total of 161 PFS-related guidelines, checklists, frameworks, and recommendations were identified via a review of recently published behavioral intervention PFS and backward/forward citation tracking of well-know PFS literature (e.g., CONSORT Ext. for PFS). Authors of all 161 PFS publications were invited to complete a three-round Delphi survey, which was used to guide the creation of a consolidated list of considerations to guide the design, conduct, and reporting of PFS conducted by researchers in the behavioral sciences.

Results

A total of 496 authors were invited to take part in the Delphi survey, 50 (10.1%) of which completed all three rounds, representing 60 (37.3%) of the 161 identified PFS-related guidelines, checklists, frameworks, and recommendations. A set of twenty considerations, broadly categorized into six themes (Intervention Design, Study Design, Conduct of Trial, Implementation of Intervention, Statistical Analysis and Reporting) were generated from a review of the 161 PFS-related publications as well as a synthesis of feedback from the three-round Delphi process. These 20 considerations are presented alongside a supporting narrative for each consideration as well as a crosswalk of all 161 publications aligned with each consideration for further reading.

Conclusion

We leveraged expert opinion from researchers who have published PFS-related guidelines, checklists, frameworks, and recommendations on a wide range of topics and distilled this knowledge into a valuable and universal resource for researchers conducting PFS. Researchers may use these considerations alongside the previously published literature to guide decisions about all aspects of PFS, with the hope of creating and disseminating interventions with broad public health impact.

Free Summer Day Camp to Address Childhood Obesity: Is There Demand?

Children from low-income households, and who are overweight or obese (OWOB), are at risk of accelerated weight gain during summer. Summer day camps (SDCs) have the potential to mitigate accelerated weight gain during summer as these settings can positively influence children's obesogenic behaviors (i.e., increase physical activity); however, barriers exist to attending, most notably cost. Little is known on whether low-income caregivers of children with OWOB would be interested in having their child attend SDC for free. Caregivers (n = 109, 82% mother respondents, >75% Medicaid and Minority Household) with a child attending pediatric endocrinology clinics completed a one-page survey to explore demand. Approximately 66% of respondents expressed interest for their child to attend SDC for free. Providing free SDC for children with OWOB and from low-income households is a possible strategy to tackle childhood obesity during summer.

Are parent-reported sleep logs essential? A comparison of three approaches to guide open source accelerometry-based nocturnal sleep processing in children

We examined the comparability of children's nocturnal sleep estimates using accelerometry data, processed with and without a sleep log. In a secondary analysis, we evaluated factors associated with disagreement between processing approaches. Children (n = 722, age 5-12 years) wore a wrist-based accelerometer for 14 days during Autumn 2020, Spring 2021, and/or Summer 2021. Outcomes included sleep period, duration, wake after sleep onset (WASO), and timing (onset, midpoint, waketime). Parents completed surveys including children's nightly bed/wake time. Data were processed with parent-reported bed/wake time (sleep log), the Heuristic algorithm looking at Distribution of Change in Z-Angle (HDCZA) algorithm (no log), and an 8 p.m.-8 a.m. window (generic log) using the R-package 'GGIR' (version 2.6-4). Mean/absolute bias and limits of agreement were calculated and visualised with Bland-Altman plots. Associations between child, home, and survey characteristics and disagreement were examined with tobit regression. Just over half of nights demonstrated no difference in sleep period between sleep log and no log approaches. Among all nights, the sleep log approach produced longer sleep periods (9.3 min; absolute mean bias [AMB] = 28.0 min), shorter duration (1.4 min; AMB = 14.0 min), greater WASO (11.0 min; AMB = 15.4 min), and earlier onset (13.4 min; AMB = 17.4 min), midpoint (8.8 min; AMB = 15.3 min), and waketime (3.9 min; AMB = 14.8 min) than no log. Factors associated with discrepancies included smartphone ownership, bedroom screens, nontraditional parent work schedule, and completion on weekend/summer nights (range = 0.4-10.2 min). The generic log resulted in greater AMB among sleep outcomes. Small mean differences were observed between nights with and without a sleep log. Discrepancies existed on weekends, in summer, and for children with smartphones and screens in the bedroom.

What does it mean to use the mean? The impact of different data handling strategies on the proportion of children classified as meeting 24-hr movement guidelines and associations with overweight and obesity

Background

Despite the widespread endorsement of 24-hour movement guidelines (physical activity, sleep, screentime) for youth, no standardized processes for categorizing guideline achievement exists. The purpose of this study was to illustrate the impact of different data handling strategies on the proportion of children meeting 24-hour movement guidelines (24hrG) and associations with overweight and obesity.

Methods

A subset of 524 children (ages 5-12yrs) with complete 24-hour behavior measures on at least 10 days was used to compare the impact of data handling strategies on estimates of meeting 24hrG. Physical activity and sleep were measured via accelerometry. Screentime was measured via parent self-report. Comparison of meeting 24hrG were made using 1) average of behaviors across all days (AVG-24hr), 2) classifying each day and evaluating the percentage meeting 24hrG from 10-100% of their measured days (DAYS-24hr), and 3) the average of a random sample of 4 days across 10 iterations (RAND-24hr). A second subset of children (N=475) with height and weight data was used to explore the influence of each data handling strategy on children meeting guidelines and the odds of overweight/obesity via logistic regression.

Results

Classification for AVG-24hr resulted in 14.7% of participants meeting 24hrG. Classification for DAYS-24hr resulted in 63.5% meeting 24hrG on 10% of measured days with <1% meeting 24hrG on 100% of days. Classification for RAND-24hr resulted in 15.9% of participants meeting 24hrG. Across 10 iterations, 63.6% of participants never met 24hrG regardless of the days sampled, 3.4% always met 24hrG, with the remaining 33.0% classified as meeting 24hrG for at least one of the 10 random iterations of days. Using AVG-24hr as a strategy, meeting all three guidelines associated with lower odds of having overweight obesity (OR=0.38, p<0.05). The RAND-24hr strategy produced a range of odds from 0.27 to 0.56. Using the criteria of needing to meet 24hrG on 100% of days, meeting all three guidelines associated with the lowest odds of having overweight and obesity as well (OR=0.04, p<0.05).

Conclusions

Varying estimates of meeting the 24hrG and the odds of overweight and obesity results from different data handling strategies and days sampled.

Accuracy and Precision of Opportunistic Measures of Body Composition from the Tanita DC-430U

Background: It is essential to quantify the accuracy and precision of bioelectrical impedance (BIA)-estimated percent body fat (%BF) to better interpret community-based research findings that utilize opportunistic measures. Methods: Study 1 measured the accuracy of a new dual-frequency foot-to-foot BIA device (Tanita DC-430U) compared with dual-energy X-ray absorptiometry (DXA) among healthy elementary school-aged children (N = 50). Study 2 examined the precision of BIA %BF estimates within and between days among children and adults (N = 38). Results: Regarding accuracy, Tanita DC-430U underestimated %BF by 8.0 percentage points compared with DXA (20.6% vs. 28.5%), but correctly ranked children in terms of %BF. Differences in %BF between BIA and DXA were driven by lower BIA-estimated fat mass (7.8 kg vs. 9.9 kg, p < 0.05) and higher BIA-estimated fat-free mass (25.3 kg vs. 24.1 kg, p < 0.05). The absolute agreement between BIA and DXA for estimated %BF was moderate (concordance correlation coefficients = 0.53). Regarding precision, measures taken at the same time, but on different days (root mean square standard deviation [RMSD] = 0.42-0.74) were more precise than the measures taken at different times within a single day (RMSD = 1.04-1.10). Conclusion: The Tanita DC-430U substantially underestimated %BF compared with DXA, highlighting the need to assess accuracy of new BIA devices when they are introduced to the market. Opportunistic measures of %BF estimates were most precise when taken at consistent times and in the morning, but may be utilized throughout the day with an understanding of within- and between-day variability.

Use of guidelines, checklists, frameworks, and recommendations in behavioral intervention preliminary studies and associations with reporting comprehensiveness: a scoping bibliometric review

BACKGROUND

Guidelines, checklists, frameworks, and recommendations (GCFRs) related to preliminary studies serve as essential resources to assist behavioral intervention researchers in reporting findings from preliminary studies, but their impact on preliminary study reporting comprehensiveness is unknown. The purpose of this study was to conduct a scoping bibliometric review of recently published preliminary behavioral-focused intervention studies to (1) examine the prevalence of GCFR usage and (2) determine the associations between GCFR usage and reporting feasibility-related characteristics.

METHODS

A systematic search was conducted for preliminary studies of behavioral-focused interventions published between 2018 and 2020. Studies were limited to the top 25 journals publishing behavioral-focused interventions, text mined to identify usage of GCFRs, and categorized as either not citing GCFRs or citing ≥ 2 GCFRs (Citers). A random sample of non-Citers was text mined to identify studies which cited other preliminary studies that cited GCFRs (Indirect Citers) and those that did not (Never Citers). The presence/absence of feasibility-related characteristics was compared between Citers, Indirect Citers, and Never Citers via univariate logistic regression.

RESULTS

Studies (n = 4143) were identified, and 1316 were text mined to identify GCFR usage (n = 167 Citers). A random sample of 200 studies not citing a GCFR were selected and categorized into Indirect Citers (n = 71) and Never Citers (n = 129). Compared to Never Citers, Citers had higher odds of reporting retention, acceptability, adverse events, compliance, cost, data collection feasibility, and treatment fidelity (ORrange = 2.62-14.15, p < 0.005). Citers also had higher odds of mentioning feasibility in purpose statements, providing progression criteria, framing feasibility as the primary outcome, and mentioning feasibility in conclusions (ORrange = 6.31-17.04, p < 0.005) and lower odds of mentioning efficacy in purpose statements, testing for efficacy, mentioning efficacy in conclusions, and suggesting future testing (ORrange = 0.13-0.54, p < 0.05). Indirect Citers had higher odds of reporting acceptability and treatment fidelity (ORrange = 2.12-2.39, p < 0.05) but lower odds of testing for efficacy (OR = 0.36, p < 0.05) compared to Never Citers.

CONCLUSION

The citation of GCFRs is associated with greater reporting of feasibility-related characteristics in preliminary studies of behavioral-focused interventions. Researchers are encouraged to use and cite literature that provides guidance on design, implementation, analysis, and reporting to improve the comprehensiveness of reporting for preliminary studies.

Policy, systems, and environmental interventions addressing physical activity in early childhood education settings: A systematic review

Policy, systems, and environmental (PSE) approaches can facilitate physical activity in priority populations (e.g., racial and ethnic minority, low wealth groups) within early childhood education (ECE) settings. The purpose of this review was to 1) characterize the inclusion of priority populations within ECE physical activity interventions containing PSE approaches and 2) identify and describe interventions within these populations. Seven databases were systematically searched (January 2000-Febrary 2022) for ECE-based interventions focusing on children (0-6 years) that utilized at least one PSE approach. Eligible studies included a child physical activity or physical activity environment outcome and child or center-level population characteristics. Forty-four studies, representing 42 interventions were identified. For Aim 1, half of interventions included one PSE approach (21/42), with only 11/42 including three or more approaches. Physical environment changes [e.g., adding play equipment, modifying space (25/42)] were the most used PSE approaches followed by system [e.g., integrating activity into routines, (21/42)] and policy [e.g., outdoor time (20/42)] approaches. Nearly half of interventions were conducted in predominantly priority populations (18/42). Studies were primarily rated as good (51%) or fair (38%) methodological quality using the Downs and Black checklist. In Aim 2, of the 12 interventions assessing child physical activity in priority populations, 9/12 reported at least one physical activity outcome in the expected direction. Of the 11 interventions assessing the physical activity environment, 9/11 reported an effect in the expected direction. Findings indicate clear opportunities exist to target priority populations by incorporating PSE approaches in ECE physical activity interventions.

Evaluation of a device-agnostic approach to predict sleep from raw accelerometry data collected by Apple Watch Series 7, Garmin Vivoactive 4, and ActiGraph GT9X Link in children with sleep disruptions

GOAL AND AIMS

Evaluate the performance of a sleep scoring algorithm applied to raw accelerometry data collected from research-grade and consumer wearable actigraphy devices against polysomnography.

FOCUS METHOD/TECHNOLOGY

Automatic sleep/wake classification using the Sadeh algorithm applied to raw accelerometry data from ActiGraph GT9X Link, Apple Watch Series 7, and Garmin Vivoactive 4.

REFERENCE METHOD/TECHNOLOGY

Standard manual PSG sleep scoring.

SAMPLE

Fifty children with disrupted sleep (M = 8.5 years, range = 5-12 years, 42% Black, 64% male).

DESIGN

Participants underwent to single night lab polysomnography while wearing ActiGraph, Apple, and Garmin devices.

CORE ANALYTICS

Discrepancy and epoch-by-epoch analyses for sleep/wake classification (devices vs. polysomnography).

ADDITIONAL ANALYTICS AND EXPLORATORY ANALYSES

Equivalence testing for sleep/wake classification (research-grade actigraphy vs. commercial devices).

CORE OUTCOMES

Compared to polysomnography, accuracy, sensitivity, and specificity were 85.5, 87.4, and 76.8, respectively, for Actigraph; 83.7, 85.2, and 75.8, respectively, for Garmin; and 84.6, 86.2, and 77.2, respectively, for Apple. The magnitude and trend of bias for total sleep time, sleep efficiency, sleep onset latency, and wake after sleep were similar between the research and consumer wearable devices.

IMPORTANT ADDITIONAL OUTCOMES

Equivalence testing indicated that total sleep time and sleep efficiency estimates from the research and consumer wearable devices were statistically significantly equivalent.

CORE CONCLUSION

This study demonstrates that raw acceleration data from consumer wearable devices has the potential to be harnessed to predict sleep in children. While further work is needed, this strategy could overcome current limitations related to proprietary algorithms for predicting sleep in consumer wearable devices.

The mysterious case of the disappearing pilot study: a review of publication bias in preliminary behavioral interventions presented at health behavior conferences

BACKGROUND

The number of preliminary studies conducted and published has increased in recent years. However, there are likely many preliminary studies that go unpublished because preliminary studies are typically small and may not be perceived as methodologically rigorous. The extent of publication bias within preliminary studies is unknown but can prove useful to determine whether preliminary studies appearing in peer-reviewed journals are fundamentally different than those that are unpublished. The purpose of this study was to identify characteristics associated with publication in a sample of abstracts of preliminary studies of behavioral interventions presented at conferences.

METHODS

Abstract supplements from two primary outlets for behavioral intervention research (Society of Behavioral Medicine and International Society of Behavioral Nutrition and Physical Activity) were searched to identify all abstracts reporting findings of behavioral interventions from preliminary studies. Study characteristics were extracted from the abstracts including year presented, sample size, design, and statistical significance. To determine if abstracts had a matching peer-reviewed publication, a search of authors' curriculum vitae and research databases was conducted. Iterative logistic regression models were used to estimate odds of abstract publication. Authors with unpublished preliminary studies were surveyed to identify reasons for nonpublication.

RESULTS

Across conferences, a total of 18,961 abstracts were presented. Of these, 791 were preliminary behavioral interventions, of which 49% (388) were published in a peer-reviewed journal. For models with main effects only, preliminary studies with sample sizes greater than n = 24 were more likely to be published (range of odds ratios, 1.82 to 2.01). For models including interactions among study characteristics, no significant associations were found. Authors of unpublished preliminary studies indicated small sample sizes and being underpowered to detect effects as barriers to attempting publication.

CONCLUSIONS

Half of preliminary studies presented at conferences go unpublished, but published preliminary studies appearing in peer-reviewed literature are not systematically different from those that remain unpublished. Without publication, it is difficult to assess the quality of information regarding the early-stage development of interventions. This inaccessibility inhibits our ability to learn from the progression of preliminary studies.

Scientists' perception of pilot study quality was influenced by statistical significance and study design

OBJECTIVES

Preliminary studies play a key role in developing large-scale interventions but may be held to higher or lower scientific standards during the peer review process because of their preliminary study status.

STUDY DESIGN AND SETTING

Abstracts from 5 published obesity prevention preliminary studies were systematically modified to generate 16 variations of each abstract. Variations differed by 4 factors: sample size (n = 20 vs. n = 150), statistical significance (P < 0.05 vs. P > 0.05), study design (single group vs. randomized 2 groups), and preliminary study status (presence/absence of pilot language). Using an online survey, behavioral scientists were provided with a randomly selected variation of each of the 5 abstracts and blinded to the existence of other variations. Respondents rated each abstract on aspects of study quality.

RESULTS

Behavioral scientists (n = 271, 79.7% female, median age 34 years) completed 1,355 abstract ratings. Preliminary study status was not associated with perceived study quality. Statistically significant effects were rated as more scientifically significant, rigorous, innovative, clearly written, warranted further testing, and had more meaningful results. Randomized designs were rated as more rigorous, innovative, and meaningful.

CONCLUSION

Findings suggest reviewers place a greater value on statistically significant findings and randomized control design and may overlook other important study characteristics.

Policy, system, and environmental interventions addressing obesity and diet-related outcomes in early childhood education settings: A systematic review

Early childhood education (ECE) settings play an important role in child dietary intake and excess weight gain. Policy, systems, and environment (PSE) approaches have potential to reduce disparities in children at higher risk for obesity. The purpose of this review was to (1) characterize the inclusion of populations at higher risk for obesity in ECE interventions and (2) identify effective ECE interventions in these populations. Seven databases were searched for ECE interventions. Intervention characteristics and methodological quality were assessed in 35 articles representing 34 interventions. Interventions identified were mainly a combination of ECE and parent interventions (41%) or stand-alone ECE intervention (29%), with few multisector efforts (23%) or government regulations assessed (5%). Many included policy (70%) or social environment components (61%). For Aim 1, two thirds were conducted in primarily populations at higher risk for obesity (67%). Studies were rated as fair or good methodological quality. For Aim 2, 10 studies demonstrated effectiveness at improving diet or reducing obesity in populations at higher risk for obesity. Most included a longer intervention (i.e., >6 months), multiple PSE components, and formative work. Opportunities to incorporate more PSE components in ECE-based interventions and collaborate with parents and communities are warranted to improve child health.

A Sliding Scale Signal Quality Metric of Photoplethysmography Applicable to Measuring Heart Rate across Clinical Contexts with Chest Mounting as a Case Study

Photoplethysmography (PPG) signal quality as a proxy for accuracy in heart rate (HR) measurement is useful in various public health contexts, ranging from short-term clinical diagnostics to free-living health behavior surveillance studies that inform public health policy. Each context has a different tolerance for acceptable signal quality, and it is reductive to expect a single threshold to meet the needs across all contexts. In this study, we propose two different metrics as sliding scales of PPG signal quality and assess their association with accuracy of HR measures compared to a ground truth electrocardiogram (ECG) measurement.

METHODS

We used two publicly available PPG datasets (BUT PPG and Troika) to test if our signal quality metrics could identify poor signal quality compared to gold standard visual inspection. To aid interpretation of the sliding scale metrics, we used ROC curves and Kappa values to calculate guideline cut points and evaluate agreement, respectively. We then used the Troika dataset and an original dataset of PPG data collected from the chest to examine the association between continuous metrics of signal quality and HR accuracy. PPG-based HR estimates were compared with reference HR estimates using the mean absolute error (MAE) and the root-mean-square error (RMSE). Point biserial correlations were used to examine the association between binary signal quality and HR error metrics (MAE and RMSE).

RESULTS

ROC analysis from the BUT PPG data revealed that the AUC was 0.758 (95% CI 0.624 to 0.892) for signal quality metrics of STD-width and 0.741 (95% CI 0.589 to 0.883) for self-consistency. There was a significant correlation between criterion poor signal quality and signal quality metrics in both Troika and originally collected data. Signal quality was highly correlated with HR accuracy (MAE and RMSE, respectively) between PPG and ground truth ECG.

CONCLUSION

This proof-of-concept work demonstrates an effective approach for assessing signal quality and demonstrates the effect of poor signal quality on HR measurement. Our continuous signal quality metrics allow estimations of uncertainties in other emergent metrics, such as energy expenditure that relies on multiple independent biometrics. This open-source approach increases the availability and applicability of our work in public health settings.

Feasibility indicators in obesity-related behavioral intervention preliminary studies: a historical scoping review

BACKGROUND

Behavioral interventions are often complex, operate at multiple levels, across settings, and employ a range of behavior change techniques. Collecting and reporting key indicators of initial trial and intervention feasibility is essential to decisions for progressing to larger-scale trials. The extent of reporting on feasibility indicators and how this may have changed over time is unknown. The aims of this study were to (1) conduct a historical scoping review of the reporting of feasibility indicators in behavioral pilot/feasibility studies related to obesity published through 2020, and (2) describe trends in the amount and type of feasibility indicators reported in studies published across three time periods: 1982-2006, 2011-2013, and 2018-2020.

METHODS

A search of online databases (PubMed, Embase, EBSCOhost, Web of Science) for health behavior pilot/feasibility studies related to obesity published up to 12/31/2020 was conducted and a random sample of 600 studies, 200 from each of the three timepoints (1982-2006, 2011-2013, and 2018-2020), was included in this review. The presence/absence of feasibility indicators, including recruitment, retention, participant acceptability, attendance, compliance, and fidelity, were identified/coded for each study. Univariate logistic regression models were employed to assess changes in the reporting of feasibility indicators across time.

RESULTS

A total of 16,365 unique articles were identified of which 6873 of these were reviewed to arrive at the final sample of 600 studies. For the total sample, 428 (71.3%) studies provided recruitment information, 595 (99.2%) provided retention information, 219 (36.5%) reported quantitative acceptability outcomes, 157 (26.2%) reported qualitative acceptability outcomes, 199 (33.2%) reported attendance, 187 (31.2%) reported participant compliance, 23 (3.8%) reported cost information, and 85 (14.2%) reported treatment fidelity outcomes. When compared to the Early Group (1982-2006), studies in the Late Group (2018-2020) were more likely to report recruitment information (OR=1.60, 95%CI 1.03-2.49), acceptability-related quantitative (OR=2.68, 95%CI 1.76-4.08) and qualitative (OR=2.32, 95%CI 1.48-3.65) outcomes, compliance outcomes (OR=2.29, 95%CI 1.49-3.52), and fidelity outcomes (OR=2.13, 95%CI 1.21, 3.77).

CONCLUSION

The reporting of feasibility indicators within behavioral pilot/feasibility studies has improved across time, but key aspects of feasibility, such as fidelity, are still not reported in the majority of studies. Given the importance of behavioral intervention pilot/feasibility studies in the translational science spectrum, there is a need for improving the reporting of feasibility indicators.

Barriers to Optimal Child Sleep among Families with Low Income: A Mixed-Methods Study to Inform Intervention Development

This study gathered formative data on barriers to optimal child sleep to inform the development of a sleep intervention for parents of preschool-aged children in low-income households. Parents (n = 15, age: 34 ± 8 years, household income: $30,000 ± 17,845/year) reporting difficulties with their child's sleep participated in this study. Mixed methods included an online survey and semi-structured phone interview. Items assessed barriers/facilitators to optimal child sleep and intervention preferences. Interview transcripts were coded using inductive analyses and constant-comparison methods to generate themes. Derived themes were then mapped onto the Theoretical Domains Framework to contextualize barriers and inform future intervention strategies. Themes that emerged included: stimulating bedtime activities, child behavior challenges, variability in children's structure, parent work responsibilities, sleep-hindering environment, and parent's emotional capacity. Parent's intervention preferences included virtual delivery (preferred by 60% of parents) to reduce barriers and provide flexibility. Mixed preferences were observed for the group (47%) vs. individual (53%) intervention sessions. Parents felt motivated to try new intervention strategies given current frustrations, the potential for tangible results, and knowing others were in a similar situation. Future work will map perceived barriers to behavior change strategies using the Behavior Change Wheel framework to develop a parenting sleep intervention.

Classroom teachers' "off-the-shelf" use of movement integration products and its impact on children's sedentary behavior and physical activity

Movement integration (MI) products are one of many MI strategies that aim to reduce students' sedentary behavior (SB) and increase physical activity (PA) during classroom time. This study examined elementary classroom teachers' off-the-shelf (i.e., no researcher support) use of MI products (GoNoodle Plus [GN], ABC for Fitness [ABC], Take10) and their impact on students' SB and PA. Teachers (N = 57) at five schools received one MI product and reported MI strategy uses/day while student (n = 1,098, 52% female, 66% Black) accelerometer-determined SB and PA was assessed. Mixed regression models estimated changes in MI uses/day and SB and PA during the school day prior to and after teachers received the MI product. GoNoodle was the only MI product where overall MI strategy uses/day increased (∆ = 0.8, 95% CI = 0.1, 1.4). Across products, students' SB increased (∆ = 2.2, 95% CI = 1.2, 3.1) while light (∆ = -1.7, 95% CI = 1.2, 3.1) and MVPA (∆ = -0.5, 95% CI = -0.8, -0.2) decreased. For GN SB (∆ = -3.3, 95% CI = -7.8, 1.3), light (∆ = 2.5, 95% CI = -0.7, 5.7), and MVPA (∆ = 0.8, 95% CI = -0.9, 2.5), did not show statistically significant change. For Take10 SB (∆ = 1.0, 95% CI = -0.2, 2.2) and MVPA (∆ = 0.1, 95% CI = -0.3, 0.6) did not change while light PA decreased (∆ = -1.1, 95% CI = -2.0, -0.3). For ABC SB increased (∆ = 11.1, 95% CI = 8.4, 13.9) while light (∆ = -7.0, 95% CI = -8.9, -5.0) and MVPA (∆ = -4.2, 95% CI = -5.2, -3.1) decreased. GN shows promise for classroom teacher use. However, given limited uptake of the other products and the lack of change in children's SB and PA, this study suggests that off-the-shelf MI products cannot be integrated into classroom routines without additional support.

Feasibility of Measuring Screen Time, Activity, and Context Among Families With Preschoolers: Intensive Longitudinal Pilot Study

Background

Digital media has made screen time more available across multiple contexts, but our understanding of the ways children and families use digital media has lagged behind the rapid adoption of this technology.

Objective

This study evaluated the feasibility of an intensive longitudinal data collection protocol to objectively measure digital media use, physical activity, sleep, sedentary behavior, and socioemotional context among caregiver-child dyads. This paper also describes preliminary convergent validity of ecological momentary assessment (EMA) measures and preliminary agreement between caregiver self-reported phone use and phone use collected from passive mobile sensing.

Methods

Caregivers and their preschool-aged child (3-5 years) were recruited to complete a 30-day assessment protocol. Within 30-days, caregivers completed 7 days of EMA to measure child behavior problems and caregiver stress. Caregivers and children wore an Axivity AX3 (Newcastle Upon Tyne) accelerometer to assess physical activity, sedentary behavior, and sleep. Phone use was assessed via passive mobile sensing; we used Chronicle for Android users and screenshots of iOS screen time metrics for iOS users. Participants were invited to complete a second 14-day protocol approximately 3-12 months after their first assessment. We used Pearson correlations to examine preliminary convergent validity between validated questionnaire measures of caregiver psychological functioning, child behavior, and EMA items. Root mean square errors were computed to examine the preliminary agreement between caregiver self-reported phone use and objective phone use.

Results

Of 110 consenting participants, 105 completed all protocols (105/110, 95.5% retention rate). Compliance was defined a priori as completing ≥70%-75% of each protocol task. There were high compliance rates for passive mobile sensing for both Android (38/40, 95%) and iOS (64/65, 98%). EMA compliance was high (105/105, 100%), but fewer caregivers and children were compliant with accelerometry (62/99, 63% and 40/100, 40%, respectively). Average daily phone use was 383.4 (SD 157.0) minutes for Android users and 354.7 (SD 137.6) minutes for iOS users. There was poor agreement between objective and caregiver self-reported phone use; root mean square errors were 157.1 and 81.4 for Android and iOS users, respectively. Among families who completed the first assessment, 91 re-enrolled to complete the protocol a second time, approximately 7 months later (91/105, 86.7% retention rate).

Conclusions

It is feasible to collect intensive longitudinal data on objective digital media use simultaneously with accelerometry and EMA from an economically and racially diverse sample of families with preschool-aged children. The high compliance and retention of the study sample are encouraging signs that these methods of intensive longitudinal data collection can be completed in a longitudinal cohort study. The lack of agreement between self-reported and objectively measured mobile phone use highlights the need for additional research using objective methods to measure digital media use.

International Registered Report Identifier (IRRID)

RR2-36240

Fund behavioral science like the frameworks we endorse: the case for increased funding of preliminary studies by the National Institutes of Health

Innovative, groundbreaking science relies upon preliminary studies (aka pilot, feasibility, proof-of-concept). In the behavioral sciences, almost every large-scale intervention is supported by a series of one or more rigorously conducted preliminary studies. The importance of preliminary studies was established by the National Institutes of Health (NIH) in 2014/2015 in two translational science frameworks (NIH Stage and ORBIT models). These frameworks outline the essential role preliminary studies play in developing the next generation of evidence-based behavioral prevention and treatment interventions. Data produced from preliminary studies are essential to secure funding from the NIH’s most widely used grant mechanism for large-scale clinical trials, namely the R01. Yet, despite their unquestionable importance, the resources available for behavioral scientists to conduct rigorous preliminary studies are limited. In this commentary, we discuss ways the existing funding structure at the NIH, despite its clear reliance upon high-quality preliminary studies, inadvertently discourages and disincentivizes their pursuit by systematically underfunding them. We outline how multiple complementary and pragmatic steps via a small reinvestment of funds from larger trials could result in a large increase in funding for smaller preliminary studies. We make the case such a reinvestment has the potential to increase innovative science, increase the number of investigators currently funded, and would yield lasting benefits for behavioral science and scientists alike.

Impact of Virtual vs. In-Person School on Children Meeting the 24-h Movement Guidelines during the COVID-19 Pandemic

The pandemic mitigation strategy of closing schools, while necessary, may have unintentionally impacted children's moderate-to-vigorous physical activity (MVPA), sleep, and time spent watching screens. In some locations, schools used hybrid attendance models, with some days during the week requiring in-person and others virtual attendance. This scenario offers an opportunity to evaluate the impact of attending in-person school on meeting the 24-h movement guidelines. Children (N = 690, 50% girls, K-5th) wore wrist-placed accelerometers for 14 days during October/November 2020. Parents completed daily reports on child time spent on screens and time spent on screens for school. The schools' schedule was learning for 2 days/week in-person and 3 days/week virtually. Using only weekdays (M-F), the 24-h movement behaviors were classified, and the probability of meeting all three was compared between in-person vs. virtual learning and across grades. Data for 4956 weekdays (avg. 7 d/child) were collected. In-person school was associated with a greater proportion (OR = 1.70, 95% CI: 1.33-2.18) of days that children were meeting the 24-h movement guidelines compared to virtual school across all grades. Students were more likely to meet the screen time (OR = 9.14, 95% CI: 7.05-11.83) and MVPA (OR = 1.50, 95% CI: 1.25-1.80) guidelines and less likely to meet the sleep (OR = 0.73, 95% CI: 0.62-0.86) guidelines on the in-person compared to the virtual school days. Structured environments, such as school, have a protective effect on children's movement behaviors, especially physical activity and screen time.

0188 Associations between Preschoolers’ Behavioral Difficulties and Variability in Sleep Duration and Bedtime

Introduction

Variability in children’s sleep patterns has been linked with health outcomes including obesity, poor mood, and behavioral difficulties. However, much of this evidence stems from parent-reported measures of sleep. Understanding these associations in preschool-age children using device-based measures is important as sleep habits tend to develop and stabilize during this time. The purpose of this study was to examine associations between parent-reported behavioral difficulties and device-measured sleep among preschoolers.

Methods

Ninety-five preschool-aged children (3-5 years, 51% female, 30% Black) with at least two valid nights of sleep were in included in this analysis. Children were asked to wear an Axivity AX3 accelerometer on their non-dominant wrist for 30 days. Parents completed the Strengths and Difficulties Questionnaire which assessed child behaviors over the past 6 months. Raw accelerometry data were processed with GGIR (v2.3). We used MixWild to conduct mixed effects location scale models with a random intercept and scale predicting nocturnal duration variability and bedtime variability. Time invariant behavior subscales (conduct problems, hyperactivity/inattention, peer relationship problems, emotional symptoms, prosocial behavior, and total difficulties) were included as predictors of child sleep duration and bedtime variability.

Results

Children had an average of 13.4 ± 7.4 (range 2-29) nights of valid data. Average nocturnal sleep duration was 9.7 ± 1.4 hours and average bedtime was 9:48 PM. There were no statistically significant associations between any SDQ subscales and variability in children’s sleep duration and bedtime. There was an association between random location and scale such that participants with later average bedtimes also had more variability in their bedtime (p &lt; 0.001).

Conclusion

Variability in nocturnal sleep was not associated with parent reported behavioral difficulties, which is contrary to recent findings. It is unclear if sleep duration and bedtime variability are associated with day-level changes in children’s behavior. Additional work that emphasizes aspects of sleep beyond sleep duration is needed to advance our understanding of preschool-age children’s sleep.

Support (If Any)

This was supported by the National Institute of General Medical Sciences of the NIH for the UofSC Research Center for Child Well-Being (P20GM130420) and by the National Heart, Lung, and Blood Institute (F32HL154530).

Early-stage studies to larger-scale trials: investigators’ perspectives on scaling-up childhood obesity interventions

Background

Pilot/feasibility studies play an important role in the development and refinement of behavioral interventions by providing information about feasibility, acceptability, and potential efficacy. Despite their importance and wide-spread use, the approaches taken by behavioral scientists to scale-up early-stage studies to larger-scale trials has received little attention. The aim of our study was to understand the role that pilot studies play in the development and execution of larger-scale trials.

Methods

We conducted interviews with childhood obesity researchers who had published pilot behavioral interventions and larger-scale trials of the same or similar interventions. Questions were asked about the role of pilot studies in developing larger-scale trials and the challenges encountered when scaling-up an intervention based upon pilot findings. Data were coded and analyzed using an inductive analytic approach to identify themes.

Results

Twenty-four interventionists (54% women, 37–70 years old, mean 20 years since terminal degree) completed a total of 148 pilot studies across their careers (mean 6.4, range 1–20), of which 59% were scaled-up. Scaling was described as resource intensive and pilot work was considered essential to successfully competing for funding by 63% of the sample (n = 15). When asked to define a high-quality pilot study, interventionists described studies that allowed them to evaluate two independent factors: components of their intervention (e.g., acceptability, feasibility) and study parameters (e.g., sample size, measures). Interventionists expressed that more process implementation measures, different study designs, and additional iterations could improve decisions to scale-up. Most agreed that pilot studies were likely to produce inflated estimates of potential efficacy though only nine interventionists provided potential solutions for decreasing inflated measures of efficacy. Suggested major causes of inflated effects included high levels of oversight in pilot studies (e.g., researcher support), reliance on subjective measures, and utilizing convenience or highly motivated samples. Potential solutions included designing pilots for real-world implementation, only conducting randomized controlled pilot studies, and pre-registering pilot studies.

Conclusions

Pilot studies purposes are multifaceted and deemed essential to obtaining funding for larger-scale trials. Clarifying the form and function of preliminary, early-stage research may enhance the productive utilization of early-stage studies and reduced drops in efficacy when transitioning to larger scale studies.

Supplementary Information

The online version contains supplementary material available at 10.1186/s40814-022-00991-8.

Impact of risk of generalizability biases in adult obesity interventions: A meta-epidemiological review and meta-analysis

Biases introduced in early-stage studies can lead to inflated early discoveries. The risk of generalizability biases (RGBs) identifies key features of feasibility studies that, when present, lead to reduced impact in a larger trial. This meta-study examined the influence of RGBs in adult obesity interventions. Behavioral interventions with a published feasibility study and a larger scale trial of the same intervention (e.g., pairs) were identified. Each pair was coded for the presence of RGBs. Quantitative outcomes were extracted. Multilevel meta-regression models were used to examine the impact of RGBs on the difference in the effect size (ES, standardized mean difference) from pilot to larger scale trial. A total of 114 pairs, representing 230 studies, were identified. Overall, 75% of the pairs had at least one RGB present. The four most prevalent RGBs were duration (33%), delivery agent (30%), implementation support (23%), and target audience (22%) bias. The largest reductions in the ES were observed in pairs where an RGB was present in the pilot and removed in the larger scale trial (average reduction ES -0.41, range -1.06 to 0.01), compared with pairs without an RGB (average reduction ES -0.15, range -0.18 to -0.14). Eliminating RGBs during early-stage testing may result in improved evidence.

Measuring Micro Temporal Processes Underlying Preschoolers Screen Use and Behavioral Health: Protocol for the Tots & Tech Study (Preprint)

Background

Excessive screen time is associated with poor health and behavioral outcomes in children. However, research on screen time use has been hindered by methodological limitations, including retrospective reports of usual screen time and lack of momentary etiologic processes occurring within each day.

Objective

This study is designed to assess the feasibility and utility of a comprehensive multibehavior protocol to measure the digital media use and screen time context among a racially and economically diverse sample of preschoolers and their families. This paper describes the recruitment, data collection, and analytical protocols for the Tots and Tech study.

Methods

The Tots and Tech study is a longitudinal, observational study of 100 dyads: caregivers and their preschool-age children (aged 3-5 years). Both caregivers and children will wear an Axivity AX3 accelerometer (Axivity Ltd) for 30 days to assess their physical activity, sedentary behavior, and sleep. Caregivers will complete ecological momentary assessments (EMAs) for 1 week to measure child behavioral problems, caregiver stress, and child screen time.

Results

The Tots and Tech study was funded in March 2020. This study maintains rolling recruitment, with each dyad on their own assessment schedule, depending on the time of enrollment. Enrollment was scheduled to take place between September 2020 and May 2022. We aim to enroll 100 caregiver-child dyads. The Tots and Tech outcome paper is expected to be published in 2022.

Conclusions

The Tots and Tech study attempts to overcome previous methodological limitations by using objective measures of screen time, physical activity, sedentary behavior, and sleep behaviors with contextual factors measured by EMA. The results will be used to evaluate the feasibility and utility of a comprehensive multibehavior protocol using objective measures of mobile screen time and accelerometry in conjunction with EMA among caregiver-child dyads. Future observational and intervention studies will be able to use this study protocol to better measure screen time and its context.

International Registered Report Identifier (IRRID)

DERR1-10.2196/36240

Impact of the COVID-19 pandemic on elementary schoolers' physical activity, sleep, screen time and diet: A quasi-experimental interrupted time series study

BACKGROUND

COVID-19 school closures pose a threat to children's wellbeing, but no COVID-19-related studies have assessed children's behaviours over multiple years .

OBJECTIVE

To examine children's obesogenic behaviours during spring and summer of the COVID-19 pandemic compared to previous data collected from the same children during the same calendar period in the 2 years prior.

METHODS

Physical activity and sleep data were collected via Fitbit Charge-2 in 231 children (7-12 years) over 6 weeks during spring and summer over 3 years. Parents reported their child's screen time and dietary intake via a survey on 2-3 random days/week.

RESULTS

Children's behaviours worsened at a greater rate following the pandemic onset compared to pre-pandemic trends. During pandemic spring, sedentary behaviour increased (+79 min; 95% CI = 60.6, 97.1) and MVPA decreased (-10 min, 95% CI = -18.2, -1.1) compared to change in previous springs (2018-2019). Sleep timing shifted later (+124 min; 95% CI = 112.9, 135.5). Screen time (+97 min, 95% CI = 79.0, 115.4) and dietary intake increased (healthy: +0.3 foods, 95% CI = 0.2, 0.5; unhealthy: +1.2 foods, 95% CI = 1.0, 1.5). Similar patterns were observed during summer.

CONCLUSIONS

Compared to pre-pandemic measures, children's PA, sedentary behaviour, sleep, screen time, and diet were adversely altered during the COVID-19 pandemic. This may ultimately exacerbate childhood obesity.

Differences in ​the proportion of children meeting behavior guidelines ​between summer ​and school by socioeconomic status and race

OBJECTIVE

Children who fail to meet activity, sleep, and screen-time guidelines are at increased risk for obesity. Further, children who are Black are more likely to have obesity when compared to children who are White, and children from low-income households are at increased risk for obesity when compared to children from higher-income households. The objective of this study was to evaluate the proportion of days meeting obesogenic behavior guidelines during the school year compared to summer vacation by race and free/reduced priced lunch (FRPL) eligibility.

METHODS

Mixed-effects linear and logistic regressions estimated the proportion of days participants met activity, sleep, and screen-time guidelines during summer and school by race and FRPL eligibility within an observational cohort sample.

RESULTS

Children (n = 268, grades = K - 4, 44.1%FRPL, 59.0% Black) attending three schools participated. Children's activity, sleep, and screen-time were collected during an average of 23 school days and 16 days during summer vacation. During school, both children who were White and eligible for FRPL met activity, sleep, and screen-time guidelines on a greater proportion of days when compared to their Black and non-eligible counterparts. Significant differences in changes from school to summer in the proportion of days children met activity (-6.2%, 95CI = -10.1%, -2.3%; OR = 0.7, 95CI = 0.6, 0.9) and sleep (7.6%, 95CI = 2.9%, 12.4%; OR = 2.1, 95CI = 1.4, 3.0) guidelines between children who were Black and White were observed. Differences in changes in activity (-8.5%, 95CI = -4.9%, -12.1%; OR = 1.5, 95CI = 1.3, 1.8) were observed between children eligible versus uneligible for FRPL.

CONCLUSIONS

Summer vacation may be an important time for targeting activity and screen-time of children who are Black and/or eligible for FRPL.

COVID-19 Leads to Accelerated Increases in Children's BMI z-Score Gain: An Interrupted Time-Series Study

INTRODUCTION

The COVID-19 pandemic may have negatively impacted children's weight status owing to the closure of schools, increased food insecurity and reliance on ultraprocessed foods, and reduced opportunities for outdoor activity.

METHODS

In this interrupted time-series study, height and weight were collected from children (n=1,770 children, mean age=8.7 years, 55.3% male, 64.6% Black) and were transformed into BMI z-score in each August/September from 2017 to 2020. Mixed-effects linear regression estimated yearly BMI z-score change before the COVID-19 pandemic year (i.e., 2017-2019) and during the COVID-19 pandemic year (i.e., 2019-2020). Subgroup analyses by sex, race (i.e., Black, White, other race), weight status (overweight or obese and normal weight), and grade (i.e., lower=kindergarten-2nd grade and upper=3rd-6th grade) were conducted.

RESULTS

Before the COVID-19 pandemic, children's yearly BMI z-score change was +0.03 (95% CI= -0.10, 0.15). Change during the COVID-19 pandemic was +0.34 (95% CI=0.21, 0.47), an acceleration in BMI z-score change of +0.31 (95% CI=0.19, 0.44). For girls and boys, BMI z-score change accelerated by +0.33 (95% CI=0.16, 0.50) and +0.29 (95% CI=0.12, 0.46), respectively, during the pandemic year. Acceleration in BMI z-score change during the pandemic year was observed for children who were Black (+0.41, 95% CI=0.21, 0.61) and White (+0.22, 95% CI=0.06, 0.39). For children classified as normal weight, BMI z-score change accelerated by +0.58 (95% CI=0.40, 0.76). Yearly BMI z-score change accelerated for lower elementary/primary (+0.23, 95% CI=0.08, 0.37) and upper elementary/primary (+0.42, 95% CI=0.42, 0.63) children.

CONCLUSIONS

If similar BMI z-score accelerations occurred for children across the world, public health interventions to address this rapid unhealthy BMI gain will be urgently needed.

Small studies, big decisions: the role of pilot/feasibility studies in incremental science and premature scale-up of behavioral interventions

Background

Careful consideration and planning are required to establish “sufficient” evidence to ensure an investment in a larger, more well-powered behavioral intervention trial is worthwhile. In the behavioral sciences, this process typically occurs where smaller-scale studies inform larger-scale trials. Believing that one can do the same things and expect the same outcomes in a larger-scale trial that were done in a smaller-scale preliminary study (i.e., pilot/feasibility) is wishful thinking, yet common practice. Starting small makes sense, but small studies come with big decisions that can influence the usefulness of the evidence designed to inform decisions about moving forward with a larger-scale trial. The purpose of this commentary is to discuss what may constitute sufficient evidence for moving forward to a definitive trial. The discussion focuses on challenges often encountered when conducting pilot/feasibility studies, referred to as common (mis)steps, that can lead to inflated estimates of both feasibility and efficacy, and how the intentional design and execution of one or more, often small, pilot/feasibility studies can play a central role in developing an intervention that scales beyond a highly localized context.

Main body

Establishing sufficient evidence to support larger-scale, definitive trials, from smaller studies, is complicated. For any given behavioral intervention, the type and amount of evidence necessary to be deemed sufficient is inherently variable and can range anywhere from qualitative interviews of individuals representative of the target population to a small-scale randomized trial that mimics the anticipated larger-scale trial. Major challenges and common (mis)steps in the execution of pilot/feasibility studies discussed are those focused on selecting the right sample size, issues with scaling, adaptations and their influence on the preliminary feasibility and efficacy estimates observed, as well as the growing pains of progressing from small to large samples. Finally, funding and resource constraints for conducting informative pilot/feasibility study(ies) are discussed.

Conclusion

Sufficient evidence to scale will always remain in the eye of the beholder. An understanding of how to design informative small pilot/feasibility studies can assist in speeding up incremental science (where everything needs to be piloted) while slowing down premature scale-up (where any evidence is sufficient for scaling).

239 Changes in Children’s Schoolyear and Summer Sleep during the COVID-19 Pandemic

Introduction

In spring 2020, elementary schools closed to minimize the spread of COVID-19. Questionnaire data suggest children’s sleep was impacted during the pandemic, yet device-based data (i.e. accelerometry) on this topic is lacking. The purpose of this study was to examine children’s sleep during the COVID-19 pandemic (i.e. spring and summer 2020) compared to previous data collected from the same children during each of the two previous years (spring and summer 2018 and 2019).

Methods

68 children (age = 9.9±1.2 years, 56% Black, 53% male) previously recruited for an observational cohort study wore a Fitbit Charge 2 on their wrist during the spring and summer from 2018-2020 (i.e. six 30-day measurement periods). We used multilevel mixed models to examine how children’s sleep patterns changed during the pandemic accounting for previous trajectory (i.e. 2018 to 2019). Models included age, sex, and race as covariates.

Results

Children had an average of 84 nights of sleep data across all six 30-day measurement periods. In the spring of the pandemic, children slept 24.6 minutes more (95%CI = 11.6, 37.5) compared to previous springs. During the pandemic summer, they slept 40.0 minutes more (95%CI = 24.6, 58.5) compared to previous summers. Sleep midpoint was 117.1 minutes later (95%CI = 103.6, 130.6) in the spring during the pandemic and 46.0 minutes later (95% CI = 26.9, 65.2) in the summer during the pandemic compared to previous years. Sleep efficiency improved slightly by 1.3% (95% CI = 0.7, 1.9) and 3.6% (95% CI = 2.7, 4.5) in spring and summer, respectively, during the pandemic compared to previous years.

Conclusion

During the COVID-19 pandemic, children slept longer after accounting for previous developmental trends. Notably, the shift in sleep timing during the pandemic was nearly two hours later in the spring compared to previous years, potentially due to the lack of structure usually provided by school. Later sleep timing is independently associated with poor health behaviors (e.g., nutrition, physical activity, screen time). Future studies should examine if these changes in sleep persist over time and have potential long-term effects on children’s health.

Support (if any)

R21HD095164 (PI Weaver) & UofSC COVID-19 Research Initiative Grant (PI Armstrong)

Comparison of multichannel and single-channel wrist-based devices with polysomnography to measure sleep in children and adolescents

STUDY OBJECTIVES

To compare sleep parameters produced by the Fitbit Charge 3 (Fitbit) and Actigraph GT9X accelerometer (Actigraph) to polysomnography in children and adolescents.

METHODS

Participants (n = 56, ages 9.2 ± 3.3 years) wore a Fitbit and an Actigraph on their nondominant wrist concurrently with polysomnography during an overnight observation at a children's sleep laboratory. Total sleep time, sleep efficiency, wake after sleep onset, sleep onset, and sleep offset were extracted from the Fitabase and Actilife software packages, respectively, with the Sadeh algorithm. Bland-Altman plots were used to assess the agreement between wearable devices and polysomnography.

RESULTS

Seventy-nine percent of participants were diagnosed with OSA. Compared with polysomnography, the Fitbit and the Actigraph underestimated total sleep time by 6.1 minutes (absolute mean bias [AMB] = 27.7 minutes) and 31.5 minutes (AMB = 38.2 minutes), respectively. The Fitbit overestimated sleep efficiency by 3.0% (AMB = 6.3%), and the Actigraph underestimated sleep efficiency by 12.9% (AMB = 13.2%). The Fitbit overestimated wake after sleep onset by 18.8 minutes (AMB = 23.9 minutes), and the Actigraph overestimated wake after sleep onset by 56.1 minutes (AMB = 54.7 minutes). In addition, the Fitbit and the Actigraph underestimated sleep onset by 1.2 minutes (AMB = 13.9 minutes) and 10.2 minutes (AMB = 18.1 minutes), respectively. Finally, the Fitbit and the Actigraph overestimated sleep offset by 6.0 minutes (AMB = 12.0 minutes) and 10.5 minutes (AMB = 12.6 minutes). Linear regression indicated significant trends, with the Fitbit underestimating wake after sleep onset and sleep efficiency at higher values.

CONCLUSIONS

The Fitbit provided comparable and in some instances better sleep estimates with polysomnography compared to the Actigraph. Findings support the use of multichannel devices to measure sleep in children and adolescents. Additional studies are needed in healthy children over several nights and in free-living settings.

Cross-Sectional Associations of 24-Hour Sedentary Time, Physical Activity, and Sleep Duration Compositions with Sleep Quality and Habits in Preschoolers

Although some studies indicate physical activity and sleep quality are positively associated in children, most reports examined physical activity independent of other 24-h behaviors and focused on older children. The aim of this cross-sectional study was to examine the predicted changes in sleep efficiency and habits when reallocating time between movement behaviors using compositional isotemporal substitution in preschool-aged children. Accelerometers were worn by 288 participants (51.6 ± 9.5 months) for up to 16 days. Sleep outcomes included sleep efficiency, nap frequency, sleep disturbances, and bedtime resistance. Compositional isotemporal substitution analyses demonstrated that the combined effect of 24-h movement behaviors was associated with sleep efficiency (p < 0.001) and nap frequency (p < 0.003). When sleep increased by 30 min at the expense of stationary time or light physical activity, estimates of sleep efficiency and bedtime resistance decreased while nap frequency increased. When stationary time increased by 30 min from moderate to vigorous physical activity, estimated sleep efficiency increased and sleep disturbances decreased. Although this study presents preliminary evidence that 24-h movement behavior compositions in early childhood are associated with sleep quality and nap frequency, estimated effects from theoretical time reallocations across sleep outcomes were mixed.

The impact of a randomized controlled trial of a lifestyle intervention on postpartum physical activity among at-risk hispanic women: Estudio PARTO

AIMS

To assess the impact of a culturally modified, motivationally targeted, individually-tailored intervention on postpartum physical activity (PA) and PA self-efficacy among Hispanic women.

METHODS

Estudio PARTO was a randomized controlled trial conducted in Western Massachusetts from 2013-17. Hispanic women who screened positive for gestational diabetes mellitus were randomized to a Lifestyle Intervention (LI, n = 100) or to a comparison Health and Wellness (HW, n = 104) group during late pregnancy. Exercise goals in LI were to meet American College of Obstetrician & Gynecologists guidelines for postpartum PA. The Pregnancy Physical Activity Questionnaire (PPAQ) and the Self-Efficacy for Physical Activity Questionnaire were administered at 6 weeks, 6 months, and 1 year postpartum.

RESULTS

Compared to baseline levels, both groups had significant increases in moderate-to-vigorous PA at 6 months and one year postpartum (i.e., LI: mean change = 30.9 MET-hrs/wk, p = 0.05; HW: 27.6 MET-hrs/wk, p = 0.01), with only LI group experiencing significant increases in vigorous PA (mean change = 1.3 MET-hrs/wk, p = 0.03). Based on an intent-to-treat analysis using mixed effects models, we observed no differences in pattern of change in PA intensity and type over time between intervention groups (all p > 0.10). However, there was the suggestion of a greater decrease in sedentary activity in the LI group compared to the HW group (β = -3.56, p = 0.09).

CONCLUSIONS

In this randomized trial among high-risk Hispanic women, both groups benefitted from participation in a postpartum intervention.

Validity of Wrist-Worn photoplethysmography devices to measure heart rate: A systematic review and meta-analysis

Heart rate (HR), when combined with accelerometry, can dramatically improve estimates of energy expenditure and sleep. Advancements in technology, via the development and introduction of small, low-cost photoplethysmography devices embedded within wrist-worn consumer wearables, have made the collection of heart rate (HR) under free-living conditions more feasible. This systematic review and meta-analysis compared the validity of wrist-worn HR estimates to a criterion measure of HR (electrocardiography ECG or chest strap). Searches of PubMed/Medline, Web of Science, EBSCOhost, PsycINFO, and EMBASE resulted in a total of 44 articles representing 738 effect sizes across 15 different brands. Multi-level random effects meta-analyses resulted in a small mean difference (beats per min, bpm) of -0.40 bpm (95 confidence interval (CI) -1.64 to 0.83) during sleep, -0.01 bpm (-0.02 to 0.00) during rest, -0.51 bpm (-1.60 to 0.58) during treadmill activities (walking to running), while the mean difference was larger during resistance training (-7.26 bpm, -10.46 to -4.07) and cycling (-4.55 bpm, -7.24 to -1.87). Mean difference increased by 3 bpm (2.5 to 3.5) per 10 bpm increase of HR for resistance training. Wrist-worn devices that measure HR demonstrate acceptable validity compared to a criterion measure of HR for most common activities.

Feasibility, Acceptability, and Preliminary Efficacy of a Recess-Based Fitness Intervention in Elementary School Children

Although fitness may benefit cognition in youth, most attention has been given to cardiorespiratory fitness despite the health benefits of muscular fitness. Few studies have examined interventions that incorporate both cardiorespiratory and muscular fitness or have been offered during school recess. Furthermore, most fitness intervention studies examining cognitive outcomes have not reported on implementation information. The purpose of this pilot study was to examine the feasibility, acceptability, and preliminary efficacy on fitness and cognition of a recess intervention in elementary school children. Two schools were randomized to either a 3-month cardiorespiratory and muscular fitness intervention (15 minutes/weekday during recess) or control condition (standard recess activities). Process evaluation (feasibility and acceptability) measures were recorded daily (research staff questionnaire), weekly (accelerometer and heart rate monitors), and post-intervention (participant and school-staff questionnaires). Preliminary efficacy measures included pre- and post-intervention inhibition/attention, working memory, and cardiorespiratory and muscular fitness scores. Some feasibility and acceptability measures were favorable (88% of the lessons were implemented, 78% of the lessons were implemented as planned, and the majority of students and school staff were satisfied with most aspects of the intervention). However, intensity adherence during the intervention sessions based on accelerometry (% of time spent in moderate-to-vigorous activity: 41.7 ± 14.5) and participation (19.4% attendance rate) were lower than expected. Preliminary efficacy of the intervention on cognitive and fitness outcomes was not demonstrated. This study provided evidence that some aspects of the fitness intervention were acceptable during school recess. However, important implementation factors (i.e., intervention exposure) should be targeted to improve youth fitness programs offered during this school setting.

Effect of a culturally-tailored mother-daughter physical activity intervention on pre-adolescent African-American girls' physical activity levels

Positive parent-child attachment can be determined by opportunities for the child to interact with his/her parent and can influence a child's physical activity (PA) behavior. Therefore, an intervention that provides children and their parent more time to interact positively could impact children's PA. We examined the efficacy of a 12-week mother-daughter intervention on African-American girls' PA levels. In Spring of 2013 and 2014, mother-daughter dyads (n = 76) from Springfield, MA, were randomly assigned to one of three groups [child-mother (CH-M, n = 28), child alone (CH, n = 25), or control (CON, n = 23)] that participated in an afterschool culturally-tailored dance intervention (60 min/day, 3 days/week, 12 weeks). Girls in the CH-M group participated in the intervention with their maternal figure, while girls in the CH group participated in the intervention alone. CON group participants received weekly health-related newsletters. PA was assessed with accelerometers for seven days at baseline, 6-weeks, and 12-weeks. Hierarchical linear modeling was used to examine rates of change in PA. During the afterschool intervention time, girls in the CH-M group displayed a significantly steeper rate of increase in their percent time spent in vigorous PA compared to both the CON (γ = 0.80, p < 0.001) and the CH group (χ² (1)=13.01, p < 0.001). Mothers in the CH-M group displayed a significantly steeper rate of increase in their percent time spent in total daily moderate-to-vigorous PA compared to CH group's mothers (γ = 0.07, p = 0.01). This culturally-tailored mother-daughter afterschool intervention influenced African-American girls' afterschool hour PA levels, but not total daily PA.

Trial Registration: Study is registered at www.clinicaltrials.govNCT01588379.

•

A joint mother-daughter dance intervention can improve mothers' activity level.

•

An afterschool dance intervention can improve girls afterschool activity level.

•

A joint afterschool dance intervention can improve mother and daughter relationship.

•

Mothers and daughters enjoy participating in culturally-tailored dance intervention.