Physical activity promotion in Latin American populations: a systematic review on issues of internal and external validity

An integrative review of parent education approaches in sport: Considerations for program planning and evaluation

In recent years, there has been an increase in the delivery and evaluation of parent education programs within youth sport. Subsequently, some recent reviews of these programs have been conducted. However, one consistent issue across many of the programs and associated review papers is the lack of an appropriate evaluation framework to guide the planning or associated reporting of the outcomes of the interventions. This has limited understanding of the overall impact of sport parenting interventions. Thus, the purposes of the current study were as follows: (a) to identify commonalities in the reporting and evaluation of parent education programs; (b) to identify gaps in the reporting and evaluation of parent education programs; (c) to draw these insights together to provide suggestions regarding how the RE-AIM could be used to enhance planning and evaluation of evidence-based programs for parent education in sport. Specifically, utilizing the RE-AIM framework to provide insights into pertinent evaluation metrics, this integrative review aimed to identify commonalities and gaps in the reporting of parent education programs. The RE-AIM framework considers the essential elements to assess the external and internal validity of interventions through five dimensions: Reach, Effectiveness, Adoption, Implementation, and Maintenance (Am J Public Health. 1999;89(9):1322-1327). Subsequently, the review aimed to provide suggestions regarding strategies to enhance the planning and evaluation of evidence-based programs for parent education in sport. Overall, the analysis demonstrated that most studies presented some pertinent evaluation information related to the RE-AIM framework, such as the number of participants and contacts made, the measures used, and the program level. However, the studies also lacked information on participant exclusion criteria, the method used to select the delivery agent (e.g., parents engaged in the program), and cost measures. Overall, the current study identified various areas where programs could be enhanced, specifically related to reporting procedural elements (e.g., program design, target population, and costs) pertaining to the implementation of parent education programs.

Health benefits of Open Streets programmes in Latin America: a quantitative health impact assessment

BACKGROUND

To improve physical activity in Latin American cities, several interventions have been promoted, such as Open Streets programmes. Our study aims to quantify the health and economic effects of Open Streets-related physical activity in 15 Latin American cities.

METHODS

We used a quantitative health impact assessment approach to estimate annual premature deaths and disease incidence (ischaemic heart disease, ischaemic stroke, type 2 diabetes, colon cancer, breast cancer, and dementia) avoided, the disability-adjusted life-years (DALYs) gained, and the cost saving (from reduced premature mortality) related to increased physical activity from Open Streets programmes in 15 Latin American cities. Input data were obtained from scientific publications, reports, and open street city surveys spanning 2017 to 2019. Physical activity data were converted to metabolic equivalent of the task. Exposure-response relationship functions were applied to estimate relative risk and population-attributable fraction, enabling the assessment of premature deaths and disease incidence.

FINDINGS

The percentage of male users of the Open Streets programmes ranged from 55% (27 500 of 50 000 in Guatemala) to 75% (2250 of 3000 in El Alto, Bolivia), and female users ranged from 25% (750; El Alto) to 45% (22 500; Guatemala). We estimated that the current Open Streets programmes in the 15 Latin American cities studied could prevent 363 (95% CI 271-494) annual premature deaths due to increased physical activity, with an annual economic impact of US$194·1 million (144·9 million-263·9 million) saved and an annual reduction of 1036·7 DALYs (346·7-1778·3). If one Open Streets event is added per week in each of those cities, the potential benefit could increase to 496 (370 to 677) premature deaths prevented each year.

INTERPRETATION

Open Streets programmes in Latin America can provide health and economic benefits related to increased physical activity and can be used as a health promotion and disease prevention tool.

FUNDING

EU's Horizon 2020 research and innovation programme.

Municipal community centers as healthy settings: evaluation of a real-world health promotion intervention in Jerusalem

Background

This study presents an intervention designed to foster the implementation of health promotion programs within District Municipality Community Centers (DMCCs) in Jerusalem, and the creation of a peer network of healthy settings with a shared aspiration of collaborating and implementing health-promoting policies at the community level. We also present the evaluation strategy, based on the EQUIHP and RE-AIM frameworks.

Methods

Twenty DMCCs completed our program. This evaluation research involved a comprehensive seminar during the first year for DMCCs coordinators, teaching them the principles of health promotion. An educational kit was distributed during the second year. The evaluation strategy included a process evaluation and annual evaluations based on the EQUIHP and RE-AIM frameworks. The EQUIHP tool was divided into four dimensions of evaluation: 1) Framework of health promotion principles, 2) Project development and implementation, 3) Project management, and 4) Sustainability; while the RE-AIM domains included: 1)Reach, 2)Effectiveness, 3)Adoption, 4)Implementation and 5)Maintenance.

Results

The program led to high responsiveness among DMCCs and to the implementation of diverse health promotion initiatives, with a participation of approximately 29,191 residents. The EQUIHP evaluation showed an improvement in program quality in Year 2. The final RE-AIM evaluation presented a total median score of 0.61 for all domains, where 0 was non-performance and 1.0 was full performance. The ‘Framework of health promotion principles’ and ‘Reach’ components received the highest median score (0.83, 1.0 and 0.87), while the ‘Sustainability and ‘Maintenance’ components received the lowest (0.5).

Conclusions

This innovative program adapts the Healthy Cities approach (initiated by the World Health Organization in 1986) to the development of community center health-promoting settings within the larger municipal framework, training local community center staff members to assess and address local health concerns and build community capacity. The local focus and efforts may help community actors to create health promotion programs more likely to be adopted, feasible in the ‘real-world’ and able to produce public health impact in the communities where people live. Moreover, collaboration and cooperation among DMCCs may lead to a broader community health vision, forging coalitions that can advocate more powerfully for health promotion.

Trial registration

NIH trial registration number: NCT04470960.

Retrospectively registered on: 14/07/2020.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-022-14220-7.

Assessing the Pragmatic Nature of mHealth Interventions Promoting Physical Activity: A Systematic Review and Meta-Analysis (Preprint)

BACKGROUND

Mobile health (mHealth) apps can promote physical activity; however, the pragmatic nature (ie, how well research translates into real-world settings) of these studies is unknown. The impact of study design choices, for example, intervention duration, on intervention effect sizes is also understudied.

OBJECTIVE

This review and meta-analysis aims to describe the pragmatic nature of recent mHealth interventions for promoting physical activity and examine the associations between study effect size and pragmatic study design choices.

METHODS

The PubMed, Scopus, Web of Science, and PsycINFO databases were searched until April 2020. Studies were eligible if they incorporated apps as the primary intervention, were conducted in health promotion or preventive care settings, included a device-based physical activity outcome, and used randomized study designs. Studies were assessed using the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) and Pragmatic-Explanatory Continuum Indicator Summary-2 (PRECIS-2) frameworks. Study effect sizes were summarized using random effect models, and meta-regression was used to examine treatment effect heterogeneity by study characteristics.

RESULTS

Overall, 3555 participants were included across 22 interventions, with sample sizes ranging from 27 to 833 (mean 161.6, SD 193.9, median 93) participants. The study populations' mean age ranged from 10.6 to 61.5 (mean 39.6, SD 6.5) years, and the proportion of males included across all studies was 42.8% (1521/3555). Additionally, intervention lengths varied from 2 weeks to 6 months (mean 60.9, SD 34.9 days). The primary app- or device-based physical activity outcome differed among interventions: most interventions (17/22, 77%) used activity monitors or fitness trackers, whereas the rest (5/22, 23%) used app-based accelerometry measures. Data reporting across the RE-AIM framework was low (5.64/31, 18%) and varied within specific dimensions (Reach=44%; Effectiveness=52%; Adoption=3%; Implementation=10%; Maintenance=12.4%). PRECIS-2 results indicated that most study designs (14/22, 63%) were equally explanatory and pragmatic, with an overall PRECIS-2 score across all interventions of 2.93/5 (SD 0.54). The most pragmatic dimension was flexibility (adherence), with an average score of 3.73 (SD 0.92), whereas follow-up, organization, and flexibility (delivery) appeared more explanatory with means of 2.18 (SD 0.75), 2.36 (SD 1.07), and 2.41 (SD 0.72), respectively. An overall positive treatment effect was observed (Cohen d=0.29, 95% CI 0.13-0.46). Meta-regression analyses revealed that more pragmatic studies (-0.81, 95% CI -1.36 to -0.25) were associated with smaller increases in physical activity. Treatment effect sizes were homogenous across study duration, participants' age and gender, and RE-AIM scores.

CONCLUSIONS

App-based mHealth physical activity studies continue to underreport several key study characteristics and have limited pragmatic use and generalizability. In addition, more pragmatic interventions observe smaller treatment effects, whereas study duration appears to be unrelated to the effect size. Future app-based studies should more comprehensively report real-world applicability, and more pragmatic approaches are needed for maximal population health impacts.

TRIAL REGISTRATION

PROSPERO CRD42020169102; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=169102.

Evaluating physical activity interventions for socioeconomically disadvantaged adults through the RE-AIM framework: A systematic review of experimental and non–/quasi-experimental trials

•

The review evaluated internal and external validity using the rE-AIM Framework.

•

Results indicate an overall low reporting of validity factors.

•

Information on adoption and maintenance was particularly low.

•

Future studies should improve the reporting across all rE-AIM dimensions.

•

Future studies should consider adaptations during the implementation phase.

The promotion of physical activity in people from lower social strata is a public health priority. Previous reviews of physical activity interventions among socioeconomically disadvantaged adults have focused on intervention effectiveness without considering their translation into practice. This review utilised the RE-AIM framework (Reach, Efficacy/Effectiveness, Adoption, Implementation, Maintenance) to (1) evaluate the extent to which experimental and non–/quasi-experimental trials of interventions to promote physical activity among socioeconomically disadvantaged adults report on issues of internal and external validity and (2) to provide recommendations for future intervention studies.

Four databases were searched through June 2021. We included studies published in English or German since 2000 that tested physical activity interventions for socioeconomically disadvantaged adults. Two researchers coded all studies using a validated RE-AIM data extraction tool with 61 indicators referring to internal and external validity. Binary coding (yes = 1/no = 0) was applied to calculate the number and percentage of studies reporting each of the indicators.

We included 39 studies of which 22 were non–/quasi-experimental trials. Indicators of reach were most frequently reported (59.2%), followed by implementation (38.9%) and efficacy/effectiveness (28.9%). Dimensions related to external validity were least frequently reported (adoption: 21.9%, maintenance: 17.8%). Few differences were found between experimental and non–/quasi-experimental trials.

Analysis showed overall poor reporting of components related to internal and external validity. We recommend that future research should increase attention on reporting indicators of internal and external validity to facilitate their translation and implementation into real world settings.

Trial registration: The review was registered with PROSPERO (CRD42021283688).

Evaluating the Dissemination and Implementation of a Community Health Worker-Based Community Wide Campaign to Improve Fruit and Vegetable Intake and Physical Activity among Latinos along the U.S.-Mexico Border

This study evaluated the dissemination and implementation of a culturally tailored community-wide campaign (CWC), Tu Salud ¡Si Cuenta! (TSSC), to augment fruit and vegetable (FV) consumption and physical activity (PA) engagement among low-income Latinos of Mexican descent living along the U.S.-Mexico Border in Texas. TSSC used longitudinal community health worker (CHW) home visits as a core vehicle to enact positive change across all socioecological levels to induce behavioral change. TSSC's reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) was examined. A dietary questionnaire and the Godin-Shepherd Exercise Questionnaire measured program effectiveness on mean daily FV consumption and weekly PA engagement, respectively. Participants were classified based on CHW home visits into "low exposure" (2-3 visits) and "high exposure" (4-5 visits) groups. The TSSC program reached low-income Latinos (n = 5686) across twelve locations. TSSC demonstrated effectiveness as, compared to the low exposure group, the high exposure group had a greater FV intake (mean difference = +0.65 FV servings daily, 95% CI: 0.53-0.77) and an increased PA (mean difference = +185.6 MET-minutes weekly, 95% CI: 105.9-265.4) from baseline to the last follow-up on a multivariable linear regression analysis. Multivariable logistic regression revealed that the high exposure group had higher odds of meeting both FV guidelines (adjusted odds ratio (AOR) = 2.03, 95% CI: 1.65-2.47) and PA guidelines (AOR = 1.36, 95% CI: 1.10-1.68) at the last follow-up. The program had a 92.3% adoption rate, with 58.3% of adopting communities meeting implementation fidelity, and 91.7% of communities maintaining TSSC. TSSC improved FV consumption and PA engagement behaviors among low-income Latinos region wide. CHW delivery and implementation funding positively influenced reach, effectiveness, adoption, and maintenance, while lack of qualified CHWs negatively impacted fidelity.

The Faith, Activity, and Nutrition (FAN) dissemination and implementation study: changes in and maintenance of organizational practices over 24 months in a statewide initiative

BACKGROUND

Few studies have examined the impact of ecological health promotion interventions on organizational practices over time, especially in faith-based settings. This statewide dissemination and implementation study examined change in organizational practices and their predictors across a 24-month period, as well as maintenance of change.

METHODS

Using a pre-post quasi-experimental design, church coordinators from 92 United Methodist Churches in South Carolina (42% predominantly African American congregations) completed surveys at baseline, and immediate, 12-, and 24-months post-training regarding physical activity (PA) and healthy eating (HE) organizational practices consistent with the Faith, Activity, and Nutrition (FAN) program (opportunities, policies, pastor support, messages) and possible predictors. The study was guided by the RE-AIM framework and the Consolidated Framework for Implementation Research (CFIR). Mixed model repeated measures analyses examined change in organizational practices over time. Regression models examined CFIR predictors of 24-month PA and HE organizational practices, controlling for baseline practices. Churches were also classified as maintainers (implemented at 12 and 24 months), non-sustained implementers (implemented at 12 but not 24 months), delayed implementers (implemented at 24 but not 12 months), and low implementers (implemented at neither 12 nor 24 months) for each FAN component.

RESULTS

PA and HE organizational practices increased over time (p < .0001). CFIR domains (and constructs within) of intervention characteristics (adaptability, relative advantage, cost/time), inner setting (relative priority, organizational rewards, readiness, congregant needs), characteristics of the implementer (self-efficacy, perceived benefits), and implementation process (engaging opinion leaders, engaging champions) were important predictors of 24-month PA and HE organizational practices. Over half of churches implementing PA policies, PA messages, HE policies, and HE opportunities at 12 months were maintainers at 24 months, and one-third were maintainers for PA opportunities, HE messages, and PA and HE pastor support. Furthermore, 16% of 12-month non-implementers were delayed implementers at 24 months for PA policies and 31% were delayed implementers for HE policies.

CONCLUSIONS

This study makes important contributions to the faith-based health promotion literature by including a large sample of churches, testing an ecological intervention approach, and assessing organizational practices over a 24-month period. Study findings can guide technical assistance and program adaptations over time.

TRIAL REGISTRATION

This study was registered in clinicaltrials.gov NCT02868866 on August 16, 2016.

Internet Search Results for Older Adult Physical Activity Guidelines: Scoping Review

Background

Older adults seek health-related information through casual internet searches. Yet, researchers focus on peer-reviewed journals and conference presentations as primary dissemination strategies. Representatives of mass media are alerted (passive diffusion) of new studies or recommendations, but the veracity of the information shared is not often analyzed, and when it is, the analysis is often not comprehensive. However, most older adults do not have access to peer-reviewed journal articles or paid subscription services for more reputable media outlets.

Objective

We aimed to determine what information was readily available (ie, open access) to older adults who may casually search the internet for physical activity recommendations.

Methods

We performed a 6-part scoping review to determine the research question and available evidence, and extract data within open-access top hits using popular online search engines. Results were categorized by a dissemination model that has categories of sources, channels, audience, and messages.

Results

After the iterative search process, 92 unique articles were included and coded. Only 5 (5%) cited physical activity guidelines, and most were coded as promoting healthy aging (82/92, 89%) and positive framing (84/92, 91%). Most articles were posed as educational, but the authors’ credentials were rarely reported (ie, 22% of the time). Muscle strengthening and balance components of the physical activity guidelines for older adults were rarely reported (72/92, 78% and 80/92, 87%, respectively) or inaccurately reported (3/92, 3% and 3/92, 3%, respectively).

Conclusions

Inconsistent messages lead to mistrust of science and public health representatives. This work highlights the lack of evidence within existing open-access resources. Further efforts are needed to ensure evidence-based public health messages are in the sources and channels older adults are using to inform their knowledge and behaviors.

Scaling a Community-Wide Campaign Intervention to Manage Hypertension and Weight Loss

Public health impacts can be achieved when evidence-based interventions are implemented to those most in need. Too often implementation never or slowly occurs. The community-wide campaign intervention Tu Salud ¡Si Cuenta! has evidence of improving health outcomes related to chronic disease among low-income, Latinos. Using the RE-AIM Framework, this study examined if the scaled-up version of the intervention is associated with improvements in hypertension and obesity in 12 locations. Each element of the RE-AIM framework was examined. For "Effectiveness," we examined outcomes overall and by implementing location. We used linear and logistic regression to assess if exposure in the intervention was associated with improvement in hypertension and weight loss. Participants were stratified into "low exposure" (2-3 outreach visits) vs. "high exposure" (4-5 outreach visits). Based on the RE-AIM Framework, the intervention "reached" its intended population of low-income Latinos, demonstrated "effectiveness" in improving hypertension and obesity, was "adopted" at a high level in all but one site, was "implemented" with fidelity to the intervention model with moderate success across locations, and showed high "maintenance" over time. For effectiveness specifically, we found that out of 5,019 participants, 2,508 (50%) had a baseline hypertensive blood pressure (BP) reading. Of the 2,508, 1,245 (49.9%) recovered to normal blood pressure or pre-hypertension stage by last follow-up. After adjusting for baseline BP and potential confounders in multivariable linear regression models, the high exposure group had significantly more reduction in systolic BP (adjusted mean difference in % change = -0.96; p = 0.002) and diastolic BP (adjusted mean difference in % change = -1.61; p < 0.0001) compared to the low exposure group. After controlling for baseline weight and other confounders, the high exposure group had significantly greater decrease in weight compared to the low exposure group (adjusted mean difference in % change = -1.28; p < 0.0001). Results from the multivariable logistic regression models indicated that compared to the low exposure group the high exposure group was more likely to achieve a clinically significant minimum 5% weight loss [adjusted odds ratio (OR) = 2.97; p < 0.0001). This study contributes evidence that a Community-Wide Campaign model holds promise for addressing hypertension and obesity among low-income Latinos.

Implementation at-scale of school-based physical activity interventions: A systematic review utilizing the RE-AIM framework

School-based interventions can increase young people's physical activity levels, but few are implemented at-scale (i.e., the expanded delivery of efficacious interventions under real-world conditions into new/broader populations). The Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework can be used to describe the extent to which interventions have been implemented at-scale. The aim of our review was to determine the extent to which studies of school-based physical activity interventions implemented at-scale reported information across the RE-AIM dimensions. We conducted a systematic search of seven electronic databases to identify studies published up to June 2019. A total of 26 articles (representing 14 individual studies) met the inclusion criteria and were analyzed. Eleven studies reported actual or estimated number of students exposed to the intervention; however, the representativeness of these students was rarely reported. Nine studies reported the intervention effect on the primary outcome during scale-up. Ten studies reported the rate of participating schools/teachers; however, none reported on the characteristics of adopters/nonadopters. Eight studies reported intervention fidelity. Eleven studies described the extent to which the intervention was sustained in schools. There was considerable variability in the reporting of RE-AIM outcomes across studies. There is a need for greater consistency in the evaluation, and reporting of, school-based physical activity interventions implemented at-scale.

Health Promoting School Interventions in Latin America: A Systematic Review Protocol on the Dimensions of the RE-AIM Framework

Understanding the dimensions of internal and external validities (e.g., using the RE-AIM model: Reach, Effectiveness/Efficacy, Adoption, Implementation, and Maintenance) of school interventions is important to guide research and practice in this context. The aim of this systematic review protocol is to synthesize evidence on the RE-AIM dimensions in interventions based on the Health Promoting School (HPS) approach from the World Health Organization (WHO) in Latin America. Studies of interventions based on HPS-WHO that were carried out in Latin America involving the population of 5 to 18-year-olds will be eligible. Searches in nine electronic databases, a study repository, the gray literature, and the retrieved articles' reference lists will be performed, without year or publication language limits. Study selection and data extraction will be conducted by independent researchers. Data on intervention implementation will be summarized in categories of HPS-WHO actions: (1) school curriculum, (2) changes in the social and/or physical environment of schools, and (3) actions with families and the community. A previously validated tool will be used to summarize the information on the dimensions of the RE-AIM model. The strengths and limitations of the included studies will be evaluated using the Critical Appraisal Skills Program (CASP) tool, and the confidence level of evidence will be assessed according to the GRADE CERQual tool.

Re-thinking Physical Activity Programs for Older Brazilians and the Role of Public Health Centers: A Randomized Controlled Trial Using the RE-AIM Model

Background: Explored the role of public health centers in the delivery of physical activity programs to older Brazilians.

Methods: Total of 114 older adults (81% women) from public health centers across the city of Florianopolis, Brazil, were randomized into three groups: behavior change group (n = 36), traditional exercise group (n = 52), and control group (n = 26). The behavioral change group included 12 weekly meetings (2 h each). The traditional exercise group offered a 12-week exercise class. Individuals in the control group participated only in measurements. Program evaluation included a mixed-methods approach following the RE-AIM framework (reach, effectiveness, adoption, implementation, and maintenance). Trained interviewers conducted 12 focus groups and 32 interviews with participants in the program, professionals delivering the programs, community health workers, and local and city administrators overseeing public health centers. Participants completed health, quality of life, and fitness assessments at four time points.

Results: The study reached 11.5% of the eligible population in the community. Older adults' resistance to change and limited understanding of behavior change science by public health center staff hindered program reach. Physician encouraging patient participation and personal invitations by community health workers were perceived as favorable factors. Results of program effectiveness and maintenance suggest that behavior change strategies may be better suited than traditional exercise classes for decreasing sedentary time and increasing moderate-to-vigorous physical activity, as well as improving participants' quality of life. Only 14% of public health centers in the city adopted the programs. Heavy workload of health educators delivering the programs and limited physical space for program delivery were barriers for adoption. The fidelity of program delivery was high and indicates that the programs are culturally-appropriate for the Brazilian context and feasible for implementation by local health educators.

Conclusions: Our findings support the potential for dissemination of behavior change and traditional exercise programs to older adults through public health centers in Brazil.

REBEC: RBR-9pkxn2 (retrospectively registered) Register April 20, 2019.

Amount of physical activity necessary for a normal level of high-sensitivity C-reactive protein in ELSA-Brasil: a cross-sectional study

BACKGROUND

Studies have shown that physical activity levels can be inversely associated with high-sensitivity C-reactive protein (hs-CRP) levels. However, the amount of physical activity required to maintain normal hs-CRP levels is still a matter for speculation.

OBJECTIVE

To identify the amount of physical activity necessary to discriminate the hs-CRP levels in adults.

DESIGN AND SETTING

Cross-sectional study at six teaching and research institutions.

METHODS

The study sample comprised 10,231 adults aged 35 to 74 years who were participants in the Brazilian Longitudinal Study of Adult Health (ELSA-Brasil). Receiver operating characteristic (ROC) curves were constructed to compare the amount of physical activity in two domains (leisure time and commuting) with hs-CRP levels. The sensitivity and specificity were calculated to identify the best cutoff for physical activity level that would be needed to maintain normal levels of hs-CRP (< 3 mg/l).

RESULTS

The area under the ROC curve was only statistically significant for discriminating normal levels of hs-CRP according to the amount of physical activity when the two study domains were added together. The accumulated physical activity level of 200 minutes/week was the best cutoff for discriminating normal levels of hs-CRP in adults of both sex.

CONCLUSIONS

Physical activity in the leisure-time and commuting domains together, of duration 200 minutes/week, was associated with normal hs-CRP values.

Rural physical activity interventions in the United States: a systematic review and RE-AIM evaluation

Background

Previous reviews of rural physical activity interventions were focused on intervention effectiveness and had reported overall mixed findings. The purpose of this systematic review was to apply the Reach, Efficacy, Adoption, Implementation and Maintenance (RE-AIM) framework to evaluate the extent to which rural physical activity interventions in the U.S. have reported on dimensions of internal and external validity and to offer suggestions for future physical activity interventions for rural U.S. populations.

Methods

Pubmed, PsychINFO, CINAHL, PAIS, and Web of Science were searched through February 2019 to identify physical activity intervention studies conducted in rural regions in the U.S. with adult populations. Titles, abstracts, and full texts of articles were reviewed against inclusion and exclusion criteria. Data extraction from included articles included a summary of study details, rural classification system used, and the presence or absence of a total 61 RE-AIM indicators, including reach (n = 13), efficacy/effectiveness (n = 10), adoption (n = 21), implementation (n = 9), and maintenance (n = 8).

Results

A total of 40 full-text articles representing 29 unique studies were included. Classifications of rurality included self-statements by authors (n = 19, 65.5%), population/census-based definitions (n = 3, 10.3%), Rural Urban Continuum Codes (n = 3, 10.3%), Rural Urban Commuting Area codes (n = 2, 6.9%), the 2014 Alabama Rural Health Association classification system (n = 1, 3.4%) and the U.S. Office of Management and Budget classification system (n = 1, 3.4%). Individual studies reported between 14.8 to 52.5% of total RE-AIM indicators. Studies reported 15.4 to 84.6% indicators for reach; 20.0 to 70.0% indicators for efficacy/effectiveness; 4.8 to 47.6% indicators for adoption; 11.1 to 88.9% indicators for implementation; and 0 to 25.0% indicators for maintenance.

Conclusions

We found an overall poor reporting of components related to external validity, which hinders the generalizability of intervention findings, and a lack of consistency in the definition of rurality. Future research should focus on balancing factors of internal and external validity, and should aim to develop a greater understanding of how rurality influences health and behavior to provide contextual knowledge needed to advance the translation of physical activity interventions into practice in rural communities and reduce rural health disparities.

Trial registration

The review protocol was registered with PROSPERO: CRD42019116308.

[Assistance programs for physical activity in Brazilian schools: a review based on the RE-AIM model]

The analysis of physical activity (PA) assistance programs is of major importance to ensure progress in the area. The Reach, Efficacy, Adoption, Implementation and Maintenance (RE-AIM) tool has been broadly disseminated in the literature. This study set out to identify PA assistance programs among Brazilian students and analyze them using the RE-AIM tool. The search was conducted in the Lilacs, SportDiscus, SciELO, Scopus, Web of Science, EBSCOhot, PsycINFO and PubMed databases. After thoroughly researching titles, abstracts and studies, 15 articles (seven PA assistance programs) were included. The programs were conducted in the past decade at public schools in the South and Southeast of Brazil. Multicomponent (education and teacher training) strategies were used with positive results in the practice of PA. With respect to the results of the RE-AIM tool, it was found that the most reported dimensions were "reach" (74%), followed by "efficacy" (48%), "adoption" (43%), "implementation" (35%) and "maintenance" (5%). The indicators most frequently mentioned were those related to the internal validity of the program: demographic and behavioral information of the target population, method of identification of the target population, sample size, participation rate and number of organizational units involved.

Health professional-delivered obesity prevention interventions during the first 1,000 days: A systematic review of external validity reporting

Background: Childhood obesity prevention interventions delivered by health professionals during the first 1,000 days show some evidence of effectiveness, particularly in relation to behavioural outcomes. External validity refers to how generalisable interventions are to populations or settings beyond those in the original study. The degree to which external validity elements are reported in such studies is unclear however. This systematic review aimed to determine the extent to which childhood obesity interventions delivered by health professionals during the first 1,000 days report on elements that can be used to inform generalizability across settings and populations. Methods: Eligible studies meeting study inclusion and exclusion criteria were identified through a systematic review of 11 databases and three trial registers. An assessment tool based on the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework was used to assess the external validity of included studies. It comprised five dimensions: reach and representativeness of individuals, reach and representativeness of settings, implementation and adaptation, outcomes for decision making maintenance and/or institutionalisation. Two authors independently assessed the external validity of 20% of included studies; discrepancies were resolved, and then one author completed assessments of the remaining studies. Results: In total, 39 trials involving 46 interventions published between 1999 and 2019 were identified. The majority of studies were randomized controlled trials (n=24). Reporting varied within and between dimensions. External validity elements that were poorly described included: representativeness of individuals and settings, treatment receipt, intervention mechanisms and moderators, cost effectiveness, and intervention sustainability and acceptability. Conclusions: Our review suggests that more emphasis is needed on research designs that consider generalisability, and the reporting of external validity elements in early life childhood obesity prevention interventions. Important gaps in external validity reporting were identified that could facilitate decisions around the translation and scale-up of interventions from research to practice. Registration: PROSPERO CRD42016050793 03/11/16.

Health professional-delivered obesity prevention interventions during the first 1,000 days: A systematic review of external validity reporting

Background: Childhood obesity prevention interventions delivered by health professionals during the first 1,000 days show some evidence of effectiveness, particularly in relation to behavioural outcomes. External validity refers to how generalisable interventions are to populations or settings beyond those in the original study. The degree to which external validity elements are reported in such studies is unclear however. This systematic review aimed to determine the extent to which childhood obesity interventions delivered by health professionals during the first 1,000 days report on elements that can be used to inform generalizability across settings and populations. Methods: Eligible studies meeting study inclusion and exclusion criteria were identified through a systematic review of 11 databases and three trial registers. An assessment tool based on the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework was used to assess the external validity of included studies. It comprised five dimensions: reach and representativeness of individuals, reach and representativeness of settings, implementation and adaptation, outcomes for decision making maintenance and/or institutionalisation. Two authors independently assessed the external validity of 20% of included studies; discrepancies were resolved, and then one author completed assessments of the remaining studies. Results: In total, 39 trials involving 46 interventions published between 1999 and 2019 were identified. The majority of studies were randomized controlled trials (n=24). Reporting varied within and between dimensions. External validity elements that were poorly described included: representativeness of individuals and settings, treatment receipt, intervention mechanisms and moderators, cost effectiveness, and intervention sustainability and acceptability. Conclusions: Our review suggests that more emphasis is needed on research designs that consider generalisability, and the reporting of external validity elements in early life childhood obesity prevention interventions. Important gaps in external validity reporting were identified that could facilitate decisions around the translation and scale-up of interventions from research to practice. Registration: PROSPERO CRD42016050793 03/11/16.

RE-AIM Planning and Evaluation Framework: Adapting to New Science and Practice With a 20-Year Review

The RE-AIM planning and evaluation framework was conceptualized two decades ago. As one of the most frequently applied implementation frameworks, RE-AIM has now been cited in over 2,800 publications. This paper describes the application and evolution of RE-AIM as well as lessons learned from its use. RE-AIM has been applied most often in public health and health behavior change research, but increasingly in more diverse content areas and within clinical, community, and corporate settings. We discuss challenges of using RE-AIM while encouraging a more pragmatic use of key dimensions rather than comprehensive applications of all elements. Current foci of RE-AIM include increasing the emphasis on cost and adaptations to programs and expanding the use of qualitative methods to understand "how" and "why" results came about. The framework will continue to evolve to focus on contextual and explanatory factors related to RE-AIM outcomes, package RE-AIM for use by non-researchers, and integrate RE-AIM with other pragmatic and reporting frameworks.

Studies About Physical Activity Interventions Including Follow-Up Analysis: A Systematic Review

BACKGROUND

Some studies have used the follow-up method to analyze real behavioral changes in research involving physical activity (PA) interventions. This has great scientific value; however, it is hard to apply without satisfactory resources and research funding. Little is known about how many studies have used this method to analyze PA interventions in low-income and middle-income countries, especially Brazil.

PURPOSE

To describe Brazilian studies using follow-up analysis after PA interventions.

METHODS

A systematic review was performed including Brazilian studies with follow-up analysis after PA interventions; the analyzed papers were from the previous 10 years. The search was carried out in Portuguese, English, and Spanish in the following databases: SciELO, Latin American and Caribbean Health Science Literature, PubMed, and Scopus. The Preferred Reporting Items for Systematic Review and Meta-Analysis method was used.

RESULTS

In total, 6 of the 7 studies analyzed were from the southeast region, with the intervention time ranging from 2 to 12 months, carrying out follow-up every 5.3 months with 2.2 observations on average. The interventions had a behavioral approach and were generally carried out in universities, hospitals, and ambulatory care.

CONCLUSION

Studies on PA interventions using follow-up analysis are scarce. Considering the relevance of follow-up studies to measure behavior changes, the results suggest that more studies about this topic are essential in Brazil.

Evaluating the effectiveness of physician counseling to promote physical activity in Mexico: an effectiveness-implementation hybrid study

Integrating physical activity (PA) counseling in routine clinical practice remains a challenge. The purpose of this study was to evaluate the implementation and effectiveness of a pragmatic strategy aimed to improve physician PA counseling and patient PA. An effectiveness-implementation type-2 hybrid design was used to evaluate a 3-h training (i.e., implementation strategy-IS) to increase physician use of the 5-As (assess, advise, agree, assist, arrange) for PA counseling (i.e., clinical intervention-CI) and to determine if the CI improved patient PA. Patients of trained and untrained physicians reported on PA and quality of life pre-post intervention. Medical charts (N = 1700) were examined to assess the proportion of trained physicians that used the 5-As. The RE-AIM framework informed our evaluation. 305/322 of eligible physicians participated in the IS (M age = 40 years, 52% women) and 683/730 of eligible patients in the CI (M age = 49 years, 77% women). The IS was adopted by all state regions and cost ~ $20 Mexican pesos (US$1) per provider trained. Physician adoption of any of the 5-As improved from pre- to post-training (43 vs. 52%, p < .01), with significant increases in the use of assessment (43 vs. 52%), advising (25 vs. 39%), and assisting with barrier resolution (7 vs. 15%), but not in collaborative goal setting (13 vs. 17%) or arranging for follow-up (1 vs. 1%). Patient PA and quality of life did not improve. The IS intervention was delivered with high fidelity at a low cost, but appears to be insufficient to lead to broad adoption of the CI.

Reach and representativeness of ethnic minority women in the Health Is Power Study: a longitudinal analysis

Reach is a key factor in translating research to practical application. This study examined reach and representativeness of a multi-city, randomized controlled community health trial in African American (AA) and Hispanic or Latina (HL) women. Participants completed measures of demographics, body mass index (BMI), percent body fat, resting heart rate, and blood pressure followed by a run-in procedure and a randomization meeting. AA were more likely to be screened out initially; HL were more likely to drop out. Participation did not differ by city or recruitment method. Women who completed the post-intervention assessment were more likely to be AA, older, and have higher socioeconomic status (p values < .05). This study showed moderate levels of reach but overrepresented higher educated, wealthier, and older women at the completion of the study. Representativeness can change over the course of the study and impact the practicality of translating research to practice.

Evaluating the impact of a walking program in a disadvantaged area: using the RE-AIM framework by mixed methods

Background

The positive health impact of physical activity (PA) is well known, yet a large proportion of the world’s population remains sedentary. General PA programs are common as health promotion initiatives. However, effectiveness evaluations of such PA programs on individual and organizational aspects, which could inform the decision-making process of public health bodies are still lacking, particularly in the most socially disadvantaged areas, where health promotion schemes are particularly needed. The aim of this study was to assess the effectiveness of a Guided Walking Program in a high social vulnerability context.

Methods

A quasi-experimental, mixed methods study was conducted. The program had a duration of 6 months and a 6-month follow-up period after the intervention. Session frequency was five times a week, where sessions consisted of supervised PA combined with educational sessions. The Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) framework was followed to assess the program. The International Physical Activity Questionnaire (IPAQ) and accelerometers were used to measure levels of PA. Focus groups were conducted to gain a comprehensive insight on the implementation domain.

Results

Most subjects in the intervention (IG) (n = 74) and control (CG) (n = 74) groups were female (IG:90.5%; CG:95.9%), aged 18–49 years (IG:44.6%; CG:43.2%), received less than 1 minimum wage (IG:74.3%; CG:83.7%) and had 0–4 years of formal education (IG:52.1%; CG:46.1%). The reach of the intervention was 0.3%. The IG showed increased levels of PA at post-intervention and 6-month follow-up. However, the difference between groups was not statistically significant. Adoption data revealed that 89.5% of the professionals in the Primary Health Care Center (health center) team perceived the benefits of the program for the population. The program was independently promoted by the health center team for a further 4 months post-intervention. The qualitative data revealed that the program was discontinued due to participants’ low adherence and human resource limitations in the unit’s operational dynamics.

Conclusions

A health promotion intervention in a socially deprived setting faces challenges but can be effective and feasible to implement. The present study informs the development of future health promotion initiatives in this context.

Trial registration

NCT02857127. Registered: 30 July 2016 (retrospectively registered).

A systematic review of children's dietary interventions with parents as change agents: Application of the RE-AIM framework

INTRODUCTION

Interventions targeting children's dietary behavior often include strategies that target parents as implementation agents of change, though parent involvement on intervention effectiveness is unclear. The present study systematically assessed (1) reporting of reach, effectiveness, adoption, implementation and maintenance (RE-AIM) of child dietary intervention studies with parents as change agents and (2) evaluated within these studies the comparative effectiveness of interventions with and without a parent component.

METHODS

The search was conducted in PubMed, PsycINFO, and Cochrane Library. Eligible studies were required to include a condition with a parental component, a comparison/control group, and target a child dietary behavior outcome. Forty-nine articles met criteria. Raters extracted RE-AIM and parent implementation information for each study.

RESULTS

Effectiveness (72.5%) was the highest reported RE-AIM element, followed by reach (27.5%), adoption (12.5%), implementation (10%), and maintenance (2.5%). Median reporting of parent implementation was highest for adoption and enactment (20%), followed by receipt (7.5%), and maintenance (2.5%). Six studies tested comparative effectiveness of parental involvement on child dietary outcomes.

CONCLUSION

Current RE-AIM reporting among children's dietary interventions is inchoate. The contribution of parental involvement on intervention effectiveness remains unclear. Increased focus should be placed on reporting of external validity information, to enable better translation of research to practical applications.

Interventions to improve physical activity during pregnancy: a systematic review on issues of internal and external validity using the RE-AIM framework

BACKGROUND

Physical activity (PA) during pregnancy has significant health benefits for the mother and her child; however, many women reduce their activity levels during pregnancy and most are not sufficiently active. Given the important health benefits of PA during pregnancy, evidence that supports research translation is vital.

OBJECTIVES

To determine the extent to which physical activity interventions for pregnant women report on internal and external validity factors using the RE-AIM framework (reach, efficacy/effectiveness, adoption, implementation, and maintenance).

SEARCH STRATEGY

Ten databases were searched up to 1 June 2015. Eligible published papers and unpublished/grey literature were identified using relevant search terms.

SELECTION CRITERIA

Studies had to report on physical activity interventions during pregnancy, including measures of physical activity during pregnancy at baseline and at least one point post-intervention. Randomised controlled trials and quasi-experimental studies that had a comparator group were included.

DATA COLLECTION AND ANALYSIS

Reporting of RE-AIM dimensions were summarised and synthesised across studies.

MAIN RESULTS

The reach (72.1%) and efficacy/effectiveness (71.8%) dimensions were commonly reported; however, the implementation (28.9%) and adoption (23.2%) dimensions were less commonly reported and no studies reported on maintenance.

CONCLUSIONS

This review highlights the under-reporting of issues of contextual factors in studies of physical activity during pregnancy. The translation of physical activity interventions during pregnancy could be improved through reporting of representativeness of participants, clearer reporting of outcomes, more detail on the setting and staff who deliver interventions, costing of interventions and the inclusion of process evaluations and qualitative data.

TWEETABLE ABSTRACT

The systematic review highlights the under-reporting of contextual factors in studies of physical activity during pregnancy.

Physical activity interventions to promote positive youth development among indigenous youth: a RE-AIM review

Physical activity (PA) programs are a promising strategy to promote positive youth development (PYD). It is not known if published reports provide sufficient information to promote the implementation of effective PYD in indigenous youth. The purpose of this study was to assess the extent to which published literature on PA programs that promote PYD in indigenous youth report on RE-AIM (reach, effectiveness, adoption, implementation, maintenance) indicators. A systematic literature search was conducted to identify articles reporting on PA programs that promote PYD in indigenous youth. The search yielded 8084 articles. A validated 21-item RE-AIM abstraction tool assessing internal and external validity factors was used to extract data from 10 articles meeting eligibility criteria. The most commonly reported dimensions were effectiveness (73 %), adoption (48 %), and maintenance (43 %). Reach (34 %) and implementation (30 %) were less often reported. Published research provides insufficient information to inform real-world implementation of PA programs to promote PYD in indigenous youth.

Using a Mixed-Methods RE-AIM Framework to Evaluate Community Health Programs for Older Latinas

OBJECTIVE

This study used the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework to evaluate a promotora-led community health program designed for Latinas ages 50 and older that sought to improve physical activity, nutrition, and stress management.

METHOD

A mixed-methods evaluation approach was administered at participant and organizational levels with a focus on the efficacy, adoption, implementation, and maintenance components of the RE-AIM theoretical model.

RESULTS

The program was shown to be effective at improving participants' eating behaviors, increasing their physical activity levels, and lowering their depressive symptoms. Promotoras felt motivated and sufficiently prepared to deliver the program. Some implementation challenges were reported. More child care opportunities and an increased focus on mental well-being were suggested.

DISCUSSION

The promotora delivery model has promise for program sustainability with both promotoras and participants alike expressing interest in leading future programs.

Implementation conditions for diet and physical activity interventions and policies: an umbrella review

BACKGROUND

This umbrella review aimed at identifying evidence-based conditions important for successful implementation of interventions and policies promoting a healthy diet, physical activity (PA), and a reduction in sedentary behaviors (SB). In particular, we examined if the implementation conditions identified were intervention-specific or policy-specific. This study was undertaken as part of the DEterminants of DIet and Physical Activity (DEDIPAC) Knowledge Hub, a joint action as part of the European Joint Programming Initiative a Healthy Diet for a Healthy Life.

METHODS

A systematic review of reviews and stakeholder documents was conducted. Data from nine scientific literature databases were analyzed (95 documents met the inclusion criteria). Additionally, published documentation of eight major stakeholders (e.g., World Health Organization) were systematically searched (17 documents met the inclusion criteria). The RE-AIM framework was used to categorize elicited conditions. Across the implementation conditions 25 % were identified in at least four documents and were subsequently classified as having obtained sufficient support.

RESULTS

We identified 312 potential conditions relevant for successful implementation; 83 of these received sufficient support. Using the RE-AIM framework eight implementation conditions that obtained support referred to the reach in the target population; five addressed efficacy of implementation processes; 24 concerned adoption by the target staff, setting, or institutions; 43 referred to consistency, costs, and adaptations made in the implementation process; three addressed maintenance of effects over time. The vast majority of implementation conditions (87.9 %; 73 of 83) were supported by documents referring to both interventions and policies. There were seven policy-specific implementation conditions, which focused on increasing complexities of coexisting policies/legal instruments and their consequences for implementation, as well as politicians' collaboration in implementation.

CONCLUSIONS

The use of the proposed list of 83 conditions for successful implementation may enhance the implementation of interventions and policies which pursue identification of the most successful actions aimed at improving diet, PA and reducing SB.

Fidelity to and comparative results across behavioral interventions evaluated through the RE-AIM framework: a systematic review

BACKGROUND

The reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) framework was developed to determine potential public health impact of interventions (i.e., programs, policy, and practice). The purpose of this systematic review was to determine (1) comparative results across accurately reported RE-AIM indicators, (2) relevant information when there remains under-reporting or misclassification of data across each dimension, (3) the degree to which authors intervened to improve outcomes related to each dimension, and (4) the number of articles reporting RE-AIM dimensions for a given study.

METHODS

In April 2013, a systematic search of the RE-AIM framework was completed in PubMed, PSYCHInfo, EbscoHost, Web of Science, and Scopus. Evidence was analyzed until January 2015.

RESULTS

Eighty-two interventions that included empirical data related to at least one of the RE-AIM dimensions were included in the review. Across these interventions, they reached a median sample size of 320 participants (M = 4894 ± 28,256). Summarizing the effectiveness indicators, we found that: the average participation rate was 45 % (±28 %), 89 % of the interventions reported positive changes in the primary outcome and 11 interventions reported broader outcomes (e.g., quality of life). As for individual-level maintenance, 11 % of studies showed effects ≥6 months post-program. Average setting and staff adoption rates were 75 % (±32 %) and 79 % (±28 %), respectively. Interventions reported being delivered as intended (82 % (±16 %)) and 22 % intervention reported adaptations to delivery. There were insufficient data to determine average maintenance at the organizational level. Data on costs associated with each dimension were infrequent and disparate: four studies reported costs of recruitment, two reported intervention costs per participant, and two reported adoption costs.

CONCLUSIONS

The RE-AIM framework has been employed in a variety of populations and settings for the planning, delivery, and evaluation of behavioral interventions. This review highlights inconsistencies in the degree to which authors reported each dimension in its entirety as well as inaccuracies in reporting indicators within each dimension. Further, there are few interventions that aim to improve outcomes related to reach, adoption, implementation, and maintenance.

Evaluating Intervention Programs Targeting Parents to Manage Childhood Overweight and Obesity: A Systematic Review Using the RE-AIM Framework

Intervention programs targeting parents to manage childhood overweight and obesity have emerged based on parents influence on the health behaviors of their children. The purpose of this review was to systematically evaluate intervention programs targeting parents to manage childhood overweight and obesity using the Reach, Efficacy, Adopt, Implementation, and Maintenance (RE-AIM) framework. There was a moderate risk of bias across all studies. The overall proportion of studies (n=7) reporting on each dimension of the RE-AIM framework ranged from 78.6% (reach) to 23.8% (maintenance). The majority of intervention programs demonstrated improvement in child BMI. However intervention programs did not reach families of diverse race/ethnicity, were provided by highly trained professionals, and demonstrated high attrition, thus limiting generalizability.

Are physical activity studies in Hispanics meeting reporting guidelines for continuous monitoring technology? A systematic review

BACKGROUND

Continuous monitoring technologies such as accelerometers and pedometers are the gold standard for physical activity (PA) measurement. However, inconsistencies in use, analysis, and reporting limit the understanding of dose-response relationships involving PA and the ability to make comparisons across studies and population subgroups. These issues are particularly detrimental to the study of PA across different ethnicities with different PA habits. This systematic review examined the inclusion of published guidelines involving data collection, processing, and reporting among articles using accelerometers or pedometers in Hispanic or Latino populations.

METHODS

English (PubMed; EbscoHost) and Spanish (SCIELO; Biblioteca Virtual en Salud) articles published between 2000 and 2013 using accelerometers or pedometers to measure PA among Hispanics or Latinos were identified through systematic literature searches. Of the 253 abstracts which were initially reviewed, 57 met eligibility criteria (44 accelerometer, 13 pedometer). Articles were coded and reviewed to evaluate compliance with recommended guidelines (N = 20), and the percentage of accelerometer and pedometer articles following each guideline were computed and reported.

RESULTS

On average, 57.1 % of accelerometer and 62.2 % of pedometer articles reported each recommended guideline for data collection. Device manufacturer and model were reported most frequently, and provision of instructions for device wear in Spanish was reported least frequently. On average, 29.6 % of accelerometer articles reported each guideline for data processing. Definitions of an acceptable day for inclusion in analyses were reported most frequently, and definitions of an acceptable hour for inclusion in analyses were reported least frequently. On average, 18.8 % of accelerometer and 85.7 % of pedometer articles included each guideline for data reporting. Accelerometer articles most frequently included average number of valid days and least frequently included percentage of wear time.

DISCUSSION

Inclusion of standard collection and reporting procedures in studies using continuous monitoring devices in Hispanic or Latino population is generally low.

CONCLUSIONS

Lack of reporting consistency in continuous monitoring studies limits researchers' ability to compare studies or draw meaningful conclusions concerning amounts, quality, and benefits of PA among Hispanic or Latino populations. Reporting data collection, computation, and decision-making standards should be required. Improved interpretability would allow practitioners and researchers to apply scientific findings to promote PA.

Coach development programmes to improve interpersonal coach behaviours: a systematic review using the re-aim framework

OBJECTIVE

Although evidence supports the effectiveness of interpersonal Coach Development Programmes (CDPs), which are designed to foster coach-athlete relationships, an intervention's impact is shaped by numerous factors over and above effectiveness. The purpose of this systematic review was to examine the extent that published articles describing interpersonal CDP trials reported on indicators of internal and external validity, as conceptualised in the RE-AIM framework (ie, Reach, Effectiveness, Adoption, Implementation and Maintenance).

METHODS

The search strategy was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses guidelines, involving a database search and supplemental manual search of key articles and journals. After initial screening, the full-text search strategy involved identifying articles describing CDP trials and then selecting a specific subgroup of articles involving interpersonal CDP trials and excluding ineligible articles. Resulting trials were coded using a 47-item sport coaching adaptation of the RE-AIM coding sheet.

RESULTS

17 published articles met eligibility criteria, representing 10 distinct CDP trials. After attaining coder agreement, global ratings of RE-AIM indicators within interpersonal CDP trials ranged from the low to moderate quality. Whereas indicators of effectiveness and implementation were reported to some extent across all studies, maintenance within sport organisations and a number of specific indicators from across dimensions were rarely reported.

CONCLUSIONS

These findings inform the future design and evaluation of CDPs that have the potential to be adopted in numerous settings and reach athletes and coaches who can most benefit.

Using the RE-AIM framework to evaluate physical activity public health programs in México

Background

Physical activity (PA) public health programming has been widely used in Mexico; however, few studies have documented individual and organizational factors that might be used to evaluate their public health impact. The RE-AIM framework is an evaluation tool that examines individual and organizational factors of public health programs. The purpose of this study was to use the RE-AIM framework to determine the degree to which PA programs in Mexico reported individual and organizational factors and to investigate whether reporting differed by the program’s funding source.

Methods

Public health programs promoting PA were systematically identified during 2008–2013 and had to have an active program website. Initial searches produced 23 possible programs with 12 meeting inclusion criteria. A coding sheet was developed to capture behavioral, outcome and RE-AIM indicators from program websites.

Results

In addition to targeting PA, five (42%) programs also targeted dietary habits and the most commonly reported outcome was change in body composition (58%). Programs reported an average of 11.1 (±3.9) RE-AIM indicator items (out of 27 total). On average, 45% reported reach indicators, 34% reported efficacy/effectiveness indicators, 60% reported adoption indicators, 40% reported implementation indicators, and 35% reported maintenance indicators. The proportion of RE-AIM indicators reported did not differ significantly for programs that were government supported (M = 10, SD = 3.1) and programs that were partially or wholly privately or corporately supported (M = 12.0, SD = 4.4).

Conclusion

While reach and adoption of these programs were most commonly reported, there is a need for stronger evaluation of behavioral and health outcomes before the public health impact of these programs can be established.

Electronic supplementary material

The online version of this article (doi:10.1186/s12889-015-1474-2) contains supplementary material, which is available to authorized users.