Methodological issues in research on web-based behavioral interventions

Studying the Digital Intervention Engagement-Mediated Relationship Between Intrapersonal Measures and Pre-Exposure Prophylaxis Adherence in Sexual and Gender Minority Youth: Secondary Analysis of a Randomized Controlled Trial

BACKGROUND

Improving adherence to pre-exposure prophylaxis (PrEP) via digital health interventions (DHIs) for young sexual and gender minority men who have sex with men (YSGMMSM) is promising for reducing the HIV burden. Measuring and achieving effective engagement (sufficient to solicit PrEP adherence) in YSGMMSM is challenging.

OBJECTIVE

This study is a secondary analysis of the primary efficacy randomized controlled trial (RCT) of Prepared, Protected, Empowered (P3), a digital PrEP adherence intervention that used causal mediation to quantify whether and to what extent intrapersonal behavioral, mental health, and sociodemographic measures were related to effective engagement for PrEP adherence in YSGMMSM.

METHODS

In May 2019, 264 YSGMMSM were recruited for the primary RCT via social media, community sites, and clinics from 9 study sites across the United States. For this secondary analysis, 140 participants were eligible (retained at follow-up, received DHI condition in primary RCT, and completed trial data). Participants earned US currency for daily use of P3 and lost US currency for nonuse. Dollars accrued at the 3-month follow-up were used to measure engagement. PrEP nonadherence was defined as blood serum concentrations of tenofovir-diphosphate and emtricitabine-triphosphate that correlated with ≤4 doses weekly at the 3-month follow-up. Logistic regression was used to estimate the total effect of baseline intrapersonal measures on PrEP nonadherence, represented as odds ratios (ORs) with a null value of 1. The total OR for each intrapersonal measure was decomposed into direct and indirect effects.

RESULTS

For every US $1 earned above the mean (US $96, SD US $35.1), participants had 2% (OR 0.98, 95% CI 0.97-0.99) lower odds of PrEP nonadherence. Frequently using phone apps to track health information was associated with a 71% (OR 0.29, 95% CI 0.06-0.96) lower odds of PrEP nonadherence. This was overwhelmingly a direct effect, not mediated by engagement, with a percentage mediated (PM) of 1%. Non-Hispanic White participants had 83% lower odds of PrEP nonadherence (OR 0.17, 95% CI 0.05-0.48) and had a direct effect (PM=4%). Participants with depressive symptoms and anxiety symptoms had 3.4 (OR 3.42, 95% CI 0.95-12) and 3.5 (OR 3.51, 95% CI 1.06-11.55) times higher odds of PrEP nonadherence, respectively. Anxious symptoms largely operated through P3 engagement (PM=51%).

CONCLUSIONS

P3 engagement (dollars accrued) was strongly related to lower odds of PrEP nonadherence. Intrapersonal measures operating through P3 engagement (indirect effect, eg, anxious symptoms) suggest possible pathways to improve PrEP adherence DHI efficacy in YSGMMSM via effective engagement. Conversely, the direct effects observed in this study may reflect existing structural disparity (eg, race and ethnicity) or behavioral dispositions toward technology (eg, tracking health via phone apps). Evaluating effective engagement in DHIs with causal mediation approaches provides a clarifying and mechanistic view of how DHIs impact health behavior.

TRIAL REGISTRATION

ClinicalTrials.gov; NCT03320512; https://clinicaltrials.gov/study/NCT03320512.

An Image-Recognition Dietary Assessment App for Adolescents With Obesity: Pilot Randomized Controlled Trial

BACKGROUND

Adolescence is a period of increased susceptibility to developing obesity-related health issues due to poor eating patterns and increased sedentary behaviors. Recommendations for pediatric obesity management include dietary assessments. However, adolescents often avoid food logging through traditional methods. The use of image-recognition dietary assessment apps in adolescents with obesity is not well studied. Eating for Wellness (E4W) is a mobile app that determines the nutritional content of meals from photos and incorporates nutritional goal setting. Nutritional data can be displayed for health care providers (HCPs) via the Clinician Portal, while the data are presented to the user in a manner that minimizes the focus on calorie counting.

OBJECTIVE

This study aims to evaluate the usability and feasibility of E4W, a mobile health app designed to improve dietary intake in adolescents with obesity attending an obesity clinic, using a phased approach.

METHODS

The overall study was conducted in 2 phases to refine and evaluate E4W. In Phase 1, usability was tested through 3 iterative cycles of patient interviews. A total of 14 patient participants, aged 12-18 years with a BMI≥97th percentile, were included. Participants performed standardized scenario-based tasks in E4W and provided feedback on the app. Two iterative cycles were conducted for HCPs (n=4). Refinements were made during each cycle based on issues encountered and feedback provided. In Phase 2, a pilot randomized controlled trial of 32 adolescents (16 adolescents enrolled in the experimental group for 1 month, and 16 controls enrolled for 1 month) was completed. Both groups met with their dietitian at baseline, midstudy, and 1 month following their baseline visit to discuss goals and eating patterns. The control group was instructed to take photos of all intake using their default phone camera, without access to E4W, while those in the experimental group received full access to E4W. The primary outcome was the feasibility of implementation. Secondary outcomes examined overall change in dietary intake and achievement of nutritional goals.

RESULTS

Usability testing demonstrated that E4W and the Clinician Portal were easy to use, efficient, and well-liked by patients and HCPs. Feasibility testing revealed high patient acceptability scores. However, significant technical challenges were encountered. Although the use of E4W did not significantly impact patient engagement (control: mean 0.9, SD 0.7; experimental: mean 1.7, SD 1.9; P=.14), there were outliers in the experimental group with very high engagement and improved self-reported efficacy. Overall, there was no improvement in dietary intake, although assessment was hindered by poor adherence to traditional methods of food logging.

CONCLUSIONS

E4W and the Clinician Portal were well-received by patients and HCPs. Further research is warranted and planned to determine if E4W can improve dietary intake and achievement of nutritional goals in adolescents with obesity.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05548868; https://clinicaltrials.gov/study/NCT05548868.

Web-Based Coping Skills Training and Coach Support for Women Living With a Partner With an Alcohol Use Disorder: Randomized Controlled Trial

BACKGROUND

Individuals living with a partner with an alcohol use disorder (AUD) can experience significant psychological distress and use health care more than those without a partner with an AUD. However, the prevailing treatment system's focus on the partner and personal barriers limit these individuals from getting help for themselves. Preliminary work on a self-directed, web-based coping skills training program, Stop Spinning My Wheels (SSMW), shows promise in broadening available treatments for this population. In this study, we conducted a robust evaluation of SSMW primary outcomes.

OBJECTIVE

The study aims to test whether women with a partner with an AUD assigned to SSMW experienced a greater reduction in negative affect (depression and anger) (1) than a usual web care (UWC) control and (2) with brief phone coach support (SSMW+coach) rather than without (SSMW only) and (3) whether baseline negative affect moderated treatment effects.

METHODS

Women (mean age 45.7, SD 10.8 years; Black: 17/456, 3.7%; White: 408/456, 89.5%) were randomized to SSMW only, SSMW+coach, or UWC. Depression (Beck Depression Inventory-II) and anger (State-Trait Anger Expression Inventory 2-State Anger) were assessed at baseline, 12-week posttest, and 6- and 12-month follow-ups.

RESULTS

Participants in all conditions decreased in depression from baseline to posttest and from baseline to follow-up; SSMW-only and SSMW+coach participants decreased in anger, but UWC participants did not. Compared to UWC participants, SSMW-only participants experienced greater anger reduction (P=.03), and SSMW+coach participants experienced a greater reduction in depression (P<.001) from baseline to posttest. However, from baseline to follow-up, only a greater, but not statistically significant (P=.052), reduction in anger occurred in SSMW+coach compared to UWC. Although the SSMW conditions did not differ from each other in negative affect outcomes (P=.06-.57), SSMW+coach had higher program engagement and satisfaction (all P<.004). Baseline negative affect did not moderate effects, although remission from baseline clinically relevant depressive symptoms (Beck Depression Inventory≥14) was higher in SSMW only (33/67, 49%; odds ratio 2.13, 95% CI 1.05-4.30; P=.03) and SSMW+coach (46/74, 62%; odds ratio 3.60, 95% CI 1.79-7.23; P<.001) than in UWC (21/67, 31%); remission rates did not differ between the SSMW conditions (P=.12).

CONCLUSIONS

The results partially supported the hypotheses. The SSMW conditions had earlier effects than UWC, but positive change in UWC mitigated the hypothesized long-term SSMW-UWC differences. The results highlight the importance of incorporating active controls in web-based clinical trials. Although SSMW+coach showed benefits over SSMW only on engagement and satisfaction measures and in the number needed to treat (5.6 for SSMW only; 3.2 for SSMW+coach), the SSMW conditions were comparable and superior to UWC on depressive symptom remission levels. Overall, SSMW with or without a coach can reduce clinically meaningful distress and add to available treatment options for this large, underserved group.

TRIAL REGISTRATION

ClinicalTrials.gov NCT02984241; https://www.clinicaltrials.gov/study/NCT02984241.

Reducing patient delay in acute coronary syndrome: Randomized controlled trial testing effect of behaviour change intervention on intentions to seek help

OBJECTIVES

The aim of this study was to evaluate the efficacy of a behaviour change intervention to reduce patient delay with symptoms of acute coronary syndrome.

DESIGN

A 3-arm web-based, parallel randomized controlled trial.

METHODS

The intervention comprised 12 behaviour change techniques (BCTs) embedded in a text-only or text+visual narrative (the techniques were systematically identified through systematic review and a consensus exercise). Between February and November 2017, n = 145 people who had recently experienced acute coronary syndrome were randomly allocated to intervention ('text+visual' or 'text-only') or control. Intentions to phone an ambulance immediately for acute coronary syndrome symptoms were assessed before and after the intervention using symptom scenarios, and the change in intention was compared across the three groups.

RESULTS

Significant increases in intention to phone an ambulance immediately for ACS symptoms were seen following the 'text+visual' intervention but not following 'text-only' or control. However, the study was underpowered to detect any significant changes in intention between the 3 groups. There were no unintended effects on intentions for non-urgent symptoms.

CONCLUSIONS

A 'text+visual' BCT-based intervention may significantly increase intention to phone an ambulance with symptoms of ACS. Further testing of the effect of the intervention on actual behaviour is required.

Effect of a Machine Learning Recommender System and Viral Peer Marketing Intervention on Smoking Cessation: A Randomized Clinical Trial

IMPORTANCE

Novel data science and marketing methods of smoking-cessation intervention have not been adequately evaluated.

OBJECTIVE

To compare machine learning recommender (ML recommender) computer tailoring of motivational text messages vs a standard motivational text-based intervention (standard messaging) and a viral peer-recruitment tool kit (viral tool kit) for recruiting friends and family vs no tool kit in a smoking-cessation intervention.

DESIGN, SETTING, AND PARTICIPANTS

This 2 ×2 factorial randomized clinical trial with partial allocation, conducted between July 2017 and September 2019 within an online tobacco intervention, recruited current smokers aged 18 years and older who spoke English from the US via the internet and peer referral. Data were analyzed from March through May 2022.

INTERVENTIONS

Participants registering for the online intervention were randomly assigned to the ML recommender or standard messaging groups followed by partially random allocation to access to viral tool kit or no viral tool kit groups. The ML recommender provided ongoing refinement of message selection based on user feedback and comparison with a growing database of other users, while the standard system selected messages based on participant baseline readiness to quit.

MAIN OUTCOMES AND MEASURES

Our primary outcome was self-reported 7-day point prevalence smoking cessation at 6 months.

RESULTS

Of 1487 participants who smoked (444 aged 19-34 years [29.9%], 508 aged 35-54 years [34.1%], 535 aged ≥55 years [36.0%]; 1101 [74.0%] females; 189 Black [12.7%] and 1101 White [78.5%]; 106 Hispanic [7.1%]), 741 individuals were randomly assigned to the ML recommender group and 746 individuals to the standard messaging group; viral tool kit access was provided to 745 participants, and 742 participants received no such access. There was no significant difference in 6-month smoking cessation between ML recommender (146 of 412 participants [35.4%] with outcome data) and standard messaging (156 of 389 participants [40.1%] with outcome data) groups (adjusted odds ratio, 0.81; 95% CI, 0.61-1.08). Smoking cessation was significantly higher in viral tool kit (177 of 395 participants [44.8%] with outcome data) vs no viral tool kit (125 of 406 participants [30.8%] with outcome data) groups (adjusted odds ratio, 1.48; 95% CI, 1.11-1.98).

CONCLUSIONS AND RELEVANCE

In this study, machine learning-based selection did not improve performance compared with standard message selection, while viral marketing did improve cessation outcomes. These results suggest that in addition to increasing dissemination, viral recruitment may have important implications for improving effectiveness of smoking-cessation interventions.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT03224520.

Feasibility and Acceptability of an Internet-Based Intervention for Young Adults with ADHD

Internet-based interventions (IBIs) to treat psychological disorders are available, but accessibility to these to treat attention-deficit/hyperactivity disorder (ADHD) in young adult populations is quite limited. The current study examined the feasibility of a proposed IBI for ADHD and participant perceptions regarding treatment acceptability and credibility, and outcome expectancy. Participants (N = 235; aged 18-35) with a prior ADHD diagnosis were recruited through Amazon's Mechanical Turk (MTurk) and were provided with a proposed IBI and explanatory outlines of treatment module content. Participants in the cross-sectional study were randomly assigned to either a tailored (i.e., targeted content modules), minimal (i.e., presented overall fewer and non-targeted modules), or full (i.e., all possible modules) condition. Results demonstrated moderate IBI acceptability among participants in the tailored and full conditions. The majority of participants preferred IBI over face-to-face (F2F) treatment, and most individuals who preferred F2F treatment also considered an IBI to be an acceptable treatment modality. Lack of significant mean differences between the tailored and full conditions on several of the main outcomes of interest (e.g., perceptions of acceptability) suggests that implementation of either method of treatment could prove effective. Differences based on treatment length and relevance, and biological sex were also explored. Implications, limitations, and future directions are discussed.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s41347-022-00256-4.

If you personalize it, will they use it?: Self-reported and observed use of a tailored, internet-based pain self-management program

Little is known about how individuals with chronic pain use tailored internet-based interventions. This study is the first to compare self-reported skill module use to observed module access and to examine each of these in relationship to tailored recommendations to access specific content. Participants (N = 58) enrolled in a 10-week trial of the Pain EASE program, a tailored internet-based intervention that includes 10 pain self-management skill modules. Participants completed a "Self-Assessment," which was used to provide a "Personalized Plan" that encouraged accessing specific modules. Participants self-reported module use during weekly data collection telephone calls. Program log data were extracted to capture "observed" module use during the trial period. Findings indicated significantly greater self-reported use of the Pain EASE modules compared to observed access with log data. Further, log data revealed that participants accessed less than half of the modules recommended to them via tailoring.

Internet and Face-to-face Cognitive Behavioral Therapy for Postnatal Depression Compared With Treatment as Usual: Randomized Controlled Trial of MumMoodBooster

BACKGROUND

Previous research has confirmed that symptoms of postnatal depression (PND) can be ameliorated through internet-delivered psychological interventions. Advantages of internet-delivered treatment include anonymity, convenience, and catering to women who are unable to access face-to-face (FTF) treatments. To date, no research has examined the efficacy of such interventions compared directly with FTF treatments in women clinically diagnosed with PND.

OBJECTIVE

This study aims to compare the efficacy of one of the first web-based cognitive behavioral therapy (CBT) interventions (internet CBT+coach calls) for PND (MumMoodBooster [MMB]) with FTF-CBT in a randomized controlled trial (RCT).

METHODS

In this study, 116 postnatal women with a Diagnostic and Statistical Manual for Mental Disorders, Fourth Edition (DSM-IV) diagnosis of major or minor depression were randomized to MMB (39/116, 33.6%), FTF-CBT (39/116, 33.6%), or a treatment-as-usual (TAU) control condition (38/116, 32.8%). Diagnostic status was determined at baseline and at 21-week follow-up using the Structured Clinical Interview for the DSM-IV. Severity of anxiety and depressive symptoms was evaluated using the Depression Anxiety Stress Scales and the revised Beck Depression Inventory at baseline, 12-week follow-up (after treatment), and 21-week follow-up.

RESULTS

Of the 116 participants, 107 (92.2%) had a diagnosis of major depression at baseline. Rates of remission from a major or minor depressive episode at 21 weeks in both the FTF-CBT and MMB groups were superior to that of the TAU group (56.6% and 47.7% less likely to be depressed, respectively) and they were not significantly different from each other. Although remission rates differed between TAU and FTF-CBT, growth models showed that, in terms of symptom reduction across time, the FTF-CBT treatment was not significantly better than TAU. By comparison, MMB was statistically superior to both TAU and FTF-CBT in reducing symptoms of depression, anxiety, and stress from baseline to the 21-week follow-up (large and moderate effect sizes). Thus, after 21 weeks, the average symptom scores for depression and anxiety of women receiving MMB were approximately half those of women in both the TAU and FTF-CBT groups.

CONCLUSIONS

In this RCT, MMB was at least as effective as FTF-CBT in achieving remission from a diagnosed PND episode. MMB was superior to TAU and FTF-CBT in encouraging and maintaining reduction of symptom severity over the 21-week follow-up for depressed postnatal women. These findings replicate results of prior studies on MMB that showed clinically significant improvements in depressive symptoms, and they provide direct empirical support that internet-delivered treatment for depressed postnatal women is a viable alternative to FTF treatment. The generalizability of the results needs to be examined in future research, as RCTs of internet-based versus FTF treatments necessarily involve a subset of people who are willing to undertake either modality of treatment.

TRIAL REGISTRATION

Australia and New Zealand Clinical Trials Registry (ANZCTR) ACTRN12613000881730; https://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=364683&isReview=true.

Comparing recruitment strategies for a digital smoking cessation intervention: Technology-assisted peer recruitment, social media, ResearchMatch, and smokefree.gov

BACKGROUND

Choosing the right recruitment strategy has implications for the successful conduct of a trial. Our objective was to compare a novel peer recruitment strategy to four other recruitment strategies for a large randomized trial testing a digital tobacco intervention.

METHODS

We compared enrollment rates, demographic and baseline smoking characteristics, and odds of completing the 6-month study by recruitment strategy. Cost of recruitment strategies per retained participant was calculated using staff personnel time and advertisement costs.

FINDINGS

We enrolled 1487 participants between August 2017 and March 2019 from: Peer recruitment n = 273 (18.4%), Facebook Ads n = 505 (34%), Google Ads = 200 (13.4%), ResearchMatch n = 356 (23.9%) and Smokefree.govn = 153 (10.3%). Mean enrollment rate per active recruitment month: 1) Peer recruitment, n = 13.9, 2) Facebook ads, n = 25.3, 3) Google ads, n = 10.51, 4) Research Match, n = 59.3, and 5) Smokefree.gov, n = 13.9. Peer recruitment recruited the greatest number of males (n = 110, 40.3%), young adults (n = 41, 14.7%), participants with a high school degree or less (n = 24, 12.5%) and smokers within one's social network. Compared to peer recruitment (retention rate = 57%), participants from Facebook were less likely (OR 0.46, p < 0.01, retention rate = 40%), and those from ResearchMatch were more likely to complete the study (OR 1.90, p < 0.01, retention rate = 70%). Peer recruitment was moderate in cost per retained participant ($47.18) and substantially less costly than Facebook ($173.60).

CONCLUSIONS

Though peer recruitment had lower enrollment than other strategies, it may provide greater access to harder to reach populations and possibly others who smoke within one's social network while being moderately cost-effective. ClinicalTrials.gov: NCT03224520.

Promoting physical activity in young adult cancer survivors using mHealth and adaptive tailored feedback strategies: Design of the Improving Physical Activity after Cancer Treatment (IMPACT) randomized controlled trial

INTRODUCTION

Despite the health benefits of physical activity for cancer survivors, nearly 60% of young adult cancer survivors (YACS) are physically inactive. Few physical activity interventions have been designed specifically for YACS.

PURPOSE

To describe the rationale and design of the IMPACT (IMproving Physical Activity after Cancer Treatment) trial, which tests the efficacy of a theory-based, mobile physical activity intervention for YACS.

METHODS

A total of 280 physically inactive YACS (diagnosed at ages 18-39) will be randomized to a self-help control or intervention condition. All participants will receive an activity tracker and companion mobile app, cellular-enabled scale, individual videochat session, and access to a Facebook group. Intervention participants will also receive a 6-month mobile intervention based on social cognitive theory, which targets improvements in behavioral capability, self-regulation, self-efficacy, and social support, and incorporates self-regulation strategies and behavior change techniques. The program includes: behavioral lessons; adaptive goal-setting in response to individuals' changing activity patterns; tailored feedback based on objective data and self-report measures; tailored text messages; and Facebook prompts encouraging peer support. Assessments occur at baseline, 3, 6, and 12 months. The primary outcome is total physical activity min/week at 6 months (assessed via accelerometry); secondary outcomes include total physical activity at 12 months, sedentary behavior, weight, and psychosocial measures.

CONCLUSIONS

IMPACT uniquely focuses on physical activity in YACS using an automated tailored mHealth program. Study findings could result in a high-reach, physical activity intervention for YACS that has potential to be adopted on a larger scale and reduce cancer-related morbidity. ClinicalTrials.gov Identifier: NCT03569605.

Smartphone-Delivered Progressive Muscle Relaxation for the Treatment of Migraine in Primary Care: A Randomized Controlled Trial

OBJECTIVE

Scalable, accessible forms of behavioral therapy for migraine prevention are needed. We assessed the feasibility and acceptability of progressive muscle relaxation (PMR) delivered by a smartphone application (app) in the Primary Care setting.

METHODS

This pilot study was a non-blinded, randomized, parallel-arm controlled trial of adults with migraine and 4+ headache days/month. Eligible participants spoke English and owned a smartphone. All participants were given the RELAXaHEAD app which includes an electronic headache diary. Participants were randomized to receive 1 of the 2 versions of the app-one with PMR and the other without PMR. The primary outcomes were measures of feasibility (adherence to the intervention and diary entries during the 90-day interval) and acceptability (satisfaction levels). We conducted exploratory analyses to determine whether there was a change in Migraine Disability Assessment Scale (MIDAS) scores or a change in headache days.

RESULTS

Of 139 participants (77 PMR, 62 control), 116 (83%) were female, mean age was 41.7 ± 12.8 years. Most patients 108/139 (78%) had moderate-severe disability. Using a 1-5 Likert scale, participants found the app easy to use (mean 4.2 ± 0.7) and stated that they would be happy to engage in the PMR intervention again (mean 4.3 ± 0.6). For the first 6 weeks, participants practiced PMR 2-4 days/week. Mean per session duration was 11.1 ± 8.3 minutes. Relative to the diary-only group, the PMR group showed a greater non-significant decline in mean MIDAS scores (-8.7 vs -22.7, P = .100) corresponding to a small-moderate mean effect size (Cohen's d = 0.38).

CONCLUSION

Smartphone-delivered PMR may be an acceptable, accessible form of therapy for migraine. Mean effects show a small-moderate mean effect size in disability scores.

Carbohydrate Counting App Using Image Recognition for Youth With Type 1 Diabetes: Pilot Randomized Control Trial

BACKGROUND

Carbohydrate counting is an important component of diabetes management, but it is challenging, often performed inaccurately, and can be a barrier to optimal diabetes management. iSpy is a novel mobile app that leverages machine learning to allow food identification through images and that was designed to assist youth with type 1 diabetes in counting carbohydrates.

OBJECTIVE

Our objective was to test the app's usability and potential impact on carbohydrate counting accuracy.

METHODS

Iterative usability testing (3 cycles) was conducted involving a total of 16 individuals aged 8.5-17.0 years with type 1 diabetes. Participants were provided a mobile device and asked to complete tasks using iSpy app features while thinking aloud. Errors were noted, acceptability was assessed, and refinement and retesting were performed across cycles. Subsequently, iSpy was evaluated in a pilot randomized controlled trial with 22 iSpy users and 22 usual care controls aged 10-17 years. Primary outcome was change in carbohydrate counting ability over 3 months. Secondary outcomes included levels of engagement and acceptability. Change in HbA1c level was also assessed.

RESULTS

Use of iSpy was associated with improved carbohydrate counting accuracy (total grams per meal, P=.008), reduced frequency of individual counting errors greater than 10 g (P=.047), and lower HbA1c levels (P=.03). Qualitative interviews and acceptability scale scores were positive. No major technical challenges were identified. Moreover, 43% (9/21) of iSpy participants were still engaged, with usage at least once every 2 weeks, at the end of the study.

CONCLUSIONS

Our results provide evidence of efficacy and high acceptability of a novel carbohydrate counting app, supporting the advancement of digital health apps for diabetes care among youth with type 1 diabetes. Further testing is needed, but iSpy may be a useful adjunct to traditional diabetes management.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04354142; https://clinicaltrials.gov/ct2/show/NCT04354142.

Feasibility study for supporting medication adherence for adults with cystic fibrosis: mixed-methods process evaluation

OBJECTIVES

To undertake a process evaluation of an adherence support intervention for people with cystic fibrosis (PWCF), to assess its feasibility and acceptability.

SETTING

Two UK cystic fibrosis (CF) units.

PARTICIPANTS

Fourteen adult PWCF; three professionals delivering adherence support ('interventionists'); five multi-disciplinary CF team members.

INTERVENTIONS

Nebuliser with data recording and transfer capability, linked to a software platform, and strategies to support adherence to nebulised treatments facilitated by interventionists over 5 months (± 1 month).

PRIMARY AND SECONDARY MEASURES

Feasibility and acceptability of the intervention, assessed through semistructured interviews, questionnaires, fidelity assessments and click analytics.

RESULTS

Interventionists were complimentary about the intervention and training. Key barriers to intervention feasibility and acceptability were identified. Interventionists had difficulty finding clinic space and time in normal working hours to conduct review visits. As a result, fewer than expected intervention visits were conducted and interviews indicated this may explain low adherence in some intervention arm participants. Adherence levels appeared to be >100% for some patients, due to inaccurate prescription data, particularly in patients with complex treatment regimens. Flatlines in adherence data at the start of the study were linked to device connectivity problems. Content and delivery quality fidelity were 100% and 60%-92%, respectively, indicating that interventionists needed to focus more on intervention 'active ingredients' during sessions.

CONCLUSIONS

The process evaluation led to 14 key changes to intervention procedures to overcome barriers to intervention success. With the identified changes, it is feasible and acceptable to support medication adherence with this intervention.

TRIAL REGISTRATION NUMBER

ISRCTN13076797; Results.

Online Guide for Electronic Health Evaluation Approaches: Systematic Scoping Review and Concept Mapping Study

BACKGROUND

Despite the increase in use and high expectations of digital health solutions, scientific evidence about the effectiveness of electronic health (eHealth) and other aspects such as usability and accuracy is lagging behind. eHealth solutions are complex interventions, which require a wide array of evaluation approaches that are capable of answering the many different questions that arise during the consecutive study phases of eHealth development and implementation. However, evaluators seem to struggle in choosing suitable evaluation approaches in relation to a specific study phase.

OBJECTIVE

The objective of this project was to provide a structured overview of the existing eHealth evaluation approaches, with the aim of assisting eHealth evaluators in selecting a suitable approach for evaluating their eHealth solution at a specific evaluation study phase.

METHODS

Three consecutive steps were followed. Step 1 was a systematic scoping review, summarizing existing eHealth evaluation approaches. Step 2 was a concept mapping study asking eHealth researchers about approaches for evaluating eHealth. In step 3, the results of step 1 and 2 were used to develop an "eHealth evaluation cycle" and subsequently compose the online "eHealth methodology guide."

RESULTS

The scoping review yielded 57 articles describing 50 unique evaluation approaches. The concept mapping study questioned 43 eHealth researchers, resulting in 48 unique approaches. After removing duplicates, 75 unique evaluation approaches remained. Thereafter, an "eHealth evaluation cycle" was developed, consisting of six evaluation study phases: conceptual and planning, design, development and usability, pilot (feasibility), effectiveness (impact), uptake (implementation), and all phases. Finally, the "eHealth methodology guide" was composed by assigning the 75 evaluation approaches to the specific study phases of the "eHealth evaluation cycle."

CONCLUSIONS

Seventy-five unique evaluation approaches were found in the literature and suggested by eHealth researchers, which served as content for the online "eHealth methodology guide." By assisting evaluators in selecting a suitable evaluation approach in relation to a specific study phase of the "eHealth evaluation cycle," the guide aims to enhance the quality, safety, and successful long-term implementation of novel eHealth solutions.

Online Guide for Electronic Health Evaluation Approaches: Systematic Scoping Review and Concept Mapping Study

BACKGROUND

Despite the increase in use and high expectations of digital health solutions, scientific evidence about the effectiveness of electronic health (eHealth) and other aspects such as usability and accuracy is lagging behind. eHealth solutions are complex interventions, which require a wide array of evaluation approaches that are capable of answering the many different questions that arise during the consecutive study phases of eHealth development and implementation. However, evaluators seem to struggle in choosing suitable evaluation approaches in relation to a specific study phase.

OBJECTIVE

The objective of this project was to provide a structured overview of the existing eHealth evaluation approaches, with the aim of assisting eHealth evaluators in selecting a suitable approach for evaluating their eHealth solution at a specific evaluation study phase.

METHODS

Three consecutive steps were followed. Step 1 was a systematic scoping review, summarizing existing eHealth evaluation approaches. Step 2 was a concept mapping study asking eHealth researchers about approaches for evaluating eHealth. In step 3, the results of step 1 and 2 were used to develop an "eHealth evaluation cycle" and subsequently compose the online "eHealth methodology guide."

RESULTS

The scoping review yielded 57 articles describing 50 unique evaluation approaches. The concept mapping study questioned 43 eHealth researchers, resulting in 48 unique approaches. After removing duplicates, 75 unique evaluation approaches remained. Thereafter, an "eHealth evaluation cycle" was developed, consisting of six evaluation study phases: conceptual and planning, design, development and usability, pilot (feasibility), effectiveness (impact), uptake (implementation), and all phases. Finally, the "eHealth methodology guide" was composed by assigning the 75 evaluation approaches to the specific study phases of the "eHealth evaluation cycle."

CONCLUSIONS

Seventy-five unique evaluation approaches were found in the literature and suggested by eHealth researchers, which served as content for the online "eHealth methodology guide." By assisting evaluators in selecting a suitable evaluation approach in relation to a specific study phase of the "eHealth evaluation cycle," the guide aims to enhance the quality, safety, and successful long-term implementation of novel eHealth solutions.

Engagement and Weight Loss in a Web and Mobile Program for Low-Income Postpartum Women: Fit Moms/Mamás Activas

Internet-based weight loss programs can be effective in promoting weight loss and are less-intensive than traditional face-to-face approaches, which may provide more flexibility for postpartum, low-income women to engage in such programs. Few studies have examined patterns of engagement in internet-based programs for this population. This article used data from the internet-based Fit Moms/Mamás Activas intervention, a 12-month cluster randomized controlled trial that was effective in promoting postpartum weight loss among low-income, predominantly Hispanic women. The overall objectives of this study were to (1) characterize patterns of engagement with the Fit Moms/Mamás Activas website among intervention participants and (2) explore associations between engagement and 12-month weight loss outcomes among study completers (87.4%). A number of engagement variables were calculated for each participant, including website logins; time spent on the website; number of posts to the "Discussion Forum;" number of days tracking weight, diet, and physical activity; number of page visits to various website components; and number of in-person visits attended. The average number of logins was 70.74 (approximately once weekly), and average total time spent on the website was 185.35 minutes (approximately 3 hours) over 1 year. Self-monitoring ("Web Diary") and social support ("Discussion Forum") were the most frequently visited components of the website, and more frequent engagement with these components, as well as greater attendance at in-person group sessions, predicted greater percent weight loss at 12 months. Interventions highlighting these features may be particularly effective for weight loss in this population.

Effectiveness of social media (Facebook), targeted mailing, and in-person solicitation for the recruitment of young adult in a diabetes self-management clinical trial

BACKGROUND/AIMS

Research is needed to identify promising recruitment strategies to reach and engage diverse young adults in diabetes clinical research. The aim of this study was to examine the relative strengths and weaknesses of three recruitment strategies used in a diabetes self-management clinical trial: social media advertising (Facebook), targeted mailing, and in-person solicitation of clinic patients.

METHODS

Strategies were compared in terms of (1) cost-effectiveness (i.e. cost of recruitment/number of enrolled participants), (2) ability to yield participants who would not otherwise be reached by alternative strategies, and (3) likelihood of participants recruited through each strategy to adhere to study procedures. We further explored the appeal (overall and among age and gender subgroups) of social media advertisement features.

RESULTS

In-person recruitment of clinic patients was overall the most cost-effective strategy. However, differences in demographic, clinical, and psychosocial characteristics of participants recruited via different strategies suggest that the combination of these approaches yielded a more diverse sample than would any one strategy alone. Once successfully enrolled, there was no difference in study completion and intervention adherence between individuals recruited by the three recruitment strategies.

CONCLUSIONS

Ultimately, the utility of a recruitment strategy is defined by its ability to effectively attract people representative of the target population who are willing to enroll in and complete the study. Leveraging a variety of recruitment strategies appears to produce a more representative sample of young adults, including those who are less engaged in diabetes care.

User Experiences of an Internet-Based Stepped-Care Intervention for Individuals With Cancer and Concurrent Symptoms of Anxiety or Depression (the U-CARE AdultCan Trial): Qualitative Study

BACKGROUND

The internet-based stepped-care intervention iCAN-DO, used in the multicenter randomized controlled trial AdultCan, was developed for adult patients undergoing treatment for cancer and concurrently experiencing anxiety or depressive symptoms. iCAN-DO aimed to decrease symptoms of anxiety or depression. Step 1 comprises access to a library with psychoeducational material and a peer-support section, as well as the possibility to pose questions to a nurse. Step 2 of the intervention offers treatment consisting of internet-based cognitive behavioral therapy (iCBT) to participants still experiencing anxiety or depression at 1, 4, or 7 months after inclusion.

OBJECTIVE

The study aimed to explore user experiences of delivery, design, and structure of iCAN-DO from the perspective of people with cancer.

METHODS

We studied user experiences by interviewing 15 informants individually: 10 women with breast cancer (67%), 4 men with prostate cancer (27%), and 1 man with colorectal cancer (7%) with a mean age 58.9 years (SD 8.9). The interviews focused on informants' perceptions of ease of use and of system design and structure. Informants had been included in iCAN-DO for at least 7 months. They were purposefully selected based on activity in Step 1, participation in iCBT (ie, Step 2), gender, and diagnosis.

RESULTS

Of the 15 informants, 6 had been offered iCBT (40%). All informants used the internet on a daily basis, but 2 (13%) described themselves as very inexperienced computer users. The analysis revealed three subthemes, concerning how user experiences were affected by disease-specific factors and side effects (User experience in the context of cancer), technical problems (Technical struggles require patience and troubleshooting), and the structure and design of iCAN-DO (Appealing and usable, but rather simple).

CONCLUSIONS

The results indicate that user experiences were affected by informants' life situations, the technical aspects and the design of iCAN-DO, and informants' preferences. The results have generated some developments feasible to launch during the ongoing study, but if iCAN-DO is to be used beyond research interest, a greater level of tailoring of information, features, and design may be needed to improve user experiences. The use of recurrent questionnaires during the treatment period may highlight an individual's health, but also function as a motivator showing improvements over time.

Evaluating the efficacy of the Family Check-Up Online: A school-based, eHealth model for the prevention of problem behavior during the middle school years

This study evaluated the efficacy of a family-centered preventive intervention, the Family Check-Up (FCU), delivered as an online, eHealth model to middle school families. To increase accessibility of family-centered prevention in schools, we adapted the evidence-based FCU to an online format, with the goal of providing a model of service delivery that is feasible, given limited staffing and resources in many schools. Building on prior research, we randomly assigned participants to waitlist control (n = 105), FCU Online as a web-based intervention (n = 109), and FCU Online with coaching support (n = 108). We tested the effects of the intervention on multiple outcomes, including parental self-efficacy, child self-regulation, and child behavior, in this registered clinical trial (NCT03060291). Families engaged in the intervention at a high rate (72% completed the FCU assessment) and completed 3-month posttest assessments with good retention (94% retained). Random assignment to the FCU Online with coaching support was associated with reduced emotional problems for children (p = .003, d = -0.32) and improved parental confidence and self-efficacy (p = .018, d = 0.25) when compared with waitlist controls. Risk moderated effects: at-risk youth showed stronger effects than did those with minimal risk. The results have implications for online delivery of family-centered interventions in schools.

Development and usability testing of HEARTPA♀N: protocol for a mixed methods strategy to develop an integrated smartphone and web-based intervention for women with cardiac pain

INTRODUCTION

More women experience cardiac pain related to coronary artery disease and cardiac procedures compared with men. The overall goal of this programme of research is to develop an integrated smartphone and web-based intervention (HEARTPA♀N) to help women recognise and self-manage cardiac pain.

METHODS AND ANALYSIS

This protocol outlines the mixed methods strategy used for the development of the HEARTPA♀N content/core feature set (phase 2A), usability testing (phase 2B) and evaluation with a pilot randomised controlled trial (RCT) (phase 3). We are using the individual and family self-management theory, mobile device functionality and pervasive information architecture of mHealth interventions, and following a sequential phased approach recommended by the Medical Research Council to develop HEARTPA♀N. The phase 3 pilot RCT will enable us to refine the prototype, inform the methodology and calculate the sample size for a larger multisite RCT (phase 4, future work). Patient partners have been actively involved in setting the HEARTPA♀N research agenda, including defining patient-reported outcome measures for the pilot RCT: pain and health-related quality of life (HRQoL). As such, the guidelines for Inclusion of Patient-Reported Outcomes in Clinical Trial Protocols (SPIRIT-PRO) are used to report the protocol for the pilot RCT (phase 3). Quantitative data (eg, demographic and clinical information) will be summarised using descriptive statistics (phases 2AB and 3) and a content analysis will be used to identify themes (phase 2AB). A process evaluation will be used to assess the feasibility of the implementation of the intervention and a preliminary efficacy evaluation will be undertaken focusing on the outcomes of pain and HRQoL (phase 3).

ETHICS AND DISSEMINATION

Ethics approval was obtained from the University of Toronto (36415; 26 November 2018). We will disseminate knowledge of HEARTPA♀N through publication, conference presentation and national public forums (Café Scientifique), and through fact sheets, tweets and webinars.

TRIAL REGISTRATION NUMBER

NCT03800082.

Conducting Psychological Intervention Research in the Information Age: Reconsidering the "State of the Field"

Enthusiasm for technology in mental health has evolved as a function of its promise to increase the reach and impact of services, particularly for traditionally at-risk and underserved groups. Preliminary findings suggest that technology-enhanced interventions indeed hold promise for increasing engagement in and outcomes of evidence-based treatment approaches. The time- and resourceintensive nature of traditional randomized control trials, however, may be even more of a challenge for further advancement in this area, given the rapid innovation of consumer driven new product development. Accordingly, this review aims to summarize how a broader range of scientific designs and analyses may be necessary in order to further advance and optimize the reach and impact of technology-enhanced psychological practice. Examples of various approaches are provided and recommendations are provided for future work in this area.

A focus group study of older adults' perceptions and preferences towards web-based physical activity interventions

OBJECTIVE

To explore older adults' perceptions and preferences for web-based physical activity interventions.

PARTICIPANTS

Adults 65+ years were recruited via telephoning randomly selected households in Central Queensland, Australia.

METHODS

Six focus groups were conducted with a total of 46 adults 65+ years. Data were analyzed by qualitative content analysis.

RESULTS

This group of older adults liked websites that have links to information and included instructional videos and disliked websites that were hard to navigate. Many participants did not express an initial interest in web-based physical activity programs. The most common reason was that they did not have a computer or adequate internet connection. Some participants said they would be interested if it included a structured exercise program. When asked about preferences for web-based physical activity programs, this group preferred them to be simple and not cluttered, to include personalized advice, to include reminder check-ins and the ability to review goals after illness or injury. The most common preference for personalized advice in web-based interventions was that the information needs to be tailored to their existing injuries and illnesses.

CONCLUSION

The findings from this study will inform the design of future web-based interventions specifically tailored to the needs of older people.

Factors influencing engagement in an online support group for family caregivers of individuals with advanced cancer

Objective: To explore factors that influenced engagement in an online support group (OSG) for family caregivers of hospice patients with cancer.Design: Secondary qualitative data analysis.Sample: 58 family caregivers of hospice patients with advanced cancer.Methods: Template analysis of individual family caregiver interviews.Findings: Emotional isolation and caregiving downtime positively influenced engagement, while reluctance to share personal information, a short timeframe of participation in the OSG, and caregiving commitments were negatively influential. While the group facilitation and secure privacy settings of the OSG were viewed positively, reactions to the OSG platform and group tone were mixed. Information on pain and the dying process was found to be particularly engaging.Practice implications: Providers offering OSGs for family caregivers should maximize factors that promote meaningful member engagement, responding to changes in activity and tone over time.

Formative Evaluation to Build an Online Parenting Skills and Youth Drug Prevention Program: Mixed Methods Study

Background

Family-based drug prevention programs that use group-based formats with trained facilitators, such as the Strengthening Families Program (SFP), are effective in preventing underage drinking and youth drug use. However, these programs are resource-intensive and have high costs and logistical demands. Tailoring them for Web-based delivery is more cost-effective and makes it easier to scale these programs for widespread dissemination. This requires the active involvement of all key stakeholders to determine content and delivery format.

Objective

The aim was to obtain consumer, agency stakeholder, and expert input into the design of a Web-based parenting skills training and youth drug prevention program.

Methods

We conducted 10 focus groups with 85 adults (range 4-10, average 8 per group), 20 stakeholder interviews with family services agency staff, and discussed critical design considerations with 10 prevention scientists and e-learning experts to determine the optimal program content and technology features for SFP Online. Focus group participants also answered survey questions on perceived barriers to use, desired navigational features, preferred course format, desired content, preferred reward structures, course length, interactive components, computer efficacy, and technology use. Descriptive statistics were used to examine consumer characteristics; linear regression was used to examine relations between SFP exposure and four continuous outcome measures, including desired program content, interactive technology, and concerns that may inhibit future use of SFP Online. Logistic regression was used as a binary measure of whether consumers desired fun games in the SFP Online program.

Results

Three broad thematic categories emerged from the qualitative interviews enumerating the importance of (1) lesson content, (2) logistics for program delivery, and (3) multimedia interactivity. Among the many significant relations, parents who viewed more SFP lessons reported more reasons to use an online program (beta=1.48, P=.03) and also wanted more interactivity (6 lessons: beta=3.72, P=.01; >6 lessons: beta=2.39, P=.01), parents with less interest in a mixed delivery format (class and online) reported fewer reasons to use the online program (beta=−3.93, P=.01), comfort using computers was negatively associated with concerns about the program (beta=−1.83, P=.01), having mobile phone access was related to fewer concerns about online programs (beta=−1.63, P=.02), willingness to view an online program using a mobile phone was positively associated with wanting more online components (beta=1.95, P=.02), and parents who wanted fun games wanted more interactivity (beta=2.28, P=.01).

Conclusions

Formative evaluation based on user-centered approaches can provide rich information that fuels development of an online program. The user-centered strategies in this study lay the foundation for improving SFP Online and provide a means to accommodate user interests and ensure the product serves as an effective prevention tool that is attractive to consumers, engaging, and can overcome some of the barriers to recruitment and retention that have previously affected program outcomes in family-based prevention.

Improving Adherence to Smoking Cessation Treatment: Smoking Outcomes in a Web-based Randomized Trial

Background

Partial adherence in Internet smoking cessation interventions presents treatment and evaluation challenges. Increasing adherence may improve outcomes.

Purpose

To present smoking outcomes from an Internet randomized trial of two strategies to encourage adherence to tobacco dependence treatment components: (i) a social network (SN) strategy to integrate smokers into an online community and (ii) free nicotine replacement therapy (NRT). In addition to intent-to-treat analyses, we used novel statistical methods to distinguish the impact of treatment assignment from treatment utilization.

Methods

A total of 5,290 current smokers on a cessation website (WEB) were randomized to WEB, WEB + SN, WEB + NRT, or WEB + SN + NRT. The main outcome was 30-day point prevalence abstinence at 3 and 9 months post-randomization. Adherence measures included self-reported medication use (meds), and website metrics of skills training (sk) and community use (comm). Inverse Probability of Retention Weighting and Inverse Probability of Treatment Weighting jointly addressed dropout and treatment selection. Propensity weights were used to calculate Average Treatment effects on the Treated.

Results

Treatment assignment analyses showed no effects on abstinence for either adherence strategy. Abstinence rates were 25.7%-32.2% among participants that used all three treatment components (sk+comm +meds).Treatment utilization analyses revealed that among such participants, sk+comm+meds yielded large percentage point increases in 3-month abstinence rates over sk alone across arms: WEB = 20.6 (95% CI = 10.8, 30.4), WEB + SN = 19.2 (95% CI = 11.1, 27.3), WEB + NRT = 13.1 (95% CI = 4.1, 22.0), and WEB + SN + NRT = 20.0 (95% CI = 12.2, 27.7).

Conclusions

Novel propensity weighting approaches can serve as a model for establishing efficacy of Internet interventions and yield important insights about mechanisms.

Clinical Trials.gov

NCT01544153.

Predictors of Participation in an eHealth, Family-Based Preventive Intervention for Hispanic Youth

The Familias Unidas intervention is an efficacious family-based preventive intervention for reducing substance use and other health risks among Hispanic youth. A current randomized controlled trial (RCT) is examining this intervention's efficacy when delivered via the Internet (eHealth). eHealth interventions can overcome logistical barriers to participation, yet there is limited information about the feasibility of these interventions, especially among ethnic minorities. This paper examines participation and predictors of participation in the eHealth Familias Unidas intervention in a sample of 113 Hispanic families whose adolescent had behavioral problems. Analyses examined multidimensional ways of characterizing participation, including the following: (1) total intervention participation, (2) initial engagement (participating in at least one of the first three intervention sessions), (3) completing the pre-recorded, eHealth parent group sessions, and (4) participating in the live, facilitator-led, eHealth family sessions. Participation in this eHealth intervention was comparable to, and in most cases higher than, previous, face-to-face Familias Unidas interventions. High levels of baseline family stress were associated with lower initial engagement and lower family session participation. Greater parental Hispanicism was associated with more participation in eHealth parent group sessions and across the total intervention. Higher levels of baseline effective parenting, in other words less intervention need, were significantly associated with lower levels of total intervention participation and lower levels of family session participation. Implications for preventive interventions delivered via Internet are discussed.

Smartphone-based migraine behavioral therapy: a single-arm study with assessment of mental health predictors

Progressive muscle relaxation (PMR) is an under-utilized Level A evidence-based treatment for migraine prevention. We studied the feasibility and acceptability of smartphone application (app)-based PMR for migraine in a neurology setting, explored whether app-based PMR might reduce headache (HA) days, and examined potential predictors of app and/or PMR use. In this single-arm pilot study, adults with ICHD3 migraine, 4+ HA days/month, a smartphone, and no prior behavioral migraine therapy in the past year were asked to complete a daily HA diary and do PMR for 20 min/day for 90 days. Outcomes were: adherence to PMR (no. and duration of audio plays) and frequency of diary use. Predictors in the models were baseline demographics, HA-specific variables, baseline PROMIS (patient-reported outcomes measurement information system) depression and anxiety scores, presence of overlapping pain conditions studied and app satisfaction scores at time of enrollment. Fifty-one patients enrolled (94% female). Mean age was 39 ± 13 years. The majority (63%) had severe migraine disability at baseline (MIDAS). PMR was played 22 ± 21 days on average. Mean/session duration was 11 ± 7 min. About half (47%) of uses were 1+ time/week and 35% of uses were 2+ times/week. There was a decline in use/week. On average, high users (PMR 2+ days/week in the first month) had 4 fewer days of reported HAs in month 2 vs. month 1, whereas low PMR users (PMR < 2 days/week in the first month) had only 2 fewer HA days in month 2. PROMIS depression score was negatively associated with the log odds of using the diary at least once (vs. no activity) in a week (OR = 0.70, 95% CI = [0.55, 0.85]) and of doing the PMR at least once in a week (OR = 0.77, 95% CI = [0.68, 0.91]). PROMIS anxiety was positively associated with using the diary at least once every week (OR = 1.33, 95% CI = [1.09, 1.73]) and with doing the PMR at least once every week (OR = 1.14 [95% CI = [1.02, 1.31]). In conclusion, about half of participants used smartphone-based PMR intervention based upon a brief, initial introduction to the app. App use was associated with reduction in HA days. Higher depression scores were negatively associated with diary and PMR use, whereas higher anxiety scores were positively associated.

Understanding User Experience: Exploring Participants' Messages With a Web-Based Behavioral Health Intervention for Adolescents With Chronic Pain

BACKGROUND

Delivery of behavioral health interventions on the internet offers many benefits, including accessibility, cost-effectiveness, convenience, and anonymity. In recent years, an increased number of internet interventions have been developed, targeting a range of conditions and behaviors, including depression, pain, anxiety, sleep disturbance, and eating disorders. Human support (coaching) is a common component of internet interventions that is intended to boost engagement; however, little is known about how participants interact with coaches and how this may relate to their experience with the intervention. By examining the data that participants produce during an intervention, we can characterize their interaction patterns and refine treatments to address different needs.

OBJECTIVE

In this study, we employed text mining and visual analytics techniques to analyze messages exchanged between coaches and participants in an internet-delivered pain management intervention for adolescents with chronic pain and their parents.

METHODS

We explored the main themes in coaches' and participants' messages using an automated textual analysis method, topic modeling. We then clustered participants' messages to identify subgroups of participants with similar engagement patterns.

RESULTS

First, we performed topic modeling on coaches' messages. The themes in coaches' messages fell into 3 categories: Treatment Content, Administrative and Technical, and Rapport Building. Next, we employed topic modeling to identify topics from participants' message histories. Similar to the coaches' topics, these were subsumed under 3 high-level categories: Health Management and Treatment Content, Questions and Concerns, and Activities and Interests. Finally, the cluster analysis identified 4 clusters, each with a distinguishing characteristic: Assignment-Focused, Short Message Histories, Pain-Focused, and Activity-Focused. The name of each cluster exemplifies the main engagement patterns of that cluster.

CONCLUSIONS

In this secondary data analysis, we demonstrated how automated text analysis techniques could be used to identify messages of interest, such as questions and concerns from users. In addition, we demonstrated how cluster analysis could be used to identify subgroups of individuals who share communication and engagement patterns, and in turn facilitate personalization of interventions for different subgroups of patients. This work makes 2 key methodological contributions. First, this study is innovative in its use of topic modeling to provide a rich characterization of the textual content produced by coaches and participants in an internet-delivered behavioral health intervention. Second, to our knowledge, this is the first example of the use of a visual analysis method to cluster participants and identify similar patterns of behavior based on intervention message content.

Investigating the Use of an Electronic Activity Monitor System as a Component of Physical Activity and Weight-Loss Interventions in Nonclinical Populations: A Systematic Review

BACKGROUND

Electronic activity monitor systems (EAMSs) have been readily incorporated into physical activity (PA) and weight-loss interventions to facilitate self-monitoring PA behavior. A comprehensive review is required to better understand their utility as intervention modalities in nonclinical populations.

METHODS

Medscape, MEDLINE, PsycINFO, and Cochrane databases were searched in February 2017, with a search update in April 2017. Citation screening, risk of bias assessment, and an intensity evaluation were conducted in duplicate by 2 investigators.

RESULTS

The search returned 409 unique citations. Of which, 22 citations met the inclusion criteria. Seven studies found significant between-group differences: 3 in weight loss, 3 in PA levels, and 1 in both weight loss and PA levels. Effective interventions lasted 6 weeks to 12 months. Positive health outcomes were demonstrated when users interacted with multiple features of the EAMS and had access to other services, such as personal coaching or environmental reinforcement.

CONCLUSIONS

When control and intervention groups have access to the same components, such as counseling or group interaction, the addition of an EAMS for self-monitoring within the intervention group may not confer more favorable results. Risk of performance bias and low sample sizes should be addressed in future trials to generate more reliable findings.

Predicting user adherence to behavioral eHealth interventions in the real world: examining which aspects of intervention design matter most

Existing frameworks have identified a range of intervention design features that may facilitate adherence to eHealth interventions; however, empirical data are lacking on whether intervention design features can predict user adherence in the real world-where the public access available tools-and whether some design aspects of behavioral eHealth interventions are more important than others in predicting adherence. This study examined whether intervention design qualities predict user adherence to behavioral eHealth interventions in real-world use and which qualities matter the most. We correlated the online activities of users of 30 web-based behavioral interventions-collected from a proprietary data set of anonymized logs from consenting users of Microsoft Internet Explorer add-on-with interventions' quality ratings obtained by trained raters prior to empirical examination. The quality ratings included: Usability, Visual Design, User Engagement, Content, Therapeutic Persuasiveness (i.e., persuasive design and incorporation of behavior change techniques), and Therapeutic Alliance. We found Therapeutic Persuasiveness (i.e., the incorporation of persuasive design/behavior change principles) to be the most robust predictor of adherence (i.e., duration of use, number of unique sessions; 40 ≤ rs ≤ .58, ps ≤ .005), explaining 42% of the variance in user adherence in our regression model. Results indicated up to six times difference in the percentage of users utilizing the interventions for more than a minimum amount of time and sessions based on Therapeutic Persuasiveness. Findings suggest the importance of persuasive design and behavior change techniques incorporation during the design and evaluation of digital behavioral interventions.

Mining User-Generated Content in an Online Smoking Cessation Community to Identify Smoking Status: A Machine Learning Approach

Online smoking cessation communities help hundreds of thousands of smokers quit smoking and stay abstinent each year. Content shared by users of such communities may contain important information that could enable more effective and personally tailored cessation treatment recommendations. This study demonstrates a novel approach to determine individuals' smoking status by applying machine learning techniques to classify user-generated content in an online cessation community. Study data were from BecomeAnEX.org, a large, online smoking cessation community. We extracted three types of novel features from a post: domain-specific features, author-based features, and thread-based features. These features helped to improve the smoking status identification (quit vs. not) performance by 9.7% compared to using only text features of a post's content. In other words, knowledge from domain experts, data regarding the post author's patterns of online engagement, and other community member reactions to the post can help to determine the focal post author's smoking status, over and above the actual content of a focal post. We demonstrated that machine learning methods can be applied to user-generated data from online cessation communities to validly and reliably discern important user characteristics, which could aid decision support on intervention tailoring.

Culturally Adapted, Web-Based Cognitive Behavioral Therapy for Spanish-Speaking Individuals With Substance Use Disorders: A Randomized Clinical Trial

OBJECTIVES

To evaluate whether adding Web-based cognitive behavioral treatment (CBT) to standard outpatient psychiatric or addiction treatment improved substance use outcomes.

METHODS

We conducted a randomized clinical trial in New Haven, Connecticut, between 2014 and 2017 comparing 8 weeks of standard outpatient treatment to the same treatment with access to a culturally adapted version of Web-based CBT with a 6-month follow-up. Participants were 92 treatment-seeking individuals with Spanish as their primary language and current substance use disorder, with few other restrictions.

RESULTS

Treatment completion and data availability were high (98% of the randomized sample). For the primary outcome (change in frequency of primary substance used), there was a significant effect of treatment condition by time (t 1, 718 = -2.64; 95% confidence interval = -0.61, 0.09; P = .01), indicating significantly greater reductions for those assigned to Web CBT, which were durable through the 6-month follow-up. The knowledge test indicated significantly greater increases for those assigned to Web CBT.

CONCLUSIONS

Adding a culturally adapted version of Web-based CBT to standard treatment improved substance use outcomes. Public Health Implications. This approach has high potential to address health disparities by providing an easily accessible, inexpensive form of evidence-based treatment to a range of Latinos with substance use disorders.

Participant Recruitment and Retention in Remote eHealth Intervention Trials: Methods and Lessons Learned From a Large Randomized Controlled Trial of Two Web-Based Smoking Interventions

BACKGROUND

Despite having many advantages, online eHealth trials are not without challenges-notably, participant recruitment, and outcome data retention. Moreover, publications from these trials rarely provide detailed information on the methods used for recruitment and retention or discuss implications of the methods for future studies.

OBJECTIVE

To address this need for empirical guidance regarding recruitment and outcome data retention planning, we aim to describe the methods and lessons learned from the recruitment and retention procedures used in a large randomized trial of 2 Web-based smoking cessation interventions.

METHODS

To ensure a demographically and geographically diverse participant sample, we used the recruitment strategies (1) traditional, (2) Web-based, and (3) online survey panel methods and adaptively modified each in response to recruitment success. At baseline, participants indicated how they heard about the study and answered demographic questions. To maximize trial retention at each of the 3-, 6-, and 12-month assessment points, 4 survey modalities (first Web, followed by phone, mail, and postcard) were sequentially timed over a 30-day period. Participants received US $25 for submitting their responses, regardless of modality, and received an additional US $10 bonus for completing the Web survey within 24h of electronic notification.

RESULTS

We randomized 2637 smokers in 16 months and achieved 88% retention at 12-months. Participants (79.26% female, 72.60% Caucasian) were recruited from all 50 states. The majority of participants were recruited through Facebook (49.43%), followed by the survey panel (20.85%), free internet sources (14.54%), traditional media (11.34%), and Google ads (3.84%). Descriptively, participant demographics varied by recruitment source. Of the completed follow-up surveys, most were completed by Web (92%). Retention rates did not vary by recruitment source.

CONCLUSIONS

Continuous monitoring and refinement of multiple recruitment methods, particularly of online advertising campaigns, allowed us to maximize the effectiveness of recruitment strategies in recruiting a large, diverse sample of smokers. Likewise, offering multiple follow-up survey modalities in sequential order along with time-dependent bonus incentives enabled us to obtain outcome data from a very high level of enrolled participants for the duration of the trial protocol. These strategies may be similarly useful in other trials.

TRIAL REGISTRATION

ClinicalTrials.gov NCT01812278; https://clinicaltrials.gov/ct2/show/NCT01812278 (Archived by WebCite at http://www.webcitation.org/71gy5GLvO).

The Family Check-Up Online Program for Parents of Middle School Students: Protocol for a Randomized Controlled Trial

Background

Research has established that skillful family management during adolescence protects youth from a variety of mental health and behavioral problems. Interventions associated with this research have focused on parenting skills as the mediator that links early risk factors with a profile of later behavioral risk, including problem behavior, substance use, and school failure. Fortunately, positive changes in family management skills have been linked to meaningful improvements in adolescent behavior, and these improvements have been significant across a variety of cultural groups.

Objective

We describe the background, research design, and intervention components of an electronic health version of the Family Check-Up program that is targeting middle school children and is being evaluated in a randomized controlled trial for its usability, feasibility, and efficacy.

Methods

We used an iterative formative research process to develop an electronic health version of the Family Check-Up program. In our ongoing randomized controlled trial, eligible families are randomly assigned to 1 of 3 conditions: Family Check-Up Online-only (n≈100), Family Check-Up Online + Coach (n≈100), and a waitlist control condition (middle school as usual; n≈100). We are conducting assessments at baseline, 3 months following randomization (posttest), and at follow-ups scheduled for 6 months and 12 months.

Results

This randomized controlled trial project was funded in 2015. Participant recruitment was completed in spring 2018 and enrollment is ongoing. Follow-up assessments will be completed in 2019.

Conclusions

The innovative Family Check-Up Online program has the potential to help address many of the barriers that more traditional school-based behavioral mental health implementation strategies have yet to solve, including staffing and resources to implement family-centered support within schools.

Trial Registration

ClinicalTrials.gov NCT03060291; https://clinicaltrials.gov/ct2/show/NCT03060291 (Archived by WebCite at http://www.webcitation.org/70f8keeN4)

Trial Registration

RR1-10.2196/11106

Student engagement and comfort during a web-based personalized feedback intervention for alcohol and sexual assault

INTRODUCTION

The purpose of this study was to investigate individual engagement and comfort during a web-based intervention for alcohol and sexual assault risk reduction.

METHODS

Participants were 264 college women (aged 18-20) who reported engaging in heavy episodic drinking in the past month. Participants were randomized to either an intervention condition (alcohol, sexual assault risk reduction, or combined) or a control condition (full or minimal assessment). Participants rated their experiences during the procedures following the assessment or receipt of the intervention depending on condition. Survey usage information (e.g., time data, completion of intervention) was automatically recorded.

RESULTS

Most participants completed the intervention as intended (in a reasonable amount of time, in private, without consuming substances). Women with a sexual assault history were most comfortable in the sexual assault risk reduction intervention, whereas women who frequently engaged in heavy episodic drinking were least comfortable in the alcohol intervention condition. Self-reported distraction was not impacted by personal relevance of the intervention, but was associated with setting of participation.

CONCLUSIONS

Results suggest that most college women completed web-based personalized feedback interventions as designed, despite minimal discomfort.

A Pilot Randomized Controlled Trial of an Internet-Based Alcohol Intervention in a Workplace Setting

PURPOSE

The aim of this study was to compare the effectiveness of a brief and an intensive self-help alcohol intervention and to assess the feasibility of recruiting to such interventions in a workplace setting.

METHOD

Employees who screened positive for hazardous drinking (n = 85) received online personalized normative feedback and were randomly assigned to one out of two conditions: either they received an e-booklet about the effects of alcohol or they received a self-help intervention comprising 62 web-based, fully automated, and interactive sessions, plus reminder e-mails, and mobile phone text messages (Short Message Service).

RESULTS

Two months after baseline, the responders in the intensive condition drank an average of five to six drinks less per week compared to the responders in the brief condition (B = 5.68, 95% CI = 0.48-10.87, P = .03). There was no significant difference between conditions, using baseline observation carried forward imputation (B = 2.96, 95% CI = -0.50-6.42, P = .09). Six months after baseline, no significant difference was found, neither based on complete cases nor intent-to-treat (B = 1.07, 95% CI = -1.29-3.44, P = .37). Challenges with recruitment are thoroughly reported.

CONCLUSION

The study supports the feasibility and the safety of use for both brief and intensive Internet-based self-help in an occupational setting. The study may inform future trials, but due to recruitment problems and low statistical power, the findings are inconclusive in terms of the intensive program being more effective than brief intervention alone.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT01931618.

Baseline Characteristics and Generalizability of Participants in an Internet Smoking Cessation Randomized Trial

BACKGROUND

The potential for sampling bias in Internet smoking cessation studies is widely recognized. However, few studies have explicitly addressed the issue of sample representativeness in the context of an Internet smoking cessation treatment trial.

PURPOSE

The purpose of the present study is to examine the generalizability of participants enrolled in a randomized controlled trial of an Internet smoking cessation intervention using weighted data from the National Health Interview Survey (NHIS).

METHODS

A total of 5290 new users on a smoking cessation website enrolled in the trial between March 2012 and January 2015. Descriptive statistics summarized baseline characteristics of screened and enrolled participants, and multivariate analysis examined predictors of enrollment. Generalizability analyses compared demographic and smoking characteristics of trial participants to current smokers in the 2012-2014 waves of NHIS (n = 19,043) and to an NHIS subgroup based on Internet use and cessation behavior (n = 3664). Effect sizes were obtained to evaluate the magnitude of differences across variables.

RESULTS

Predictors of study enrollment were age, gender, race, education, and motivation to quit. Compared to NHIS smokers, trial participants were more likely to be female, college educated, and daily smokers and to have made a quit attempt in the past year (all effect sizes 0.25-0.60). In comparisons with the NHIS subgroup, differences in gender and education were attenuated, while differences in daily smoking and smoking rate were amplified.

CONCLUSIONS

Few differences emerged between Internet trial participants and nationally representative samples of smokers, and all were in expected directions. This study highlights the importance of assessing generalizability in a focused and specific manner. CLINICALTRIALS.GOV: #NCT01544153.

Implementation of a Web-Based Organ Donation Educational Intervention: Development and Use of a Refined Process Evaluation Model

Background

The lack of available organs is often considered to be the single greatest problem in transplantation today. Internet use is at an all-time high, creating an opportunity to increase public commitment to organ donation through the broad reach of Web-based behavioral interventions. Implementing Internet interventions, however, presents challenges including preventing fraudulent respondents and ensuring intervention uptake. Although Web-based organ donation interventions have increased in recent years, process evaluation models appropriate for Web-based interventions are lacking.

Objective

The aim of this study was to describe a refined process evaluation model adapted for Web-based settings and used to assess the implementation of a Web-based intervention aimed to increase organ donation among African Americans.

Methods

We used a randomized pretest-posttest control design to assess the effectiveness of the intervention website that addressed barriers to organ donation through corresponding videos. Eligible participants were African American adult residents of Georgia who were not registered on the state donor registry. Drawing from previously developed process evaluation constructs, we adapted reach (the extent to which individuals were found eligible, and participated in the study), recruitment (online recruitment mechanism), dose received (intervention uptake), and context (how the Web-based setting influenced study implementation) for Internet settings and used the adapted model to assess the implementation of our Web-based intervention.

Results

With regard to reach, 1415 individuals completed the eligibility screener; 948 (67.00%) were determined eligible, of whom 918 (96.8%) completed the study. After eliminating duplicate entries (n=17), those who did not initiate the posttest (n=21) and those with an invalid ZIP code (n=108), 772 valid entries remained. Per the Internet protocol (IP) address analysis, only 23 of the 772 valid entries (3.0%) were within Georgia, and only 17 of those were considered unique entries and could be considered for analyses. With respect to recruitment, 517 of the 772 valid entries (67.0%) of participants were recruited from a Web recruiter. Regarding dose received, no videos from the intervention website were watched in their entirety, and the average viewing duration was 17 seconds over the minimum. With respect to context, context analysis provided us with valuable insights into factors in the Internet environment that may have affected study implementation. Although only active for a brief period of time, the Craigslist website advertisement may have contributed the largest volume of fraudulent responses.

Conclusions

We determined fraud and low uptake to be serious threats to this study and further confirmed the importance of conducting a process evaluation to identify such threats. We suggest checking participants’ IP addresses before study initiation, selecting software that allows for automatic duplicate protection, and tightening minimum requirements for intervention uptake. Further research is needed to understand how process evaluation models can be used to monitor implementation of Web-based studies.

Examining effectiveness of tailorable computer-assisted therapy programmes for substance misuse: Programme usage and clinical outcomes data from Breaking Free Online

RATIONALE

When evaluating complex, tailorable digital behavioural interventions, additional approaches may be required alongside established methodologies such as randomised controlled trials (RCTs). Research evaluating a computer-assisted therapy (CAT) programme for substance misuse, Breaking Free Online (BFO), is informed by Medical Research Council (MRC) guidance recommending examination of 'mechanisms of action' of individual intervention strategies, which is relevant when evaluating digital interventions with content that may evolve over time.

AIMS

To report findings from examination of mechanisms of action of tailoring advice within the BFO programme and outcomes from specific intervention strategies.

METHODOLOGY

Analysis of covariance and linear regressions were used to assess intervention completion data, and psychometric and clinical outcomes, for 2311 service users accessing drug and alcohol treatment services across the UK.

RESULTS

Tailoring advice provided to users appeared to prompt them to prioritise completion of intervention strategies associated with their areas of highest biopsychosocial impairment. Completion of specific intervention strategies within BFO were associated with specific clinical outcomes, with a dose response also being found. Mechanisms of action analyses revealed the primacy of cognitions, with cognitive restructuring strategies being associated with improvements in mental health, severity of substance dependence, quality of life and global biopsychosocial functioning.

CONCLUSIONS

The MRC framework provides an evolved research paradigm within the field of digital behavioural change. By assessing baseline profiles of need, BFO can target the most appropriate clinical content for individual users. Mechanisms of action research can be used to inform modifications to BFO to continually update clinical content and the technology platform.

Online Education and e-Consent for GeneScreen, a Preventive Genomic Screening Study

BACKGROUND

Online study recruitment is increasingly popular, but we know little about the decision making that goes into joining studies in this manner. In GeneScreen, a genomic screening study that utilized online education and consent, we investigated participants' perceived ease when deciding to join and their understanding of key study features.

METHODS

Individuals were recruited via mailings that directed them to a website where they could learn more about GeneScreen, consent to participate, and complete a survey.

RESULTS

Participants found it easy to decide to join GeneScreen and had a good understanding of study features. Multiple regression analyses revealed that ease of deciding to join was related to confidence in one's genetic self-efficacy, limited concerns about genetic screening, trust in and lack of frustration using the website, and the ability to spend a limited time on the website. Understanding of study features was related to using the Internet more frequently and attaining more information about GeneScreen conditions.

CONCLUSIONS

The ease of deciding to join a genomic screening study and comprehension of its key features should be treated as different phenomena in research and practice. There is a need for a more nuanced understanding of how individuals respond to web-based consent information.

The implementation of web-based cognitive rehabilitation in adult cancer survivors: examining participant engagement, attrition and treatment fidelity

PURPOSE

Low engagement and high attrition are common challenges in web-based interventions. Typical measures of engagement reported in the literature are not meaningful for describing participant activity within the intervention and can be misleading. This research aimed to develop a more meaningful method of measuring engagement in an online cognitive rehabilitation program whilst monitoring treatment fidelity.

METHODS

A pilot study and randomised controlled trial (RCT) were conducted. Data from 60 participants were analysed from three intervention groups: pilot cancer group, pilot non-cancer group and RCT cancer group. Groups completed the 4-week eReCog program comprised of four online modules. Engagement scores were calculated based on activities completed in each module. Attrition, interaction with the program facilitator and correlations with outcome measures were analysed.

RESULTS

Overall engagement in the intervention was high. The non-cancer group participated significantly less than the cancer groups (p = < 0.001), whereby the percentage of activity items completed was 92, 87 and 78% in the pilot cancer, RCT cancer and pilot non-cancer groups, respectively. Attrition was higher in the pilot non-cancer group (24%) compared to the pilot cancer group (8%) and the RCT cancer group (16%). Total engagement was correlated with fewer prospective memory problems on instrumental activities of daily living (p = 0.018).

CONCLUSIONS

Measuring completed activities in online interventions appears a more meaningful measure of engagement than other conventional methods described in the literature and has the potential to increase treatment fidelity in web-based research.

A novel web-support intervention to promote recovery following Anterior Cruciate Ligament reconstruction: A pilot randomised controlled trial

BACKGROUND

Self-efficacy is positively associated with adherence behaviours and rehabilitation outcomes following Anterior Cruciate Ligament (ACL) reconstruction. An internet resource can be an effective way to provide information, goal setting, patient monitoring and hence support overall self-management.

PURPOSE

This study examined the feasibility of a three month 'internet-based intervention' (mobile-oriented site) to enhance recovery for patients following ACL reconstruction. The potential effect of the internet-based intervention on knee pain, function, self-efficacy and fear of pain were also assessed.

METHOD

This was a pilot randomised controlled trial (RCT) with pre and post intervention design (assessments at one week and three months following ACL reconstruction) comparing: (1) a control group and (2) an intervention group (internet-based intervention). A set of qualitative and quantitative assessments were included to evaluate potential improvements in self-efficacy, pain and function and perception of the internet intervention.

RESULTS AND CONCLUSION

Seventeen participants were available for analysis (n = 10 intervention and n = 7 control group). Participants reported the internet-based intervention to be a useful tool for information, reminder and reinforcement for performing their exercise rehabilitation with 30.3% (±35.3%) adherence to the internet-based intervention. No differences were observed between the groups over time on the outcome questionnaires (p > 0.05). Australian New Zealand Clinical Trials Registry (ANZCTR): ACTRN12616001379404.

A Blended Web-Based Gaming Intervention on Changes in Physical Activity for Overweight and Obese Employees: Influence and Usage in an Experimental Pilot Study

Background

Addressing the obesity epidemic requires the development of effective interventions aimed at increasing physical activity (PA). eHealth interventions with the use of accelerometers and gaming elements, such as rewarding or social bonding, seem promising. These eHealth elements, blended with face-to-face contacts, have the potential to help people adopt and maintain a physically active lifestyle.

Objective

The aim of this study was to assess the influence and usage of a blended Web-based gaming intervention on PA, body mass index (BMI), and waist circumference among overweight and obese employees.

Methods

In an uncontrolled before-after study, we observed 52 health care employees with BMI more than 25 kg/m², who were recruited via the company’s intranet and who voluntarily participated in a 23-week Web-based gaming intervention, supplemented (blended) with non-eHealth components. These non-eHealth components were an individual session with an occupational health physician involving motivational interviewing and 5 multidisciplinary group sessions. The game was played by teams in 5 time periods, aiming to gain points by being physically active, as measured by an accelerometer. Data were collected in 2014 and 2015. Primary outcome was PA, defined as length of time at MET (metabolic equivalent task) ≥3, as measured by the accelerometer during the game. Secondary outcomes were reductions in BMI and waist circumference, measured at baseline and 10 and 23 weeks after the start of the program. Gaming elements such as “compliance” with the game (ie, days of accelerometer wear), “engagement” with the game (ie, frequency of reaching a personal monthly target), and “eHealth teams” (ie, social influence of eHealth teams) were measured as potential determinants of the outcomes. Linear mixed models were used to evaluate the effects on all outcome measures.

Results

The mean age of participants was 48.1 years; most participants were female (42/51, 82%). The mean PA was 86 minutes per day, ranging from 6.5 to 223 minutes, which was on average 26.2 minutes per day more than self-reported PA at baseline and remained fairly constant during the game. Mean BMI was reduced by 1.87 kg/m² (5.6%) and waist circumference by 5.6 cm (4.8%). The univariable model showed that compliance, engagement, and eHealth team were significantly associated with more PA, which remained significant for eHealth team in the multivariable model.

Conclusions

This blended Web-based gaming intervention was beneficial for overweight workers in becoming physically active above the recommended activity levels during the entire intervention period, and a favorable influence on BMI and waist circumference was observed. Promising components in the intervention, and thus targets for upscaling, are eHealth teams and engagement with the game. Broader implementation and long-term follow-up can provide insights into the sustainable effects on PA and weight loss and into who benefits the most from this approach.

Are Social Networking Sites Making Health Behavior Change Interventions More Effective? A Meta-Analytic Review

The increasing popularity of social networking sites (SNSs) has drawn scholarly attention in recent years, and a large amount of efforts have been made in applying SNSs to health behavior change interventions. However, these interventions showed mixed results, with a large variance of effect sizes in Cohen's d ranging from -1.17 to 1.28. To provide a better understanding of SNS-based interventions' effectiveness, a meta-analysis of 21 studies examining the effects of health interventions using SNS was conducted. Results indicated that health behavior change interventions using SNS are effective in general, but the effects were moderated by health topic, methodological features, and participant features. Theoretical and practical implications of findings are discussed.

Improving Adherence to Smoking Cessation Treatment: Intervention Effects in a Web-Based Randomized Trial

BACKGROUND

Web-based smoking cessation interventions can deliver evidence-based treatments to a wide swath of the population, but effectiveness is often limited by insufficient adherence to proven treatment components. This study evaluated the impact of a social network (SN) intervention and free nicotine replacement therapy (NRT) on adherence to evidence-based components of smoking cessation treatment in the context of a Web-based intervention.

METHODS

A sample of adult U.S. smokers (N = 5290) was recruited via BecomeAnEX.org, a free smoking cessation Web site. Smokers were randomized to one of four arms: (1) an interactive, evidence-based smoking cessation Web site (WEB) alone; (2) WEB in conjunction with an SN intervention designed to integrate participants into the online community (WEB+SN); (3) WEB plus free NRT (WEB+NRT); and (4) the combination of all treatments (WEB+SN+NRT). Adherence outcomes assessed at 3-month follow-up were as follows: Web site utilization metrics, use of skills training components, intratreatment social support, and pharmacotherapy use.

RESULTS

WEB+SN+NRT outperformed all others on Web site utilization metrics, use of practical counseling tools, intratreatment social support, and NRT use. It was the only intervention to promote the sending of private messages and the viewing of community pages over WEB alone. Both social network arms outperformed WEB on most metrics of online community engagement. Both NRT arms showed higher medication use compared to WEB alone.

CONCLUSIONS

This study demonstrated the effectiveness of two approaches for improving adherence to evidence-based components of smoking cessation treatment. Integrated approaches to medication provision and social network engagement can enhance adherence to components known to improve cessation.

IMPLICATIONS

This study demonstrated that an integrated approach to medication provision and social network integration, when delivered through an online program, can enhance adherence across all three recommended components of an evidence-based smoking cessation program (skills training, social support, and pharmacotherapy use). Nicotine replacement therapy-when provided as part of an integrated program-increases adherence to other program elements, which in turn augment its own therapeutic effects. An explicit focus on approaches to improve treatment adherence is an important first step to identifying leverage points for optimizing intervention effectiveness.