Collecting outcome data of a text messaging smoking cessation intervention with in-program text assessments: How reliable are the results?

SMS-text messaging for collecting outcome measures after acute stroke

Introduction

Traditional methods for obtaining outcomes for patients after acute stroke are resource-intensive. This study aimed to examine the feasibility, reliability, cost, and acceptability of collecting outcomes after acute stroke with a short message service (SMS)-text messaging program.

Methods

Patients were enrolled in an SMS-text messaging program at acute stroke hospitalization discharge. Participants were prompted to complete assessments including the modified Rankin scale (mRS) and Patient-Reported Outcomes Measurement (PROM) Information System Global-10 at 30, 60, and 90 days postdischarge via SMS-text. Agreement and cost of SMS-text data collection were compared to those obtained from traditional follow-up methods (via phone or in the clinic). Participant satisfaction was surveyed upon program conclusion.

Results

Of the 350 patients who agreed to receive SMS texts, 40.5% responded to one or more assessments. Assessment responders were more likely to have English listed as their preferred language (p = 0.009), have a shorter length of hospital stay (p = 0.01), lower NIH stroke scale upon admission (p < 0.001), and be discharged home (p < 0.001) as compared to nonresponders. Weighted Cohen's kappa revealed that the agreement between SMS texting and traditional methods was almost perfect for dichotomized (good vs. poor) (κ = 0.8) and ordinal levels of the mRS score (κ = 0.8). Polychoric correlations revealed a significant association for PROM scores ( ρ  = 0.4, p < 0.01 and ρ  = 0.4, p < 0.01). A cost equation showed that gathering outcomes via SMS texting would be less costly than phone follow-up for cohorts with more than 181 patients. Nearly all participants (91%) found the program acceptable and not burdensome (94%), and most (53%) felt it was helpful. Poststroke outcome data collection via SMS texting is feasible, reliable, low-cost, and acceptable. Reliability was higher for functional outcomes as compared to PROMs.

Conclusions

While further validation is required, our findings suggest that SMS texting is a feasible method for gathering outcomes after stroke at scale to evaluate the efficacy of acute stroke treatments.

Effectiveness of an optimized text message and Internet intervention for smoking cessation: A randomized controlled trial

AIMS

To evaluate the effectiveness of a combined internet and text message intervention for smoking cessation compared with an internet intervention alone. The text message intervention was optimized for engagement in an earlier multiphase optimization (MOST) screening phase.

DESIGN

A parallel, two-group, individually randomized clinical trial (RCT) was conducted in a MOST confirming phase. Recruitment spanned December 2018 to March 2019. Follow-up was conducted at 3 and 9 months, beginning March 2019 and ending January 2020.

SETTING

United States: a digital study conducted among new registrants on a free tobacco cessation website.

PARTICIPANTS

Eligible individuals were 618 adult current smokers in the United States, age 18 years or older who signed up for text messages during website registration (67.2% female, 70.4% white).

INTERVENTIONS

The treatment arm (WEB+TXT; n = 311) received access to the website and text messaging. The control arm (WEB; n = 307) received access to the website alone.

MEASUREMENTS

The primary outcome was self-reported 30-day point prevalence abstinence (ppa) at 9 months post-randomization analyzed under intent to treat (ITT), counting non-responders as smoking. Secondary outcomes included 3-month measures of 30-day ppa, intervention engagement and intervention satisfaction.

FINDINGS

Abstinence rates at 9 months were 23.1% among WEB+TXT and 23.2% among WEB (OR = 1.00, 95% CI = 0.69-1.45; P = 0.99). WEB+TXT increased engagement with 5 of 6 interactive features (standardized mean difference (SMD) = 0.26-0.47, all P < 0.001) and repeat website visits (48.7% vs 38.9%, SMD = 0.14, P = 0.02). Satisfaction metrics favored WEB+TXT (satisfied: 96.3% vs 90.5%, SMD = 0.17, P = 0.008; recommend to friend: 95.9% vs 90.1%, SMD = 0.16, P = 0.028).

CONCLUSIONS

A randomized controlled trial found no evidence that a combined internet and text message intervention for smoking cessation compared with an internet intervention alone increased 9-month abstinence rates among adult current smokers in the United States, despite evidence of higher levels of intervention engagement and satisfaction at 3 months.

Effectiveness of a Vaping Cessation Text Message Program Among Young Adult e-Cigarette Users: A Randomized Clinical Trial

IMPORTANCE

e-Cigarettes are the most commonly used tobacco product among young adults (YAs). Despite the harms of nicotine exposure among YAs, there are few, if any, empirically tested vaping cessation interventions available.

OBJECTIVE

To determine the effectiveness of a text message program for vaping cessation among YAs vs assessment-only control.

DESIGN, SETTING, AND PARTICIPANTS

A parallel, 2-group, double-blind, individually randomized clinical trial was conducted from December 2019 to November 2020 among YA e-cigarette users. Eligible individuals were US residents aged 18 to 24 years who owned a mobile phone with an active text message plan, reported past 30-day e-cigarette use, and were interested in quitting in the next 30 days. Participants were recruited via social media ads, the intervention was delivered via text message, and assessments were completed via website or mobile phone. Follow-up was conducted at 1 and 7 months postrandomization; follow-up data collection began January 2020 and ended in November 2020. The study was prespecified in the trial protocol.

INTERVENTIONS

All participants received monthly assessments via text message about e-cigarette use. The assessment-only control arm (n = 1284) received no additional intervention. The active intervention arm (n = 1304) also received This is Quitting, a fully automated text message program for vaping cessation that delivers social support and cognitive and behavioral coping skills training.

MAIN OUTCOMES AND MEASURES

The primary outcome was self-reported 30-day point prevalence abstinence (ppa) at 7 months analyzed under intention-to-treat analysis, which counted nonresponders as vaping. Secondary outcomes were 7-day ppa under intention-to-treat analysis and retention weighted complete case analysis of 30-day and 7-day ppa.

RESULTS

Of the 2588 YA e-cigarette users included in the trial, the mean (SD) age was 20.4 (1.7) years, 1253 (48.4%) were male, 2159 (83.4%) were White, 275 (10.6%) were Hispanic, and 493 (19.0%) were a sexual minority. Most participants (n = 2129; 82.3%) vaped within 30 minutes of waking. The 7-month follow-up rate was 76.0% (n = 1967), with no differential attrition. Abstinence rates were 24.1% (95% CI, 21.8%-26.5%) among intervention participants and 18.6% (95% CI, 16.7%-20.8%) among control participants (odds ratio, 1.39; 95% CI, 1.15-1.68; P < .001). No baseline variables moderated the treatment-outcome relationship, including nicotine dependence.

CONCLUSIONS AND RELEVANCE

Results of this randomized clinical trial demonstrated that a tailored and interactive text message intervention was effective in promoting vaping cessation among YAs. These results establish a benchmark of intervention effectiveness.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT04251273.

Real-World Utilization and Outcomes of the Veterans Health Administration's Smoking Cessation Text Message Program

INTRODUCTION

Smoking cessation mobile health (mHealth) programs are effective and have been recommended for integration into health care services but have not been evaluated in real-world health care settings. The Veterans Health Administration, a safety net health care provider, provides health care for 9 million US military veterans. Veterans Health Administration implemented the SmokefreeVET text message program in 2013.

METHODS

A retrospective evaluation of 6153 SmokefreeVET subscribers was conducted. The primary outcome was 30-day self-reported abstinence at 6 months. Secondary outcomes included percentage of opt outs, program completers, and 30-day self-reported abstinence at 3 months.

RESULTS

SmokefreeVET subscribers were on average 47.5 years old and 71.4% male. Smoking cessation medication use was reported by 11.5% of subscribers at the start of their quit attempt and subscribers enrolled in the program for an average of 29 days. Subscribers who were younger, female, and heavier smokers were more likely to opt out of the six-week program early. The abstinence rate for the primary outcome, self-reported 30-day abstinence at 6 months among all subscribers was 3.7%.

CONCLUSIONS

SmokefreeVET enrolled a younger and more female population of subscribers than other studies of veterans interested in tobacco treatment. The mHealth program was generally acceptable to veterans, yet strategies to increase retention may improve completion rates and outcomes. In this real-world setting, nearly half of the mHealth program subscribers combined use of the text program with smoking cessation medication. Further study of the optimal combination of mHealth with smoking cessation treatments is needed.

IMPLICATIONS

mHealth smoking cessation programs can be effectively implemented within real-world health care settings, even in those serving disadvantaged populations. Further research to improve mHealth program efficacy and integration into clinical settings will increase the population-level impact of these effective smoking cessation programs.

Peer Mentoring and Automated Text Messages for Smoking Cessation: A Randomized Pilot Trial

INTRODUCTION

Text-messaging programs for smoking cessation, while efficacious, have high dropout rates. To address this problem, we developed and tested the feasibility and early efficacy of a peer-mentoring intervention for smoking cessation provided by former smokers.

METHODS

Adult US smokers were recruited nationally into a randomized pilot trial (N = 200), comparing 6-8 weeks of automated text-messaging support (SmokefreeTXT) and automated text support plus personalized texts from a peer mentor who formerly smoked. The primary outcome was biochemically verified 7-day point-prevalence abstinence at 3 months post-quit date, assessed on an intention-to-treat basis (missing = smoking). Self-reported abstinence, program acceptability, user engagement, and user perceptions were also assessed.

RESULTS

Biochemically verified abstinence at 3 months was 7.9% (8/101) in the intervention group and 3.0% (3/99) in the control group (adjusted difference 6.5, 95% CI = 0.7% to 12.3%; p = .03). Self-reported abstinence at 3 months was 23.8% (24/101) in the intervention group versus 13.1% (13/99) in the control group (adjusted difference 12.7, 95% CI = 1.2% to 24.1%; p = .03). The intervention had a positive but insignificant effect on overall satisfaction (78.3% vs. 72.9% control group, p = .55). Having a mentor did not significantly alter duration of interaction with the program nor the proportion unsubscribing, although the intervention group reset their quit date with greater frequency (p < .01) and sent more messages (p < .01).

CONCLUSIONS

Peer mentoring combined with automated text messages was feasible and acceptable and increased smoking abstinence compared with automated messages alone. The results highlight the promise of this intervention approach and the need for a full-scale evaluation.

IMPLICATIONS

Providing quitting assistance by automated text messaging has been shown to increase smoking abstinence. Yet, dropout rates in text-messaging programs are high. No studies have tested the effectiveness of peer mentors who are former smokers as part of a text-messaging intervention, although they represent a promising way to retain, engage, and support smokers. This randomized pilot trial suggests that peer mentors can complement automated text-messaging programs to promote smoking abstinence.