Cost and Threshold Analysis of the FinishIt Campaign to Prevent Youth Smoking in the United States

Review of Evaluation Metrics Used in Digital and Traditional Tobacco Control Campaigns

BACKGROUND

Mass media campaigns for public health are increasingly using digital media platforms, such as web-based advertising and social media; however, there is a lack of evidence on how to best use these digital platforms for public health campaigns. To generate this evidence, appropriate campaign evaluations are needed, but with the proliferation of digital media-related metrics, there is no clear consensus on which evaluation metrics should be used. Public health campaigns are diverse in nature, so to facilitate analysis, this review has selected tobacco control campaigns as the scope of the study.

OBJECTIVE

This literature review aimed to examine how tobacco control campaigns that use traditional and digital media platforms have been evaluated.

METHODS

Medicine and science databases (Medical Literature Analysis and Retrieval System Online [MEDLINE], EMBASE, PsycINFO, Cumulative Index to Nursing and Allied Health Literature [CINAHL], and Scopus), and a marketing case study database (World Advertising Research Center) were searched for articles published between 2013 and 2018. Two authors established the eligibility criteria and reviewed articles for inclusion. Individual campaigns were identified from the articles, and information on campaigns and their evaluations were supplemented with searches on Google, Google Scholar, and social media platforms. Data about campaign evaluations were tabulated and mapped to a conceptual framework.

RESULTS

In total, 17 campaigns were included in this review, with evaluations reported on by 51 articles, 17 marketing reports, and 4 grey literature reports. Most campaigns were from English-speaking countries, with behavioral change as the primary objective. In the process evaluations, a wide range of metrics were used to assess the reach of digital campaign activities, making comparison between campaigns difficult. Every campaign in the review, except one, reported some type of engagement impact measure, with website visits being the most commonly reported metric (11 of the 17 campaigns). Other commonly reported evaluation measures identified in this review include engagement on social media, changes in attitudes, and number of people contacting smoking cessation services. Of note, only 7 of the 17 campaigns attempted to measure media platform attribution, for example, by asking participants where they recalled seeing the campaign or using unique website tracking codes for ads on different media platforms.

CONCLUSIONS

One of the key findings of this review is the numerous and diverse range of measures and metrics used in tobacco control campaign evaluations. To address this issue, we propose principles to guide the selection of digital media-related metrics for campaign evaluations, and also outline a conceptual framework to provide a coherent organization to the diverse range of metrics. Future research is needed to specifically investigate whether engagement metrics are associated with desired campaign outcomes, to determine whether reporting of engagement metrics is meaningful in campaign evaluations.

Cost-Effectiveness of Using Mass Media to Prevent Tobacco Use among Youth and Young Adults: The FinishIt Campaign

Mass media campaigns have been hailed as some of the most effective tobacco prevention interventions. This study examined the cost-effectiveness of the national tobacco prevention campaign, truth^® FinishIt, to determine the cost per quality-adjusted life year (QALY) saved and the return on investment (ROI). The cost–utility analysis used four main parameters: program costs, number of smoking careers averted, treatment costs, and number of QALYs saved whenever a smoking career is averted. Parameters were varied to characterize cost-effectiveness under different assumptions (base case, conservative, optimistic, and most optimistic). The ROI estimate compared campaign expenditures to the cost saved due to the campaign implementation. Analyses were conducted in 2019. The base case analysis indicated the campaign results in a societal cost savings of $3.072 billion. Under the most conservative assumptions, estimates indicated the campaign was highly cost-effective at $1076 per QALY saved. The overall ROI estimate was $174 ($144 in costs to smokers, $24 in costs to the smoker’s family, and $7 in costs to society) in cost savings for every $1 spent on the campaign. In all analyses, the FinishIt campaign was found to reach or exceed the threshold levels of cost savings or cost-effectiveness, with a positive ROI. These findings point to the value of this important investment in the health of the younger generation.