"At least someone thinks I'm doing well": a real-world evaluation of the quit-smoking app StopCoach for lower socio-economic status smokers

Mapping Theories, Models, and Frameworks to Evaluate Digital Health Interventions: Scoping Review

BACKGROUND

Digital health interventions (DHIs) are a central focus of health care transformation efforts, yet their uptake in practice continues to fall short of their potential. In order to achieve their desired outcomes and impact, DHIs need to reach their target population and need to be used. Many factors can rapidly intersect between this dynamic of users and interventions. The application of theories, models, and frameworks (TMFs) can facilitate the systematic understanding and explanation of the complex interactions between users, practices, technology, and health system factors that underpin research questions. There remains a gap in our understanding of how TMFs have been applied to guide the evaluation of DHIs with real-world health system operations.

OBJECTIVE

This study aims to map TMFs used in studies to guide the evaluation of DHIs. The objectives are to (1) describe the TMFs and the constructs they target, (2) identify how TMFs have been prospectively used (ie, their roles) in primary studies to evaluate DHIs, and (3) to reflect on the relevance and utility of our findings for knowledge users.

METHODS

This scoping review was conducted in partnership with knowledge users using an integrated knowledge translation approach. We included papers (eg, reports; empirical quantitative, qualitative, and mixed methods studies; conference proceedings; and dissertations) if primary insights resulting from the application of TMFs were presented. Any type of DHI was eligible. Papers published from 2000 and onward were mainly identified from the following databases: MEDLINE (Ovid), CINAHL Complete (EBSCOhost), PsycINFO (Ovid), EBM Reviews (Ovid), and Embase (Ovid).

RESULTS

A total of 156 studies published between 2000 and 2022 were included. A total of 68 distinct TMFs were identified across 85 individual studies. In more than half (85/156, 55%) of the included studies, 1 of following 6 prevailing TMFs were reported: Consolidated Framework for Implementation Research (n=39); the Reach, Effectiveness, Adoption, Implementation, and Maintenance Framework (n=17); the Technology of Acceptance Model (n=16); the Unified Theory on Acceptance and Use of Technology (n=12); the Diffusion of Innovation Theory (n=10); and Normalization Process Theory (n=9). The most common intended roles of the 6 TMFs were to inform data collection (n=86), to inform data analysis (n=69), and to identify key constructs that may serve as barriers and facilitators (n=52).

CONCLUSIONS

As TMFs are most often reported to be applied to support data collection and analysis, researchers should consider more clearly synthesizing key insights as practical use cases to both increase the relevance and digestibility of their findings. There is also a need to adapt or develop guidelines for better reporting DHIs and the use of TMFs to guide evaluation. Hence, it would contribute to ensuring ongoing technology transformation efforts are evidence and theory informed rather than anecdotally driven.

Use of the Therapy App Prescinde for Increasing Adherence to Smoking Cessation Treatment

Tobacco use poses major health risks and is a major contributor to causes of death worldwide. Mobile phone-based cessation apps for this substance are gaining popularity, often used as a component of traditional interventions. This study aimed to analyze adherence to an intervention using a mobile phone application (App-therapy Prescinde (v1)) as a function of sociodemographic variables (age, gender, educational level, and profession) as well as the primary activities supported by the app (reducing tobacco or cannabis use and increasing physical exercise). The participants were recruited through the web pages of the Occupational Risk Prevention Service and the Psychology Clinic of the University of Granada during the COVID-19 confinement period. The application's contents include three components (self-report, motivational phrases, and goal setting). Our findings indicate that being male, being aged between 26 and 62, having a high school education, and being unemployed increase the likelihood of adherence to the Prescinde therapy app three months after usage. Our findings highlight the importance of developing new therapeutic approaches and conducting in-depth studies on the factors associated with adherence to tobacco cessation and cannabis cessation treatments via mobile phone applications.

An overview of facilitators and barriers in the development of eHealth interventions for people of low socioeconomic position: A Delphi study

OBJECTIVE

eHealth interventions can improve the health outcomes of people with a low socioeconomic position (SEP) by promoting healthy lifestyle behaviours. However, developing and implementing these interventions among the target group can be challenging for professionals. To facilitate the uptake of effective interventions, this study aimed to identify the barriers and facilitators anticipated or experienced by professionals in the development, reach, adherence, implementation and evaluation phases of eHealth interventions for people with a low SEP.

METHOD

We used a Delphi method, consisting of two online questionnaires, to determine the consensus on barriers and facilitators anticipated or experienced during eHealth intervention phases and their importance. Participants provided open-ended responses in the first round and rated statements in the second round. The interquartile range was used to calculate consensus, and the (totally) agree ratings were used to assess importance.

RESULTS

Twenty-seven professionals participated in the first round, and 19 (70.4%) completed the second round. We found a consensus for 34.8% of the 46 items related to highly important rated barriers, such as the lack of involvement of low-SEP people in the development phase, lack of knowledge among professionals about reaching the target group, and lack of knowledge among lower-SEP groups about using eHealth interventions. Additionally, we identified a consensus for 80% of the 60 items related to highly important rated facilitators, such as rewarding people with a low SEP for their involvement in the development phase and connecting eHealth interventions to the everyday lives of lower-SEP groups to enhance reach.

CONCLUSION

Our study provides valuable insights into the barriers and facilitators of developing eHealth interventions for people with a low SEP by examining current practices and offering recommendations for future improvements. Strengthening facilitators can help overcome these barriers. To achieve this, we recommend defining the roles of professionals and lower-SEP groups in each phase of eHealth intervention and disseminating this study's findings to professionals to optimize the impact of eHealth interventions for this group.

Use of the Smoking Cessation App Ex-Smokers iCoach and Associations With Smoking-Related Outcomes Over Time in a Large Sample of European Smokers: Retrospective Observational Study

BACKGROUND

Digital interventions are increasingly used to support smoking cessation. Ex-smokers iCoach was a widely available app for smoking cessation used by 404,551 European smokers between June 15, 2011, and June 21, 2013. This provides a unique opportunity to investigate the uptake of a freely available digital smoking cessation intervention and its effects on smoking-related outcomes.

OBJECTIVE

We aimed to investigate whether there were distinct trajectories of iCoach use, examine which baseline characteristics were associated with user groups (based on the intensity of use), and assess if and how these groups were associated with smoking-related outcomes.

METHODS

Analyses were performed using data from iCoach users registered between June 15, 2011, and June 21, 2013. Smoking-related data were collected at baseline and every 3 months thereafter, with a maximum of 8 follow-ups. First, group-based modeling was applied to detect distinct trajectories of app use. This was performed in a subset of steady users who had completed at least 1 follow-up measurement. Second, ordinal logistic regression was used to assess the baseline characteristics that were associated with user group membership. Finally, generalized estimating equations were used to examine the association between the user groups and smoking status, quitting stage, and self-efficacy over time.

RESULTS

Of the 311,567 iCoach users, a subset of 26,785 (8.6%) steady iCoach users were identified and categorized into 4 distinct user groups: low (n=17,422, 65.04%), mild (n=4088, 15.26%), moderate (n=4415, 16.48%), and intensive (n=860, 3.21%) users. Older users and users who found it important to quit smoking had higher odds of more intensive app use, whereas men, employed users, heavy smokers, and users with higher self-efficacy scores had lower odds of more intensive app use. User groups were significantly associated with subsequent smoking status, quitting stage, and self-efficacy over time. For all groups, over time, the probability of being a smoker decreased, whereas the probability of being in an improved quitting stage increased, as did the self-efficacy to quit smoking. For all outcomes, the greatest change was observed between baseline and the first follow-up at 3 months. In the intensive user group, the greatest change was seen between baseline and the 9-month follow-up, with the observed change declining gradually in moderate, mild, and low users.

CONCLUSIONS

In the subset of steady iCoach users, more intensive app use was associated with higher smoking cessation rates, increased quitting stage, and higher self-efficacy to quit smoking over time. These users seemed to benefit most from the app in the first 3 months of use. Women and older users were more likely to use the app more intensively. Additionally, users who found quitting difficult used the iCoach app more intensively and grew more confident in their ability to quit over time.

Using the Unified Theory of Acceptance and Use of Technology (UTAUT) and e-health literacy(e-HL) to investigate the tobacco control intentions and behaviors of non-smoking college students in China: a cross-sectional investigation

BACKGROUND

Non-smoking college students are starting to smoke in increasing numbers, which shows that their tobacco control situation seems not optimistic. The UTAUT and e-HL are commonly used models and theories to predict health behaviors, while there are few studies on tobacco control. This paper aims to study the influencing factors of tobacco control intention and behavior of non-smoking college students in China by combining the UTAUT and e-HL.

METHODS

Based on the stratified sampling method, 625 college students from 12 universities were selected. Data were collected using a self-made questionnaire designed based on the UTAUT and e-health literacy scales. Data were analyzed by SPSS 22 and AMOS 26, including descriptive statistics, one-way variance analysis and structural equation model analysis.

RESULTS

The results of one-way variance analysis showed that there were significant differences in the score of non-smoking college students' tobacco control intention or behavior by hometowns, monthly living expenses, and parents' smoking history. Performance expectancy, effort expectancy, social influence had direct positive effects on behavioral intention. Facilitating condition, behavioral intention had direct positive impacts on use behavior and e-HL had an indirect positive impact on use behavior.

CONCLUSIONS

The combination of the UTAUT and e-HL can be used as an appropriate framework to predict the influencing factors of non-smoking college students' intention and behavior of tobacco control. Improving performance expectancy, effort expectancy, and e-HL among non-smoking college students, creating positive social environments, and providing facilitating condition are key aspects of increasing their tobacco control intention and behavior. It is also beneficial to promote the implementation of smoke-free campus and smoke-free family projects.

A scoping review of applications of the Consolidated Framework for Implementation Research (CFIR) to telehealth service implementation initiatives

BACKGROUND

The Consolidated Framework for Implementation Research (CFIR), introduced in 2009, has the potential to provide a comprehensive understanding of the determinants of implementation-effectiveness of health service innovations. Although the CFIR has been increasingly used in recent years to examine factors influencing telehealth implementation, no comprehensive reviews currently exist on the scope of knowledge gained exclusively from applications of the CFIR to telehealth implementation initiatives. This review sought to address this gap.

METHODS

PRISMA-ScR criteria were used to inform a scoping review of the literature. Five academic databases (PUBMED, PROQUEST, SCIDIRECT, CINAHL, and WoS) were searched for eligible sources of evidence from 01.01.2010 through 12.31.2021. The initial search yielded a total of 18,388 records, of which, 64 peer-reviewed articles met the inclusion criteria for the review. Included articles were reviewed in full to extract data, and data collected were synthesized to address the review questions.

RESULTS

Most included articles were published during or after 2020 (64%), and a majority (77%) were qualitative or mixed-method studies seeking to understand barriers or facilitators to telehealth implementation using the CFIR. There were few comparative- or implementation-effectiveness studies containing outcome measures (5%). The database search however, revealed a growing number of protocols for implementation-effectiveness studies published since 2020. Most articles (91%) reported the CFIR Inner Setting domain (e.g., leadership engagement) to have a predominant influence over telehealth implementation success. By comparison, few articles (14%) reported the CFIR Outer Setting domain (e.g., telehealth policies) to have notable influence. While more (63%) telehealth initiatives were focused on specialty (vs primary) care, a vast majority (78%) were focused on clinical practice over medical education, healthcare administration, or population health.

CONCLUSIONS

Organized provider groups have historically paid considerable attention to advocating for telehealth policy (Outer Setting) reform. However, results suggest that for effective telehealth implementation, provider groups need to refocus their efforts on educating individual providers on the complex inter-relationships between Inner Setting constructs and telehealth implementation-effectiveness. On a separate note, the growth in implementation-effectiveness study protocols since 2020, suggests that additional outcome measures may soon be available, to provide a more nuanced understanding of the determinants of effective telehealth implementation based on the CFIR domains and constructs.

Users' needs for a digital smoking cessation application and how to address them: A mixed-methods study

Background

Despite their increasing prevalence and potential, eHealth applications for behavior change suffer from a lack of adherence and from dropout. Advances in virtual coach technology provide new opportunities to improve this. However, these applications still do not always offer what people need. We, therefore, need a better understanding of people's needs and how to address these, based on both actual experiences of users and their reflections on envisioned scenarios.

Methods

We conducted a longitudinal study in which 671 smokers interacted with a virtual coach in five sessions. The virtual coach assigned them a new preparatory activity for quitting smoking or increasing physical activity in each session. Participants provided feedback on the activity in the next session. After the five sessions, participants were asked to describe barriers and motivators for doing their activities. In addition, they provided their views on videos of scenarios such as receiving motivational messages. To understand users' needs, we took a mixed-methods approach. This approach triangulated findings from qualitative data, quantitative data, and the literature.

Results

We identified 14 main themes that describe people's views of their current and future behaviors concerning an eHealth application. These themes relate to the behaviors themselves, the users, other parties involved in a behavior, and the environment. The most prevalent theme was the perceived usefulness of behaviors, especially whether they were informative, helpful, motivating, or encouraging. The timing and intensity of behaviors also mattered. With regards to the users, their perceived importance of and motivation to change, autonomy, and personal characteristics were major themes. Another important role was played by other parties that may be involved in a behavior, such as general practitioners or virtual coaches. Here, the themes of companionableness, accountability, and nature of the other party (i.e., human vs AI) were relevant. The last set of main themes was related to the environment in which a behavior is performed. Prevalent themes were the availability of sufficient time, the presence of prompts and triggers, support from one's social environment, and the diversity of other environmental factors. We provide recommendations for addressing each theme.

Conclusions

The integrated method of experience-based and envisioning-based needs acquisition with a triangulate analysis provided a comprehensive needs classification (empirically and theoretically grounded). We expect that our themes and recommendations for addressing them will be helpful for designing applications for health behavior change that meet people's needs. Designers should especially focus on the perceived usefulness of application components. To aid future work, we publish our dataset with user characteristics and 5,074 free-text responses from 671 people.