1
|
Islam A, Chaudhry BM, Islam A. RACares: a conceptual design to guide mHealth relational agent development based on a systematic review. Mhealth 2024; 10:11. [PMID: 38323144 PMCID: PMC10839507 DOI: 10.21037/mhealth-23-46] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Accepted: 11/16/2023] [Indexed: 02/08/2024] Open
Abstract
Background A relational agent (RA) is a digital tool tailored to communicate with users, aiming to establish a sense of social ease and emotional bond, particularly focusing on their health and well-being concerns. A mobile health (mHealth) RA is particularly crafted to communicate with users within their mobile devices. As healthcare becomes increasingly digital, these mHealth RAs can serve as personal health assistants, e.g., guiding users through medical regimens, offering reminders for medication, providing emotional support during health crises, or even aiding in mental well-being exercises. Their accessibility, especially for those in remote areas, can bridge the gap between patients and immediate health assistance, revolutionizing the way healthcare is approached and delivered. Methods In this paper, our primary focus is introducing a conceptual design for mHealth RAs with the aim of enhanced user engagement, personalized health interventions, consistent support, data collection and monitoring, and enhanced multimodal accessibility. To develop this conceptual design, we employed an inductive approach. This involved conducting a qualitative analysis on data gathered from a systematic literature review of RAs. Consequently, this analysis allowed us to identify a taxonomy of key design features essential for RAs. Results This paper provides a conceptual design of mHealth RAs which includes five stages: user input receiving stage, input processing stage, data analysis stage, output processing stage, and output generation stage. A stage is a logical assembly of interconnected functionalities (components) that work together to accomplish a certain objective or set of goals. Each stage's outputs are used as inputs in the stages that follow after it. There is also a Data and Personalization Controller for aiding the data analysis stage. The stages are logically arranged one after another as follows: input, process, analysis, and output. Conclusions The conceptual design aims to create RAs for various mHealth applications, including patient education, mental health counseling, and chronic disease management. This design is crucial in digital health research as it enhances patient-RA interactions, potentially improving health outcomes and experiences in non-life-threatening scenarios where RAs can be an alternative to human healthcare professionals (HCPs).
Collapse
Affiliation(s)
- Ashraful Islam
- Center for Computational and Data Sciences, Independent University Bangladesh, Dhaka, Bangladesh
- Department of Computer Science and Engineering, Independent University Bangladesh, Dhaka, Bangladesh
| | - Beenish Moalla Chaudhry
- School of Computing and Informatics, University of Louisiana at Lafayette, Lafayette, LA, USA
| | - Aminul Islam
- School of Computing and Informatics, University of Louisiana at Lafayette, Lafayette, LA, USA
| |
Collapse
|
2
|
Hamina A, Odsbu I, Borchgrevink PC, Chen LC, Clausen T, Espnes KA, Gjesdal K, Handal M, Hartikainen S, Hjellvik V, Holter MTS, Høibø T, Kurita GP, Langaas HC, Lid TG, Nøst TH, Sjøgren P, Skurtveit S. Cohort Description: Preventing an Opioid Epidemic in Norway - Focusing on Treatment of Chronic Pain (POINT) - A National Registry-Based Study. Clin Epidemiol 2022; 14:1477-1486. [PMID: 36523790 PMCID: PMC9744863 DOI: 10.2147/clep.s382136] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Accepted: 10/25/2022] [Indexed: 07/30/2023] Open
Abstract
AIM The POINT project aims to provide evidence to optimise chronic pain management, prevent adverse consequences of opioids, and improve chronic pain patients' pain relief, functional capacity, and quality of life. We describe the outline of the project and its work packages. More specifically, we describe a cohort of persons with chronic pain and a cohort of long-term opioid users identified from a national registry linkage. DATA SOURCES The project utilises data from nationwide healthcare and population registers in Norway. Using the Norwegian Prescription Database, we identified a cohort of persons who have been dispensed drugs reimbursed for chronic pain and a cohort of persons who used opioids long term from 2010 to 2019. Data from the Norwegian Registry for Primary Health Care and the Norwegian Patient Registry (2008-2019), Cancer Registry (1990-2018) Cause of Death Registry (2010-2019) and demographic and socioeconomic registers from Statistics Norway (2010-2019) were linked to the cohorts. STUDY POPULATION There were 568,869 participants with chronic pain. Sixty-three percent of the cohort was women, and the mean age was 57.1 years. There were 336,712 long-term opioid users (58.6% women; 60.9 years). In chronic pain and long-term opioid user cohorts, the most frequent musculoskeletal diagnosis was back pain diagnosed in primary care (27.6% and 30.7%). Psychiatric diagnoses were also common. MAIN VARIABLES Upcoming studies will utilise psychiatric and somatic diagnoses from the patient registers, drug use from the prescription register, causes of death, demographics, and socioeconomic status (eg, education, income, workability, immigrant status) as exposures or outcomes. CONCLUSION AND FUTURE PLANS The two cohorts have numerous pain-related diagnoses, especially in the musculoskeletal system, and noticeably frequent somatic and psychiatric morbidity. The POINT project also includes later work packages that explore prescriber and patient perspectives around safe and effective treatment of chronic pain.
Collapse
Affiliation(s)
- Aleksi Hamina
- Norwegian Centre for Addiction Research (SERAF), Institute of Clinical Medicine, University of Oslo, Oslo, Norway
| | - Ingvild Odsbu
- Department of Mental Disorders, Division of Mental and Physical Health, the Norwegian Institute of Public Health, Oslo, Norway
| | - Petter Christian Borchgrevink
- Department of Pain and Complex Disorders, St. Olavs Hospital, Trondheim University Hospital, Trondheim, Norway
- Institute of Circulation and Medical Imaging, Norwegian University of Science and Technology, Trondheim, Norway
| | - Li-Chia Chen
- Division of Pharmacy and Optometry, School of Health Sciences, University of Manchester, Manchester, UK
| | - Thomas Clausen
- Norwegian Centre for Addiction Research (SERAF), Institute of Clinical Medicine, University of Oslo, Oslo, Norway
| | - Ketil Arne Espnes
- Department of Clinical Pharmacology, St. Olavs Hospital, Trondheim University Hospital, Trondheim, Norway
- Regional Medicines Information and Pharmacovigilance Centre (RELIS), Department of Clinical Pharmacology, St. Olavs Hospital, Trondheim University Hospital, Trondheim, Norway
| | - Kine Gjesdal
- Faculty of Health Sciences, University of Stavanger, Stavanger, Norway
- Center for Alcohol and Drug Research (KORFOR), Stavanger University Hospital, Stavanger, Norway
| | - Marte Handal
- Norwegian Centre for Addiction Research (SERAF), Institute of Clinical Medicine, University of Oslo, Oslo, Norway
- Department of Chronic Diseases, Division of Mental and Physical Health, the Norwegian Institute of Public Health, Oslo, Norway
| | | | - Vidar Hjellvik
- Department of Chronic Diseases, Division of Mental and Physical Health, the Norwegian Institute of Public Health, Oslo, Norway
| | | | - Trond Høibø
- Research Unit for General Practice, NORCE Norwegian Research Centre, Bergen, Norway
| | - Geana Paula Kurita
- Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
- Department of Oncology, Rigshospitalet Copenhagen University Hospital, Copenhagen, Denmark
- Department of Anaesthesiology, Pain and Respiratory Support, Rigshospitalet Copenhagen University Hospital, Copenhagen, Denmark
| | - Harald Christian Langaas
- Regional Medicines Information and Pharmacovigilance Centre (RELIS), Department of Clinical Pharmacology, St. Olavs Hospital, Trondheim University Hospital, Trondheim, Norway
| | - Torgeir Gilje Lid
- Faculty of Health Sciences, University of Stavanger, Stavanger, Norway
- Center for Alcohol and Drug Research (KORFOR), Stavanger University Hospital, Stavanger, Norway
| | - Torunn Hatlen Nøst
- Department of Pain and Complex Disorders, St. Olavs Hospital, Trondheim University Hospital, Trondheim, Norway
- Department of Mental Health, Norwegian University of Science and Technology, Trondheim, Norway
| | - Per Sjøgren
- Department of Oncology, Rigshospitalet Copenhagen University Hospital, Copenhagen, Denmark
| | - Svetlana Skurtveit
- Norwegian Centre for Addiction Research (SERAF), Institute of Clinical Medicine, University of Oslo, Oslo, Norway
- Department of Mental Disorders, Division of Mental and Physical Health, the Norwegian Institute of Public Health, Oslo, Norway
| | | |
Collapse
|
3
|
Kulhánek A, Lukavska K, Gabrhelík R, Novák D, Burda V, Prokop J, Holter MTS, Brendryen H. Comparing Reminders Sent via SMS Text Messaging and Email for Improving Adherence to an Electronic Health Program: Randomized Controlled Trial. JMIR Mhealth Uhealth 2022; 10:e31040. [PMID: 35302945 PMCID: PMC8976257 DOI: 10.2196/31040] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2021] [Revised: 08/12/2021] [Accepted: 12/20/2021] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND eHealth interventions can help people change behavior (eg, quit smoking). Reminders sent via SMS text messaging or email may improve the adherence to web-based programs and increase the probability of successful behavior change; however, it is unclear whether their efficiency is affected by the modality of the communication channel. OBJECTIVE A 2-armed randomized control trial was conducted to compare the effect of providing reminders via SMS text messaging versus email on the adherence to an eHealth program for smoking cessation and on the probability to initiate a quit attempt. METHODS Smokers were recruited via an internet-based advertisement. A total of 591 participants who diverted from intended use of the program (ie, failed to log on to a session) were automatically randomized to the experimental (SMS text messaging reminder, n=304) or the active comparator (email reminder, n=287) group. RESULTS Unexpectedly, we found that the mode of reminder delivery did not significantly affect either the adherence, namely the number of completed program sessions, with the SMS text messaging reminder group showing a mean of 4.30 (SD 3.24) and the email reminder group showing a mean of 4.36 (SD 3.27) (t586=0.197, P=.84, and Cohen d=0.016), or the outcome, namely the quit smoking attempt rate (34.2% in the SMS text messaging group vs 31.7% in the email group; χ21=0.4, P=.52). Secondary analyses showed that age, gender, and education had significant effects on program adherence and education on the outcome. Moreover, we found a significant interaction effect between the mode of reminder delivery and gender on program adherence, suggesting that the effectiveness of SMS text message reminders might be different for females and males. However, this particular finding should be treated with care as it was based on post hoc subgroup analysis. CONCLUSIONS This study indicates that the modality of user reminders to log on increased neither the program adherence nor the probability of quitting smoking. This suggests that program developers may save costs using emails instead of SMS text messaging reminders. TRIAL REGISTRATION ClinicalTrials.gov NCT03276767; https://clinicaltrials.gov/ct2/show/ NCT03276767.
Collapse
Affiliation(s)
- Adam Kulhánek
- Department of Addictology, General University Hospital in Prague, Prague, Czech Republic
- Department of Addictology, First Faculty of Medicine, Charles University, Prague, Czech Republic
| | - Katerina Lukavska
- Department of Addictology, General University Hospital in Prague, Prague, Czech Republic
- Department of Addictology, First Faculty of Medicine, Charles University, Prague, Czech Republic
- Department of Psychology, Faculty of Education, Charles University, Prague, Czech Republic
| | - Roman Gabrhelík
- Department of Addictology, General University Hospital in Prague, Prague, Czech Republic
- Department of Addictology, First Faculty of Medicine, Charles University, Prague, Czech Republic
| | - Daniel Novák
- Department of Cybernetics, Faculty of Electrical Engineering, Czech Technical University in Prague, Prague, Czech Republic
| | - Václav Burda
- Department of Addictology, First Faculty of Medicine, Charles University, Prague, Czech Republic
- Department of Cybernetics, Faculty of Electrical Engineering, Czech Technical University in Prague, Prague, Czech Republic
| | - Jindřich Prokop
- Department of Cybernetics, Faculty of Electrical Engineering, Czech Technical University in Prague, Prague, Czech Republic
| | - Marianne T S Holter
- The Norwegian Centre for Addiction Research (SERAF), Faculty of Medicine, University of Oslo, Oslo, Norway
- Department of Psychology, Faculty of Social Sciences, University of Oslo, Oslo, Norway
| | - Håvar Brendryen
- The Norwegian Centre for Addiction Research (SERAF), Faculty of Medicine, University of Oslo, Oslo, Norway
- Department of Psychology, Faculty of Social Sciences, University of Oslo, Oslo, Norway
| |
Collapse
|
4
|
Potthoff S, O'Donnell AJ, Karlsen AT, Brendryen H, Lid TG. Pragmatic approaches for addressing alcohol in general practice: Development of a tailored implementation intervention. FRONTIERS IN HEALTH SERVICES 2022; 2:940383. [PMID: 36925895 PMCID: PMC10012791 DOI: 10.3389/frhs.2022.940383] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Accepted: 10/31/2022] [Indexed: 11/18/2022]
Abstract
Introduction Alcohol consumption is a leading global risk factor for ill-health and premature death. Alcohol screening and brief interventions (SBI) delivered in primary care is effective at reducing alcohol consumption, but routine implementation remains problematic. Screening all patients for excessive drinking (universal screening) is resource-intensive and may be at odds with general practitioners' (GPs') perceived professional role. This study aimed to develop a tailored, theory-based training intervention to strengthen GPs' ability to address alcohol and to manage alcohol-related health problems through a pragmatic approach based on clinical relevance. Methods A qualitative study design involving focus group interviews and a structured questionnaire for free text replies with GPs in Norway. Behavioral analysis assessed factors influencing delivery of SBI according to the 'capability, opportunity, motivation and behavior' (COM-B) model to inform intervention development using the Behavior Change Wheel. Qualitative data were analyzed using framework analysis and an iterative approach was adopted to develop the training. Results A purposive sample of GPs attended the focus groups (n = 25) and completed the questionnaire (n = 55). Four areas required additional support including: understanding the link between alcohol use and health problems; opening up the conversation on alcohol use; addressing alcohol and dealing with obstacles; and following-up and maintaining change. Findings informed the development of a four-session interactive training intervention and a digital intervention for providing support for patients between consultations to address the identified needs. Conclusion This work highlights the value of pragmatic, relevance-based clinical strategies, as opposed to universal screening approaches to addressing alcohol in primary care. A pragmatic approach is more in line with GPs existing sclinical skill set and holds the potential to improve widespread uptake and implementation of SBI in routine primary care.
Collapse
Affiliation(s)
- Sebastian Potthoff
- Centre for Alcohol and Drug Research, Stavanger University Hospital, Stavanger, Norway.,Department of Social Work, Education and Community Wellbeing, Northumbria University, Newcastle upon Tyne, United Kingdom
| | - Amy Jane O'Donnell
- Population and Health Sciences Institute, Newcastle University, Newcastle upon Tyne, United Kingdom
| | | | - Håvar Brendryen
- Department of Psychology, Faculty of Social Sciences, University of Oslo, Oslo, Norway
| | - Torgeir Gilje Lid
- Centre for Alcohol and Drug Research, Stavanger University Hospital, Stavanger, Norway.,Faculty of Health Sciences, University of Stavanger, Stavanger, Norway.,Research Unit for General Practice, NORCE Norwegian Research Centre, Bergen, Norway
| |
Collapse
|
5
|
Wen S, Wiers RW, Boffo M, Grasman RP, Pronk T, Larsen H. Subtypes of smokers in a randomized controlled trial of a web-based smoking cessation program and their role in predicting intervention non-usage attrition: Implications for the development of tailored interventions. Internet Interv 2021; 26:100473. [PMID: 34765460 PMCID: PMC8569479 DOI: 10.1016/j.invent.2021.100473] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/02/2021] [Revised: 10/11/2021] [Accepted: 10/14/2021] [Indexed: 11/29/2022] Open
Abstract
INTRODUCTION Web-based smoking interventions hold potential for smoking cessation; however, many of them report low intervention usage (i.e., high levels of non-usage attrition). One strategy to counter this issue is to tailor such interventions to user subtypes if these can be identified and related to non-usage attrition outcomes. The aim of this study was two-fold: (1) to identify and describe a smoker typology in participants of a web-based smoking cessation program and (2) to explore subtypes of smokers who are at a higher risk for non-usage attrition (i.e., early dropout times). METHODS We conducted secondary analyses of data from a large randomized controlled trial (RCT) that investigated effects of a web-based Cognitive Bias Modification intervention in adult smokers. First, we conducted a two-step cluster analysis to identify subtypes of smokers based on participants' baseline characteristics (including demographics, psychological and smoking-related variables, N = 749). Next, we conducted a discrete-time survival analysis to investigate the predictive value of the subtypes on time until dropout. RESULTS We found three distinct clusters of smokers: Cluster 1 (25.2%, n = 189) was characterized by participants being relatively young, highly educated, unmarried, light-to-moderate smokers, poly-substance users, and relatively high scores on sensation seeking and impulsivity; Cluster 2 (41.0%, n = 307) was characterized by participants being older, with a relatively high socio-economic status (SES), moderate-to-heavy smokers and regular drinkers; Cluster 3 (33.8%, n = 253) contained mostly females of older age, and participants were further characterized by a relatively low SES, heavy smoking, and relatively high scores on hopelessness, anxiety sensitivity, impulsivity, depression, and alcohol use. Additionally, Cluster 1 was more likely to drop out at the early stage of the intervention compared to Cluster 2 (adjusted Hazard Ratio (HR adjusted) = 1.51, 95% CI = [1.25, 1.83]) and Cluster 3 (HR adjusted = 1.52, 95% CI = [1.25, 1.86]). CONCLUSIONS We identified three clusters of smokers that differed on a broad range of characteristics and on intervention non-usage attrition patterns. This highlights the heterogeneity of participants in a web-based smoking cessation program. Also, it supports the idea that such interventions could be tailored to these subtypes to prevent non-usage attrition. The subtypes of smokers identified in this study need to be replicated in the field of e-health outside the context of RCT; based on the smoker subtypes identified in this study, we provided suggestions for developing tailored web-based smoking cessation intervention programs in future research.
Collapse
Affiliation(s)
- Si Wen
- Addiction Development and Psychopathology (ADAPT)-lab, Department of Psychology, University of Amsterdam, Amsterdam, the Netherlands,Corresponding author at: Addiction Development and Psychopathology (ADAPT)-Lab, Department of Psychology, University of Amsterdam, Postbus 15916, 1001 NK Amsterdam, the Netherlands.
| | - Reinout W. Wiers
- Addiction Development and Psychopathology (ADAPT)-lab, Department of Psychology, University of Amsterdam, Amsterdam, the Netherlands,Center for Urban Mental Health, University of Amsterdam, Amsterdam, the Netherlands
| | - Marilisa Boffo
- Addiction Development and Psychopathology (ADAPT)-lab, Department of Psychology, University of Amsterdam, Amsterdam, the Netherlands,Department of Psychology, Education and Child Studies, Erasmus University Rotterdam, Rotterdam, the Netherlands
| | - Raoul P.P.P. Grasman
- Programme group Psychological Methods, Department of Psychology, University of Amsterdam, Amsterdam, the Netherlands
| | - Thomas Pronk
- Addiction Development and Psychopathology (ADAPT)-lab, Department of Psychology, University of Amsterdam, Amsterdam, the Netherlands,Open Science Tools (PsychoPy)-Lab, School of Psychology, University of Nottingham, Nottingham, United Kingdom of Great Britain and Northern Ireland
| | - Helle Larsen
- Addiction Development and Psychopathology (ADAPT)-lab, Department of Psychology, University of Amsterdam, Amsterdam, the Netherlands
| |
Collapse
|
6
|
In Search of Embodied Conversational and Explainable Agents for Health Behaviour Change and Adherence. MULTIMODAL TECHNOLOGIES AND INTERACTION 2021. [DOI: 10.3390/mti5090056] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Conversational agents offer promise to provide an alternative to costly and scarce access to human health providers. Particularly in the context of adherence to treatment advice and health behavior change, they can provide an ongoing coaching role to motivate and keep the health consumer on track. Due to the recognized importance of face-to-face communication and establishment of a therapist-patient working alliance as the biggest single predictor of adherence, our review focuses on embodied conversational agents (ECAs) and their use in health and well-being interventions. The article also introduces ECAs who provide explanations of their recommendations, known as explainable agents (XAs), as a way to build trust and enhance the working alliance towards improved behavior change. Of particular promise, is work in which XAs are able to engage in conversation to learn about their user and personalize their recommendations based on their knowledge of the user and then tailor their explanations to the beliefs and goals of the user to increase relevancy and motivation and address possible barriers to increase intention to perform the healthy behavior.
Collapse
|
7
|
Baumel A, Muench FJ. Effort-Optimized Intervention Model: Framework for Building and Analyzing Digital Interventions That Require Minimal Effort for Health-Related Gains. J Med Internet Res 2021; 23:e24905. [PMID: 33709943 PMCID: PMC7998331 DOI: 10.2196/24905] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2020] [Revised: 12/16/2020] [Accepted: 01/16/2021] [Indexed: 02/02/2023] Open
Abstract
The majority of digital health interventions lean on the promise of bringing health and self-care into people’s homes and hands. However, these interventions are delivered while people are in their triggering environments, which places competing demands on their attention. Individuals struggling to change or learn a new behavior have to work hard to achieve even a minor change because of the automatic forces propelling them back to their habitual behaviors. We posit that effort and burden should be explored at the outset and throughout the digital intervention development process as a core therapeutic mechanism, beyond the context of design or user experience testing. In effort-focused conceptualization, it is assumed that, even though goals are rational and people want to achieve them, they are overtaken by competing cognitive, emotional, and environmental processes. We offer the term effort-optimized intervention to describe interventions that focus on user engagement in the face of competing demands. We describe design components based on a 3-step process for planning an effort-optimized intervention: (1) nurturing effortless cognitive and environmental salience to help people keep effort-related goals prominent despite competition; (2) making it as effortless as possible to complete therapeutic activities to avoid ego depletion and self-efficacy reduction; and (3) turning the necessary effortful activities into sustainable assets. We conclude by presenting an example of designing a digital health intervention based on the effort-optimized intervention model.
Collapse
Affiliation(s)
- Amit Baumel
- Department of Community Mental Health, University of Haifa, Haifa, Israel
| | | |
Collapse
|
8
|
Baumel A, Fleming T, Schueller SM. Digital Micro Interventions for Behavioral and Mental Health Gains: Core Components and Conceptualization of Digital Micro Intervention Care. J Med Internet Res 2020; 22:e20631. [PMID: 33118946 PMCID: PMC7661243 DOI: 10.2196/20631] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2020] [Revised: 08/11/2020] [Accepted: 08/13/2020] [Indexed: 01/19/2023] Open
Abstract
Although many people access publicly available digital behavioral and mental health interventions, most do not invest as much effort in these interventions as hoped or intended by intervention developers, and ongoing engagement is often low. Thus, the impact of such interventions is minimized by a misalignment between intervention design and user behavior. Digital micro interventions are highly focused interventions delivered in the context of a person’s daily life with little burden on the individual. We propose that these interventions have the potential to disruptively expand the reach of beneficial therapeutics by lowering the bar for entry to an intervention and the effort needed for purposeful engagement. This paper provides a conceptualization of digital micro interventions, their component parts, and principles guiding their use as building blocks of a larger therapeutic process (ie, digital micro intervention care). The model represented provides a structure that could improve the design, delivery, and research on digital micro interventions and ultimately improve behavioral and mental health care and care delivery.
Collapse
|
9
|
Tremain H, McEnery C, Fletcher K, Murray G. The Therapeutic Alliance in Digital Mental Health Interventions for Serious Mental Illnesses: Narrative Review. JMIR Ment Health 2020; 7:e17204. [PMID: 32763881 PMCID: PMC7442952 DOI: 10.2196/17204] [Citation(s) in RCA: 61] [Impact Index Per Article: 15.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/29/2019] [Revised: 06/07/2020] [Accepted: 06/07/2020] [Indexed: 12/17/2022] Open
Abstract
BACKGROUND Digital mental health interventions offer unique advantages, and research indicates that these interventions are effective for a range of mental health concerns. Although these interventions are less established for individuals with serious mental illnesses, they demonstrate significant promise. A central consideration in traditional face-to-face therapies is the therapeutic alliance, whereas the nature of a digital therapeutic alliance and its relationship with outcomes requires further attention, particularly for individuals with serious mental illnesses. OBJECTIVE This narrative review aims to encourage further consideration and critical evaluation of the therapeutic alliance in digital mental health, specifically for individuals with serious mental illnesses. METHODS A narrative review was conducted by combining 3 main areas of the literature: the first examining the evidence for digital mental health interventions for serious mental illnesses, the second illuminating the nature and role of the therapeutic alliance in digital interventions, and the third surrounding practical considerations to enhance a digital therapeutic alliance. RESULTS Results indicated that a therapeutic alliance can be cultivated in digital interventions for those with serious mental illnesses, but that it may have unique, yet-to-be-confirmed characteristics in digital contexts. In addition, a therapeutic alliance appears to be less directly associated with outcomes in digital interventions than with those in face-to-face therapies. One possibility is that the digital therapeutic alliance is associated with increased engagement and adherence to digital interventions, through which it appears to influence outcomes. A number of design and implementation considerations may enhance the digital therapeutic alliance, including human support and technological features. CONCLUSIONS More research is required to further understand the nature and specific role of a therapeutic alliance in digital interventions for serious mental illnesses, particularly in informing their design. This review revealed several key research priorities to advance the therapeutic alliance in digital interventions.
Collapse
Affiliation(s)
- Hailey Tremain
- Centre for Mental Health, Faculty of Health, Arts and Design, Swinburne University of Technology, Hawthorn, Australia
| | | | - Kathryn Fletcher
- Centre for Mental Health, Faculty of Health, Arts and Design, Swinburne University of Technology, Hawthorn, Australia
| | - Greg Murray
- Centre for Mental Health, Faculty of Health, Arts and Design, Swinburne University of Technology, Hawthorn, Australia
| |
Collapse
|
10
|
Holter MTS, Ness O, Johansen AB, Brendryen H. Making Come-Alive and Keeping Un-Alive: How People Relate to Self-Guided Web-Based Health Interventions. QUALITATIVE HEALTH RESEARCH 2020; 30:927-941. [PMID: 32046613 PMCID: PMC7322942 DOI: 10.1177/1049732320902456] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Abstract
Health interventions delivered online (self-guided web-based interventions) may become more helpful through a person-to-program "working alliance." In psychotherapy, the working alliance signifies a therapeutically useful client-therapist relationship and includes an emotional bond. However, there exist no theories of how program users relate to online programs, or that explain a person-to-program bond theoretically. Addressing this gap, we conducted qualitative interviews with and collected program data from users of a self-guided web-based intervention. Taking a grounded theory approach, the analysis arrived at a model of relating based on two relational modes-making come-alive and keeping un-alive. Different combinations of these modes could describe a range of ways of relating to the program, including a nonsocial interaction, a semi-social interaction, and a semi-social relationship. A person-to-program bond is explained by the model as an experienced supportive social presence, enabled by making come-alive and a positive program interaction.
Collapse
Affiliation(s)
- Marianne T. S. Holter
- The Norwegian Centre for Addiction Research (SERAF), Faculty of Medicine, University of Oslo, Oslo, Norway
| | - Ottar Ness
- Department of Education and Lifelong Learning, Norwegian University of Science and Technology, Trondheim, Norway
| | - Ayna B. Johansen
- The Norwegian Centre for Addiction Research (SERAF), Faculty of Medicine, University of Oslo, Oslo, Norway
| | - Håvar Brendryen
- The Norwegian Centre for Addiction Research (SERAF), Faculty of Medicine, University of Oslo, Oslo, Norway
| |
Collapse
|
11
|
Kienen N, Wiltenburg TD, Bittencourt L, Scarinci IC. Development of a gender-relevant tobacco cessation intervention for women in Brazil-an intervention mapping approach to planning. HEALTH EDUCATION RESEARCH 2019; 34:505-520. [PMID: 31495883 PMCID: PMC7962721 DOI: 10.1093/her/cyz025] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/26/2019] [Accepted: 08/13/2019] [Indexed: 06/10/2023]
Abstract
The purpose of this article is to describe the development of a theory-based, culturally and gender-relevant Community Health Worker (CWH)-led tobacco cessation intervention for low-income Brazilian women who augments the tobacco cessation program offered through the public health system using Intervention Mapping (IM). We began with the establishment of a network of representatives from different segments of society followed by comprehensive needs assessments. We then established a logical planning process that was guided by a theoretical framework (Social Cognitive Theory) and existing evidence-based tobacco cessation programs, taking into account socio-political context of a universal health care system. Given the gender-relevance of our intervention and the importance of social support in tobacco cessation among women, we chose an intervention that would be delivered within the public health system but augmented by CHWs that would be trained in behavior change by researchers. One of major advantages of utilizing IM was that decisions were made in a transparent and supportive manner with involvement of all stakeholders throughout the process. Despite the fact that this process is very taxing on researchers and the health care system as it takes time, resources and negotiation skills, it builds trust and promotes ownership which can assure sustainability.
Collapse
Affiliation(s)
- Nádia Kienen
- Department of Psychology and Behavior Analysis, Universidade Estadual de Londrina, Rodovia Celso Garcia Cid, PR 445 Km 380, Londrina, PR, Brazil
| | - Thaís Distéfano Wiltenburg
- Department of Psychology and Behavior Analysis, Universidade Estadual de Londrina, Rodovia Celso Garcia Cid, PR 445 Km 380, Londrina, PR, Brazil
| | - Lorna Bittencourt
- Division of Preventive Medicine, University of Alabama at Birmingham, 1717 11th Avenue South, MT 609, Birmingham, AL, USA
| | - Isabel C Scarinci
- Division of Preventive Medicine, University of Alabama at Birmingham, 1717 11th Avenue South, MT 609, Birmingham, AL, USA
| |
Collapse
|
12
|
Baumel A, Muench F, Edan S, Kane JM. Objective User Engagement With Mental Health Apps: Systematic Search and Panel-Based Usage Analysis. J Med Internet Res 2019; 21:e14567. [PMID: 31573916 PMCID: PMC6785720 DOI: 10.2196/14567] [Citation(s) in RCA: 328] [Impact Index Per Article: 65.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2019] [Revised: 07/01/2019] [Accepted: 07/19/2019] [Indexed: 11/18/2022] Open
Abstract
Background Understanding patterns of real-world usage of mental health apps is key to maximizing their potential to increase public self-management of care. Although developer-led studies have published results on the use of mental health apps in real-world settings, no study yet has systematically examined usage patterns of a large sample of mental health apps relying on independently collected data. Objective Our aim is to present real-world objective data on user engagement with popular mental health apps. Methods A systematic engine search was conducted using Google Play to identify Android apps with 10,000 installs or more targeting anxiety, depression, or emotional well-being. Coding of apps included primary incorporated techniques and mental health focus. Behavioral data on real-world usage were obtained from a panel that provides aggregated nonpersonal information on user engagement with mobile apps. Results In total, 93 apps met the inclusion criteria (installs: median 100,000, IQR 90,000). The median percentage of daily active users (open rate) was 4.0% (IQR 4.7%) with a difference between trackers (median 6.3%, IQR 10.2%) and peer-support apps (median 17.0%) versus breathing exercise apps (median 1.6%, IQR 1.6%; all z≥3.42, all P<.001). Among active users, daily minutes of use were significantly higher for mindfulness/meditation (median 21.47, IQR 15.00) and peer support (median 35.08, n=2) apps than for apps incorporating other techniques (tracker, breathing exercise, psychoeducation: medians range 3.53-8.32; all z≥2.11, all P<.05). The medians of app 15-day and 30-day retention rates were 3.9% (IQR 10.3%) and 3.3% (IQR 6.2%), respectively. On day 30, peer support (median 8.9%, n=2), mindfulness/meditation (median 4.7%, IQR 6.2%), and tracker apps (median 6.1%, IQR 20.4%) had significantly higher retention rates than breathing exercise apps (median 0.0%, IQR 0.0%; all z≥2.18, all P≤.04). The pattern of daily use presented a descriptive peak toward the evening for apps incorporating most techniques (tracker, psychoeducation, and peer support) except mindfulness/meditation, which exhibited two peaks (morning and night). Conclusions Although the number of app installs and daily active minutes of use may seem high, only a small portion of users actually used the apps for a long period of time. More studies using different datasets are needed to understand this phenomenon and the ways in which users self-manage their condition in real-world settings.
Collapse
Affiliation(s)
- Amit Baumel
- Department of Community Mental Health, University of Haifa, Haifa, Israel
| | | | - Stav Edan
- Department of Community Mental Health, University of Haifa, Haifa, Israel
| | - John M Kane
- Psychiatry Research, The Zucker Hillside Hospital, Northwell Health, Glen Oaks, NY, United States
| |
Collapse
|
13
|
Holter MT, Johansen AB, Ness O, Brinkmann S, Høybye MT, Brendryen H. Qualitative Interview Studies of Working Mechanisms in Electronic Health: Tools to Enhance Study Quality. J Med Internet Res 2019; 21:e10354. [PMID: 31066683 PMCID: PMC6526686 DOI: 10.2196/10354] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2018] [Revised: 01/17/2019] [Accepted: 02/07/2019] [Indexed: 01/23/2023] Open
Abstract
Future development of electronic health (eHealth) programs (automated Web-based health interventions) will be furthered if program design can be based on the knowledge of eHealth’s working mechanisms. A promising and pragmatic method for exploring potential working mechanisms is qualitative interview studies, in which eHealth working mechanisms can be explored through the perspective of the program user. Qualitative interview studies are promising as they are suited for exploring what is yet unknown, building new knowledge, and constructing theory. They are also pragmatic, as the development of eHealth programs often entails user interviews for applied purposes (eg, getting feedback for program improvement or identifying barriers for implementation). By capitalizing on these existing (applied) user interviews to also pursue (basic) research questions of how such programs work, the knowledge base of eHealth’s working mechanisms can grow quickly. To be useful, such interview studies need to be of sufficient quality, which entails that the interviews should generate enough data of sufficient quality relevant to the research question (ie, rich data). However, getting rich interview data on eHealth working mechanisms can be surprisingly challenging, as several of the authors have experienced. Moreover, when encountering difficulties as we did, there are few places to turn to, there are currently no guidelines for conducting such interview studies in a way that ensure their quality. In this paper, we build on our experience as well as the qualitative literature to address this need, by describing 5 challenges that may arise in such interviews and presenting methodological tools to counteract each challenge. We hope the ideas we offer will spark methodological reflections and provide some options for researchers interested in using qualitative interview studies to explore eHealth’s working mechanisms.
Collapse
Affiliation(s)
- Marianne Ts Holter
- Norwegian Centre for Addiction Research (SERAF), Institute of Clinical Medicine, University of Oslo, Oslo, Norway
| | - Ayna B Johansen
- Norwegian Centre for Addiction Research (SERAF), Institute of Clinical Medicine, University of Oslo, Oslo, Norway
| | - Ottar Ness
- Department of Education and Lifelong Learning, Norwegian University of Science and Technology (NTNU), Trondheim, Norway
| | - Svend Brinkmann
- Department of Communication and Psychology, Aalborg University, Aalborg, Denmark
| | - Mette T Høybye
- Elective Surgery Centre, Regional Hospital Silkeborg, Silkeborg, Denmark.,Department of Clinical Medicine, Interacting Minds Centre, Aarhus University, Aarhus, Denmark
| | - Håvar Brendryen
- Norwegian Centre for Addiction Research (SERAF), Institute of Clinical Medicine, University of Oslo, Oslo, Norway
| |
Collapse
|
14
|
Baumel A, Kane JM. Examining Predictors of Real-World User Engagement with Self-Guided eHealth Interventions: Analysis of Mobile Apps and Websites Using a Novel Dataset. J Med Internet Res 2018; 20:e11491. [PMID: 30552077 PMCID: PMC6315225 DOI: 10.2196/11491] [Citation(s) in RCA: 66] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2018] [Revised: 09/16/2018] [Accepted: 10/22/2018] [Indexed: 01/29/2023] Open
Abstract
Background The literature suggests that the product design of self-guided electronic health (eHealth) interventions impacts user engagement. Traditional trial settings, however, do not enable the examination of these relationships in real-world use. Objective This study aimed to examine whether the qualities of product design, research evidence, and publicly available data predict real-world user engagement with mobile and Web-based self-guided eHealth interventions. Methods This analysis included self-guided mobile and Web-based eHealth interventions available to the public—with their qualities assessed using the Enlight suite of scales. Scales included Usability, Visual Design, User Engagement, Content, Therapeutic Persuasiveness, Therapeutic Alliance, Credibility, and Research Evidence. Behavioral data on real-world usage were obtained from a panel that provides aggregated nonpersonal information on user engagement with websites and mobile apps, based on a time window of 18 months that was set between November 1, 2016 and April 30, 2018. Real-world user engagement variables included average usage time (for both mobile apps and websites) and mobile app user retention 30 days after download. Results The analysis included 52 mobile apps (downloads median 38,600; interquartile range [IQR] 116,000) and 32 websites (monthly unique visitors median 5689; IQR 30,038). Results point to moderate correlations between Therapeutic Persuasiveness, Therapeutic Alliance, and the 3 user engagement variables (.31≤rs≤.51; Ps≤.03). Visual Design, User Engagement, and Content demonstrated similar degrees of correlation with mobile app engagement variables (.25≤rs≤.49; Ps≤.04) but not with average usage time of Web-based interventions. Positive correlations were also found between the number of reviews on Google Play and average app usage time (r=.58; P<.001) and user retention after 30 days (r=.23; P=.049). Although several product quality ratings were positively correlated with research evidence, the latter was not significantly correlated with real-world user engagement. Hierarchical stepwise regression analysis revealed that either Therapeutic Persuasiveness or Therapeutic Alliance explained 15% to 26% of user engagement variance. Data on Google Play (number of reviews) explained 15% of the variance of mobile app usage time above Enlight ratings; however, publicly available data did not significantly contribute to explaining the variance of the other 2 user-engagement variables. Conclusions Results indicate that the qualities of product design predict real-world user engagement with eHealth interventions. The use of real-world behavioral datasets is a novel way to learn about user behaviors, creating new avenues for eHealth intervention research.
Collapse
Affiliation(s)
- Amit Baumel
- Department of Community Mental Health, University of Haifa, Haifa, Israel
| | - John M Kane
- Zucker Hillside Hospital, Glen Oaks, NY, United States
| |
Collapse
|
15
|
Scheerman JFM, van Empelen P, van Loveren C, van Meijel B. A Mobile App (WhiteTeeth) to Promote Good Oral Health Behavior Among Dutch Adolescents with Fixed Orthodontic Appliances: Intervention Mapping Approach. JMIR Mhealth Uhealth 2018; 6:e163. [PMID: 30120085 PMCID: PMC6119215 DOI: 10.2196/mhealth.9626] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2017] [Revised: 04/26/2018] [Accepted: 05/15/2018] [Indexed: 12/23/2022] Open
Abstract
Background The insertion of fixed orthodontic appliances increases the risk of dental caries, particularly in adolescents. Caries can be prevented through good oral health behavior. To support adolescents with fixed orthodontic appliances and for promoting oral health behavior, we developed a theory- and evidence-based mHealth program, the WhiteTeeth app. Objective The objective of our paper was to describe the systematic development and content of the WhiteTeeth app. Methods For systematic development of the program, we used the intervention mapping (IM) approach. In this paper, we present the results of applying the first 5 steps of IM to the design of an mHealth program: (1) identifying target behaviors and determinants through problem analysis, including a literature search, a survey study, and semistructured interviews, to explore adolescent oral health behavior during orthodontic therapy; (2) defining program outcomes and objectives; (3) selecting theoretical methods and translating them into practical strategies for the program design; (4) producing the program, including a pilot test with 28 adolescents testing the acceptability and usability of the WhiteTeeth app; and (5) planning implementation and adoption. Results On the basis of our literature search, we identified fluoride use and control of dental plaque levels (eg, tooth brushing and proxy brush usage) as target behaviors for preventing caries. Next, we identified important and changeable determinants of oral health behavior that fitted the theoretical concepts of the Health Action Process Approach (HAPA) theory. The HAPA theory, the self-regulation theory, and the results of the semistructured interviews were used to define the program objectives, that is, the performance and change objectives. After defining the objectives, we identified multiple behavior change techniques that could be used to achieve these objectives, such as providing oral health information and feedback, prompting self-monitoring, coaching of set actions and coping plans, and sending reminders. We translated these methods into practical strategies, such as videos and a brushing timer. Next, we combined these strategies into a single program resulting in the WhiteTeeth app (which is available on both iTunes and Google Play stores as “Witgebit”). Adolescents with fixed orthodontic appliances and dental professionals were included in the development process to increase the success of implementation. The pilot test revealed that the app users appreciated and liked the app. The WhiteTeeth app can be integrated into current orthodontic care. Conclusions IM allowed us to identify multiple techniques that have been shown to be the most effective in initiating behavior change, but have not yet been incorporated into existing orthodontic apps. The WhiteTeeth app contains all these techniques, which makes it a unique and promising home-based app for promoting oral health in adolescents with fixed orthodontic appliances.
Collapse
Affiliation(s)
- Janneke Francisca Maria Scheerman
- Department of Preventive Dentistry, Academic Center for Dentistry Amsterdam, University of Amsterdam and Vrije Universiteit Amsterdam, Amsterdam, Netherlands.,Cluster Oral Hygiene, Department of Health, Sports & Welfare, Inholland University, Amsterdam, Netherlands.,Department of Child Health, Netherlands Organization for Applied Scientific Research, Leiden, Netherlands
| | - Pepijn van Empelen
- Department of Child Health, Netherlands Organization for Applied Scientific Research, Leiden, Netherlands
| | - Cor van Loveren
- Department of Preventive Dentistry, Academic Center for Dentistry Amsterdam, University of Amsterdam and Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Berno van Meijel
- Cluster Nursing, Department of Health, Sports & Welfare, Inholland University, Amsterdam, Netherlands.,Department of Psychiatry, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam Medical Center, Amsterdam, Netherlands.,Parnassia Psychiatric Institute, The Hague, Netherlands
| |
Collapse
|
16
|
A Pilot Randomized Controlled Trial of an Internet-Based Alcohol Intervention in a Workplace Setting. Int J Behav Med 2018; 24:768-777. [PMID: 28755326 DOI: 10.1007/s12529-017-9665-0] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
PURPOSE The aim of this study was to compare the effectiveness of a brief and an intensive self-help alcohol intervention and to assess the feasibility of recruiting to such interventions in a workplace setting. METHOD Employees who screened positive for hazardous drinking (n = 85) received online personalized normative feedback and were randomly assigned to one out of two conditions: either they received an e-booklet about the effects of alcohol or they received a self-help intervention comprising 62 web-based, fully automated, and interactive sessions, plus reminder e-mails, and mobile phone text messages (Short Message Service). RESULTS Two months after baseline, the responders in the intensive condition drank an average of five to six drinks less per week compared to the responders in the brief condition (B = 5.68, 95% CI = 0.48-10.87, P = .03). There was no significant difference between conditions, using baseline observation carried forward imputation (B = 2.96, 95% CI = -0.50-6.42, P = .09). Six months after baseline, no significant difference was found, neither based on complete cases nor intent-to-treat (B = 1.07, 95% CI = -1.29-3.44, P = .37). Challenges with recruitment are thoroughly reported. CONCLUSION The study supports the feasibility and the safety of use for both brief and intensive Internet-based self-help in an occupational setting. The study may inform future trials, but due to recruitment problems and low statistical power, the findings are inconclusive in terms of the intensive program being more effective than brief intervention alone. TRIAL REGISTRATION ClinicalTrials.gov Identifier: NCT01931618.
Collapse
|
17
|
Pifarré M, Carrera A, Vilaplana J, Cuadrado J, Solsona S, Abella F, Solsona F, Alves R. TControl: A mobile app to follow up tobacco-quitting patients. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2017; 142:81-89. [PMID: 28325449 DOI: 10.1016/j.cmpb.2017.02.022] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/16/2016] [Revised: 02/10/2017] [Accepted: 02/17/2017] [Indexed: 06/06/2023]
Abstract
BACKGROUND AND OBJECTIVE Tobacco smoking is a major risk factor for a wide range of respiratory and circulatory diseases in active and passive smokers. Well-designed campaigns are raising awareness to the problem and an increasing number of smokers seeks medical assistance to quit their habit. In this context, there is the need to develop mHealth Apps that assist and manage large smoke quitting programs in efficient and economic ways. OBJECTIVES Our main objective is to develop an efficient and free mHealth app that facilitates the management of, and assistance to, people who want to quit smoking. As secondary objectives, our research also aims at estimating the economic effect of deploying that App in the public health system. METHODS Using JAVA and XML we develop and deploy a new free mHealth App for Android, called TControl (Tobacco-quitting Control). We deploy the App at the Tobacco Unit of the Santa Maria Hospital in Lleida and determine its stability by following the crashes of the App. We also use a survey to test usability of the app and differences in aptitude for using the App in a sample of 31 patients. Finally, we use mathematical models to estimate the economic effect of deploying TControl in the Catalan public health system. RESULTS TControl keeps track of the smoke-quitting users, tracking their status, interpreting it, and offering advice and psychological support messages. The App also provides a bidirectional communication channel between patients and clinicians via mobile text messages. Additionally, registered patients have the option to interchange experiences with each other by chat. The App was found to be stable and to have high performances during startup and message sending. Our results suggest that age and gender have no statistically significant effect on patient aptitude for using TControl. Finally, we estimate that TControl could reduce costs for the Catalan public health system (CPHS) by up to € 400M in 10 years. CONCLUSIONS TControl is a stable and well behaved App, typically operating near optimal performance. It can be used independent of age and gender, and its wide implementation could decrease costs for the public health system.
Collapse
Affiliation(s)
- Marc Pifarré
- Department of Computer Science & INSPIRES, University of Lleida, Jaume II 69, E-25001 Lleida, Spain.
| | - Adrián Carrera
- Department of Computer Science & INSPIRES, University of Lleida, Jaume II 69, E-25001 Lleida, Spain.
| | - Jordi Vilaplana
- Department of Computer Science & INSPIRES, University of Lleida, Jaume II 69, E-25001 Lleida, Spain.
| | | | - Sara Solsona
- Hesoft Group, Partida Bovà, 15, E-25196, Lleida, Spain.
| | - Francesc Abella
- Department of Basic Medical Sciences & IRBLleida, University of Lleida, Avda Alcalde Rovira Roure 80, E-25198, Lleida, Spain.
| | - Francesc Solsona
- Department of Computer Science & INSPIRES, University of Lleida, Jaume II 69, E-25001 Lleida, Spain; Hesoft Group, Partida Bovà, 15, E-25196, Lleida, Spain.
| | - Rui Alves
- Department of Basic Medical Sciences & IRBLleida, University of Lleida, Avda Alcalde Rovira Roure 80, E-25198, Lleida, Spain.
| |
Collapse
|
18
|
Baumel A, Faber K, Mathur N, Kane JM, Muench F. Enlight: A Comprehensive Quality and Therapeutic Potential Evaluation Tool for Mobile and Web-Based eHealth Interventions. J Med Internet Res 2017; 19:e82. [PMID: 28325712 PMCID: PMC5380814 DOI: 10.2196/jmir.7270] [Citation(s) in RCA: 109] [Impact Index Per Article: 15.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2017] [Revised: 02/21/2017] [Accepted: 02/22/2017] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND Studies of criteria-based assessment tools have demonstrated the feasibility of objectively evaluating eHealth interventions independent of empirical testing. However, current tools have not included some quality constructs associated with intervention outcome, such as persuasive design, behavior change, or therapeutic alliance. In addition, the generalizability of such tools has not been explicitly examined. OBJECTIVE The aim is to introduce the development and further analysis of the Enlight suite of measures, developed to incorporate the aforementioned concepts and address generalizability aspects. METHODS As a first step, a comprehensive systematic review was performed to identify relevant quality rating criteria in line with the PRISMA statement. These criteria were then categorized to create Enlight. The second step involved testing Enlight on 42 mobile apps and 42 Web-based programs (delivery mediums) targeting modifiable behaviors related to medical illness or mental health (clinical aims). RESULTS A total of 476 criteria from 99 identified sources were used to build Enlight. The rating measures were divided into two sections: quality assessments and checklists. Quality assessments included usability, visual design, user engagement, content, therapeutic persuasiveness, therapeutic alliance, and general subjective evaluation. The checklists included credibility, privacy explanation, basic security, and evidence-based program ranking. The quality constructs exhibited excellent interrater reliability (intraclass correlations=.77-.98, median .91) and internal consistency (Cronbach alphas=.83-.90, median .88), with similar results when separated into delivery mediums or clinical aims. Conditional probability analysis revealed that 100% of the programs that received a score of fair or above (≥3.0) in therapeutic persuasiveness or therapeutic alliance received the same range of scores in user engagement and content-a pattern that did not appear in the opposite direction. Preliminary concurrent validity analysis pointed to positive correlations of combined quality scores with selected variables. The combined score that did not include therapeutic persuasiveness and therapeutic alliance descriptively underperformed the other combined scores. CONCLUSIONS This paper provides empirical evidence supporting the importance of persuasive design and therapeutic alliance within the context of a program's evaluation. Reliability metrics and preliminary concurrent validity analysis indicate the potential of Enlight in examining eHealth programs regardless of delivery mediums and clinical aims.
Collapse
Affiliation(s)
- Amit Baumel
- Psychiatry Research, The Feinstein Institute for Medical Research, Glen Oaks, NY, United States.,Northwell Hofstra School of Medicine, Hempstead, NY, United States
| | - Keren Faber
- Psychiatry Research, The Feinstein Institute for Medical Research, Glen Oaks, NY, United States
| | - Nandita Mathur
- Psychiatry Research, The Feinstein Institute for Medical Research, Glen Oaks, NY, United States
| | - John M Kane
- Psychiatry Research, The Feinstein Institute for Medical Research, Glen Oaks, NY, United States.,Northwell Hofstra School of Medicine, Hempstead, NY, United States
| | - Fred Muench
- Psychiatry Research, The Feinstein Institute for Medical Research, Glen Oaks, NY, United States.,Northwell Hofstra School of Medicine, Hempstead, NY, United States
| |
Collapse
|