1
|
Rodriguez DV, Chen J, Viswanadham RVN, Lawrence K, Mann D. Leveraging Machine Learning to Develop Digital Engagement Phenotypes of Users in a Digital Diabetes Prevention Program: Evaluation Study. JMIR AI 2024; 3:e47122. [PMID: 38875579 PMCID: PMC11041485 DOI: 10.2196/47122] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/08/2023] [Revised: 07/25/2023] [Accepted: 01/03/2024] [Indexed: 06/16/2024]
Abstract
BACKGROUND Digital diabetes prevention programs (dDPPs) are effective "digital prescriptions" but have high attrition rates and program noncompletion. To address this, we developed a personalized automatic messaging system (PAMS) that leverages SMS text messaging and data integration into clinical workflows to increase dDPP engagement via enhanced patient-provider communication. Preliminary data showed positive results. However, further investigation is needed to determine how to optimize the tailoring of support technology such as PAMS based on a user's preferences to boost their dDPP engagement. OBJECTIVE This study evaluates leveraging machine learning (ML) to develop digital engagement phenotypes of dDPP users and assess ML's accuracy in predicting engagement with dDPP activities. This research will be used in a PAMS optimization process to improve PAMS personalization by incorporating engagement prediction and digital phenotyping. This study aims (1) to prove the feasibility of using dDPP user-collected data to build an ML model that predicts engagement and contributes to identifying digital engagement phenotypes, (2) to describe methods for developing ML models with dDPP data sets and present preliminary results, and (3) to present preliminary data on user profiling based on ML model outputs. METHODS Using the gradient-boosted forest model, we predicted engagement in 4 dDPP individual activities (physical activity, lessons, social activity, and weigh-ins) and general activity (engagement in any activity) based on previous short- and long-term activity in the app. The area under the receiver operating characteristic curve, the area under the precision-recall curve, and the Brier score metrics determined the performance of the model. Shapley values reflected the feature importance of the models and determined what variables informed user profiling through latent profile analysis. RESULTS We developed 2 models using weekly and daily DPP data sets (328,821 and 704,242 records, respectively), which yielded predictive accuracies above 90%. Although both models were highly accurate, the daily model better fitted our research plan because it predicted daily changes in individual activities, which was crucial for creating the "digital phenotypes." To better understand the variables contributing to the model predictor, we calculated the Shapley values for both models to identify the features with the highest contribution to model fit; engagement with any activity in the dDPP in the last 7 days had the most predictive power. We profiled users with latent profile analysis after 2 weeks of engagement (Bayesian information criterion=-3222.46) with the dDPP and identified 6 profiles of users, including those with high engagement, minimal engagement, and attrition. CONCLUSIONS Preliminary results demonstrate that applying ML methods with predicting power is an acceptable mechanism to tailor and optimize messaging interventions to support patient engagement and adherence to digital prescriptions. The results enable future optimization of our existing messaging platform and expansion of this methodology to other clinical domains. TRIAL REGISTRATION ClinicalTrials.gov NCT04773834; https://www.clinicaltrials.gov/ct2/show/NCT04773834. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) RR2-10.2196/26750.
Collapse
Affiliation(s)
| | - Ji Chen
- New York University Grosman School of Medicine, New York, NY, United States
| | | | - Katharine Lawrence
- New York University Grosman School of Medicine, New York, NY, United States
- New York University Langone Health, New York, NY, United States
| | - Devin Mann
- New York University Grosman School of Medicine, New York, NY, United States
- New York University Langone Health, New York, NY, United States
| |
Collapse
|
2
|
Guest PC, Vasilevska V, Al-Hamadi A, Eder J, Falkai P, Steiner J. Digital technology and mental health during the COVID-19 pandemic: a narrative review with a focus on depression, anxiety, stress, and trauma. Front Psychiatry 2023; 14:1227426. [PMID: 38188049 PMCID: PMC10766703 DOI: 10.3389/fpsyt.2023.1227426] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Accepted: 12/11/2023] [Indexed: 01/09/2024] Open
Abstract
The sudden appearance and devastating effects of the COVID-19 pandemic resulted in the need for multiple adaptive changes in societies, business operations and healthcare systems across the world. This review describes the development and increased use of digital technologies such as chat bots, electronic diaries, online questionnaires and even video gameplay to maintain effective treatment standards for individuals with mental health conditions such as depression, anxiety and post-traumatic stress syndrome. We describe how these approaches have been applied to help meet the challenges of the pandemic in delivering mental healthcare solutions. The main focus of this narrative review is on describing how these digital platforms have been used in diagnostics, patient monitoring and as a treatment option for the general public, as well as for frontline medical staff suffering with mental health issues.
Collapse
Affiliation(s)
- Paul C. Guest
- Department of Psychiatry, Otto-von-Guericke-University Magdeburg, Magdeburg, Germany
- Laboratory of Translational Psychiatry, Otto-von-Guericke-University Magdeburg, Magdeburg, Germany
- Laboratory of Neuroproteomics, Department of Biochemistry and Tissue Biology, Institute of Biology University of Campinas (UNICAMP), Campinas, Brazil
| | - Veronika Vasilevska
- Department of Psychiatry, Otto-von-Guericke-University Magdeburg, Magdeburg, Germany
- Laboratory of Translational Psychiatry, Otto-von-Guericke-University Magdeburg, Magdeburg, Germany
| | - Ayoub Al-Hamadi
- Department of Neuro-Information Technology, Institute for Information Technology and Communications Otto-von-Guericke University Magdeburg, Magdeburg, Germany
| | - Julia Eder
- Department of Psychiatry and Psychotherapy, University Hospital Ludwig-Maximilians-University Munich, Munich, Germany
| | - Peter Falkai
- Department of Psychiatry and Psychotherapy, University Hospital Ludwig-Maximilians-University Munich, Munich, Germany
| | - Johann Steiner
- Department of Psychiatry, Otto-von-Guericke-University Magdeburg, Magdeburg, Germany
- Laboratory of Translational Psychiatry, Otto-von-Guericke-University Magdeburg, Magdeburg, Germany
- Center for Health and Medical Prevention (CHaMP), Magdeburg, Germany
- German Center for Mental Health (DZPG), Center for Intervention and Research on Adaptive and Maladaptive Brain Circuits Underlying Mental Health (C-I-R-C), Halle-Jena-Magdeburg, Magdeburg, Germany
- Center for Behavioral Brain Sciences (CBBS), Magdeburg, Germany
| |
Collapse
|
3
|
Hammad NM, Kay MC. Perspectives on healthy eating practices and acceptance of WIC-approved foods among parents of young children enrolled in WIC. PLoS One 2023; 18:e0295902. [PMID: 38127887 PMCID: PMC10734995 DOI: 10.1371/journal.pone.0295902] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2022] [Accepted: 12/01/2023] [Indexed: 12/23/2023] Open
Abstract
INTRODUCTION The prevalence of childhood obesity remains high in the United States, particularly among children living in low-income households. Diet quality plays an important role in obesity prevention, particularly among mothers as they serve as role models. Those served by the Special Supplemental Nutrition Program for Women, Infants, and Children (WIC) receive nutrient-rich foods aimed at increasing diet quality, yet redemption is low. Digital interventions targeting WIC parents show potential for behavior change and could be used for childhood obesity prevention. METHODS This study describes the formative research conducted to understand perspectives on healthy eating practices, acceptance of WIC-approved foods, and preferences for the use of digital tools to improve the purchasing and consumption of WIC-approved foods to improve diet quality. In-depth interviews were conducted with 13 WIC parents and caregivers. RESULTS A variety of definitions for and misconceptions about healthy eating exist among WIC caregivers. Most purchased foods were fruits, vegetables, milk, cheese, and eggs and the least purchased foods were yogurt and peanut butter. The biggest facilitator for purchasing WIC-approved foods was the preference of children and caregivers, whereas the biggest barrier was children's picky eating behaviors. Most caregivers reported using their phone to get nutrition information. Most caregivers reported their interest in receiving weekly text messages and indicated preferences about receiving recipes. CONCLUSION A text messaging program that includes sending weekly messages, recipes, and nutrition tips is hypothesized to improve diet quality and increase redemption of WIC-approved foods.
Collapse
Affiliation(s)
- Nour M. Hammad
- Department of Nutrition, Harvard University, Boston, Massachusetts, United States of America
| | - Melissa C. Kay
- Department of Pediatrics, Duke University, Durham, North Carolina, United States of America
| |
Collapse
|
4
|
Facchinetti G, Petrucci G, Albanesi B, De Marinis MG, Piredda M. Can Smart Home Technologies Help Older Adults Manage Their Chronic Condition? A Systematic Literature Review. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2023; 20:1205. [PMID: 36673957 PMCID: PMC9859495 DOI: 10.3390/ijerph20021205] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/30/2022] [Revised: 12/23/2022] [Accepted: 01/01/2023] [Indexed: 05/26/2023]
Abstract
The management of chronic diseases requires personalized healthcare that allows older adults to manage their diseases at home. This systematic review aimed to describe the smart home technologies used in the management of chronic diseases in older people. A systematic literature review was conducted on four databases and was reported following the PRISMA statement. Nineteen articles were included. The intervention technologies were classified into three groups: smart home, characterized by environmental sensors detecting motion, contact, light, temperature, and humidity; external memory aids, characterized by a partnership between mobile apps and smart home-based activity learning; and hybrid technology, with the integration of multiple technologies, such as devices installed at patients' homes and telemedicine. The health outcomes evaluated are vital signs, medication management, ADL-IADL, mobility, falls, and quality of life. Smart homes show great potential in the management of chronic diseases by favouring the control of exacerbations and increasing patients' safety by providing support in disease management, including support for cognitively impaired older people. The use of smart homes in the community could bring numerous benefits in terms of continuity of care, allowing the constant monitoring of older people by local and hospital health services.
Collapse
Affiliation(s)
- Gabriella Facchinetti
- Research Unit of Nursing Science, Department of Medicine and Surgery, Campus Bio-Medico di Roma University, Via Alvaro del Portillo, 00128 Rome, Italy
| | - Giorgia Petrucci
- Department of Orthopaedic and Trauma Surgery, Campus Bio-Medico di Roma University, Via Alvaro del Portillo, 00128 Rome, Italy
| | - Beatrice Albanesi
- Department of Public Health and Pediatrics, University of Turin, Via Santena 5 bis, 10126 Turin, Italy
| | - Maria Grazia De Marinis
- Research Unit of Nursing Science, Department of Medicine and Surgery, Campus Bio-Medico di Roma University, Via Alvaro del Portillo, 00128 Rome, Italy
- Campus Bio-Medico University Hospital Foundation, Via Alvaro del Portillo, 00128 Rome, Italy
| | - Michela Piredda
- Research Unit of Nursing Science, Department of Medicine and Surgery, Campus Bio-Medico di Roma University, Via Alvaro del Portillo, 00128 Rome, Italy
| |
Collapse
|
5
|
The Impact of a Web-Based Lifestyle Educational Program ('Living Better') Reintervention on Hypertensive Overweight or Obese Patients. Nutrients 2022; 14:nu14112235. [PMID: 35684034 PMCID: PMC9182666 DOI: 10.3390/nu14112235] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2022] [Revised: 05/23/2022] [Accepted: 05/25/2022] [Indexed: 11/17/2022] Open
Abstract
‘Living Better’, a self-administered web-based intervention, designed to facilitate lifestyle changes, has already shown positive short- and medium-term health benefits in patients with an obesity−hypertension phenotype. The objectives of this study were: (1) to examine the long-term (3-year) evolution of a group of hypertensive overweight or obese patients who had already followed the ‘Living Better’ program; (2) to analyze the effects of completing this program a second time (reintervention) during the COVID-19 pandemic. A quasi-experimental design was used. We recruited 29 individuals from the 105 who had participated in our first study. We assessed and compared their systolic and diastolic blood pressure (SBP and DBP), body mass index (BMI), eating behavior, and physical activity (PA) level (reported as METs-min/week), at Time 0 (first intervention follow-up), Time 1 (before the reintervention), and Time 2 (post-reintervention). Our results showed significant improvements between Time 1 and Time 2 in SBP (−4.7 (−8.7 to −0.7); p = 0.017), DBP (−3.5 (−6.2 to −0.8); p = 0.009), BMI (−0.7 (−1.0 to −0.4); p < 0.001), emotional eating (−2.8 (−5.1 to −0.5); p = 0.012), external eating (−1.1 (−2.1 to −0.1); p = 0.039), and PA (Time 1: 2308 ± 2266; Time 2: 3203 ± 3314; p = 0.030, Z = −2.17). Statistical analysis showed no significant differences in SPB, DBP, BMI, and eating behavior between Time 0 and Time 1 (p > 0.24). Implementation of the ‘Living Better’ program maintained positive long-term (3-year) health benefits in patients with an obesity−hypertension phenotype. Moreover, a reintervention with this program during the COVID-19 pandemic produced significant improvements in blood pressure, BMI, eating behavior, and PA.
Collapse
|
6
|
Fearnley J, Joseph L, Vasanthan L, Sitilertpisan P, Paungmali A, Pirunsan U. Methods of engagement and levels of involvement of stakeholders in the management of work-related musculoskeletal disorders: A systematic scoping review. J Public Health (Oxf) 2022. [DOI: 10.1007/s10389-021-01663-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022] Open
|
7
|
Rodriguez DV, Lawrence K, Luu S, Yu JL, Feldthouse DM, Gonzalez J, Mann D. Development of a computer-aided text message platform for user engagement with a digital Diabetes Prevention Program: a case study. J Am Med Inform Assoc 2021; 29:155-162. [PMID: 34664647 PMCID: PMC8714274 DOI: 10.1093/jamia/ocab206] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2021] [Revised: 09/03/2021] [Accepted: 09/09/2021] [Indexed: 11/12/2022] Open
Abstract
Digital Diabetes Prevention Programs (dDPP) are novel mHealth applications that leverage digital features such as tracking and messaging to support behavior change for diabetes prevention. Despite their clinical effectiveness, long-term engagement to these programs remains a challenge, creating barriers to adherence and meaningful health outcomes. We partnered with a dDPP vendor to develop a personalized automatic message system (PAMS) to promote user engagement to the dDPP platform by sending messages on behalf of their primary care provider. PAMS innovates by integrating into clinical workflows. User-centered design (UCD) methodologies in the form of iterative cycles of focus groups, user interviews, design workshops, and other core UCD activities were utilized to defined PAMS requirements. PAMS uses computational tools to deliver theory-based, automated, tailored messages, and content to support patient use of dDPP. In this article, we discuss the design and development of our system, including key requirements and features, the technical architecture and build, and preliminary user testing.
Collapse
Affiliation(s)
- Danissa V Rodriguez
- Department of Population Health, NYU Grossman School of Medicine, New York, New York, USA
| | - Katharine Lawrence
- Department of Population Health, NYU Grossman School of Medicine, New York, New York, USA
| | - Son Luu
- Department of Population Health, NYU Grossman School of Medicine, New York, New York, USA
| | - Jonathan L Yu
- Department of Population Health, NYU Grossman School of Medicine, New York, New York, USA
| | - Dawn M Feldthouse
- Medical Center Information Technology, NYU Langone Health, New York, New York, USA
| | - Javier Gonzalez
- Medical Center Information Technology, NYU Langone Health, New York, New York, USA
| | - Devin Mann
- Department of Population Health, NYU Grossman School of Medicine, New York, New York, USA
- Medical Center Information Technology, NYU Langone Health, New York, New York, USA
| |
Collapse
|
8
|
Lawrence K, Rodriguez DV, Feldthouse DM, Shelley D, Yu JL, Belli HM, Gonzalez J, Tasneem S, Fontaine J, Groom LL, Luu S, Wu Y, McTigue KM, Rockette-Wagner B, Mann DM. Effectiveness of an Integrated Engagement Support System to Facilitate Patient Use of Digital Diabetes Prevention Programs: Protocol for a Randomized Controlled Trial. JMIR Res Protoc 2021; 10:e26750. [PMID: 33560240 PMCID: PMC7902197 DOI: 10.2196/26750] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2020] [Accepted: 01/05/2021] [Indexed: 01/16/2023] Open
Abstract
Background Digital diabetes prevention programs (dDPPs) are effective behavior change tools to prevent disease progression in patients at risk for diabetes. At present, these programs are poorly integrated into existing health information technology infrastructure and clinical workflows, resulting in barriers to provider-level knowledge of, interaction with, and support of patients who use dDPPs. Tools that can facilitate patient-provider interaction around dDPPs may contribute to improved patient engagement and adherence to these programs and improved health outcomes. Objective This study aims to use a rigorous, user-centered design (UCD) methodology to develop a theory-driven system that supports patient engagement with dDPPs and their primary care providers with their care. Methods This study will be conducted in 3 phases. In phase 1, we will use systematic UCD, Agile software development, and qualitative research methods to identify key user (patients, providers, clinical staff, digital health technologists, and content experts) requirements, constraints, and prioritization of high-impact features to design, develop, and refine a viable intervention prototype for the engagement system. In phase 2, we will conduct a single-arm feasibility pilot of the engagement system among patients with prediabetes and their primary care providers. In phase 3, we will conduct a 2-arm randomized controlled trial using the engagement system. Primary outcomes will be weight, BMI, and A1c at 6 and 12 months. Secondary outcomes will be patient engagement (use and activity) in the dDPP. The mediator variables (self-efficacy, digital health literacy, and patient-provider relationship) will be measured. Results The project was initiated in 2018 and funded in September 2019. Enrollment and data collection for phase 1 began in September 2019 under an Institutional Review Board quality improvement waiver granted in July 2019. As of December 2020, 27 patients have been enrolled and first results are expected to be submitted for publication in early 2021. The study received Institutional Review Board approval for phases 2 and 3 in December 2020, and phase 2 enrollment is expected to begin in early 2021. Conclusions Our findings will provide guidance for the design and development of technology to integrate dDPP platforms into existing clinical workflows. This will facilitate patient engagement in digital behavior change interventions and provider engagement in patients’ use of dDPPs. Integrated clinical tools that can facilitate patient-provider interaction around dDPPs may contribute to improved patient adherence to these programs and improved health outcomes by addressing barriers faced by both patients and providers. Further evaluation with pilot testing and a clinical trial will assess the effectiveness and implementation of these tools. Trial Registration ClinicalTrials.gov NCT04049500; https://clinicaltrials.gov/ct2/show/NCT04049500 International Registered Report Identifier (IRRID) DERR1-10.2196/26750
Collapse
Affiliation(s)
- Katharine Lawrence
- Healthcare Innovation Bridging Research, Informatics, and Design Lab, Department of Population Health, NYU Langone Health, New York, NY, United States
| | - Danissa V Rodriguez
- Healthcare Innovation Bridging Research, Informatics, and Design Lab, Department of Population Health, NYU Langone Health, New York, NY, United States
| | - Dawn M Feldthouse
- Clinical Systems & Clinical Transformation, Medical Center Information Technology Clinical Informatics Department, NYU Langone Health, New York, NY, United States
| | - Donna Shelley
- Department of Population Health, NYU Langone Health, New York, NY, United States
| | - Jonathan L Yu
- Healthcare Innovation Bridging Research, Informatics, and Design Lab, Department of Population Health, NYU Langone Health, New York, NY, United States
| | - Hayley M Belli
- Division of Biostatistics, Department of Population Health, NYU Langone Health, New York, NY, United States
| | - Javier Gonzalez
- Healthcare Innovation Bridging Research, Informatics, and Design Lab, Department of Population Health, NYU Langone Health, New York, NY, United States
| | - Sumaiya Tasneem
- Healthcare Innovation Bridging Research, Informatics, and Design Lab, Department of Population Health, NYU Langone Health, New York, NY, United States
| | - Jerlisa Fontaine
- Healthcare Innovation Bridging Research, Informatics, and Design Lab, Department of Population Health, NYU Langone Health, New York, NY, United States
| | - Lisa L Groom
- NYU Rory Meyers College of Nursing, New York, NY, United States
| | - Son Luu
- Healthcare Innovation Bridging Research, Informatics, and Design Lab, Department of Population Health, NYU Langone Health, New York, NY, United States
| | - Yinxiang Wu
- Division of Biostatistics, Department of Population Health, NYU Langone Health, New York, NY, United States
| | - Kathleen M McTigue
- Division of General Internal Medicine, Department of Medicine, University of Pittsburgh, Pittsburgh, PA, United States
| | - Bonny Rockette-Wagner
- Department of Epidemiology, Graduate School of Public Health, University of Pittsburgh, Pittsburgh, PA, United States
| | - Devin M Mann
- Healthcare Innovation Bridging Research, Informatics, and Design Lab, Department of Population Health, NYU Langone Health, New York, NY, United States
| |
Collapse
|
9
|
Bremer V, Chow PI, Funk B, Thorndike FP, Ritterband LM. Developing a Process for the Analysis of User Journeys and the Prediction of Dropout in Digital Health Interventions: Machine Learning Approach. J Med Internet Res 2020; 22:e17738. [PMID: 33112241 PMCID: PMC7657718 DOI: 10.2196/17738] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2020] [Revised: 09/03/2020] [Accepted: 09/20/2020] [Indexed: 12/29/2022] Open
Abstract
Background User dropout is a widespread concern in the delivery and evaluation of digital (ie, web and mobile apps) health interventions. Researchers have yet to fully realize the potential of the large amount of data generated by these technology-based programs. Of particular interest is the ability to predict who will drop out of an intervention. This may be possible through the analysis of user journey data—self-reported as well as system-generated data—produced by the path (or journey) an individual takes to navigate through a digital health intervention. Objective The purpose of this study is to provide a step-by-step process for the analysis of user journey data and eventually to predict dropout in the context of digital health interventions. The process is applied to data from an internet-based intervention for insomnia as a way to illustrate its use. The completion of the program is contingent upon completing 7 sequential cores, which include an initial tutorial core. Dropout is defined as not completing the seventh core. Methods Steps of user journey analysis, including data transformation, feature engineering, and statistical model analysis and evaluation, are presented. Dropouts were predicted based on data from 151 participants from a fully automated web-based program (Sleep Healthy Using the Internet) that delivers cognitive behavioral therapy for insomnia. Logistic regression with L1 and L2 regularization, support vector machines, and boosted decision trees were used and evaluated based on their predictive performance. Relevant features from the data are reported that predict user dropout. Results Accuracy of predicting dropout (area under the curve [AUC] values) varied depending on the program core and the machine learning technique. After model evaluation, boosted decision trees achieved AUC values ranging between 0.6 and 0.9. Additional handcrafted features, including time to complete certain steps of the intervention, time to get out of bed, and days since the last interaction with the system, contributed to the prediction performance. Conclusions The results support the feasibility and potential of analyzing user journey data to predict dropout. Theory-driven handcrafted features increased the prediction performance. The ability to predict dropout at an individual level could be used to enhance decision making for researchers and clinicians as well as inform dynamic intervention regimens.
Collapse
Affiliation(s)
- Vincent Bremer
- Institute of Information Systems, Leuphana University Lüneburg, Lüneburg, Germany
| | - Philip I Chow
- Center for Behavioral Health & Technology, University of Virginia School of Medicine, Charlottesville, VA, United States
| | - Burkhardt Funk
- Institute of Information Systems, Leuphana University Lüneburg, Lüneburg, Germany
| | - Frances P Thorndike
- Center for Behavioral Health & Technology, University of Virginia School of Medicine, Charlottesville, VA, United States
| | - Lee M Ritterband
- Center for Behavioral Health & Technology, University of Virginia School of Medicine, Charlottesville, VA, United States
| |
Collapse
|
10
|
Crafoord MT, Fjell M, Sundberg K, Nilsson M, Langius-Eklöf A. Engagement in an Interactive App for Symptom Self-Management during Treatment in Patients With Breast or Prostate Cancer: Mixed Methods Study. J Med Internet Res 2020; 22:e17058. [PMID: 32663140 PMCID: PMC7445604 DOI: 10.2196/17058] [Citation(s) in RCA: 39] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2019] [Revised: 05/05/2020] [Accepted: 05/20/2020] [Indexed: 12/17/2022] Open
Abstract
Background Using mobile technology for symptom management and self-care can improve patient-clinician communication and clinical outcomes in patients with cancer. The interactive app Interaktor has been shown to reduce symptom burden during cancer treatment. It includes symptom assessment, an alert system for contact with health care professionals, access to self-care advice, and visualization of symptom history. It is essential to understand how digital interventions operate; one approach is to examine engagement by assessing usage and exploring user experiences. Actual usage in relation to the intended use—adherence—is an essential factor of engagement. Objective This study aimed to describe engagement with the Interaktor app among patients with breast or prostate cancer during treatment. Methods Patients from the intervention groups of two separate randomized controlled trials were included: patients with breast cancer receiving neoadjuvant chemotherapy (n=74) and patients with locally advanced prostate cancer receiving treatment with radiotherapy (n=75). The patients reported their symptoms daily. Sociodemographic and clinical data were obtained from baseline questionnaires and medical records. Logged data usage was retrieved from the server and analyzed descriptively and with multiple regression analysis. Telephone interviews were conducted with patients about their perceptions of using the app and analyzed using content analysis. Results The median adherence percentage to daily symptom reporting was 83%. Most patients used the self-care advice and free text message component. Among the patients treated for breast cancer, higher age predicted a lower total number of free text messages sent (P=.04). Among the patients treated for prostate cancer, higher age (P=.01) and higher education level (P=.04), predicted an increase in total views on self-care advice, while higher comorbidity (P=.004) predicted a decrease in total views on self-care advice. Being married or living with a partner predicted a higher adherence to daily symptom reporting (P=.02). Daily symptom reporting created feelings of having continuous contact with health care professionals, being acknowledged, and safe. Being contacted by a nurse after a symptom alert was considered convenient and highly valued. Treatment and time-related aspects influenced engagement. Daily symptom reporting was perceived as particularly meaningful at the beginning of treatment. Requests were made for advice on diet and psychological symptoms, as well as for more comprehensive and detailed information as the patient progressed through treatment. Conclusions Patient engagement in the interactive app Interaktor was high. The app promoted patient participation in their care through continuous and convenient contact with health care professionals. The predictive ability of demographic variables differed between patient groups, but higher age and a higher educational level predicted usage of specific app functions for both patient groups. Patients’ experience of relevance and interactivity influenced their engagement positively.
Collapse
Affiliation(s)
- Marie-Therése Crafoord
- Division of Nursing, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden
| | - Maria Fjell
- Division of Nursing, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden
| | - Kay Sundberg
- Division of Nursing, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden
| | - Marie Nilsson
- Division of Nursing, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden
| | - Ann Langius-Eklöf
- Division of Nursing, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden
| |
Collapse
|
11
|
Patel S, Akhtar A, Malins S, Wright N, Rowley E, Young E, Sampson S, Morriss R. The Acceptability and Usability of Digital Health Interventions for Adults With Depression, Anxiety, and Somatoform Disorders: Qualitative Systematic Review and Meta-Synthesis. J Med Internet Res 2020; 22:e16228. [PMID: 32628116 PMCID: PMC7381032 DOI: 10.2196/16228] [Citation(s) in RCA: 71] [Impact Index Per Article: 17.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2019] [Revised: 02/20/2020] [Accepted: 03/23/2020] [Indexed: 12/20/2022] Open
Abstract
Background The prevalence of mental health disorders continues to rise, with almost 4% of the world population having an anxiety disorder and almost 3.5% having depression in 2017. Despite the high prevalence, only one-third of people with depression or anxiety receive treatment. Over the last decade, the use of digital health interventions (DHIs) has risen rapidly as a means of accessing mental health care and continues to increase. Although there is evidence supporting the effectiveness of DHIs for the treatment of mental health conditions, little is known about what aspects are valued by users and how they might be improved. Objective This systematic review aimed to identify, appraise, and synthesize the qualitative literature available on service users’ views and experiences regarding the acceptability and usability of DHIs for depression, anxiety, and somatoform disorders. Methods A systematic search strategy was developed, and searches were run in 7 electronic databases. Qualitative and mixed methods studies published in English were included. A meta-synthesis was used to interpret and synthesize the findings from the included studies. Results A total of 24 studies were included in the meta-synthesis, and 3 key themes emerged with descriptive subthemes. The 3 key themes were initial motivations and approaches to DHIs, personalization of treatment, and the value of receiving personal support in DHIs. The meta-synthesis suggests that participants’ initial beliefs about DHIs can have an important effect on their engagement with these types of interventions. Personal support was valued very highly as a major component of the success of DHIs. The main reason for this was the way it enabled individual personalization of care. Conclusions Findings from the systematic review have implications for the design of future DHIs to improve uptake, retention, and outcomes in DHIs for depression, anxiety, and somatoform disorders. DHIs need to be personalized to the specific needs of the individual. Future research should explore whether the findings could be generalized to other health conditions.
Collapse
Affiliation(s)
- Shireen Patel
- Division of Psychiatry and Applied Psychology, School of Medicine, University of Nottingham, Nottingham, United Kingdom
| | - Athfah Akhtar
- School of Social Sciences, Birmingham City University, Birmingham, United Kingdom
| | - Sam Malins
- Division of Psychiatry and Applied Psychology, School of Medicine, University of Nottingham, Nottingham, United Kingdom
| | - Nicola Wright
- Faculty of Medicine, School of Health Sciences, University of Nottingham, Nottingham, United Kingdom
| | - Emma Rowley
- School of Medicine, University of Nottingham, Nottingham, United Kingdom
| | - Emma Young
- Nottinghamshire Healthcare NHS Foundation Trust, Nottingham, United Kingdom
| | - Stephanie Sampson
- NIHR MindTech MedTech Co-operative, University of Nottingham, Nottingham, United Kingdom
| | - Richard Morriss
- Division of Psychiatry and Applied Psychology, School of Medicine, University of Nottingham, Nottingham, United Kingdom.,Nottinghamshire Healthcare NHS Foundation Trust, Nottingham, United Kingdom.,NIHR MindTech MedTech Co-operative, University of Nottingham, Nottingham, United Kingdom
| |
Collapse
|
12
|
Graham AL, Papandonatos GD, Jacobs MA, Amato MS, Cha S, Cohn AM, Abroms LC, Whittaker R. Optimizing Text Messages to Promote Engagement With Internet Smoking Cessation Treatment: Results From a Factorial Screening Experiment. J Med Internet Res 2020; 22:e17734. [PMID: 32238338 PMCID: PMC7386536 DOI: 10.2196/17734] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2020] [Revised: 02/09/2020] [Accepted: 02/22/2020] [Indexed: 01/27/2023] Open
Abstract
BACKGROUND Smoking remains a leading cause of preventable death and illness. Internet interventions for smoking cessation have the potential to significantly impact public health, given their broad reach and proven effectiveness. Given the dose-response association between engagement and behavior change, identifying strategies to promote engagement is a priority across digital health interventions. Text messaging is a proven smoking cessation treatment modality and a powerful strategy to increase intervention engagement in other areas of health, but it has not been tested as an engagement strategy for a digital cessation intervention. OBJECTIVE This study examined the impact of 4 experimental text message design factors on adult smokers' engagement with an internet smoking cessation program. METHODS We conducted a 2×2×2×2 full factorial screening experiment wherein 864 participants were randomized to 1 of 16 experimental conditions after registering with a free internet smoking cessation program and enrolling in its automated text message program. Experimental factors were personalization (on/off), integration between the web and text message platforms (on/off), dynamic tailoring of intervention content based on user engagement (on/off), and message intensity (tapered vs abrupt drop-off). Primary outcomes were 3-month measures of engagement (ie, page views, time on site, and return visits to the website) as well as use of 6 interactive features of the internet program. All metrics were automatically tracked; there were no missing data. RESULTS Main effects were detected for integration and dynamic tailoring. Integration significantly increased interactive feature use by participants, whereas dynamic tailoring increased the number of features used and page views. No main effects were found for message intensity or personalization alone, although several synergistic interactions with other experimental features were observed. Synergistic effects, when all experimental factors were active, resulted in the highest rates of interactive feature use and the greatest proportion of participants at high levels of engagement. Measured in terms of standardized mean differences (SMDs), effects on interactive feature use were highest for Build Support System (SMD 0.56; 95% CI 0.27 to 0.81), Choose Quit Smoking Aid (SMD 0.38; 95% CI 0.10 to 0.66), and Track Smoking Triggers (SMD 0.33; 95% CI 0.05 to 0.61). Among the engagement metrics, the largest effects were on overall feature utilization (SMD 0.33; 95% CI 0.06 to 0.59) and time on site (SMD 0.29; 95% CI 0.01 to 0.57). As no SMD >0.30 was observed for main effects on any outcome, results suggest that for some outcomes, the combined intervention was stronger than individual factors alone. CONCLUSIONS This factorial experiment demonstrates the effectiveness of text messaging as a strategy to increase engagement with an internet smoking cessation intervention, resulting in greater overall intervention dose and greater exposure to the core components of tobacco dependence treatment that can promote abstinence. TRIAL REGISTRATION ClinicalTrials.gov NCT02585206; https://clinicaltrials.gov/ct2/show/NCT02585206. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) RR2-10.1136/bmjopen-2015-010687.
Collapse
Affiliation(s)
- Amanda L Graham
- Innovations Center, Truth Initiative, Washington, DC, United States.,Mayo Clinic College of Medicine and Science, Rochester, MN, United States
| | | | - Megan A Jacobs
- Innovations Center, Truth Initiative, Washington, DC, United States
| | - Michael S Amato
- Innovations Center, Truth Initiative, Washington, DC, United States.,Mayo Clinic College of Medicine and Science, Rochester, MN, United States
| | - Sarah Cha
- Innovations Center, Truth Initiative, Washington, DC, United States
| | - Amy M Cohn
- Oklahoma Tobacco Research Center, University of Oklahoma Health Sciences Center, Oklahoma City, OK, United States
| | - Lorien C Abroms
- Department of Prevention and Community Health, Milken Institute School of Public Health, The George Washington University, Washington, DC, United States
| | - Robyn Whittaker
- National Institute for Health Innovation, University of Auckland, Auckland, New Zealand
| |
Collapse
|
13
|
Honary M, Fisher NR, McNaney R, Lobban F. A Web-Based Intervention for Relatives of People Experiencing Psychosis or Bipolar Disorder: Design Study Using a User-Centered Approach. JMIR Ment Health 2018; 5:e11473. [PMID: 30530457 PMCID: PMC6303674 DOI: 10.2196/11473] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/03/2018] [Revised: 09/27/2018] [Accepted: 09/27/2018] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Relatives of people experiencing bipolar mood episodes or psychosis face a multitude of challenges (eg, social isolation, limited coping strategies, and issues with maintaining relationships). Despite this, there is limited informational and emotional support for people who find themselves in supporting or caring roles. Digital technologies provide us with an opportunity to offer accessible tools, which can be used flexibly to provide evidence-based information and support, allowing relatives to build their understanding of mental health problems and learn from others who have similar experiences. However, to design tools that are useful to relatives, we first need to understand their needs. OBJECTIVE The aim of this study was to use a user-centered design approach to develop an accessible Web-based intervention, based on the Relatives Education And Coping Toolkit (REACT) booklet, to support the informational and emotional needs of relatives of people experiencing psychosis or bipolar disorder. METHODS We engaged relatives of people with experiences of bipolar disorder or psychosis in workshops to identify their needs and design requirements for developing a Web-based version of a paper-based toolkit. We used a 2-phase qualitative approach to explore relatives' views on content, design, and functionalities, which are considered to be engaging and useful in a Web-based intervention. In phase 1, we consulted 24 relatives in 2 workshops to better understand their existing support infrastructure, their barriers for accessing support, unmet needs, and relatives' views on online support. On the basis of the results of these workshops, we developed a set of design considerations to be explored in a smaller workshop. Workshop 3 then involved working with 2 digitally literate relatives to design a usable and acceptable interface for our Web-based toolkit. Finally, in phase 2, we conducted a heuristic evaluation to assess the usability of the toolkit. RESULTS Our findings indicated that relatives require technologies that (1) they can place their trust in, particularly when discussing a highly sensitive topic, (2) enable learning from the lived experiences of others while retaining confidentiality, and (3) they can work through at their own pace in a personalized manner. CONCLUSIONS Our study highlights the need for providing a trustworthy, supportive tool where relatives can engage with people who have similar experiences to their own. Our heuristic evaluation showed promise in terms of perceived usability of the REACT Web-based intervention. Through this work, we emphasize the need to involve stakeholders with various characteristics, including users with limited computer literacy or experience in online support.
Collapse
Affiliation(s)
- Mahsa Honary
- School of Computing and Communications, Lancaster University, Lancaster, United Kingdom
| | - Naomi Ruth Fisher
- Spectrum Center for Mental Health Research, Division of Health Research, Lancaster University, Lancaster, United Kingdom
| | - Roisin McNaney
- School of Computing and Communications, Lancaster University, Lancaster, United Kingdom
| | - Fiona Lobban
- Spectrum Center for Mental Health Research, Division of Health Research, Lancaster University, Lancaster, United Kingdom
| |
Collapse
|
14
|
Murray E, Ross J, Pal K, Li J, Dack C, Stevenson F, Sweeting M, Parrott S, Barnard M, Yardley L, Michie S, May C, Patterson D, Alkhaldi G, Fisher B, Farmer A, O’Donnell O. A web-based self-management programme for people with type 2 diabetes: the HeLP-Diabetes research programme including RCT. PROGRAMME GRANTS FOR APPLIED RESEARCH 2018. [DOI: 10.3310/pgfar06050] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
Abstract
Background
In the UK, 6% of the UK population have diabetes mellitus, 90% of whom have type 2 diabetes mellitus (T2DM). Diabetes mellitus accounts for 10% of NHS expenditure (£14B annually). Good self-management may improve health outcomes. NHS policy is to refer all people with T2DM to structured education, on diagnosis, to improve their self-management skills, with annual reinforcement thereafter. However, uptake remains low (5.6% in 2014–15). Almost all structured education is group based, which may not suit people who work, who have family or other caring commitments or who simply do not like group-based formats. Moreover, patient needs vary with time and a single education session at diagnosis is unlikely to meet these evolving needs. A web-based programme may increase uptake.
Objectives
Our aim was to develop, evaluate and implement a web-based self-management programme for people with T2DM at any stage of their illness journey, with the goal of improving access to, and uptake of, self-management support, thereby improving health outcomes in a cost-effective manner. Specific objectives were to (1) develop an evidence-based theoretically informed programme that was acceptable to patients and health-care professionals (HCPs) and that could be readily implemented within routine NHS care, (2) determine the clinical effectiveness and cost-effectiveness of the programme compared with usual care and (3) determine how best to integrate the programme into routine care.
Design
There were five linked work packages (WPs). WP A determined patient requirements and WP B determined HCP requirements for the self-management programme. WP C developed and user-tested the Healthy Living for People with type 2 Diabetes (HeLP-Diabetes) programme. WP D was an individually randomised controlled trial in primary care with a health economic analysis. WP E used a mixed-methods and case-study design to study the potential for implementing the HeLP-Diabetes programme within routine NHS practice.
Setting
English primary care.
Participants
People with T2DM (WPs A, D and E) or HCPs caring for people with T2DM (WPs B, C and E).
Intervention
The HeLP-Diabetes programme; an evidence-based theoretically informed web-based self-management programme for people with T2DM at all stages of their illness journey, developed using participatory design principles.
Main outcome measures
WPs A and B provided data on user ‘wants and needs’, including factors that would improve the uptake and accessibility of the HeLP-Diabetes programme. The outcome for WP C was the HeLP-Diabetes programme itself. The trial (WP D) had two outcomes measures: glycated haemoglobin (HbA1c) level and diabetes mellitus-related distress, as measured with the Problem Areas in Diabetes (PAID) scale. The implementation outcomes (WP E) were the adoption and uptake at clinical commissioning group, general practice and patient levels and the identification of key barriers and facilitators.
Results
Data from WPs A and B supported our holistic approach and addressed all areas of self-management (medical, emotional and role management). HCPs voiced concerns about linkage with the electronic medical records (EMRs) and supporting patients to use the programme. The HeLP-Diabetes programme was developed and user-tested in WP C. The trial (WP D) recruited to target (n = 374), achieved follow-up rates of over 80% and the intention-to-treat analysis showed that there was an additional improvement in HbA1c levels at 12 months in the intervention group [mean difference –0.24%, 95% confidence interval (CI) –0.44% to –0.049%]. There was no difference in overall PAID score levels (mean difference –1.5 points, 95% CI –3.9 to 0.9 points). The within-trial health economic analysis found that incremental costs were lower in the intervention group than in the control group (mean difference –£111, 95% CI –£384 to £136) and the quality-adjusted life-years (QALYs) were higher (mean difference 0.02 QALYs, 95% CI 0.000 to 0.044 QALYs), meaning that the HeLP-Diabetes programme group dominated the control group. In WP E, we found that the HeLP-Diabetes programme could be successfully implemented in primary care. General practices that supported people in registering for the HeLP-Diabetes programme had better uptake and registered patients from a wider demographic than those relying on patient self-registration. Some HCPs were reluctant to do this, as they did not see it as part of their professional role.
Limitations
We were unable to link the HeLP-Diabetes programme with the EMRs or to determine the effects of the HeLP-Diabetes programme on users in the implementation study.
Conclusions
The HeLP-Diabetes programme is an effective self-management support programme that is implementable in primary care.
Future work
The HeLP-Diabetes research team will explore the following in future work: research to determine how to improve patient uptake of self-management support; develop and evaluate a structured digital educational pathway for newly diagnosed people; develop and evaluate a digital T2DM prevention programme; and the national implementation of the HeLP-Diabetes programme.
Trial registration
Research Ethics Committee reference number 10/H0722/86 for WPs A–C; Research Ethics Committee reference number 12/LO/1571 and UK Clinical Research Network/National Institute for Health Research (NIHR) Portfolio 13563 for WP D; and Research Ethics Committee 13/EM/0033 for WP E. In addition, for WP D, the study was registered with the International Standard Randomised Controlled Trial Register as reference number ISRCTN02123133.
Funding details
This project was funded by the NIHR Programme Grants for Applied Research programme and will be published in full in Programme Grants for Applied Research; Vol. 6, No. 5. See the NIHR Journals Library website for further project information.
Collapse
Affiliation(s)
- Elizabeth Murray
- Research Department of Primary Care and Population Health, University College London, London, UK
| | - Jamie Ross
- Research Department of Primary Care and Population Health, University College London, London, UK
| | - Kingshuk Pal
- Research Department of Primary Care and Population Health, University College London, London, UK
| | - Jinshuo Li
- Department of Health Sciences, University of York, Heslington, York, UK
| | - Charlotte Dack
- Research Department of Primary Care and Population Health, University College London, London, UK
| | - Fiona Stevenson
- Research Department of Primary Care and Population Health, University College London, London, UK
| | - Michael Sweeting
- Cardiovascular Epidemiology Unit, Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
| | - Steve Parrott
- Department of Health Sciences, University of York, Heslington, York, UK
| | - Maria Barnard
- Whittington Hospital, Whittington Health NHS Trust, London, UK
| | - Lucy Yardley
- Department of Psychology, University of Southampton, Southampton, UK
| | - Susan Michie
- Centre for Behaviour Change, Research Department of Clinical, Educational and Health Psychology, University College London, London, UK
| | - Carl May
- Faculty of Health Sciences, University of Southampton, Southampton, UK
| | - David Patterson
- Whittington Hospital, Whittington Health NHS Trust, London, UK
| | - Ghadah Alkhaldi
- Research Department of Primary Care and Population Health, University College London, London, UK
- Community Health Sciences Department, College of Applied Medical Sciences, King Saud University, Riyadh, Saudi Arabia
| | - Brian Fisher
- Patient Access to Electronic Records Systems Ltd (PAERS), Evergreen Life, Manchester, UK
| | - Andrew Farmer
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Orla O’Donnell
- Research Department of Primary Care and Population Health, University College London, London, UK
| |
Collapse
|
15
|
Hors-Fraile S, Schneider F, Fernandez-Luque L, Luna-Perejon F, Civit A, Spachos D, Bamidis P, de Vries H. Tailoring motivational health messages for smoking cessation using an mHealth recommender system integrated with an electronic health record: a study protocol. BMC Public Health 2018; 18:698. [PMID: 29871595 PMCID: PMC5989385 DOI: 10.1186/s12889-018-5612-5] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2017] [Accepted: 05/25/2018] [Indexed: 01/10/2023] Open
Abstract
BACKGROUND Smoking is one of the most avoidable health risk factors, and yet the quitting success rates are low. The usage of tailored health messages to support quitting has been proved to increase quitting success rates. Technology can provide convenient means to deliver tailored health messages. Health recommender systems are information-filtering algorithms that can choose the most relevant health-related items-for instance, motivational messages aimed at smoking cessation-for each user based on his or her profile. The goals of this study are to analyze the perceived quality of an mHealth recommender system aimed at smoking cessation, and to assess the level of engagement with the messages delivered to users via this medium. METHODS Patients participating in a smoking cessation program will be provided with a mobile app to receive tailored motivational health messages selected by a health recommender system, based on their profile retrieved from an electronic health record as the initial knowledge source. Patients' feedback on the messages and their interactions with the app will be analyzed and evaluated following an observational prospective methodology to a) assess the perceived quality of the mobile-based health recommender system and the messages, using the precision and time-to-read metrics and an 18-item questionnaire delivered to all patients who complete the program, and b) measure patient engagement with the mobile-based health recommender system using aggregated data analytic metrics like session frequency and, to determine the individual-level engagement, the rate of read messages for each user. This paper details the implementation and evaluation protocol that will be followed. DISCUSSION This study will explore whether a health recommender system algorithm integrated with an electronic health record can predict which tailored motivational health messages patients would prefer and consider to be of a good quality, encouraging them to engage with the system. The outcomes of this study will help future researchers design better tailored motivational message-sending recommender systems for smoking cessation to increase patient engagement, reduce attrition, and, as a result, increase the rates of smoking cessation. TRIAL REGISTRATION The trial was registered at clinicaltrials.org under the ClinicalTrials.gov identifier NCT03206619 on July 2nd 2017. Retrospectively registered.
Collapse
Affiliation(s)
- Santiago Hors-Fraile
- Department of Architecture and Computer Technology, Universidad de Sevilla, ETSII, Avenida Reina Mercedes S/N, 41012 Seville, Spain
- Department of Health Promotion, School for Public Health and Primary Care (Caphri), Maastricht University, P. Debyeplein 1, 6229 HA Maastricht, The Netherlands
| | - Francine Schneider
- Department of Health Promotion, School for Public Health and Primary Care (Caphri), Maastricht University, P. Debyeplein 1, 6229 HA Maastricht, The Netherlands
| | - Luis Fernandez-Luque
- Qatar Computing Research Institute, Hamad bin Khalifa University, Education City, Doha, Qatar
- Salumedia Tecnologías, Avenida República Argentina 24, Edificio Torre de los Remedios, Planta 5, Módulo A, Seville, Spain
| | - Francisco Luna-Perejon
- Department of Architecture and Computer Technology, Universidad de Sevilla, ETSII, Avenida Reina Mercedes S/N, 41012 Seville, Spain
| | - Anton Civit
- Department of Architecture and Computer Technology, Universidad de Sevilla, ETSII, Avenida Reina Mercedes S/N, 41012 Seville, Spain
| | - Dimitris Spachos
- Medical School, Faculty of Health Sciences, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Panagiotis Bamidis
- Medical School, Faculty of Health Sciences, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Hein de Vries
- Department of Health Promotion, School for Public Health and Primary Care (Caphri), Maastricht University, P. Debyeplein 1, 6229 HA Maastricht, The Netherlands
| |
Collapse
|
16
|
Using an Analysis of Behavior Change to Inform Effective Digital Intervention Design: How Did the PRIMIT Website Change Hand Hygiene Behavior Across 8993 Users? Ann Behav Med 2018; 51:423-431. [PMID: 27909944 PMCID: PMC5440485 DOI: 10.1007/s12160-016-9866-9] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
Abstract
Background In designing digital interventions for healthcare, it is important to understand not just whether interventions work but also how and for whom—including whether individual intervention components have different effects, whether a certain usage threshold is required to change behavior in each intervention and whether usage differs across population subgroups. Purpose We investigated these questions using data from a large trial of the digital PRimary care trial of a website based Infection control intervention to Modify Influenza-like illness and respiratory tract infection Transmission) (PRIMIT) intervention, which aimed to reduce respiratory tract infections (RTIs) by increasing hand hygiene behavior. Method Baseline and follow-up questionnaires measured behaviors, intentions and attitudes in hand hygiene. In conjunction with objective measures of usage of the four PRIMIT sessions, we analysed these observational data to examine mechanisms of behavior change in 8993 intervention users. Results We found that the PRIMIT intervention changed behavior, intentions and attitudes, and this change was associated with reduced RTIs. The largest hand hygiene change occurred after the first session, with incrementally smaller changes after each subsequent session, suggesting that engagement with the core behavior change techniques included in the first session was necessary and sufficient for behavior change. The intervention was equally effective for men and women, older and younger people and was particularly effective for those with lower levels of education. Conclusions Our well-powered analysis has implications for intervention development. We were able to determine a ‘minimum threshold’ of intervention engagement that is required for hand hygiene change, and we discuss the potential implications this (and other analyses of this type) may have for further intervention development. We also discuss the application of similar analyses to other interventions.
Collapse
|
17
|
Milward J, Drummond C, Fincham-Campbell S, Deluca P. What makes online substance-use interventions engaging? A systematic review and narrative synthesis. Digit Health 2018; 4:2055207617743354. [PMID: 29942622 PMCID: PMC6001270 DOI: 10.1177/2055207617743354] [Citation(s) in RCA: 33] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2017] [Accepted: 10/27/2017] [Indexed: 01/21/2023] Open
Abstract
Background Online substance-use interventions are effective in producing reductions in harmful-use. However, low user engagement rates with online interventions reduces overall effectiveness of interventions. Identifying optimal strategies with which to engage users with online substance-use interventions may improve usage rates and subsequent effectiveness. Objectives (1) To identify the most prevalent engagement promoting strategies utilised to increase use of online substance-use interventions. (2) To determine whether the identified engagement promoting strategies increased said use of online substance-use interventions. Review methods The reviewed followed Cochrane methodology. Databases were searched for online substance-use interventions and engagement promoting strategies limited by study type (randomised controlled trial). Due to heterogeneity between engagement promoting strategies and engagement outcomes, meta-analytic techniques were not possible. Narrative synthesis methods were used. Results Fifteen studies were included. Five different engagement promoting strategies were identified: (1) tailoring; (2) delivery strategies; (3) incentives; (4) reminders; (5) social support. The most frequently reported engagement promoting strategies was tailoring (47% of studies), followed by reminders and social support (40% of studies) and delivery strategies (33% of studies). The narrative synthesis demonstrated that tailoring, multimedia delivery of content and reminders are potential techniques for promoting engagement. The evidence for social support was inconclusive and negative for incentives. Conclusions This review was the first to examine engagement promoting strategies in solely online substance-use interventions. Three strategies were identified that may be integral in promoting engagement with online substance-use interventions. However, the small number of eligible extracted studies, inconsistent reporting of engagement outcomes and diversity of engagement features prevent firmer conclusions. More high-quality trials examining engagement are required.
Collapse
Affiliation(s)
- Joanna Milward
- Addictions Department, Institute of Psychiatry, Psychology and Neuroscience, King's College London, UK
| | - Colin Drummond
- Addictions Department, Institute of Psychiatry, Psychology and Neuroscience, King's College London, UK
| | | | - Paolo Deluca
- Addictions Department, Institute of Psychiatry, Psychology and Neuroscience, King's College London, UK
| |
Collapse
|
18
|
Lazarou I, Karakostas A, Stavropoulos TG, Tsompanidis T, Meditskos G, Kompatsiaris I, Tsolaki M. A Novel and Intelligent Home Monitoring System for Care Support of Elders with Cognitive Impairment. J Alzheimers Dis 2018; 54:1561-1591. [PMID: 27636843 DOI: 10.3233/jad-160348] [Citation(s) in RCA: 45] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND Assistive technology, in the form of a smart home environment, is employed to support people with dementia. OBJECTIVES To propose a system for continuous and objective remote monitoring of problematic daily living activity areas and design personalized interventions based on system feedback and clinical observations for improving cognitive function and health-related quality of life. METHODS The assistive technology of the proposed system, including wearable, sleep, object motion, presence, and utility usage sensors, was methodically deployed at four different home installations of people with cognitive impairment. Detection of sleep patterns, physical activity, and activities of daily living, based on the collected sensor data and analytics, was available at all times through comprehensive data visualization solutions. Combined with clinical observation, targeted psychosocial interventions were introduced to enhance the participants' quality of life and improve their cognitive functions and daily functionality. Meanwhile, participants and their caregivers were able to visualize a reduced set of information tailored to their needs. RESULTS Overall, paired-sample t-test analysis of monitored qualities revealed improvement for all participants in neuropsychological assessment. Moreover, improvement was detected from the beginning to the end of the trial, in physical condition and in the domains of sleep. Detecting abnormalities via the system, for example in sleep quality, such as REM sleep, has proved to be critical to assess current status, drive interventions, and evaluate improvements in a reliable manner. CONCLUSION It has been proved that the proposed system is suitable to support clinicians to reliably drive and evaluate clinical interventions toward quality of life improvement of people with cognitive impairment.
Collapse
Affiliation(s)
- Ioulietta Lazarou
- Information Technologies Institute, Centre for Research and Technology Hellas, Thessaloniki, Greece.,3rd Department of Neurology, Medical School, Aristotle University of Thessaloniki, Greece
| | - Anastasios Karakostas
- Information Technologies Institute, Centre for Research and Technology Hellas, Thessaloniki, Greece
| | - Thanos G Stavropoulos
- Information Technologies Institute, Centre for Research and Technology Hellas, Thessaloniki, Greece
| | - Theodoros Tsompanidis
- Information Technologies Institute, Centre for Research and Technology Hellas, Thessaloniki, Greece
| | - Georgios Meditskos
- Information Technologies Institute, Centre for Research and Technology Hellas, Thessaloniki, Greece
| | - Ioannis Kompatsiaris
- Information Technologies Institute, Centre for Research and Technology Hellas, Thessaloniki, Greece
| | - Magda Tsolaki
- Information Technologies Institute, Centre for Research and Technology Hellas, Thessaloniki, Greece.,3rd Department of Neurology, Medical School, Aristotle University of Thessaloniki, Greece.,Greek Alzheimer Association and Related Disorders, Thessaloníki, Greece
| |
Collapse
|
19
|
Sharpe EE, Karasouli E, Meyer C. Examining Factors of Engagement With Digital Interventions for Weight Management: Rapid Review. JMIR Res Protoc 2017; 6:e205. [PMID: 29061557 PMCID: PMC5673884 DOI: 10.2196/resprot.6059] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2016] [Revised: 02/02/2017] [Accepted: 09/04/2017] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Digital interventions for weight management provide a unique opportunity to target daily lifestyle choices and eating behaviors over a sustained period of time. However, recent evidence has demonstrated a lack of user engagement with digital health interventions, impacting on the levels of intervention effectiveness. Thus, it is critical to identify the factors that may facilitate user engagement with digital health interventions to encourage behavior change and weight management. OBJECTIVE The aim of this study was to identify and synthesize the available evidence to gain insights about users' perspectives on factors that affect engagement with digital interventions for weight management. METHODS A rapid review methodology was adopted. The search strategy was executed in the following databases: Web of Science, PsycINFO, and PubMed. Studies were eligible for inclusion if they investigated users' engagement with a digital weight management intervention and were published from 2000 onwards. A narrative synthesis of data was performed on all included studies. RESULTS A total of 11 studies were included in the review. The studies were qualitative, mixed-methods, or randomized controlled trials. Some of the studies explored features influencing engagement when using a Web-based digital intervention, others specifically explored engagement when accessing a mobile phone app, and some looked at engagement after text message (short message service, SMS) reminders. Factors influencing engagement with digital weight management interventions were found to be both user-related (eg, perceived health benefits) and digital intervention-related (eg, ease of use and the provision of personalized information). CONCLUSIONS The findings highlight the importance of incorporating user perspectives during the digital intervention development process to encourage engagement. The review contributes to our understanding of what facilitates user engagement and points toward a coproduction approach for developing digital interventions for weight management. Particularly, it highlights the importance of thinking about user-related and digital tool-related factors from the very early stages of the intervention development process.
Collapse
Affiliation(s)
| | - Eleni Karasouli
- Division of Clinical Trials, Warwick Medical School, University of Warwick, Coventry, United Kingdom
| | - Caroline Meyer
- Warwick Manufacturing Group, University of Warwick, Coventry, United Kingdom
| |
Collapse
|
20
|
Deighan C, Michalova L, Pagliari C, Elliott J, Taylor L, Ranaldi H. The Digital Heart Manual: A pilot study of an innovative cardiac rehabilitation programme developed for and with users. PATIENT EDUCATION AND COUNSELING 2017; 100:1598-1607. [PMID: 28342675 DOI: 10.1016/j.pec.2017.03.014] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/27/2016] [Revised: 03/06/2017] [Accepted: 03/08/2017] [Indexed: 06/06/2023]
Abstract
OBJECTIVE Patients are seeking greater choice and flexibility in how they engage with self-management programmes. While digital innovations offer opportunities to deliver supportive interventions to patients undergoing cardiac rehabilitation little is known about how accessible, useful and acceptable they are for this group. This project developed a digital version of a leading evidenced cardiac rehabilitation programme, the Heart Manual (HM). The prototype was developed and evaluated iteratively in collaboration with end users. METHODS Using a mixed methods design 28 participants provided feedback using semi-structured questionnaires and telephone interviews. RESULTS Rich data revealed the perceived user-friendliness of the HM digital format and its effectiveness at communicating the programme's key messages. It flagged areas requiring development, such as more flexible and intuitive navigation pathways. These suggestions informed the refinement of the resource. CONCLUSION This evaluation offers support for the new Digital Heart Manual and confirms the value of employing a user-centred approach when developing and improving online interventions. The system is now in use and recommendations from the evaluation are being translated into quality improvements. PRACTICE IMPLICATIONS The Digital Heart Manual is user friendly and accessible to patients and health professionals, regardless of age, presenting a suitable alternative to the paper version.
Collapse
Affiliation(s)
- C Deighan
- The Heart Manual Department, NHS Lothian, Edinburgh, UK.
| | - L Michalova
- The Heart Manual Department, NHS Lothian, Edinburgh, UK
| | | | - J Elliott
- The Heart Manual Department, NHS Lothian, Edinburgh, UK
| | - L Taylor
- The Heart Manual Department, NHS Lothian, Edinburgh, UK
| | - H Ranaldi
- The Heart Manual Department, NHS Lothian, Edinburgh, UK
| |
Collapse
|
21
|
Bailey JV, Tomlinson N, Hobbs LJ, Webster R. Challenges and opportunities in evaluating a digital sexual health intervention in a clinic setting: Staff and patient views. Digit Health 2017; 3:2055207617704272. [PMID: 29942593 PMCID: PMC6001223 DOI: 10.1177/2055207617704272] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2016] [Accepted: 03/09/2017] [Indexed: 11/30/2022] Open
Abstract
Objectives The aim of the study was to gather the views of sexual health clinic staff and male clinic users regarding digital sexual health promotion and online trial procedures. Methods The Men’s Safer Sex website was offered on tablet computers to men in the waiting rooms of three sexual health clinics, in a feasibility online randomised controlled trial (RCT). Interviews were conducted with 11 men who had participated in the trial and with nine clinic staff, to explore their views of the website and views of the online trial. Interviews were audio-recorded and transcribed, and we conducted a thematic analysis of interviews and of 281 free text comments from the online RCT outcome questionnaires. Results Clinic users and staff felt that digital interventions such as the Men’s Safer Sex website are useful, especially if NHS endorsed. Pre-appointment waiting time presents a good opportunity for intervention but clinic users and staff felt that a website should supplement rather than replace face-to-face healthcare. The RCT procedures fitted well around clinical activities, but men did not self-direct to the tablet computers. Staff were more concerned about consent and confidentiality than clinic users, and staff and patients were frustrated by multiple technical problems. The trial outcome questionnaire was thought-provoking and could constitute an intervention in itself. Participants felt that clinics would need to promote a digital intervention and/or offer the site routinely to promote engagement. Conclusion Digital interventions could usefully supplement in-person sexual health care, but there are important obstacles in terms of IT access in NHS settings, and in promoting engagement.
Collapse
Affiliation(s)
- J V Bailey
- UCL E-Health unit, Research Department of Primary Care and Population Health, University College London, London, UK
| | - N Tomlinson
- UCL E-Health unit, Research Department of Primary Care and Population Health, University College London, London, UK
| | - L J Hobbs
- UCL E-Health unit, Research Department of Primary Care and Population Health, University College London, London, UK
| | - R Webster
- UCL E-Health unit, Research Department of Primary Care and Population Health, University College London, London, UK
| |
Collapse
|
22
|
Hollis C, Falconer CJ, Martin JL, Whittington C, Stockton S, Glazebrook C, Davies EB. Annual Research Review: Digital health interventions for children and young people with mental health problems - a systematic and meta-review. J Child Psychol Psychiatry 2017; 58:474-503. [PMID: 27943285 DOI: 10.1111/jcpp.12663] [Citation(s) in RCA: 381] [Impact Index Per Article: 54.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 09/29/2016] [Indexed: 12/12/2022]
Abstract
BACKGROUND Digital health interventions (DHIs), including computer-assisted therapy, smartphone apps and wearable technologies, are heralded as having enormous potential to improve uptake and accessibility, efficiency, clinical effectiveness and personalisation of mental health interventions. It is generally assumed that DHIs will be preferred by children and young people (CYP) given their ubiquitous digital activity. However, it remains uncertain whether: DHIs for CYP are clinically and cost-effective, CYP prefer DHIs to traditional services, DHIs widen access and how they should be evaluated and adopted by mental health services. This review evaluates the evidence-base for DHIs and considers the key research questions and approaches to evaluation and implementation. METHODS We conducted a meta-review of scoping, narrative, systematic or meta-analytical reviews investigating the effectiveness of DHIs for mental health problems in CYP. We also updated a systematic review of randomised controlled trials (RCTs) of DHIs for CYP published in the last 3 years. RESULTS Twenty-one reviews were included in the meta-review. The findings provide some support for the clinical benefit of DHIs, particularly computerised cognitive behavioural therapy (cCBT), for depression and anxiety in adolescents and young adults. The systematic review identified 30 new RCTs evaluating DHIs for attention deficit/hyperactivity disorder (ADHD), autism, anxiety, depression, psychosis, eating disorders and PTSD. The benefits of DHIs in managing ADHD, autism, psychosis and eating disorders are uncertain, and evidence is lacking regarding the cost-effectiveness of DHIs. CONCLUSIONS Key methodological limitations make it difficult to draw definitive conclusions from existing clinical trials of DHIs. Issues include variable uptake and engagement with DHIs, lack of an agreed typology/taxonomy for DHIs, small sample sizes, lack of blinded outcome assessment, combining different comparators, short-term follow-up and poor specification of the level of human support. Research and practice recommendations are presented that address the key research questions and methodological issues for the evaluation and clinical implementation of DHIs for CYP.
Collapse
Affiliation(s)
- Chris Hollis
- Division of Psychiatry and Applied Psychology, School of Medicine, University of Nottingham, Nottingham, UK.,NIHR MindTech Healthcare Technology Co-operative, Institute of Mental Health, University of Nottingham, Nottingham, UK
| | - Caroline J Falconer
- Division of Psychiatry and Applied Psychology, School of Medicine, University of Nottingham, Nottingham, UK.,NIHR MindTech Healthcare Technology Co-operative, Institute of Mental Health, University of Nottingham, Nottingham, UK
| | - Jennifer L Martin
- Division of Psychiatry and Applied Psychology, School of Medicine, University of Nottingham, Nottingham, UK.,NIHR MindTech Healthcare Technology Co-operative, Institute of Mental Health, University of Nottingham, Nottingham, UK
| | | | - Sarah Stockton
- Department of Psychiatry, Warneford Hospital, Oxford, UK
| | - Cris Glazebrook
- Division of Psychiatry and Applied Psychology, School of Medicine, University of Nottingham, Nottingham, UK.,NIHR MindTech Healthcare Technology Co-operative, Institute of Mental Health, University of Nottingham, Nottingham, UK
| | - E Bethan Davies
- Division of Psychiatry and Applied Psychology, School of Medicine, University of Nottingham, Nottingham, UK.,NIHR MindTech Healthcare Technology Co-operative, Institute of Mental Health, University of Nottingham, Nottingham, UK
| |
Collapse
|
23
|
The Asthma Mobile Health Study, a large-scale clinical observational study using ResearchKit. Nat Biotechnol 2017; 35:354-362. [PMID: 28288104 DOI: 10.1038/nbt.3826] [Citation(s) in RCA: 147] [Impact Index Per Article: 21.0] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2016] [Accepted: 02/13/2017] [Indexed: 01/17/2023]
Abstract
The feasibility of using mobile health applications to conduct observational clinical studies requires rigorous validation. Here, we report initial findings from the Asthma Mobile Health Study, a research study, including recruitment, consent, and enrollment, conducted entirely remotely by smartphone. We achieved secure bidirectional data flow between investigators and 7,593 participants from across the United States, including many with severe asthma. Our platform enabled prospective collection of longitudinal, multidimensional data (e.g., surveys, devices, geolocation, and air quality) in a subset of users over the 6-month study period. Consistent trending and correlation of interrelated variables support the quality of data obtained via this method. We detected increased reporting of asthma symptoms in regions affected by heat, pollen, and wildfires. Potential challenges with this technology include selection bias, low retention rates, reporting bias, and data security. These issues require attention to realize the full potential of mobile platforms in research and patient care.
Collapse
|
24
|
Romano MF, Sardella MV, Alboni F. Web Health Monitoring Survey: A New Approach to Enhance the Effectiveness of Telemedicine Systems. JMIR Res Protoc 2016; 5:e101. [PMID: 27268949 PMCID: PMC4914780 DOI: 10.2196/resprot.5187] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2015] [Revised: 04/25/2016] [Accepted: 05/13/2016] [Indexed: 01/11/2023] Open
Abstract
BACKGROUND Aging of the European population and interest in a healthy population in western countries have contributed to an increase in the number of health surveys, where the role of survey design, data collection, and data analysis methodology is clear and recognized by the whole scientific community. Survey methodology has had to couple with the challenges deriving from data collection through information and communications technology (ICT). Telemedicine systems have not used patients as a source of information, often limiting them to collecting only biometric data. A more effective telemonitoring system would be able to collect objective and subjective data (biometric parameters and symptoms reported by the patients themselves), and to control the quality of subjective data collected: this goal be achieved only by using and merging competencies from both survey methodology and health research. OBJECTIVE The objective of our study was to propose new metrics to control the quality of data, along with the well-known indicators of survey methodology. Web questionnaires administered daily to a group of patients for an extended length of time are a Web health monitoring survey (WHMS) in a telemedicine system. METHODS We calculated indicators based on paradata collected during a WHMS study involving 12 patients, who signed in to the website daily for 2 months. RESULTS The patients' involvement was very high: the patients' response rate ranged between 1.00 and 0.82, with an outlier of 0.65. Item nonresponse rate was very low, ranging between 0.0% and 7.4%. We propose adherence to the chosen time to connect to the website as a measure of involvement and cooperation by the patients: the difference from the median time ranged between 11 and 24 minutes, demonstrating very good cooperation and involvement from all patients. To measure habituation to the questionnaire, we also compared nonresponse rates to the items between the first and the second month of the study, and found no significant difference. We computed the time to complete the questionnaire both as a measure of possible burden for patient, and to detect the risk of automatic responses. Neither of these hypothesis was confirmed, and differences in time to completion seemed to depend on health conditions. Focus groups with patients confirmed their appreciation for this "new" active role in a telemonitoring system. CONCLUSIONS The main and innovative aspect of our proposal is the use of a Web questionnaire to virtually recreate a checkup visit, integrating subjective (patient's information) with objective data (biometric information). Our results, although preliminary and if need of further study, appear promising in proposing more effective telemedicine systems. Survey methodology could have an effective role in this growing field of research and applications.
Collapse
|
25
|
Graham AL, Carpenter KM, Cha S, Cole S, Jacobs MA, Raskob M, Cole-Lewis H. Systematic review and meta-analysis of Internet interventions for smoking cessation among adults. Subst Abuse Rehabil 2016; 7:55-69. [PMID: 27274333 PMCID: PMC4876804 DOI: 10.2147/sar.s101660] [Citation(s) in RCA: 77] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/03/2022] Open
Abstract
BACKGROUND The aim of this systematic review was to determine the effectiveness of Internet interventions in promoting smoking cessation among adult tobacco users relative to other forms of intervention recommended in treatment guidelines. METHODS This review followed Cochrane Collaboration guidelines for systematic reviews. Combinations of "Internet," "web-based," and "smoking cessation intervention" and related keywords were used in both automated and manual searches. We included randomized trials published from January 1990 through to April 2015. A modified version of the Cochrane risk of bias assessment tool was used. We calculated risk ratios (RRs) for each study. Meta-analysis was conducted using random-effects method to pool RRs. Presentation of results follows the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. RESULTS Forty randomized trials involving 98,530 participants were included. Most trials had a low risk of bias in most domains. Pooled results comparing Internet interventions to assessment-only/waitlist control were significant (RR 1.60, 95% confidence interval [CI] 1.15-2.21, I (2)=51.7%; four studies). Pooled results of largely static Internet interventions compared to print materials were not significant (RR 0.83, 95% CI 0.63-1.10, I (2)=0%; two studies), whereas comparisons of interactive Internet interventions to print materials were significant (RR 2.10, 95% CI 1.25-3.52, I (2)=41.6%; two studies). No significant effects were observed in pooled results of Internet interventions compared to face-to-face counseling (RR 1.35, 95% CI 0.97-1.87, I (2)=0%; four studies) or to telephone counseling (RR 0.95, 95% CI 0.79-1.13, I (2)=0%; two studies). The majority of trials compared different Internet interventions; pooled results from 15 such trials (24 comparisons) found a significant effect in favor of experimental Internet interventions (RR 1.16, 95% CI 1.03-1.31, I (2)=76.7%). CONCLUSION Internet interventions are superior to other broad reach cessation interventions (ie, print materials), equivalent to other currently recommended treatment modes (telephone and in-person counseling), and they have an important role to play in the arsenal of tobacco-dependence treatments.
Collapse
Affiliation(s)
- Amanda L Graham
- Schroeder Institute for Tobacco Research and Policy Studies, Truth Initiative, Washington, DC, USA
- Department of Oncology, Georgetown University Medical Center/Cancer Prevention and Control Program, Lombardi Comprehensive Cancer Center, Washington, DC, USA
| | | | - Sarah Cha
- Schroeder Institute for Tobacco Research and Policy Studies, Truth Initiative, Washington, DC, USA
| | - Sam Cole
- Alere Wellbeing, Seattle, WA, USA
| | - Megan A Jacobs
- Schroeder Institute for Tobacco Research and Policy Studies, Truth Initiative, Washington, DC, USA
| | | | - Heather Cole-Lewis
- Johnson & Johnson Health and Wellness Solutions, Inc., New Brunswick, NJ, USA
- ICF International, Rockville, MD, USA
| |
Collapse
|
26
|
Kipping R, Jago R, Metcalfe C, White J, Papadaki A, Campbell R, Hollingworth W, Ward D, Wells S, Brockman R, Nicholson A, Moore L. NAP SACC UK: protocol for a feasibility cluster randomised controlled trial in nurseries and at home to increase physical activity and healthy eating in children aged 2-4 years. BMJ Open 2016; 6:e010622. [PMID: 27053273 PMCID: PMC4823443 DOI: 10.1136/bmjopen-2015-010622] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/20/2015] [Revised: 03/03/2016] [Accepted: 03/07/2016] [Indexed: 11/08/2022] Open
Abstract
INTRODUCTION Systematic reviews have identified the lack of intervention studies with young children to prevent obesity. This feasibility study examines the feasibility and acceptability of adapting the Nutrition and Physical Activity Self-Assessment for Child Care (NAP SACC) intervention in the UK to inform a full-scale trial. METHODS AND ANALYSIS A feasibility cluster randomised controlled trial in 12 nurseries in England, with 6 randomly assigned to the adapted NAP SACC UK intervention: nursery staff will receive training and support from an NAP SACC UK Partner to review the nursery environment (nutrition, physical activity, sedentary behaviours and oral health) and set goals for making changes. Parents will be invited to participate in a digital media-based home component to set goals for making changes in the home. As this is a feasibility study, the sample size was not based on a power calculation but will indicate the likely response rates and intracluster correlations. Measures will be assessed at baseline and 8-10 months later. We will estimate the recruitment rate of nurseries and children and adherence to the intervention and data. Nursery measurements will include the Environmental Policy Assessment and Observation score and the nursery staff's review of the nursery environment. Child measurements will include height and weight to calculate z-score body mass index (zBMI), accelerometer-determined minutes of moderate-to-vigorous physical activity per day and sedentary time, and diet using the Child and Diet Evaluation Tool. Questionnaires with nursery staff and parents will measure mediators. A process evaluation will assess fidelity of intervention delivery and views of participants. ETHICS AND DISSEMINATION Ethical approval for this study was given by Wales 3 NHS Research Ethics Committee. Findings will be made available through publication in peer-reviewed journals, at conferences and to participants via the University of Bristol website. Data will be available from the University of Bristol Research Data Repository. TRIAL REGISTRATION NUMBER ISRCTN16287377.
Collapse
Affiliation(s)
- R Kipping
- School of Social and Community Medicine, University of Bristol, Bristol, UK
| | - R Jago
- Centre for Exercise, Nutrition and Health Sciences, School for Policy Studies, University of Bristol, Bristol, UK
| | - C Metcalfe
- School of Social and Community Medicine, University of Bristol, Bristol, UK Bristol Randomised Trials Collaboration, Bristol, UK
| | - J White
- South East Wales Trials Unit, School of Medicine, Cardiff University, Cardiff, UK
| | - A Papadaki
- Centre for Exercise, Nutrition and Health Sciences, School for Policy Studies, University of Bristol, Bristol, UK
| | - R Campbell
- School of Social and Community Medicine, University of Bristol, Bristol, UK
| | - W Hollingworth
- School of Social and Community Medicine, University of Bristol, Bristol, UK
| | - D Ward
- Department of Nutrition, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | - S Wells
- School of Social and Community Medicine, University of Bristol, Bristol, UK
| | - R Brockman
- School of Social and Community Medicine, University of Bristol, Bristol, UK
| | - A Nicholson
- School of Social and Community Medicine, University of Bristol, Bristol, UK
| | - L Moore
- MRC/CSO Social and Public Health Sciences Unit, University of Glasgow, Glasgow, UK
| |
Collapse
|
27
|
Alkhaldi G, Hamilton FL, Lau R, Webster R, Michie S, Murray E. The Effectiveness of Prompts to Promote Engagement With Digital Interventions: A Systematic Review. J Med Internet Res 2016; 18:e6. [PMID: 26747176 PMCID: PMC4723726 DOI: 10.2196/jmir.4790] [Citation(s) in RCA: 163] [Impact Index Per Article: 20.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2015] [Revised: 08/14/2015] [Accepted: 09/23/2015] [Indexed: 02/02/2023] Open
Abstract
Background Digital interventions have been effective in improving numerous health outcomes and health behaviors; furthermore, they are increasingly being used in different health care areas, including self-management of long-term conditions, mental health, and health promotion. The full potential of digital interventions is hindered by a lack of user engagement. There is an urgent need to develop effective strategies that can promote users’ engagement with digital interventions. One potential method is the use of technology-based reminders or prompts. Objective To evaluate the effectiveness of technology-based strategies for promoting engagement with digital interventions. Methods Cochrane Collaboration guidelines on systematic review methodology were followed. The search strategy was executed across 7 electronic databases: the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, Embase, Web of Science, the Education Resources Information Center (ERIC), PsycINFO, and the Cumulative Index to Nursing and Allied Health Literature (CINAHL). Databases were searched from inception to September 13, 2013, with no language or publication type restrictions, using three concepts: randomized controlled trials, digital interventions, and engagement. Gray literature and reference lists of included studies were also searched. Titles and abstracts were independently screened by 2 authors, then the full texts of potentially eligible papers were obtained and double-screened. Data from eligible papers were extracted by one author and checked for accuracy by another author. Bias was assessed using the Cochrane risk of bias assessment tool. Narrative synthesis was performed on all included studies and, where appropriate, data were pooled using meta-analysis. All findings were reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Results A total of 14 studies were included in the review with 8774 participants. Of the 14 studies, 9 had sufficient data to be included in the meta-analyses. The meta-analyses suggested that technology-based strategies can potentially promote engagement compared to no strategy for dichotomous outcomes (relative risk [RR] 1.27, 95% CI 1.01-1.60, I2=71%), but due to considerable heterogeneity and the small sample sizes in most studies, this result should be treated with caution. No studies reported adverse or economic outcomes. Only one study with a small sample size compared different characteristics; the study found that strategies promoting new digital intervention content and those sent to users shortly after they started using the digital intervention were more likely to engage users. Conclusions Overall, studies reported borderline positive effects of technology-based strategies on engagement compared to no strategy. However, the results have to be interpreted with caution. More research is needed to replicate findings and understand which characteristics of the strategies are effective in promoting engagement and how cost-effective they are.
Collapse
Affiliation(s)
- Ghadah Alkhaldi
- eHealth Unit, Research Department of Primary Care and Population Health, University College London, London, United Kingdom.
| | | | | | | | | | | |
Collapse
|
28
|
Dedov VN, Dedova IV. Automated Management of Exercise Intervention at the Point of Care: Application of a Web-Based Leg Training System. JMIR Rehabil Assist Technol 2015; 2:e11. [PMID: 28582243 PMCID: PMC5454567 DOI: 10.2196/rehab.4812] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2015] [Revised: 07/21/2015] [Accepted: 08/11/2015] [Indexed: 12/23/2022] Open
Abstract
Background Recent advances in information and communication technology have prompted development of Web-based health tools to promote physical activity, the key component of cardiac rehabilitation and chronic disease management. Mobile apps can facilitate behavioral changes and help in exercise monitoring, although actual training usually takes place away from the point of care in specialized gyms or outdoors. Daily participation in conventional physical activities is expensive, time consuming, and mostly relies on self-management abilities of patients who are typically aged, overweight, and unfit. Facilitation of sustained exercise training at the point of care might improve patient engagement in cardiac rehabilitation. Objective In this study we aimed to test the feasibility of execution and automatic monitoring of several exercise regimens on-site using a Web-enabled leg training system. Methods The MedExercise leg rehabilitation machine was equipped with wireless temperature sensors in order to monitor its usage by the rise of temperature in the resistance unit (Δt°). Personal electronic devices such as laptop computers were fitted with wireless gateways and relevant software was installed to monitor the usage of training machines. Cloud-based software allowed monitoring of participant training over the Internet. Seven healthy participants applied the system at various locations with training protocols typically used in cardiac rehabilitation. The heart rates were measured by fingertip pulse oximeters. Results Exercising in home chairs, in bed, and under an office desk was made feasible and resulted in an intensity-dependent increase of participants’ heart rates and Δt° in training machine temperatures. Participants self-controlled their activities on smart devices, while a supervisor monitored them over the Internet. Individual Δt° reached during 30 minutes of moderate-intensity continuous training averaged 7.8°C (SD 1.6). These Δt° were used as personalized daily doses of exercise with automatic email alerts sent upon achieving them. During 1-week training at home, automatic notifications were received on 4.4 days (SD 1.8). Although the high intensity interval training regimen was feasible on-site, it was difficult for self- and remote management. Opportunistic leg exercise under the desk, while working with a computer, and training in bed while viewing television were less intensive than dosed exercise bouts, but allowed prolonged leg mobilization of 73.7 minutes/day (SD 29.7). Conclusions This study demonstrated the feasibility of self-control exercise training on-site, which was accompanied by online monitoring, electronic recording, personalization of exercise doses, and automatic reporting of adherence. The results suggest that this technology and its applications are useful for the delivery of Web-based exercise rehabilitation and cardiac training programs at the point of care.
Collapse
Affiliation(s)
- Vadim N Dedov
- MedExercise Project, Research and Development, MDXD Pty Ltd, Sydney, Australia
| | - Irina V Dedova
- Department of Anatomy, School of Medical Sciences, University of New South Wales, Sydney, Australia
| |
Collapse
|
29
|
Hamilton FL, Hornby J, Sheringham J, Kerry S, Linke S, Solmi F, Ashton C, Moore K, Murray E. DIgital Alcohol Management ON Demand (DIAMOND) feasibility randomised controlled trial of a web-based intervention to reduce alcohol consumption in people with hazardous and harmful use versus a face-to-face intervention: protocol. Pilot Feasibility Stud 2015; 1:28. [PMID: 27965806 PMCID: PMC5153867 DOI: 10.1186/s40814-015-0023-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2015] [Accepted: 07/20/2015] [Indexed: 01/18/2023] Open
Abstract
BACKGROUND "Hazardous and harmful" drinkers make up approximately 23 % of the adult population in England. However, only around 10 % of these people access specialist care, such as face-to-face extended brief treatment in community alcohol services. This may be due to stigma, difficulty accessing services during working hours, a shortage of trained counsellors and limited provision of services in many places. Web-based alcohol treatment programmes may overcome these barriers and may better suit people who are reluctant or unable to attend face-to-face services, but there is a gap in the evidence base for the acceptability, effectiveness and cost-effectiveness of these programmes compared with treatment as usual (TAU) in community alcohol services. This study aims investigate the feasibility of all parts of a randomised controlled trial (RCT) of a psychologically informed web-based alcohol treatment programme called Healthy Living for People who use Alcohol (HeLP-Alcohol) versus TAU in community alcohol services, e.g. recruitment and retention, online data collection methods, and the use and acceptability of the intervention to participants. METHODS A feasibility RCT delivered in north London community alcohol services, comparing HeLP-Alcohol with TAU. Potential participants are aged ≥18 years referred or self-referred for hazardous and harmful use of alcohol, without co-morbidities or other complex problems. The main purpose of this study is to demonstrate the feasibility of recruiting participants to the study and will test online methods for collecting baseline demographic and outcome questionnaire data, randomising participants and collecting 3-month follow-up data. The acceptability of this intervention will be measured by recruitment and retention rates, automated log-in data collection and an online service satisfaction questionnaire. The feasibility of using tailored text message, email or phone prompt to maintain engagement with the intervention will also be explored. Results of the study will inform a definitive Phase 3 RCT. RESULTS Recruitment started on 26 September 2014 and will run for 1 year. CONCLUSION The proposed trial will provide data to inform a fully powered non-inferiority effectiveness and cost-effectiveness RCT comparing HeLP-Alcohol with TAU. TRIAL REGISTRATION ISRCTN31789096.
Collapse
Affiliation(s)
- Fiona L Hamilton
- eHealth Unit, Department of Primary Care & Population Health, University College London, London, UK
| | - Jo Hornby
- eHealth Unit, Department of Primary Care & Population Health, University College London, London, UK
| | - Jessica Sheringham
- Department of Applied Health Research, University College London, London, UK
| | - Sally Kerry
- Centre for Primary Care and Public Health, Queen Mary University, London, UK
| | - Stuart Linke
- Camden and Islington NHS Foundation Trust, London, UK
| | - Francesca Solmi
- Department of Applied Health Research, University College London, London, UK
| | | | | | - Elizabeth Murray
- eHealth Unit, Department of Primary Care & Population Health, University College London, London, UK
| |
Collapse
|