What design features are used in effective e-health interventions? A review using techniques from Critical Interpretive Synthesis

Increasing physical activity among adults affected by COVID-19 social distancing restrictions: A feasibility trial of an online intervention

In response to COVID-19 social distancing restrictions, digitally delivered health interventions present as a potential solution for maintaining or improving individuals' physical activity. This study explored the feasibility of a web-based intervention, informed by the multi-process action control (M-PAC) framework to promote PA among individuals affected by social distancing. Fifty adults self-reporting as insufficiently active were randomized to a 6-week web-intervention (n = 27) or wait-list control (n = 23). Primary feasibility outcomes included recruitment and retention rates and usability and satisfaction scores; secondary outcomes of MVPA and M-PAC constructs and tertiary outcomes of mental health and wellbeing were also assessed. Overall, feasibility of the intervention was high, with a 96% recruitment rate, 84% retention rate, high satisfaction and usability scores, and comparable website usage to similar eHealth interventions. Intervention participants trended towards improved MVPA and M-PAC constructs and outcomes of mental health and wellbeing. Findings suggest study extension to a full-scale RCT.

Digital mental health interventions for the mental health care of refugees and asylum seekers: Integrative literature review

This study aimed to provide a critical analysis of the current literature on the use of digital mental health interventions (DMHIs) for the management and treatment of mental health disorders among refugees and asylum seekers. These groups are among the most disadvantaged compared to the general population in terms of health and socio-economic status, due to conflicts and wars. The number of refugees fleeing their home countries is growing exponentially, and refugees experience trauma, torture, persecution and human right abuses, which have a profound effect on their mental health and overall well-being. The researchers conducted an integrative literature review from electronic databases Medline, CINAHL and Google Scholar, selecting articles published in English from 2010 to 2023. The thematic analysis of the 10 articles identified in the review revealed four main themes and two sub-themes: (1) types of digital health intervention/apps used; (2) barriers encountered in digital health intervention; (3) user experience of the digital health intervention and (4) mapping gaps. Two sub-themes were identified located in Theme 2: (2.1) Language and demographic barriers and (2.2) Structural barriers. The study showed that the use of DMHIs was associated with positive experiences among refugees and asylum seekers. Limited mental health care is offered to refugees and asylum seekers due to a range of logistical, political, economic, geographical, language, cultural and social barriers. DMHIs have the potential to overcome and/or moderate these barriers. The study concludes that the scaled implementation of effective DMHIs holds the possibility to improve the wider distribution of mental health care among refugees and asylum seekers. However, further research is needed to confirm the effectiveness of DMHIs and to scale up studies for their utilisation among this group. In summary, this study highlights the potential of DMHIs in improving the mental health care of refugees and asylum seekers. The results of this study have important implications for mental health service providers, policymakers and researchers to address the mental health needs of this vulnerable/priority group.

Digital Interventions to Modify Skin Cancer Risk Behaviors in a National Sample of Young Adults: Randomized Controlled Trial

BACKGROUND

Young adults engage in behaviors that place them at risk for skin cancer. Dissemination of digital health promotion interventions via social media is a potentially promising strategy to modify skin cancer risk behaviors by increasing UV radiation (UVR) protection and skin cancer examinations.

OBJECTIVE

This study aimed to compare 3 digital interventions designed to modify UVR exposure, sun protection, and skin cancer detection behaviors among young adults at moderate to high risk of skin cancer.

METHODS

This study was a hybrid type II effectiveness-implementation randomized controlled trial of 2 active interventions, a digital skin cancer risk reduction intervention (UV4.me [basic]) compared with an enhanced version (UV4.me2 [enhanced]), and an electronic pamphlet (e-pamphlet). Intervention effects were assessed over the course of a year among 1369 US young adults recruited primarily via Facebook and Instagram. Enhancements to encourage intervention engagement and behavior change included more comprehensive goal-setting activities, ongoing proactive messaging related to previously established mediators (eg, self-efficacy) of UVR exposure and protection, embedded incentives for module completion, and ongoing news and video updates. Primary outcome effects assessed via linear regression were UVR exposure and sun protection and protection habits. Secondary outcome effects assessed via logistic regression were skin self-exams, physician skin exams, sunscreen use, indoor tanning, and sunburn.

RESULTS

The active interventions increased sun protection (basic: P=.02; enhanced: P<.001) and habitual sun protection (basic: P=.04; enhanced P=.01) compared with the e-pamphlet. The enhanced intervention increased sun protection more than the basic one. Each active intervention increased sunscreen use at the 3-month follow-up (basic: P=.03; enhanced: P=.01) and skin self-exam at 1 year (basic: P=.04; enhanced: P=.004), compared with the e-pamphlet. Other intervention effects and differences between the Basic and Enhanced Intervention effects were nonsignificant.

CONCLUSIONS

The active interventions were effective in improving several skin cancer risk and skin cancer prevention behaviors. Compared with the basic intervention, the enhanced intervention added to the improvement in sun protection but not other behaviors. Future analyses will explore intervention engagement (eg, proportion of content reviewed).

TRIAL REGISTRATION

ClinicalTrials.gov NCT03313492; http://clinicaltrials.gov/ct2/show/NCT03313492.

User-centered development of an internet-based CBT intervention for the treatment of loneliness in older individuals

Background

Loneliness is a widespread phenomenon associated with a number of negative health outcomes. Older individuals may constitute one important target group with a need for effective interventions. However, despite evidence showing that addressing maladaptive social cognition (e.g., via cognitive behavioral therapy [CBT]) is the most effective intervention strategy for reducing loneliness, most existing programs aimed at older individuals do not use that method. Further, in terms of mental health service use, older individuals have been found to be an extremely undertreated population. When developing interventions, active involvement of end users in the development process is essential to increase later uptake.

Objective

The aim of the present study was to develop an internet-based CBT intervention for loneliness in older individuals (i.e., aged ≥65 years) applying a user-centered design. The present report provides an in-depth description of the development process.

Methods

Two phases of qualitative data collection were conducted in parallel with intervention development using a sample of N = 12 participants including both potential end users (i.e., older adults) as well as experts (i.e., psychotherapists). Measures included semi-structured interviews and usability testing.

Results

In Phase 1 interviews, participants indicated that they were predominantly positive about the idea of an internet-based program for loneliness targeting older individuals. Individualization and interactivity were named as crucial features. In Phase 2, usability testing of a prototype program provided important insights into technical barriers to intervention use. Further, participants reported that they were missing content on philosophy/theology and the role of descendants/relatives. Valuable insights from Phase 1 and Phase 2 were incorporated into the intervention program resulting in a 7-module internet-based self-help CBT intervention.

Discussion

Findings of this study highlight the significance of including relevant stakeholders in the development process of an intervention. Additionally, results emphasize the high acceptance of internet-based interventions in this population, but also underline the need for considering age-specific aspects when developing treatments.

Scoping Review of Technological Solutions for Community Dwelling Older Adults and Implications for Instrumental Activities of Daily Living

Aging in place is not without its challenges, with physical, psychological, social, and economic burdens on caregivers and seniors. To address these challenges and promote active aging, technological advancements offer a range of digital tools, applications, and devices, enabling community dwelling older adults to live independently and safely. Despite these opportunities, the acceptance of technology among the older adults remains low, often due to a mismatch between technology development and the actual needs and goals of seniors. The aim of this review is to identify recent technological solutions that monitor the health and well-being of aging adults, particularly within the context of instrumental activities of daily living (IADL). A scoping review identified 52 studies that meet specific inclusion criteria. The outcomes were classified based on social connectedness, autonomy, mental health, physical health, and safety. Our review revealed that a predominant majority (82%) of the studies were observational in design and primarily focused on health-related IADLs (59%) and communication-related IADLs (31%). Additionally, the study highlighted the crucial role of involving older adults in study design processes, with only 8 out of the 52 studies incorporating this approach. Our review also established the interview method as the most favoured technology evaluation tool for older adults' studies. The metrics of 'usability' and 'acceptance' emerged as the most frequently employed measures for technology assessment. This study contributes to the existing literature by shedding light on the implications of technological solutions for community dwelling older adults, emphasizing the types of technologies employed and their evaluation results.

Assessing Patient-Reported Outcomes in Routine Cancer Clinical Care Using Electronic Administration and Telehealth Technologies: Realist Synthesis of Potential Mechanisms for Improving Health Outcomes

BACKGROUND

The routine measurement of patient-reported outcomes in cancer clinical care using electronic patient-reported outcome measures (ePROMs) is gaining momentum worldwide. However, a deep understanding of the mechanisms underpinning ePROM interventions that could inform their optimal design to improve health outcomes is needed.

OBJECTIVE

This study aims to identify the implicit mechanisms that underpin the effectiveness of ePROM interventions and develop program theories about how and when ePROM interventions improve health outcomes.

METHODS

A realist synthesis of the literature about ePROM interventions in cancer clinical care was performed. A conceptual framework of ePROM interventions was constructed to define the scope of the review and frame the initial program theories. Literature searches of Ovid MEDLINE, Ovid Embase, Scopus, and CINAHL, supplemented by citation tracking, were performed to identify relevant literature to develop, refine, and test program theories. Quality appraisal of relevant studies was performed using the Mixed Methods Appraisal Tool.

RESULTS

Overall, 61 studies were included in the realist synthesis: 15 (25%) mixed methods studies, 9 (15%) qualitative studies, 13 (21%) descriptive studies, 21 (34%) randomized controlled trials, and 3 (5%) quasi-experimental studies. In total, 3 initial program theories were developed regarding the salient components of ePROM interventions-remote self-reporting, real-time feedback to clinicians, and clinician-patient telecommunication. The refined theories posit that remote self-reporting enables patients to recognize and report symptoms accurately and empowers them to communicate these to clinicians, real-time feedback prompts clinicians to manage symptoms proactively, and clinician-patient telephone interactions and e-interactions between clinic encounters improve symptom management by reshaping how clinicians and patients communicate. However, the intervention may not achieve the intended benefit if ePROMs become a reminder to patients of their illness and are not meaningful to them and when real-time feedback to clinicians lacks relevance and increases the workload.

CONCLUSIONS

The key to improving health outcomes through ePROM interventions is enabling better symptom reporting and communication through remote symptom self-reporting, promoting proactive management of symptoms through real-time clinician feedback, and facilitating clinician-patient interactions. Patient engagement with self-reporting and clinician engagement in responding to feedback are vital and may reinforce each other in improving outcomes. Effective ePROM interventions might fundamentally alter how clinicians and patients interact between clinic encounters.

Midwives' perspectives about using individualized care plans in the provision of immediate postpartum care in Uganda; an exploratory qualitative study

INTRODUCTION

Individualized care planning has been slowly integrated into practice in Uganda with minimal documentation of how the concept is applied in providing care. This study explored the perceptions of midwives about the use of individualized care plans (ICPs) in the provision of immediate postpartum care.

METHODS

An exploratory descriptive qualitative approach was used in this study. We interviewed fifty midwives from 37 health facilities in Uganda's greater Mpigi region. The midwives, who were certificate and diploma holders, were purposively enrolled in the selected facilities. Deductive content analysis was done based on the COM-B model.

RESULTS

Four themes emerged from the data namely; compatibility, motivation, opportunities, and the midwives' suggested strategies and targets for improved individualized care planning. The midwives were aware of individualized care planning and they utilized it in their provision of immediate postpartum care especially when assessing clients for risks, preparing clients for referral, caring for Human Immunodeficiency virus (HIV) exposed babies and their mothers, and educating/ supporting first-time mothers (automatic motivation). Having a good nurse-patient relationship, privacy, and ample time to care for the clients were noted as motivators for individualized care plan use, while poor documentation of care, high patient load, and perceived patients' lack of understanding of the complexities of illness in the immediate postpartum period were the barriers (social opportunity) identified by midwives to the use of individualized care planning.

CONCLUSION

There are still capability, motivation, and opportunity hindrances to the use of individualized care planning. Staff recruitment, training, and harmonization of the documentation forms may improve the use of care plans in the postpartum period.

Selective Prevention of Depression in Workers Using a Smartphone App: Randomized Controlled Trial

BACKGROUND

There is increasing evidence that depression can be prevented; however, universal approaches have had limited success. Appropriate targeting of interventions to at-risk populations has been shown to have potential, but how to selectively determine at-risk individuals remains unclear. Workplace stress is a risk factor for depression and a target for intervention, but few interventions exist to prevent depression among workers at risk due to heightened stress.

OBJECTIVE

This trial aimed to evaluate the efficacy of a smartphone-based intervention in reducing the onset of depression and improving related outcomes in workers experiencing at least moderate levels of stress.

METHODS

A randomized controlled trial was conducted with participants who were currently employed and reported no clinically significant depression and at least moderate stress. The intervention group (n=1053) were assigned Anchored, a 30-day self-directed smartphone app-based cognitive behavioral- and mindfulness-based intervention. The attention-control group (n=1031) were assigned a psychoeducation website. Assessment was performed via web-based self-report questionnaires at baseline and at 1-, 3-, and 6-month postbaseline time points. The primary outcome was new depression caseness aggregated over the follow-up period. The secondary outcomes included depressive and anxiety symptoms, stress, well-being, resilience, work performance, work-related burnout, and quality of life. Analyses were conducted within an intention-to-treat framework using mixed modeling.

RESULTS

There was no significant between-group difference in new depression caseness (z score=0.69; P=.49); however, those in the Anchored arm had significantly greater depressive symptom reduction at 1 month (Cohen d=0.02; P=.049) and 6 months (Cohen d=0.08; P=.03). Anchored participants also showed significantly greater reduction in anxiety symptoms at 1 month (Cohen d=0.07; P=.04) and increased work performance at 1 month (Cohen d=0.07; P=.008) and 6 months (Cohen d=0.13; P=.01), compared with controls. Notably, for Anchored participants completing at least two-thirds of the intervention, there was a significantly lower rate of depression onset (1.1%, 95% CI 0.0%-3.7%) compared with controls (9.0%, 95% CI 6.8%-12.3%) at 1 month (z score=4.50; P<.001). Significant small to medium effect sizes for most secondary outcomes were seen in the highly engaged Anchored users compared with controls, with effects maintained at the 6-month follow-up for depressive symptoms, well-being, stress, and quality of life.

CONCLUSIONS

Anchored was associated with a small comparative reduction in depressive symptoms compared with controls, although selective prevention of case-level depression was not observed in the intention-to-treat analysis. When users adequately engaged with the app, significant findings pertaining to depression prevention, overall symptom reduction, and functional improvement were found, compared with controls. There is a need for a greater focus on engagement techniques in future research.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry (ANZCTR) ACTRN12620000178943; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=378592.

Design and Early Use of the Nationally Implemented Healthier You National Health Service Digital Diabetes Prevention Programme: Mixed Methods Study

BACKGROUND

The Healthier You National Health Service Digital Diabetes Prevention Programme (NHS-digital-DPP) is a 9-month digital behavior change intervention delivered by 4 independent providers that is implemented nationally across England. No studies have explored the design features included by service providers of digital diabetes prevention programs to promote engagement, and little is known about how participants of nationally implemented digital diabetes prevention programs such as this one make use of them.

OBJECTIVE

This study aimed to understand engagement with the NHS-digital-DPP. The specific objectives were to describe how engagement with the NHS-digital-DPP is promoted via design features and strategies and describe participants' early engagement with the NHS-digital-DPP apps.

METHODS

Mixed methods were used. The qualitative study was a secondary analysis of documents detailing the NHS-digital-DPP intervention design and interviews with program developers (n=6). Data were deductively coded according to an established framework of engagement with digital health interventions. For the quantitative study, anonymous use data collected over 9 months for each provider representing participants' first 30 days of use of the apps were obtained for participants enrolled in the NHS-digital-DPP. Use data fields were categorized into 4 intervention features (Track, Learn, Coach Interactions, and Peer Support). The amount of engagement with the intervention features was calculated for the entire cohort, and the differences between providers were explored statistically.

RESULTS

Data were available for 12,857 participants who enrolled in the NHS-digital-DPP during the data collection phase. Overall, 94.37% (12,133/12,857) of those enrolled engaged with the apps in the first 30 days. The median (IQR) number of days of use was 11 (2-25). Track features were engaged with the most (number of tracking events: median 46, IQR 3-22), and Peer Support features were the least engaged with, a median value of 0 (IQR 0-0). Differences in engagement with features were observed across providers. Qualitative findings offer explanations for the variations, including suggesting the importance of health coaches, reminders, and regular content updates to facilitate early engagement.

CONCLUSIONS

Almost all participants in the NHS-digital-DPP started using the apps. Differences across providers identified by the mixed methods analysis provide the opportunity to identify features that are important for engagement with digital health interventions and could inform the design of other digital behavior change interventions.

Asynchronous Technologies in Mental Health Care and Education

Purpose of review

Patients, providers, and trainees should understand the current types of asynchronous technologies that can be used to enhance the delivery and accessibility of mental health care. Asynchronous telepsychiatry (ATP) removes the need for real time communication between the clinician and patient, which improves efficiency and enables quality specialty care. ATP can be applied as distinct consultative and supervisory models in clinician-to-clinician, clinician-to-patient, and patient-to-mobile health settings.

Recent findings

This review is based on research literature and the authors' clinical and medical training, using experiences with asynchronous telepsychiatry from before, during, and after the COVID-19 pandemic. Our studies demonstrate that ATP provides positive outcomes in the clinician-to-patient model with demonstrated feasibility, outcomes and patient satisfaction. One author's medical education experience in the Philippines during COVID-19 highlights the potential to utilize asynchronous technology in areas with limitations to online learning. We emphasize the need to teach media skills literacy around mental health to students, coaches, therapists, and clinicians when advocating for mental well-being. Several studies have demonstrated the feasibility of incorporating asynchronous e-tools such as self-guided multimedia and artificial intelligence for data collection at the clinician-to-clinician and patient-to-mobile health level. In addition, we offer fresh perspectives on recent trends in asynchronous telehealth in wellness, applying concepts such as "tele-exercise" and "tele-yoga."

Summary

Asynchronous technologies continue to be integrated into mental health care services and research. Future research must ensure that the design and the usability of this technology puts the patient and provider first.

Navigating severe chronic cancer-related fatigue: an interpretative phenomenological analysis

OBJECTIVE

This article presents a phenomenological study on the embodied experiences of patients with Chronic Cancer-Related Fatigue (CCRF), aiming to better understand this complex phenomenon.

DESIGN

Data collection consisted of individual interviews with 25 participants who suffered from severe CCRF for at least three months after cancer treatment was finished.

MAIN OUTCOME MEASURES

Against the theoretical background of philosophical phenomenology, we explored embodied experiences, incorporated temporal and spatial aspects of living with CCRF. We applied interpretative phenomenological analysis (IPA) to analyze the transcripts of the interviews.

RESULTS

Using IPA, we identified four themes on how chronic fatigue is experienced post-cancer: (1) Worn out; (2) Diminishment of one's 'I can'; (3) Invisibility; and (4) Regaining one's 'I can'.

CONCLUSION

For clinical practice, these results imply that professionals could focus more on the role of the body and limitations of one's 'I can' when treating CCRF. By studying these embodied CCRF experiences in individual patients, future research could help personalize and optimize treatment.

Examining a Resilience Mental Health App in Adolescents: Acceptability and Feasibility Study

BACKGROUND

Resilience is defined as the ability to rely on internal characteristics and external strengths to adapt to adverse events. Although universal resilience-enhancing programs are effective for adolescents, there is a need for interventions that are more easily accessible and can be customized for individual teens. Phone apps are easy to use, can be tailored to individuals, and have demonstrated positive effects for mental health outcomes.

OBJECTIVE

This study aimed to examine the feasibility and acceptability of a resilience app for adolescents. This app aimed to enhance resilience through modules focused on depression prevention, stress management, and healthy lifestyle approaches containing videos, measures, and practice suggestions. Furthermore, the study aimed to evaluate the effect of short-term app use on changes in resilience.

METHODS

In study 1, individual interviews and focus groups were conducted with adolescents, parents, teachers, and clinicians to discuss possible incentives for using a mental health app, the benefits of app use, and concerns associated with app use. Feedback from study 1 led to ideas for the prototype. In study 2, individual interviews and focus groups were conducted with adolescents, parents, teachers, and clinicians to gather feedback about the resilience app prototype. Feedback from study 2 led to changes in the prototype, although not all suggestions could be implemented. In study 3, 40 adolescents used the app for 30 days to determine feasibility and acceptability. Additionally, resilience and secondary mental health outcomes were measured before and after app use. Dependent samples 2-tailed t tests were conducted to determine whether there were changes in resilience and secondary mental health outcomes among the adolescents before and after app use.

RESULTS

Multiple themes were identified through study 1 individual interviews and focus groups, including app content, features, engagement, benefits, concerns, and improvement. Specifically, the adolescents provided helpful suggestions for making the prototype more appealing and functional for teen users. Study 2 adolescents and adults reported that the prototype was feasible and acceptable through the Computer System Usability Questionnaire (mean 6.30, SD 1.03) and Mobile App Rating Scale (mean 4.08, SD 0.61). In study 2, there were no significant differences in resilience and mental health outcomes after using the app for 30 days. There was variation between the participants in the extent to which they used the app, which may have led to variation in the results. The users appeared to prefer the depression module and survey sections, which provided mental health feedback.

CONCLUSIONS

Qualitative and quantitative data provide evidence that youth are interested in a resilience mental health app and that the current prototype is feasible. Although there were no significant mental health changes in study 3 users, practical implications and future directions are discussed for mental health app research.

Perceptions of a self-guided web-based exercise programme for shoulder pain after spinal cord injury: A qualitative study

STUDY DESIGN

Qualitative study.

OBJECTIVES

The benefits of exercise to reduce shoulder pain in people with spinal cord injury (SCI) are well documented. Digital health interventions offer a potential solution to overcome barriers to access rehabilitation support for exercise. The aim of this project was to gain people's perspectives to inform the development of a self-guided web-based exercise intervention. Shoulder Pain Intervention delivered over the interNet (SPIN) is a self-guided web-based intervention to prescribe, monitor, and progress evidence-based exercises for people living with SCI and shoulder pain.

SETTING

Community in Auckland, New Zealand.

METHODS

The Person-Based Approach was used as the framework. Using an Interpretive Descriptive methodology, data were collected in individual and focus group interviews, exploring participants' perceptions of this intervention idea. Data were analysed using conventional content analysis.

RESULTS

Sixteen participants took part and asked Is it right for me?. This had three main sub-themes. Should I use it?, whether I believe it will work for me right now; Can I use it?, whether I can operate the intervention competently and confidently and Will I use it?, whether it will be responsive to my unique needs, and keep me coming back.

CONCLUSIONS

Participants expressed their expectations and tipping points when considering using an intervention like this. These findings will inform and guide design and development of an acceptable technology-based intervention to increase the likelihood of engagement with a self-guided web-based exercise programme. The model developed from these themes could be used to inform future self-guided intervention development.

A Digital Lifestyle Coach (E-Supporter 1.0) to Support People With Type 2 Diabetes: Participatory Development Study

BACKGROUND

A healthy lifestyle, including regular physical activity and a healthy diet, is becoming increasingly important in the treatment of chronic diseases. eHealth interventions that incorporate behavior change techniques (BCTs) and dynamic tailoring strategies could effectively support a healthy lifestyle. E-Supporter 1.0 is an eCoach designed to support physical activity and a healthy diet in people with type 2 diabetes (T2D).

OBJECTIVE

This paper aimed to describe the systematic development of E-Supporter 1.0.

METHODS

Our systematic design process consisted of 3 phases. The definition phase included the selection of the target group and formulation of intervention objectives, and the identification of behavioral determinants based on which BCTs were selected to apply in the intervention. In the development phase, intervention content was developed by specifying tailoring variables, intervention options, and decision rules. In the last phase, E-Supporter 1.0 integrated in the Diameter app was evaluated using a usability test in 9 people with T2D to assess intervention usage and acceptability.

RESULTS

The main intervention objectives were to stimulate light to moderate-vigorous physical activities or adherence to the Dutch dietary guidelines in people with T2D. The selection of behavioral determinants was informed by the health action process approach and theories explaining behavior maintenance. BCTs were included to address relevant behavioral determinants (eg, action control, self-efficacy, and coping planning). Development of the intervention resulted in 3 types of intervention options, consisting of motivational messages, behavioral feedback, and tailor-made supportive exercises. On the basis of IF-THEN rules, intervention options could be tailored to, among others, type of behavioral goal and (barriers to) goal achievement. Data on these variables could be collected using app data, activity tracker data, and daily ecological momentary assessments. Usability testing revealed that user experiences were predominantly positive, despite some problems in the fixed delivery of content.

CONCLUSIONS

The systematic development approach resulted in a theory-based and dynamically tailored eCoach. Future work should focus on expanding intervention content to other chronic diseases and lifestyle behaviors, enhancing the degree of tailoring and evaluating intervention effects on acceptability, use, and cost-effectiveness.

Clinical and cost-effectiveness of telehealth for Indigenous and culturally and linguistically diverse (CALD) people: a scoping review

OBJECTIVES

To examine the modalities and clinical and non-clinical effectiveness of telehealth services available to people from Indigenous and culturally and linguistically diverse backgrounds (CALD).

MATERIALS AND METHODS

A scoping review of peer-reviewed publications (2000-2021) on the effectiveness of telehealth interventions for Indigenous and CALD groups based on searches of Medline, CINAHL, and PsycInfo and manual searches from reference lists of captured literature reviews.

RESULTS

Of the initial 601 articles, 10 met the inclusion criteria (seven of clinical effectiveness and three of non-clinical effectiveness), with participants from the USA, Australia, New Zealand, and Canada, with sample sizes ranging from 19 to 1,665 participants (overall 327 Indigenous and 2,030 CALD patients). Telehealth was delivered via telephone or by videoconference-with or without data uploads-and follow-up ranging from 6 months to 5 years.

DISCUSSION

The findings suggest that telehealth shows some promise in: diabetes, depression, neuro/cognitive assessment, and health program adherence/service utilisation/cost. However, our confidence in the accuracy of the results is undermined by the mixed quality of designs and outcome measurements, and the high risk of bias derived from not proper random selections and small sample sizes.

CONCLUSIONS

The available literature suggests acceptable clinical and non-clinical effectiveness of telehealth against usual care in Indigenous and/or CALD groups but methodological limitations diminish their value in informing practice. Therefore, we consider it is premature to use the findings of these primary studies to draw conclusive recommendations about clinical or other effectiveness of telehealth for the two target groups. Further randomised trials with adequate sampling frames and objective outcome assessments are warranted.

Digital health interventions to improve eating behaviour of people with a lower socioeconomic position: a scoping review of behaviour change techniques

Specific approaches are needed to reach and support people with a lower socioeconomic position (SEP) to achieve healthier eating behaviours. There is a growing body of evidence suggesting that digital health tools exhibit potential to address these needs because of its specific features that enable application of various behaviour change techniques (BCTs). The aim of this scoping review is to identify the BCTs that are used in diet-related digital interventions targeted at people with a low SEP, and which of these BCTs coincide with improved eating behaviour. The systematic search was performed in 3 databases, using terms related to e/m-health, diet quality and socioeconomic position. A total of 17 full text papers were included. The average number of BCTs per intervention was 6.9 (ranged 3-15). BCTs from the cluster 'Goals and planning' were applied most often (25x), followed by the clusters 'Shaping knowledge' (18x) and 'Natural consequences' (18x). Other frequently applied BCT clusters were 'Feedback and monitoring' (15x) and 'Comparison of behaviour' (13x). Whereas some BCTs were frequently applied, such as goal setting, others were rarely used, such as social support. Most studies (n = 13) observed a positive effect of the intervention on eating behaviour (e.g. having breakfast) in the low SEP group, but this was not clearly associated with the number or type of applied BCTs. In conclusion, more intervention studies focused on people with a low SEP are needed to draw firm conclusions as to which BCTs are effective in improving their diet quality. Also, further research should investigate combinations of BCTs, the intervention design and context, and the use of multicomponent approaches. We encourage intervention developers and researchers to describe interventions more thoroughly, following the systematics of a behaviour change taxonomy, and to select BCTs knowingly.

The Effectiveness of Self-Guided Digital Interventions to Improve Physical Activity and Exercise Outcomes for People With Chronic Conditions: A Systematic Review and Meta-Analysis

Objective

The aim of this systematic review was to determine the effectiveness of self-guided digital physical activity (PA) and exercise interventions to improve physical activity and exercise (PA&E) outcomes for people living with chronic health conditions. Digital health interventions, especially those with minimal human contact, may offer a sustainable solution to accessing ongoing services and support for this population.

Methods

A comprehensive and systematic search was conducted up to December 2021, through seven databases, for randomized trials that evaluated the effect of self-guided web- or internet-based PA interventions on physical activity or exercise outcomes. Included studies had to have interventions with minimal human contact and interaction with participants needed to be automatically generated. All studies were screened for eligibility and relevant data were extracted. Two independent reviewers assessed the risk of bias using the Cochrane risk of bias tool. Standardized mean differences and 95% confidence intervals (CI) were calculated. PA data were pooled, and forest plots were generated.

Results

Sixteen studies met the eligibility criteria and included a total of 2,439 participants. There was wide variation in health conditions and intervention characteristics in mode and parameters of delivery, and in the application of theory and behavioral strategies. Self-reported PA in the intervention group was greater than controls at the end of the intervention [standardized mean difference (SMD) 0.2, 95% CI = 0.1, 0.3] and at follow up (SMD 0.3, 95% CI 0.2-0.5). The difference in objectively measured PA was small and non-significant (SMD 0.3, 95% CI -0.2 to 0.9). All interventions included behavioral strategies and ten of the sixteen were underpinned by theory.

Conclusions

Self-guided digital PA&E interventions provided a positive effect on PA immediately after the intervention. An unexpected and positive finding was a sustained increase in PA at follow-up, particularly for interventions where the behavioral strategies were underpinned by a theoretical framework. Interventions with minimal contact have the potential to support sustained PA engagement at least as well as interventions with supervision.

Systematic Review Registration

https://www.crd.york.ac.uk/prospero/, identifier: CRD42019132464.

Combining Persuasive System Design Principles and Behavior Change Techniques in Digital Interventions Supporting Long-term Weight Loss Maintenance: Design and Development of eCHANGE

BACKGROUND

Long-term weight maintenance after weight loss is challenging, and innovative solutions are required. Digital technologies can support behavior change and, therefore, have the potential to be an effective tool for weight loss maintenance. However, to create meaningful and effective digital behavior change interventions that support end user values and needs, a combination of persuasive system design (PSD) principles and behavior change techniques (BCTs) might be needed.

OBJECTIVE

This study aimed to investigate how an evidence-informed digital behavior change intervention can be designed and developed by combining PSD principles and BCTs into design features to support end user values and needs for long-term weight loss maintenance.

METHODS

This study presents a concept for how PSD principles and BCTs can be translated into design features by combining design thinking and Agile methods to develop and deliver an evidence-informed digital behavior change intervention aimed at supporting weight maintenance. Overall, 45 stakeholders participated in the systematic and iterative development process comprising co-design workshops, prototyping, Agile development, and usability testing. This included prospective end users (n=17, 38%; ie, people with obesity who had lost ≥8% of their weight), health care providers (n=9, 20%), healthy volunteers (n=4, 9%), a service designer (n=1, 2%), and stakeholders from the multidisciplinary research and development team (n=14, 31%; ie, software developers; digital designers; and eHealth, behavior change, and obesity experts). Stakeholder input on how to operationalize the design features and optimize the technology was examined through formative evaluation and qualitative analyses using rapid and in-depth analysis approaches.

RESULTS

A total of 17 design features combining PSD principles and BCTs were identified as important to support end user values and needs based on stakeholder input during the design and development of eCHANGE, a digital intervention to support long-term weight loss maintenance. The design features were combined into 4 main intervention components: Week Plan, My Overview, Knowledge and Skills, and Virtual Coach and Smart Feedback System. To support a healthy lifestyle and continued behavior change to maintain weight, PSD principles such as tailoring, personalization, self-monitoring, reminders, rewards, rehearsal, praise, and suggestions were combined and implemented into the design features together with BCTs from the clusters of goals and planning, feedback and monitoring, social support, repetition and substitution, shaping knowledge, natural consequences, associations, antecedents, identity, and self-belief.

CONCLUSIONS

Combining and implementing PSD principles and BCTs in digital interventions aimed at supporting sustainable behavior change may contribute to the design of engaging and motivating interventions in line with end user values and needs. As such, the design and development of the eCHANGE intervention can provide valuable input for future design and tailoring of evidence-informed digital interventions, even beyond digital interventions in support of health behavior change and long-term weight loss maintenance.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04537988; https://clinicaltrials.gov/ct2/show/NCT04537988.

A randomised, controlled trial of clinically implementing online hearing support

Objective: The research-oriented objective of this study was to document the effectiveness of online support for hearing aid (HA) users compared with traditional support.Design: This study is a randomised controlled trial with parallel group design. The research-oriented objectives were evaluated using the Hearing Handicap Inventory for the Elderly (HHIE) and the Communication Strategies Scale (CSS) at baseline and immediately postintervention.Study sample: Selected clients at five different clinics were randomised to an intervention group (n = 78) that took part in online hearing support and a control group (n = 58) that received standard care.Results: The analyses (intention-to-treat) showed statistically significant improvements in the HHIE-total and Emotional subscale scores for the intervention group compared with the control group. The intervention group also showed significantly greater improvement in the CSS-total and Verbal and Nonverbal subscale scores. A subgroup analysis was performed including two groups: HA use <1 year and HA use >1 year. A statistically significant improvement was found for the HA users >1 year compared with HA use <1 year.Conclusions: It is effective to clinically include online hearing support for HA users when addressing self-perceived hearing difficulties and to sharpen communication strategy skills.

Personas for Better Targeted eHealth Technologies: User-Centered Design Approach

Background

The full potential of eHealth technologies to support self-management and disease management for patients with chronic diseases is not being reached. A possible explanation for these lacking results is that during the development process, insufficient attention is paid to the needs, wishes, and context of the prospective end users. To overcome such issues, the user-centered design practice of creating personas is widely accepted to ensure the fit between a technology and the target group or end users throughout all phases of development.

Objective

In this study, we integrate several approaches to persona development into the Persona Approach Twente to attain a more holistic and structured approach that aligns with the iterative process of eHealth development.

Methods

In 3 steps, a secondary analysis was carried out on different parts of the data set using the Partitioning Around Medoids clustering method. First, we used health-related electronic patient record data only. Second, we added person-related data that were gathered through interviews and questionnaires. Third, we added log data.

Results

In the first step, 2 clusters were found, with average silhouette widths of 0.12 and 0.27. In the second step, again 2 clusters were found, with average silhouette widths of 0.08 and 0.12. In the third step, 3 clusters were identified, with average silhouette widths of 0.09, 0.12, and 0.04.

Conclusions

The Persona Approach Twente is applicable for mixed types of data and allows alignment of this user-centered design method to the iterative approach of eHealth development. A variety of characteristics can be used that stretches beyond (standardized) medical and demographic measurements. Challenges lie in data quality and fitness for (quantitative) clustering.

Are Organizational EHealth Interventions Becoming More Effective at Addressing Employee Mental Health; A Systematic Review and Meta-Analysis (Preprint)

Background

Mental health conditions are considered the leading cause of disability, sickness absence, and long-term work incapacity. eHealth interventions provide employees with access to psychological assistance. There has been widespread implementation and provision of eHealth interventions in the workplace as an inexpensive and anonymous way of addressing common mental disorders.

Objective

This updated review aimed to synthesize the literature on the efficacy of eHealth interventions for anxiety, depression, and stress outcomes in employee samples in organizational settings and evaluate whether their effectiveness has improved over time.

Methods

Systematic searches of relevant articles published from 2004 to July 2020 of eHealth intervention trials (app- or web-based) focusing on the mental health of employees were conducted. The quality and bias of all studies were assessed. We extracted means and SDs from publications by comparing the differences in effect sizes (Hedge g) in standardized mental health outcomes. We meta-analyzed these data using a random-effects model.

Results

We identified a tripling of the body of evidence, with 75 trials available for meta-analysis from a combined sample of 14,747 articles. eHealth interventions showed small positive effects for anxiety (Hedges g=0.26, 95% CI 0.13-0.39; P<.001), depression (Hedges g=0.26, 95% CI 0.19-0.34; P<.001), and stress (Hedges g=0.25, 95% CI 0.17-0.34; P<.001) in employees’ after intervention, with similar effects seen at the medium-term follow-up. However, there was evidence of no increase in the effectiveness of these interventions over the past decade.

Conclusions

This review and meta-analysis confirmed that eHealth interventions have a small positive impact on reducing mental health symptoms in employees. Disappointingly, we found no evidence that, despite the advances in technology and the enormous resources in time, research, and finance devoted to this area for over a decade, better interventions are being produced. Hopefully, these small effect sizes do not represent optimum outcomes in organizational settings.

Trial Registration

PROSPERO CRD42020185859; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=185859

Improving the Safety of Medicines via Digital Technology: An Assessment of the Scope and Quality of Risk Minimization Websites in the United States and United Kingdom

INTRODUCTION

EHealth holds tremendous promise for enhancing drug safety initiatives known as risk minimization programs. Little is known, however, regarding the scope and quality of existing risk minimization websites.

METHODS

Two publicly accessible repositories, REMS@FDA [1] and Electronic Medicines Compendium [2], were reviewed to identify all regulatorily approved risk minimization programs in the United States (US) and United Kingdom (UK) with websites. Website quality was evaluated using the Enlight Quality Assessment tool, a psychometrically validated instrument that addresses seven quality domains.

RESULTS

Ninety-three websites were identified: 59 for healthcare professionals (7 UK/52 US), and 34 for patients (5 UK/29 US). The websites functioned chiefly as archives for electronic copies of educational materials; a subset (31/93) had additional features. Mean quality ratings for Usability (mean 4.70, SD 0.59), Visual Design (mean 4.03, SD 0.87) and Content (mean 4.31, SD 0.82) were good. General Subjective Evaluation was fair (mean 3.15, SD 1.21). Mean scores for Therapeutic Alliance and Therapeutic Persuasiveness were poor (mean 2.62, SD 1.47; and mean 2.50, SD 1.48, respectively); those for User Engagement were very poor (mean 2.25, SD 1.03). No differences were found by target audience but several were identified based on region.

CONCLUSIONS

Risk minimization websites are easy to navigate and well organized. Few, however, incorporate eHealth design elements that facilitate user engagement, build therapeutic alliance and exert therapeutic persuasiveness. Such elements can enhance program uptake and effectiveness. Results highlight opportunities for improving the quality of risk minimization websites and their ability to bridge pharmaceutical and healthcare systems.

E-health interventions targeting STIs, sexual risk, substance use and mental health among men who have sex with men: four systematic reviews

Background

Human immunodeficiency virus/sexually transmitted infections, sexual risk, substance (alcohol and other legal and illegal drugs) use and mental ill health constitute a ‘syndemic’ of mutually reinforcing epidemics among men who have sex with men. Electronic health (e-health) interventions addressing these epidemics among men who have sex with men might have multiplicative effects. To our knowledge, no systematic review has examined the effectiveness of such interventions on these epidemics among men who have sex with men.

Objective

The objective was to synthesise evidence addressing the following: (1) What approaches and theories of change do existing e-health interventions employ to prevent human immunodeficiency virus/sexually transmitted infections, sexual risk, alcohol/drug use or mental ill health among men who have sex with men? (2) What factors influence implementation? (3) What are the effects of such interventions on the aforementioned epidemics? (4) Are such interventions cost-effective?

Data sources

A total of 24 information sources were searched initially (October–November 2018) [the following sources were searched: ProQuest Applied Social Sciences Index and Abstracts; Campbell Library; EBSCO Cumulative Index to Nursing and Allied Health Literature Plus, Wiley Online Library The Cochrane Library; Centre for Reviews and Dissemination databases (the Database of Abstracts of Reviews of Effects and the NHS Economic Evaluation Database); the Health Technology Assessment database; Evidence for Policy and Practice Information and Co-ordinating Centre (EPPI-Centre) database of health promotion research (Bibliomap); ProQuest Dissertations & Theses Global; OvidSP EconLit; OvidSP EMBASE; OvidSP Global Health; OvidSP Health Management Information Consortium; ProQuest International Bibliography of the Social Sciences; Ovid MEDLINE ALL; OvidSP PsycINFO; Web of Science Science Citation Index Expanded; Elsevier Scopus; OvidSP Social Policy & Practice; Web of Science Social Sciences Citation Index Expanded; ProQuest Sociological Abstracts; ClinicalTrials.gov; World Health Organization International Clinical Trials Registry Platform; EPPI-Centre Trials Register of Promoting Health Interventions; and the OpenGrey database], and an updated search of 19 of these was conducted in April 2020. Reference lists of included reports were searched and experts were contacted.

Review methods

Eligible reports presented theories of change and/or process, outcome and/or economic evaluations of e-health interventions offering ongoing support to men who have sex with men to prevent human immunodeficiency virus/sexually transmitted infections, sexual risk behaviour, alcohol/drug use and/or common mental illnesses. References were screened by title/abstract, then by full text. Data extraction and quality assessments used existing tools. Theory and process reports were synthesised using qualitative methods. Outcome and economic data were synthesised narratively; outcome data were meta-analysed.

Results

Original searches retrieved 27 eligible reports. Updated searches retrieved 10 eligible reports. Thirty-seven reports on 28 studies of 23 interventions were included: 33 on theories of change, 12 on process evaluations, 16 on outcome evaluations and one on an economic evaluation. Research question 1: five intervention types were identified – ‘online modular’, ‘computer games’ and ‘non-interactive’ time-limited/modular interventions, and open-ended interventions with ‘content organised by assessment’ and ‘general content’. Three broad types of intervention theories of change were identified, focusing on ‘cognitive/skills’, ‘self-monitoring’ and ‘cognitive therapy’. Research question 2: individual tailoring based on participant characteristics was particularly acceptable, and participants valued intervention content reflecting their experiences. Research question 3: little evidence was available of effects on human immunodeficiency virus or sexually transmitted infections. The analysis did not suggest that interventions were effective in reducing instances of human immunodeficiency virus or sexually transmitted infections. The overall meta-analysis for sexually transmitted infections reported a small non-significant increase in sexually transmitted infections in the intervention group, compared with the control group. Meta-analyses found a significant impact on sexual risk behaviour. The findings for drug use could not be meta-analysed because of study heterogeneity. Studies addressing this outcome did not present consistent evidence of effectiveness. Trials did not report effects on alcohol use or mental health. Research question 4: evidence on cost-effectiveness was limited.

Limitations

The quality of the eligible reports was variable and the economic synthesis was limited to one eligible study.

Conclusions

There is commonality in intervention theories of change and factors affecting receipt of e-health interventions. Evidence on effectiveness is limited.

Future work

Future trials should assess the impact of interventions on multiple syndemic factors, among them sexual risk, substance use and mental health; incorporate sufficient follow-up and sample sizes to detect the impact on human immunodeficiency virus/sexually transmitted infections; and incorporate rigorous process and economic evaluations.

Study registration

This study is registered as PROSPERO CRD42018110317.

Funding

This project was funded by the National Institute for Health Research (NIHR) Public Health Research programme and will be published in full in Public Health Research; Vol. 10, No. 4. See the NIHR Journals Library website for further project information.

Chatbot-Delivered Psychotherapy for Adults With Depressive and Anxiety Symptoms: A Systematic Review and Meta-Regression

Although psychotherapy is a well-established treatment for depression and anxiety, chatbot-delivered psychotherapy is an emerging field that has yet to be explored in depth. This review aims to (a) examine the effectiveness of chatbot-delivered psychotherapy in improving depressive symptoms among adults with depression or anxiety, and (b) evaluate the preferred features for the design of chatbot-delivered psychotherapy. Eight electronic databases were searched for relevant randomized controlled trials. Meta-analysis and random effects meta-regression was conducted using Comprehensive Meta-Analysis 3.0 software. Overall effect was measured using Hedges's g and determined using z statistics at significance level p < .05. Assessment of heterogeneity was done using χ² and I² tests. A meta-analysis of 11 trials revealed that chatbot-delivered psychotherapy significantly improved depressive symptoms (g = 0.54, 95% confidence interval [-0.66, -0.42], p < .001). Although no significant subgroup differences were detected, results revealed larger effect sizes for samples of clinically diagnosed anxiety or depression, chatbots with an embodiment, a combination of types of input and output formats, less than 10 sessions, problem-solving therapy, off-line platforms, and in different regions of the United States than their counterparts. Meta-regression did not identify significant covariates that had an impact on depressive symptoms. Chatbot-delivered psychotherapy can be adopted in health care institutions as an alternative treatment for depression and anxiety. More high-quality trials are warranted to confirm the effectiveness of chatbot-delivered psychotherapy on depressive symptoms. PROSPERO registration number: CRD42020153332.

Development of a Web-Based, Guided Self-help, Acceptance and Commitment Therapy-Based Intervention for Weight Loss Maintenance: Evidence-, Theory-, and Person-Based Approach

Background

The long-term impact and cost-effectiveness of weight management programs depend on posttreatment weight maintenance. There is growing evidence that interventions based on third-wave cognitive behavioral therapy, particularly acceptance and commitment therapy (ACT), could improve long-term weight management; however, these interventions are typically delivered face-to-face by psychologists, which limits the scalability of these types of intervention.

Objective

The aim of this study is to use an evidence-, theory-, and person-based approach to develop an ACT-based intervention for weight loss maintenance that uses digital technology and nonspecialist guidance to minimize the resources needed for delivery at scale.

Methods

Intervention development was guided by the Medical Research Council framework for the development of complex interventions in health care, Intervention Mapping Protocol, and a person-based approach for enhancing the acceptability and feasibility of interventions. Work was conducted in two phases: phase 1 consisted of collating and analyzing existing and new primary evidence and phase 2 consisted of theoretical modeling and intervention development. Phase 1 included a synthesis of existing evidence on weight loss maintenance from previous research, a systematic review and network meta-analysis of third-wave cognitive behavioral therapy interventions for weight management, a qualitative interview study of experiences of weight loss maintenance, and the modeling of a justifiable cost for a weight loss maintenance program. Phase 2 included the iterative development of guiding principles, a logic model, and the intervention design and content. Target user and stakeholder panels were established to inform each phase of development, and user testing of successive iterations of the prototype intervention was conducted.

Results

This process resulted in a guided self-help ACT-based intervention called SWiM (Supporting Weight Management). SWiM is a 4-month program consisting of weekly web-based sessions for 13 consecutive weeks followed by a 4-week break for participants to reflect and practice their new skills and a final session at week 18. Each session consists of psychoeducational content, reflective exercises, and behavioral experiments. SWiM includes specific sessions on key determinants of weight loss maintenance, including developing skills to manage high-risk situations for lapses, creating new helpful habits, breaking old unhelpful habits, and learning to manage interpersonal relationships and their impact on weight management. A trained, nonspecialist coach provides guidance for the participants through the program with 4 scheduled 30-minute telephone calls and 3 further optional calls.

Conclusions

This comprehensive approach facilitated the development of an intervention that is based on scientific theory and evidence for supporting people with weight loss maintenance and is grounded in the experiences of the target users and the context in which it is intended to be delivered. The intervention will be refined based on the findings of a planned pilot randomized controlled trial.

Mindfulness and skills-based eHealth intervention to reduce distress in cancer-affected patients in the Reduct trial: Intervention protocol of the make it training optimized

INTRODUCTION

Cancer-affected patients experience high distress due to various burdens. One way to expand psycho-oncological support is through digital interventions. This protocol describes the development and structure of a web-based psycho-oncological intervention, the Make It Training optimized. This intervention is currently evaluated in the Reduct trial, a multicenter randomized controlled trial.

METHODS

The Make It Training optimized was developed in six steps: A patient need and demand assessment, development and acceptability analysis of a prototype, the formation of a patient advisory council, the revision of the training, implementation into a web app, and the development of a motivation and evaluation plan.

RESULTS

Through a process of establishing cancer-affected patients' needs, prototype testing, and patient involvement, the Make It Training optimized was developed by a multidisciplinary team and implemented in a web app. It consists of 16 interactive self-guided modules which can be completed within 16 weeks.

DISCUSSION

Intervention protocols can increase transparency and increase the likelihood of developing effective web-based interventions. This protocol describes the process and results of developing a patient-oriented intervention. Future research should focus on the further personalization of web-based psycho-oncological interventions and the potential benefits of combining multiple psychotherapeutic approaches.

A Research Protocol for Implementation and Evaluation of a Patient-Focused eHealth Intervention for Chronic Kidney Disease

Self-management in chronic kidney disease (CKD) can slow disease progression; however, there are few tools available to support patients with early CKD. My Kidneys My Health is a patient-focused electronic health (eHealth) self-management tool developed by patients and caregivers. This study will investigate the implementation of My Kidneys My Health across primary care and general nephrology clinics. The study aims to: (1) identify and address barriers and facilitators that may impact implementation and sustainability of the website into routine clinical care; (2) evaluate implementation quality to inform spread and scale-up. We will conduct a multi-stage approach using qualitative methods, guided by the Quality Implementation Framework and using a qualitative content analysis approach. First, we will identify perceived barriers and facilitators to implementation and considerations for sustainability through interviews with clinicians, based on the Readiness Thinking Tool and the Long Term Success Tool. Analysis will be guided by the Consolidated Framework for Implementation Research and the Theoretical Domains Framework. Appropriate implementation strategies will be identified using the Expert Recommendations for Implementing Change compilation, and implementation plans will be developed based on Proctor's recommendations and the Action, Actor, Context, Target, Time framework. Finally, we will explore implementation quality guided by the RE-AIM framework. There is limited literature describing systematic approaches to implementing and sustaining patient-focused self-management tools into clinical care, in addition to employing tailored implementation strategies to promote adoption and sustainability. We aim to generate insights on how My Kidneys My Health can be integrated into clinical care and how to sustain use of patient-centric eHealth tools in clinical settings on a larger scale.

Supplementary Information

The online version contains supplementary material available at 10.1007/s43477-022-00038-3.

Online self-exclusion from multiple gambling venues: Stakeholder co-design of a usable and acceptable self-directed website

Gambling self-exclusion programs are under-utilised and barriers to entry include shame and embarrassment with face-to-face registration, and complex and effortful procedures. The current study aimed to facilitate self-exclusion from gambling venues via an online self-directed website. A co-design approach was used to elicit key stakeholders' perspectives on required website features, functionality, and to identify variables potentially impacting on development and implementation. Semi-structured focus groups and interviews were conducted across four stakeholders (N = 25): self-exclusion end users (consumers, n = 5), gambling counsellors (n = 7), venue staff (n = 6), and policy makers (n = 7). Overall, stakeholder perspectives were consistent with content analysis indicating the importance of website user-friendliness, flexibility, supportiveness, and trustworthiness. Importantly, these attributes were linked to target end users': perceived vulnerabilities, diverse backgrounds and individual expectations. Participants believed that the entire self-exclusion process should be conducted online, including identity verification, whilst expecting high-level data security measures to protect their personal privacy. A separate webpage was also suggested containing relevant information and links to additional help services, such as counselling. This study describes an adaptable co-design framework for developing a usable and acceptable self-exclusion website. Future studies should empirically test system usability and acceptability to refine and maximise system uptake upon implementation. Findings may have broader implications for digital health intervention design.

Process Evaluation of an Online SUpport PRogram for Older Hearing Aid Users Delivered in a Cluster Randomized Controlled Trial

Objectives: To evaluate the process of implementing a web-based support program (SUPR) for hearing aid users in the Dutch dispensing setting in order to allow interpretation of the randomized controlled trial's results (positive effects on hearing-aid related outcomes; no effects on psychosocial outcomes).

Design: Measures: context of implementation, recruitment, SUPR's: reach, implementation fidelity, dose delivered, dose received, satisfaction, and benefit. Data collection: quantitative and qualitative.

Study Sample: One hundred thirty-eight clients (mean age 68.1 years; 60% male) and 44 dispensers completed questionnaires. Five clients and 6 dispensers participated in interviews and focus groups.

Results: Clients and dispensers were generally satisfied with SUPR's usefulness. SUPR-videos were watched by 7–37% of the clients. Around half of the dispensers encouraged clients to watch them or informed them about SUPR. Some clients found the SUPR-materials suboptimal, and changes in personnel and limited dispenser-training were barriers acting on a contextual level.

Conclusions: This study identified several factors that contributed to the success of SUPR. Others factors, acting on various levels (e.g., intervention material, dispensers, and implementation context), were suboptimal and may explain the absent psychosocial effects. The identified factors are important to consider in further development of SUPR, and in other web-based support programs.

Obstructive Sleep Apnea compliance: verifications and validations of personalized interventions for PAP therapy

The Positive Airway Pressure (PAP) therapy is the most capable therapy against Obstruction Sleep Apnea (OSA). PAP therapy prevents the narrowing and collapsing of the soft tissues of the upper airway. A patient diagnosed with OSA is expected to use their CPAP machines every night for at least more than 4h for experiencing any clinical improvement. However, for the last two decades, trials were carried out to improve compliance and understand factors impacting compliance, but there were not enough conclusive results. With the advent of big data analytic and real-time monitoring, new opportunities open up to tackle this compliance issue. This paper's significant contribution is a novel framework that blends multiple external verification and validation carried out by different healthcare stakeholders. We provide a systematic verification and validation process to push towards explainable data analytic and automatic learning processes. We also present a complete mHealth solution that includes two mobile applications. The first application is for delivering tailored interventions directly to the patients. The second application is bound to different healthcare stakeholders for the verification and validation process.

Increasing Readiness for Early Integrated Palliative Oncology Care: Development and Initial Evaluation of the EMPOWER 2 Intervention

CONTEXT

Early integrated palliative care improves quality of life, but palliative care programs are underutilized. Psychoeducational interventions explaining palliative care may increase patients' readiness for palliative care.

OBJECTIVES

To 1) collaborate with stakeholders to develop the EMPOWER 2 intervention explaining palliative care, 2) examine acceptability, 3) evaluate feasibility and preliminary efficacy.

METHODS

The research was conducted at a North American cancer center and involved 21 stakeholders and 10 patient-participants. Investigators and stakeholders iteratively developed the intervention. Stakeholders rated acceptability of the final intervention. Investigators implemented a pre-post trial to examine the feasibility of recruiting 10 patients with metastatic cancer within one month and with a ≥50% consent rate. Preliminary efficacy outcomes were changes in palliative care knowledge and attitudes.

RESULTS

Using feedback from four stakeholder meetings, we developed a multimedia intervention tailored to three levels of health-literacy. The intervention provides knowledge and reassurance about the purpose and nature of palliative care, addressing cognitive and emotional barriers to utilization. Stakeholders rated the intervention and design process highly acceptable (3.78/4.00). The pilot met a priori feasibility criteria (10 patients enrolled in 14 days; 83.3% consent rate). The intervention increased palliative care knowledge by 83.1% and improved attitudes by 18.9 points on a 0 to 51 scale (Ps < 0.00001).

CONCLUSIONS

This formative research outlines the development of a psychoeducational intervention about palliative care. The intervention is acceptable, feasible, and demonstrated promising pilot test results. This study will guide clinical teams in improving patients' readiness for palliative care and inform the forthcoming EMPOWER 3 randomized clinical trial.

Development of a theory-based video-game intervention to increase advance care planning conversations by healthcare providers

Background

Hospitalization offers an opportunity for healthcare providers to initiate advance care planning (ACP) conversations, yet such conversations occur infrequently. Barriers to these conversations include attitudes, skill, and time. Our objective was to develop a theory-based, provider-level intervention to increase the frequency of ACP conversations in hospitals.

Methods

We followed a systematic process to develop a theory-based, provider-level intervention to increase ACP conversations between providers and their hospitalized patients. Using principles established in Intervention Mapping and the Behavior Change Wheel, we identified a behavioral target, a theory of behavior change, behavior change techniques, and a mode of delivery. We addressed a limitation of these two processes of intervention development by also establishing a framework of design principles to structure the selection of intervention components. We partnered with a game development company to translate the output into a video game.

Results

We identified willingness to engage in ACP conversations as the primary contributor to ACP behavior, and attitudes as a modifiable source of this willingness. We selected self-determination theory, and its emphasis on increasing autonomous motivation, as a relevant theory of behavior change and means of changing attitudes. Second, we mapped the components of autonomous motivation (i.e., autonomy, competence, and relatedness) to relevant behavior change techniques (e.g., identity). Third, we decided to deliver the intervention using a video game and to use the narrative engagement framework, which describes the use of stories to educate, model behavior, and immerse the user, to structure our selection of intervention components. Finally, in collaboration with a game development company, we used this framework to develop an adventure video game (Hopewell Hospitalist).

Conclusions

The systematic development of a theory-based intervention facilitates the mechanistic testing of the efficacy of the intervention, including the specification of hypotheses regarding mediators and moderators of outcomes. The intervention will be tested in a randomized clinical trial.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-021-00216-8.

Rural young males' acceptance & receptiveness to technology-based interventions for dating violence prevention: A qualitative descriptive study

INTRODUCTION

Rural youth are twice as likely as urban youth to experience some forms of teen dating violence (TDV), and significant barriers to accessing support services for physical, psychological, sexual violence. However, rural youth remain understudied and undersampled. Rural young men, in particular, are at risk for experiencing or perpetrating dating violence influenced by regional and sociocultural risk factors that promote male supremacy ideals while also impeding male help-seeking. Technology-based interventions circumvent some of these risk factors by offering confidential and reliable support. This study investigates rural young males' acceptability of technology-based interventions for fostering healthy relationships and preventing dating abuse, including their preferences for intervention content and features.

METHODS

Three online focus groups (n = 14) and phone interviews (n = 13) were conducted with rural young males. Participants were stratified by age (15-17 and 18-24 year-olds). Most were White (81%) from the United States Midwest (65%). Semi-structured interview data were analyzed using Qualitative Description (QD), guided by the Unified Theory of Acceptance and Use of Technology (UTAUT).

RESULTS

Three themes identified were (1) Scarcity of Useful Resources, (2) Socio-Structural Challenges for Intervention Uptake, with two subthemes (2a) Rural-Specific Structural Barriers and (2b) Rural Masculinity Disrupting Help-seeking; (3) Finally, participants discussed Functionality and Design Needs, itemizing their intervention "must-have" in terms of content, resources, and features.

CONCLUSION

This qualitative study identified obstacles and facilitators to using technology-based interventions for dating violence prevention among young rural males and offers pragmatic "ready-to-use" recommendations for the development of technology-based anti-dating violence interventions for rural youth.

Mobile Health for Smoking Cessation Among Disadvantaged Young Women During and After Pregnancy: User-Centered Design and Usability Study

Background

Smoking prevalence during and after pregnancy remains high among socioeconomically disadvantaged women. Mobile health (mHealth) apps with game and social support elements seem promising to support smoking cessation.

Objective

This study aims to describe the user-centered design and usability evaluation of Kindle, an mHealth app with game and social support elements, to support disadvantaged young women during and after pregnancy through the first stages of smoking cessation.

Methods

Disadvantaged women (n=9), members of their social networks (n=4), and nurses supporting these women (n=51) were informants throughout the iterative prototype development of Kindle according to the International Organization for Standardization 9241-11:2018. Specific phases included understanding the context of use through secondary analysis of qualitative interview data (phase 1), establishing the user and organizational requirements (phase 2), production of design solutions (phase 3), and usability inspection of the prototype through a heuristic evaluation (3 experts) along with user testing by a think aloud method (5 disadvantaged women and 5 nurses; phase 4). Usability problems were categorized according to the principles of the Healthcare Information and Management Systems Society.

Results

Phase 1 resulted in an understanding of the VoorZorg program and the needs of VoorZorg nurses and clients (eg, focus on early stages of change and building new supportive networks to aid clients in smoking cessation). In phase 2, we established requirements (n=22; eg, mHealth app, secure communication between nurses and clients, easy-to-use interfaces, inclusion of game elements, and tailoring at early stages of change in smoking cessation). Phase 3 resulted in a prototype of Kindle, combining the interface for nurses and clients, including the following functionalities: personal goal setting with earning points; secured chat function between nurses and other clients; and tips, diary, and profile creation. The heuristic evaluation and thinking aloud method in phase 4 revealed 78 usability problems in the interfaces. Most usability problems concerned simplicity (eg, unclear clickable button) and naturalness (eg, unclear icon).

Conclusions

The user-centered design and usability testing of the mHealth app Kindle yielded useful insights. The involvement of end users, specifically socioeconomically disadvantaged women during and after their pregnancy, resulted in a prototype that met their needs and requirements (eg, mHealth app, secure communication between nurses and clients, easy-to-use interfaces, inclusion of game elements, and tailoring to the early stages of change in smoking cessation) to achieve readiness for smoking cessation. Moreover, the usability evaluation by end users and experts revealed unique usability problems for this population. These insights allow for further optimization of Kindle and encourage future studies to engage disadvantaged populations in all phases of mHealth intervention design and usability testing.

Intervention Planning for the Tinnitus E-Programme 2.0, an Internet-Based Cognitive Behavioral Intervention for Tinnitus

Purpose The purpose of this study is to comprehensively describe the intervention planning process for the Tinnitus E-Programme 2.0, an Internet-based cognitive behavioral intervention for tinnitus. Method Theory-, evidence-, and person-based approaches to intervention development were used. In Phase 1, quantitative systematic reviews were used to identify potentially effective intervention techniques and design features. Primary mixed-methods research involving adults with tinnitus explored the acceptability of the first version of the intervention. In Phase 2, person-based guiding principles highlighted key intervention design objectives and features to address needs of the intervention's target group (identified in Phase 1) to maximize its acceptability, feasibility of delivery, and effectiveness. Theory-based "behavioral analysis" and "logic modeling" comprehensively described intervention content and potential mechanisms of action. From this planning work, a prototype intervention was developed. Results The intervention design objectives outlined in the guiding principles were to (a) normalize tinnitus, (b) support users to maintain a regular relaxation practice, (c) minimize the worsening of users' tinnitus sensation, and (d) ensure the intervention is accessible to those with hearing loss. Behavioral analysis and logic modeling identified intervention processes (e.g., illness perceptions, beliefs about consequences, skills, goals) and purported mediators (acceptance of tinnitus, negative thinking, use of the cognitive skills tools for managing negative thoughts, and practicing regular relaxation) hypothesized to facilitate reductions in tinnitus symptom severity. Conclusions The guiding principles highlight key design objectives and features to consider when developing interventions for tinnitus. The logic model offers hypothesized mechanisms of action that can be tested in future process analyses.

Effect of smartphone-based stress management programs on depression and anxiety of hospital nurses in Vietnam: a three-arm randomized controlled trial

There are growing concerns on stress among nurses in low- and middle-income countries (LMICs) in South-East Asia. It is important to improve mental health among nurses in these countries. The objective of this study was to examine the efficacy of two types of newly developed smartphone-based stress management programs in improving depressive and anxiety symptoms among hospital nurses in Vietnam. This study was a three-arm (including two intervention groups and one control group) randomized trial. Participants were recruited from nurses in a large general hospital in Hanoi, Vietnam. Two types (free-choice and fixed sequential order) of smartphone-based stress management programs were developed. Participants were randomly allocated to Program A (a free-choice, multimodule stress management), Program B (a fixed-order, internet cognitive behavioral therapy, iCBT), or a control group (treatment as usual). The depressive and anxiety symptoms were measured by using the Depression Anxiety and Stress Scales at baseline, 3-, and 7-month follow-up surveys. 951 participants were randomly allocated to each of the three groups. Program B showed a statistically significant effect on improving depressive symptoms at 3-month (p = 0.048), but not at 7-month (p = 0.92); Cohen's d was - 0.18 (95% CI - 0.34 to - 0.02) and 0.03 (95% CI - 1.00 to 1.05), respectively. Program A failed to show a significant intervention effect on any of the outcomes at 3- or 7-month follow-up (p > 0.05). Despite the small effect size, the present fixed-order iCBT program seems effective in improving depression of hospital nurses in Vietnam. A public health impact of the intervention can be scalable, when considering its accessibility and minimal cost.Trial registration number: The study protocol is registered at the UMIN Clinical Trials Registry (UMINCTR; ID = UMIN000033139). Registered date of the protocol is 1st Jul. 2018. https://upload.umin.ac.jp/cgi-open-bin/ctr_e/ctr_view.cgi?recptno=R000037796.

An App-Based Parenting Program to Promote Healthy Energy Balance-Related Parenting Practices to Prevent Childhood Obesity: Protocol Using the Intervention Mapping Framework

BACKGROUND

The family environment plays an important role in the development of children's energy balance-related behaviors. As a result, parents' energy balance-related parenting practices are important targets of preventive childhood obesity programs. Families with a lower socioeconomic position (SEP) may benefit from participating in such programs but are generally less well reached than families with a higher SEP.

OBJECTIVE

This paper describes the application of the Intervention Mapping Protocol (IMP) for the development of an app-based preventive intervention program to promote healthy energy balance-related parenting practices among parents of children (aged 0-4 years) with a lower SEP.

METHODS

The 6 steps of the IMP were used as a theory- and evidence-based framework to guide the development of an app-based preventive intervention program.

RESULTS

In step 1, behavioral outcomes for the app-based program (ie, children have a healthy dietary intake, sufficient sleep, and restricted screen time and sufficient physical activity) and sociocognitive (ie, knowledge, attitudes, and self-efficacy) and automatic (ie, habitual behaviors) determinants of energy balance-related parenting were identified through a needs assessment. In step 2, the behavioral outcomes were translated into performance objectives. To influence these objectives, in step 3, theory-based intervention methods were selected for each of the determinants. In step 4, the knowledge derived from the previous steps allowed for the development of the app-based program Samen Happie! through a process of continuous cocreation with parents and health professionals. In step 5, community health services were identified as potential adopters for the app. Finally, in step 6, 2 randomized controlled trials were designed to evaluate the process and effects of the app among Dutch parents of infants (trial 1) and preschoolers (trial 2). These trials were completed in November 2019 (trial 1) and February 2020 (trial 2).

CONCLUSIONS

The IMP allowed for the effective development of the app-based parenting program Samen Happie! to promote healthy energy balance-related parenting practices among parents of infants and preschoolers. Through the integration of theory, empirical evidence, and data from the target population, as well as the process of continued cocreation, the program specifically addresses parents with a lower SEP. This increases the potential of the program to prevent the development of obesity in early childhood among families with a lower SEP.

TRIAL REGISTRATION

Netherlands Trial Register NL6727, https://www.trialregister.nl/trial/6727; Netherlands Trial Register NL7371, https://www.trialregister.nl/trial/7371.

Exploring the Role of Persuasive Design in Unguided Internet-Delivered Cognitive Behavioral Therapy for Depression and Anxiety Among Adults: Systematic Review, Meta-analysis, and Meta-regression

BACKGROUND

Internet-delivered cognitive behavioral therapy (ICBT) is an effective treatment that can overcome barriers to mental health care. Various research groups have suggested that unguided ICBT (ie, ICBT without therapist support) and other eHealth interventions can be designed to enhance user engagement and thus outcomes. The persuasive systems design framework captures most design recommendations for eHealth interventions, but there is little empirical evidence that persuasive design is related to clinical outcomes in unguided ICBT.

OBJECTIVE

This study aims to provide an updated meta-analysis of randomized controlled trials of unguided ICBT for depression and anxiety, describe the frequency with which various persuasive design principles are used in such interventions, and use meta-regression to explore whether a greater number of persuasive design elements predicts efficacy in unguided ICBT for depression and anxiety.

METHODS

We conducted a systematic review of 5 databases to identify randomized controlled trials of unguided ICBT for depression and anxiety. We conducted separate random effects meta-analyses and separate meta-regressions for depression and anxiety interventions. Each meta-regression included 2 steps. The first step included, as a predictor, whether each intervention was transdiagnostic. For the meta-regression of ICBT for depression, the first step also included the type of control condition. The number of persuasive design principles identified for each intervention was added as a predictor in the second step to reveal the additional variance in effect sizes explained by persuasive design.

RESULTS

Of the 4471 articles we identified in our search, 46 (1.03%) were eligible for inclusion in our analyses. Our meta-analyses showed effect sizes (Hedges g) ranging from 0.22 to 0.31 for depression interventions, depending on the measures taken to account for bias in the results. We found a mean effect size of 0.45 (95% CI 0.33-0.56) for anxiety interventions, with no evidence that the results were inflated by bias. Included interventions were identified as using between 1 and 13 persuasive design principles, with an average of 4.95 (SD 2.85). The meta-regressions showed that a greater number of persuasive design principles predicted greater efficacy in ICBT for depression (R2 change=0.27; B=0.04; P=.02) but not anxiety (R2 change=0.05; B=0.03; P=.17).

CONCLUSIONS

These findings show wide variability in the use of persuasive design in unguided ICBT for depression and anxiety and provide preliminary support for the proposition that more persuasively designed interventions are more efficacious, at least in the treatment of depression. Further research is needed to clarify the role of persuasive design in ICBT.

eHealth Interventions to Address Sexual Health, Substance Use, and Mental Health Among Men Who Have Sex With Men: Systematic Review and Synthesis of Process Evaluations

Background

Men who have sex with men (MSM) face disproportionate risks concerning HIV and other sexually transmitted infections, substance use, and mental health. These outcomes constitute an interacting syndemic among MSM; interventions addressing all 3 together could have multiplicative effects. eHealth interventions can be accessed privately, and evidence from general populations suggests these can effectively address all 3 health outcomes. However, it is unclear how useable, accessible, or acceptable eHealth interventions are for MSM and what factors affect this.

Objective

We undertook a systematic review of eHealth interventions addressing sexual risk, substance use, and common mental illnesses among MSM and synthesized evidence from process evaluations.

Methods

We searched 19 databases, 3 trials registers, OpenGrey, and Google, and supplemented this by reference checks and requests to experts. Eligible reports were those that discussed eHealth interventions offering ongoing support to MSM aiming to prevent sexual risk, substance use, anxiety or depression; and assessed how intervention delivery or receipt varied with characteristics of interventions, providers, participants, or context. Reviewers screened citations on titles, abstracts, and then full text. Reviewers assessed quality of eligible studies, and extracted data on intervention, study characteristics, and process evaluation findings. The analysis used thematic synthesis.

Results

A total of 12 reports, addressing 10 studies of 8 interventions, were eligible for process synthesis. Most addressed sexual risk alone or with other outcomes. Studies were assessed as medium and high reliability (reflecting the trustworthiness of overall findings) but tended to lack depth and breadth in terms of the process issues explored. Intervention acceptability was enhanced by ease of use; privacy protection; use of diverse media; opportunities for self-reflection and to gain knowledge and skills; and content that was clear, interactive, tailored, reflective of MSM’s experiences, and affirming of sexual-minority identity. Technical issues and interventions that were too long detracted from acceptability. Some evidence suggested that acceptability varied by race or ethnicity and educational level; findings on variation by socioeconomic status were mixed. No studies explored how intervention delivery or receipt varied by provider characteristics.

Conclusions

Findings suggest that eHealth interventions targeting sexual risk, substance use, and mental health are acceptable for MSM across sociodemographic groups. We identified the factors shaping MSM’s receipt of such interventions, highlighting the importance of tailored content reflecting MSM’s experiences and of language affirming sexual-minority identities. Intervention developers can draw on these findings to increase the usability and acceptability of integrated eHealth interventions to address the syndemic of sexual risk, substance use, and mental ill health among MSM. Evaluators of these interventions can draw on our findings to plan evaluations that explore the factors shaping usability and acceptability.

Development and Functionality of an Internet-Based, Self-Managed Parent Training Program

Purpose This research note evaluated a self-managed, Internet intervention (i.e., Success With Stories) designed to facilitate parental reading practices and beliefs. Method Twelve reviewers were composed of parents of young children, speech-language pathologists, and experts in self-managed, Internet intervention. Satisfaction of usability, content, presentation, suitability, and exercises of Success With Stories was examined using an intervention satisfaction rating. Value and usefulness of content was evaluated via a survey. Results Reviewers found content to be valuable and useful for facilitating parental reading practices and beliefs. Results indicated high satisfaction across all reviewers. Conclusion Results point toward strengths and limitations of the protocol and future directions.

Effects of Information Architecture on the Effectiveness and User Experience of Web-Based Patient Education in Middle-Aged and Older Adults: Online Randomized Experiment

Background

Web-based patient education is increasingly offered to improve patients’ ability to learn, remember, and apply health information. Efficient organization, display, and structural design, that is, information architecture (IA), can support patients’ ability to independently use web-based patient education. However, the role of IA in the context of web-based patient education has not been examined systematically.

Objective

To support intervention designers in making informed choices that enhance patients’ learning, this paper describes a randomized experiment on the effects of IA on the effectiveness, use, and user experience of a patient education website and examines the theoretical mechanisms that explain these effects.

Methods

Middle-aged and older adults with self-reported hip or knee joint complaints were recruited to use and evaluate 1 of 3 patient education websites containing information on total joint replacement surgery. Each website contained the same textual content based on an existing leaflet but differed in the employed IA design (tunnel, hierarchical, or matrix design). Participants rated the websites on satisfaction, engagement, control, relevance, trust, and novelty and completed an objective knowledge test. Analyses of variance and structural equation modeling were used to examine the effects of IA and construct a theoretical model.

Results

We included 215 participants in our analysis. IA did not affect knowledge gain (P=.36) or overall satisfaction (P=.07) directly. However, tunnel (mean 3.22, SD 0.67) and matrix (mean 3.17, SD 0.69) architectures were found to provide more emotional support compared with hierarchical architectures (mean 2.86, SD 0.60; P=.002). Furthermore, increased perceptions of personal relevance in the tunnel IA (β=.18) were found to improve satisfaction (β=.17) indirectly. Increased perceptions of active control in the matrix IA (β=.11) also improved satisfaction (β=.27) indirectly. The final model of the IA effects explained 74.3% of the variance in satisfaction and 6.8% of the variance in knowledge and achieved excellent fit (χ²_17,215=14.7; P=.62; root mean square error of approximation=0.000; 95% CI [0.000-0.053]; comparative fit index=1.00; standardized root mean square residual=0.044).

Conclusions

IA has small but notable effects on users’ experiences with web-based health education interventions. Web-based patient education designers can employ tunnel IA designs to guide users through sequentially ordered content or matrix IA to offer users more control over navigation. Both improve user satisfaction by increasing user perceptions of relevance (tunnel) and active control (matrix). Although additional research is needed, hierarchical IA designs are currently not recommended, as hierarchical content is perceived as less supportive, engaging, and relevant, which may diminish the use and, in turn, the effect of the educational intervention.

A Web-Based Self-Management Support Prototype for Adults With Chronic Kidney Disease (My Kidneys My Health): Co-Design and Usability Testing

Background

Supporting patients to self-manage their chronic kidney disease (CKD) has been identified as a research priority by patients with CKD and those who care for them. Self-management has been shown to slow CKD progression and improve the quality of life of individuals living with the disease. Previous work has identified a need for a person-centered, theory-informed, web-based tool for CKD self-management that can be individualized to a patient’s unique situation, priorities, and preferences. We addressed this gap using an integrated knowledge translation method and patient engagement principles.

Objective

The aim of this study is to conduct systematic co-design and usability testing of a web-based self-management prototype for adults with CKD (nondialysis and nontransplant) and their caregivers to enhance self-management support.

Methods

A multistep, iterative system development cycle was used to co-design and test the My Kidneys My Health prototype. The 3-step process included creating website features and content using 2 sequential focus groups with patients with CKD and caregivers, heuristic testing using the 10 heuristic principles by Nielsen, and usability testing through in-person 60-minute interviews with patients with CKD and their caregivers. Patients with CKD, caregivers, clinicians, researchers, software developers, graphic designers, and policy makers were involved in all steps of this study.

Results

In step 1, 18 participants (14 patients and 4 caregivers) attended one of the 2 sequential focus groups. The participants provided specific suggestions for simplifying navigation as well as suggestions to incorporate video, text, audio, interactive components, and visuals to convey information. A total of 5 reviewers completed the heuristic analysis (step 2), identifying items mainly related to navigation and functionality. Furthermore, 5 participants completed usability testing (step 3) and provided feedback on video production, navigation, features and functionality, and branding. Participants reported visiting the website repeatedly for the following features: personalized food tool, my health care provider question list, symptom guidance based on CKD severity, and medication advice. Usability was high, with a mean system usability score of 90 out of 100.

Conclusions

The My Kidneys My Health prototype is a systematically developed, multifaceted, web-based CKD self-management support tool guided by the theory and preferences of patients with CKD and their caregivers. The website is user friendly and provides features that improve user experience by tailoring the content and resources to their needs. A feasibility study will provide insights into the acceptability of and engagement with the prototype and identify preliminary patient-reported outcomes (eg, self-efficacy) as well as potential factors related to implementation. This work is relevant given the shift to virtual care during the current pandemic times and provides patients with support when in-person care is restricted.

Theories of change for e-health interventions targeting HIV/STIs and sexual risk, substance use and mental ill health amongst men who have sex with men: systematic review and synthesis

BACKGROUND

Sexual risk, substance use, and mental ill health constitute a syndemic of co-occurring, mutually reinforcing epidemics amongst men who have sex with men (MSM). Developed since 1995, e-health interventions offer accessible, anonymous support and can be effective in addressing these outcomes, suggesting the potential value of developing e-health interventions that address these simultaneously amongst MSM. We conducted a systematic review of e-health interventions addressing one or more of these outcomes amongst MSM and in this paper describe the theories of change underpinning relevant interventions, what these offer and how they might complement each other.

METHODS

We identified eligible reports via expert requests, reference-checking and database and Google searches. Results were screened for reports published in 1995 or later; focused on MSM; reporting on e-health interventions providing ongoing support to prevent HIV/STIs, sexual risk behaviour, substance use, anxiety or depression; and describing intervention theories of change. Reviewers assessed report quality, extracted intervention and theory of change data, and developed a novel method of synthesis using diagrammatic representations of theories of change.

RESULTS

Thirty-three reports on 22 intervention theories of change were included, largely of low/medium-quality. Inductively grouping these theories according to their core constructs, we identified three distinct groupings of theorised pathways. In the largest, the 'cognitive/skills' grouping, interventions provide information and activities which are theorised to influence behaviour via motivation/intention and self-efficacy/perceived control. In the 'self-monitoring' grouping, interventions are theorised to trigger reflection, self-reward/critique and self-regulation. In the 'cognitive therapy' grouping, the theory of change is rooted in cognitive therapy techniques, aiming to reframe negative emotions to improve mental health.

CONCLUSIONS

The synthesised theories of change provide a framework for developing e-health interventions that might holistically address syndemic health problems amongst MSM. Improving reporting on theories of change in primary studies of e-health interventions would enable a better understanding of how they are intended to work and the evidence supporting this. The novel diagrammatic method of theory of change synthesis used here could be used for future reviews where interventions are driven by existing well-defined behaviour and behaviour change theories.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42018110317.

Current Advances in Wearable Devices and Their Sensors in Patients With Depression

In this study, a literature survey was conducted of research into the development and use of wearable devices and sensors in patients with depression. We collected 18 studies that had investigated wearable devices for assessment, monitoring, or prediction of depression. In this report, we examine the sensors of the various types of wearable devices (e.g., actigraphy units, wristbands, fitness trackers, and smartwatches) and parameters measured through sensors in people with depression. In addition, we discuss future trends, referring to research in other areas employing wearable devices, and suggest the challenges of using wearable devices in the field of depression. Real-time objective monitoring of symptoms and novel approaches for diagnosis and treatment using wearable devices will lead to changes in management of patients with depression. During the process, it is necessary to overcome several issues, including limited types of collected data, reliability, user adherence, and privacy concerns.

ImpulsePal: The systematic development of a smartphone app to manage food temptations using intervention mapping

BACKGROUND

Impulsive processes driving eating behaviour can often undermine peoples' attempts to change their behaviour, lose weight and maintain weight loss.

AIM

To develop an impulse management intervention to support weight loss in adults.

METHODS

Intervention Mapping (IM) was used to systematically develop the "ImpulsePal" intervention. The development involved: (1) a needs assessment including a qualitative study, Patient and Public advisory group and expert group consultations, and a systematic review of impulse management techniques; (2) specification of performance objectives, determinants, and change objectives; (3) selection of intervention strategies (mapping of change techniques to the determinants of change); (4) creation of programme materials; (5) specification of adoption and implementation plans; (6) devising an evaluation plan.

RESULTS

Application of the IM Protocol resulted in a smartphone app that could support reductions in unhealthy (energy dense) food consumption, overeating, and alcoholic and sugary drink consumption. ImpulsePal includes inhibition training, mindfulness techniques, implementation intentions (if-then planning), visuospatial loading, use of physical activity for craving management, and context-specific reminders. An "Emergency Button" was also included to provide access to in-the-moment support when temptation is strong.

CONCLUSIONS

ImpulsePal is a novel, theory- and evidence-informed, person-centred app that aims to support impulse management for healthier eating. Intervention Mapping facilitated the incorporation of app components that are practical operationalisations of change techniques targeting our specific change objectives and their associated theoretical determinants. Using IM enabled transparency and provided a clear framework for evaluation, and enhances replicability and the potential of the intervention to accomplish the desired outcome of facilitating weight loss through dietary change.

What got in the way? Caregiver-reported challenges to home practice of assigned intervention skills

Background

Evidence-based intervention (EBI) effectiveness is hindered by low rates of caregiver home practice, or caregiver rehearsal of intervention skills at home. Although home practice is essential to intervention success, we know little about what makes home practice difficult to complete. We sought to identify the challenges caregivers face when attempting home practice assignments within the context of community implementation of a family-based preventative EBI. We also aimed to identify barriers, perceived need, and implementation-related factors that may contribute to frequency of home practice challenges.

Methods

The family-based preventative intervention Bridges was delivered to caregivers and adolescents in three public middle schools in North America within a randomized efficacy-effectiveness hybrid trial. Caregivers (N = 233) completed worksheets in which they reported challenges to home practice of intervention skills. Caregiver-endorsed challenges were coded for emergent themes and categorized into higher-order home practice challenge domains. Additional data was gathered through multiple methods. In addition to descriptive analyses, multilevel linear regressions were conducted to identify factors associated with frequency of home practice challenge domains.

Results

Over 85% of caregivers reported one or more home practice challenges. Challenges fell into six domains: daily stresses, cognitions/beliefs about the intervention/practice, caregiver wellness/regulation, adolescent responsiveness, relevance/acceptability of intervention or assignment, and external barriers to practice. Adolescent externalizing symptoms, academic performance, and caregiver participation in the English-language intervention group (compared to Spanish-language delivery) were associated with greater frequency of reported challenges.

Conclusions

Among caregivers already attending intervention sessions, specific support to overcome challenges in daily stresses and beliefs about the intervention/practice can support greater home practice compliance, which in turn may impact overall intervention effectiveness. Findings suggest that providing services in caregivers' preferred language may avert potential challenges. Further research into home practice challenges is necessary to identify appropriate home practice implementation supports.

Plain Language Summary

Low rates and poor quality of caregiver home practice of intervention skills hampers intervention effectiveness, but no prior studies have identified the difficulties caregivers face when attempting home practice of intervention skills and their rates of occurrence. Within a community implementation of a family-based preventative intervention, we found that difficulties were common and largely fell in the domains theorized to impact engagement, such as daily stresses and beliefs about the intervention/practice. Findings also suggest that providing services and materials in caregivers' preferred language may avert potential home practice challenges. By identifying common home practice challenges and correlates of different challenges, our findings point to a need to develop appropriate and effective home practice implementation support.

Engaging youth in mHealth: what works and how can we be sure?

BACKGROUND

Youth participating in mobile health (mHealth) intervention trials often engage with the technologies [e.g., applications (app) or mobile-optimized websites] only partially, often prematurely discontinuing use altogether. Limited engagement can impact the interventions effect on behavior change and compromise researchers' ability to test and estimate the true efficacy of their interventions. While mHealth interventions have been shown to be feasible and acceptable to youth, across diverse health conditions, strategies to increase engagement have been less well studied. Specifically, within HIV prevention and care mHealth interventions, there is not consensus as to which components represent the "key ingredients" to support maximal engagement of youth. Further, successful intervention evaluation requires the ability to systematically track users' engagement with intervention components (i.e., paradata) to evaluate its effects on behavior change.

METHODS

As part of the Adolescent Medicine Trials Network UNC/Emory Center for Innovative Technology (iTech) portfolio of HIV/AIDS Interventions, we present diverse strategies used across five mHealth protocols seeking to promote youth engagement, track and measure engagement through paradata, and incorporate these components into mHealth intervention evaluations.

RESULTS

We describe the importance of defining and measuring engagement using case studies from iTech to illustrate how different research teams select mHealth features to promote youth engagement over time, taking into account features embedded in the technology design, key mechanisms of change and trial outcomes (e.g., HIV testing, pre-exposure prophylaxis uptake and adherence, HIV treatment adherence). Finally, we discuss how the research teams plan to evaluate engagement's role on their intervention's outcomes.

CONCLUSIONS

Based on this synthesis, we discuss strategies to enhance mHealth engagement during intervention development and design, ensure its monitoring and reporting throughout the trial, and evaluate its impact on trial outcomes.

A Qualitative Exploration of Perceptions of a Digital Intervention to Promote Physical Activity in Older Adults

PURPOSE

This study explored participant views of a web-based physical activity intervention for older adults and examined how they resonate with the key principles that guided intervention development.

METHODS

Qualitative interviews were carried out with 52 older adults. A deductive qualitative analysis approach was taken, based around the intervention's key principles.

RESULTS

Participants expressed mostly positive views of the intervention features, broadly confirming the appropriateness of the key principles, which were to: (a) encourage intrinsic motivation for physical activity, (b) minimize the risk of users receiving activity suggestions that are inappropriate or unsafe, (c) offer users choice regarding the activities they engage with and build confidence to undertake more activity, and (d) minimize the cognitive load and need to engage with the intervention website. The findings also identified ways in which content could be improved to further increase acceptability.

CONCLUSION

This study illustrates how using the person-based approach has enabled the identification and implementation of features that older adults appreciate.

Design Features for Improving Mobile Health Intervention User Engagement: Systematic Review and Thematic Analysis

Background

Well-designed mobile health (mHealth) interventions support a positive user experience; however, a high rate of disengagement has been reported as a common concern regarding mHealth interventions. To address this issue, it is necessary to summarize the design features that improve user engagement based on research over the past 10 years, during which time the popularity of mHealth interventions has rapidly increased due to the use of smartphones.

Objective

The aim of this review was to answer the question “Which design features improve user engagement with mHealth interventions?” by summarizing published literature with the purpose of guiding the design of future mHealth interventions.

Methods

This review followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist. Databases, namely, PubMed, Web of Science, Cochrane Library, Ovid EMBASE, and Ovid PsycINFO, were searched for English and Chinese language papers published from January 2009 to June 2019. Thematic analysis was undertaken to assess the design features in eligible studies. The Mixed Methods Appraisal Tool was used to assess study quality.

Results

A total of 35 articles were included. The investigated mHealth interventions were mainly used in unhealthy lifestyle (n=17) and chronic disease (n=10) prevention programs. Mobile phone apps (n=24) were the most common delivery method. Qualitative (n=22) and mixed methods (n=9) designs were widely represented. We identified the following 7 themes that influenced user engagement: personalization (n=29), reinforcement (n=23), communication (n=20), navigation (n=17), credibility (n=16), message presentation (n=16), and interface aesthetics (n=7). A checklist was developed that contained these 7 design features and 29 corresponding specific implementations derived from the studies.

Conclusions

This systematic review and thematic synthesis identified useful design features that make an mHealth intervention more user friendly. We generated a checklist with evidence-based items to enable developers to use our findings easily. Future evaluations should use more robust quantitative approaches to elucidate the relationships between design features and user engagement.