Predictors of adherence by adolescents to a cognitive behavior therapy website in school and community-based settings

Acceptability and Utility of a Smartphone App to Support Adolescent Mental Health (BeMe): Program Evaluation Study

BACKGROUND

Adolescents face unprecedented mental health challenges, and technology has the opportunity to facilitate access and support digitally connected generations. The combination of digital tools and live human connection may hold particular promise for resonating with and flexibly supporting young people's mental health.

OBJECTIVE

This study aimed to describe the BeMe app-based platform to support adolescents' mental health and well-being and to examine app engagement, usability, and satisfaction.

METHODS

Adolescents in the United States, aged 13 to 20 years, were recruited via the web and enrolled between September 1 and October 31, 2022. App engagement, feature use, clinical functioning, and satisfaction with BeMe were examined for 30 days. BeMe provides content based on cognitive behavioral therapy, dialectical behavior therapy, motivational interviewing, and positive psychology; interactive activities; live text-based coaching; links to clinical services; and crisis support tools (digital and live).

RESULTS

The average age of the sample (N=13,421) was 15.04 (SD 1.7) years, and 56.72% (7612/13,421) identified with she/her pronouns. For the subsample that completed the in-app assessments, the mean scores indicated concern for depression (8-item Patient Health Questionnaire mean 15.68/20, SD 5.9; n=239), anxiety (7-item Generalized Anxiety Disorder Questionnaire mean 13.37/17, SD 5.0; n=791), and poor well-being (World Health Organization-Five Well-being Index mean 30.15/100, SD 16.1; n=1923). Overall, the adolescents engaged with BeMe for an average of 2.38 (SD 2.7) days in 7.94 (SD 24.1) sessions and completed 11.26 (SD 19.8) activities. Most adolescents engaged with BeMe's content (12,270/13,421, 91.42%), mood ratings (13,094/13,421, 97.56%), and interactive skills (10,098/13,421, 75.24%), and almost one-fifth of the adolescents engaged with coaching (2539/13,421, 18.92%), clinical resources (2411/13,421, 17.96%), and crisis support resources (2499/13,421, 18.62%). Overall app engagement (total activities) was highest among female and gender-neutral adolescents compared with male adolescents (all P<.001) and was highest among younger adolescents (aged 13-14 years) compared with all other ages (all P<.001). Satisfaction ratings were generally high for content (eg, 158/176, 89.8% rated as helpful and 1044/1139, 91.66% improved coping self-efficacy), activities (5362/8468, 63.32% helpful and 4408/6072, 72.6% useful in coping with big feelings), and coaching (747/894, 83.6% helpful and 747/894, 83.6% improved coping self-efficacy). Engagement (total activities completed) predicted the likelihood of app satisfaction (P<.001).

CONCLUSIONS

Many adolescents downloaded the BeMe app and completed multiple sessions and activities. Engagement with BeMe was higher among female and younger adolescents. Ratings of BeMe's content, activities, and coaching were very positive for cognitive precursors aimed at reducing depression and anxiety and improving well-being. The findings will inform future app development to promote more sustained engagement, and future evaluations will assess the effects of BeMe on changes in mental health outcomes.

Does loneliness affect how young adults engage with and benefit from a smartphone intervention targeting suicidal ideation?: Randomised Controlled Trial (Preprint)

BACKGROUND

Loneliness is commonly reported by young people and has been shown to contribute to the rapid onset and escalation of depression and suicidal ideation during adolescence. Lonely people may also be particularly susceptible to disengaging from treatment early given the likelihood of their more complex clinical profiles leading to cognitive fatigue. While a smartphone intervention (LifeBuoy) has been shown to effectively reduce suicidal ideation in young adults, poor engagement is a well-documented issue for this therapeutic modality and has been shown to result in poorer treatment outcomes.

OBJECTIVE

This study aims to determine whether loneliness affects how young people experiencing suicidal ideation engage with and benefit from a therapeutic smartphone intervention (LifeBuoy).

METHODS

A total of 455 community-based Australian young adults (aged 18-25 years) experiencing recent suicidal ideation were randomized to use a dialectical behavioral therapy-based smartphone intervention (LifeBuoy) or an attention-matched control app (LifeBuoy-C) for 6 weeks. Participants completed measures of suicidal ideation, depression, anxiety, and loneliness at baseline (T0), post intervention (T1), and 3 months post intervention (T2). Piecewise linear mixed models were used to examine whether loneliness levels moderated the effect of LifeBuoy and LifeBuoy-C on suicidal ideation and depression across time (T0 to T1; T1 to T2). This statistical method was then used to examine whether app engagement (number of modules completed) influenced the relationship between baseline loneliness and suicidal ideation and depression across time.

RESULTS

Loneliness was positively associated with higher levels of overall suicidal ideation (B=0.75, 95% CI 0.08-1.42; P=.03) and depression (B=0.88, 95% CI 0.45-1.32; P<.001), regardless of time point or allocated condition. However, loneliness did not affect suicidal ideation scores across time (time 1: B=1.10, 95% CI -0.25 to 2.46; P=.11; time 2: B=0.43, 95% CI -1.25 to 2.12; P=.61) and depression scores across time (time 1: B=0.00, 95% CI -0.67 to 0.66; P=.99; time 2: B=0.41, 95% CI -0.37 to 1.18; P=.30) in either condition. Similarly, engagement with the LifeBuoy app was not found to moderate the impact of loneliness on suicidal ideation (B=0.00, 95% CI -0.17 to 0.18; P=.98) or depression (B=-0.08, 95% CI -0.19 to 0.03; P=.14).

CONCLUSIONS

Loneliness was not found to affect young adults' engagement with a smartphone intervention (LifeBuoy) nor any clinical benefits derived from the intervention. LifeBuoy, in its current form, can effectively engage and treat individuals regardless of how lonely they may be.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry ACTRN12619001671156; https://tinyurl.com/yvpvn5n8.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/23655.

"Good job!": Therapists' encouragement, affirmation, and personal address in internet-based cognitive behavior therapy for adolescents with depression

Internet-delivered interventions are generally effective for psychological problems. While the presence of a clinician guiding the client via text messages typically leads to better outcomes, the characteristics of what constitutes high-quality communication are less well investigated. This study aimed to identify how an internet therapist most effectively communicates with clients in internet-delivered cognitive behavioral therapy (ICBT). Using data from a treatment study of depressed adolescents with a focus on participants who had a positive outcome, messages from therapists were analyzed using thematic analysis. The study focused on the therapist's 1) encouragement and 2) affirmation, and how the therapists used 3) personal address. The analysis resulted in a total of twelve themes (Persistence Wins, You Are a Superhero, You Make Your Luck, You Understand, Hard Times, You Are Like Others, My View on the Matter, Time for a Change, Welcome In, Let Me Help You, You Affect Me, and I Am Human). Overall, the themes form patterns where treatment is described as hard work that requires a motivated client who is encouraged by the therapist. The findings are discussed based on the cognitive behavioral theoretical foundation of the treatment, prior research on therapist behaviors, and the fact that the treatment is provided over the internet.

Gender Differences in Usage and Subjective Appreciation of an Online Cognitive Behavioral Therapy for Wildfire Evacuees: Descriptive Study

BACKGROUND

Based on the most common psychological difficulties of the evacuees from the 2016 Fort McMurray wildfires in Alberta, Canada, a therapist-guided cognitive behavioral self-treatment was developed. This study aimed to explore how gender influences the usage and subjective appreciation of the RESILIENT online treatment.

METHODS

Our study included 81 English-speaking evacuees with significant posttraumatic symptoms, or with some posttraumatic symptoms accompanied by at least mild depression symptoms or subclinical insomnia, and who logged into the platform at least once. Various usage and subjective appreciation variables were analyzed, including number of completed sessions, number of logins, number of words per session, perceived efforts, perception of usefulness and intention to continue using the different strategies.

RESULTS

No difference was detected in most objective usage indicators. The number of words written in sessions 7 and 10 was significantly greater for women than for men. Regarding subjective appreciation, men had a greater perception of having put strong efforts in the cognitive restructuring strategy, while women reported in a greater proportion that they wanted to continue using physical exercise as a behavioral activation strategy.

CONCLUSIONS

Our study offers a first look into how women and men use online treatments, and what their preferences are.

Predictors of adolescent engagement and outcomes - A cross-sectional study using the togetherall (formerly Big White Wall) digital mental health platform

BACKGROUND

Online mental health platforms can improve access to, and use of, mental health support for young people who may find it difficult to engage with face-to-face delivery.

OBJECTIVE

We modelled predictors of engagement and symptom change in adolescent users of the Togetherall (formerly "Big White Wall") anonymous digital mental health peer-support platform.

METHODS

We report a retrospective analysis of longitudinal user data from UK 16-18 year Togetherall users, referred from mental health services (N = 606). Baseline demographics were reported for participants who logged anxiety and depression measures. Number of log-ins, mean session duration, total usage time, number of guided support courses and self-help materials accessed were our usage metrics. Participant characteristics and symptoms were used to predict engagement. For n = 245 users with symptom measures at >1 timepoint we modelled the effect of predictors on symptom scores.

RESULTS

Mean logins was 5.11 and mean usage time was 64.22 mins. Participants with one log-in represented 33.5% of the sample. Total time accessing Togetherall predicated greater usage of self-help materials and courses. Females made greater use of materials and courses than males. In a subsample, higher baseline depression and anxiety, longer total usage time and mean session duration predicted final depression scores, whereas higher baseline depression and anxiety and greater accessed self-help materials predicted lower final anxiety scores.

LIMITATIONS

A naturalistic design was used and symptom modelling should be interpreted with caution.

CONCLUSIONS

Findings suggest adolescents can engage with the Togetherall platform. Baseline symptoms and characteristics can inform user engagement with digital platforms.

Nonusage Attrition of Adolescents in an mHealth Promotion Intervention and the Role of Socioeconomic Status: Secondary Analysis of a 2-Arm Cluster-Controlled Trial

Background

Mobile health (mHealth) interventions may help adolescents adopt healthy lifestyles. However, attrition in these interventions is high. Overall, there is a lack of research on nonusage attrition in adolescents, particularly regarding the role of socioeconomic status (SES).

Objective

The aim of this study was to focus on the role of SES in the following three research questions (RQs): When do adolescents stop using an mHealth intervention (RQ1)? Why do they report nonusage attrition (RQ2)? Which intervention components (ie, self-regulation component, narrative, and chatbot) prevent nonusage attrition among adolescents (RQ3)?

Methods

A total of 186 Flemish adolescents (aged 12-15 years) participated in a 12-week mHealth program. Log data were monitored to measure nonusage attrition and usage duration for the 3 intervention components. A web-based questionnaire was administered to assess reasons for attrition. A survival analysis was conducted to estimate the time to attrition and determine whether this differed according to SES (RQ1). Descriptive statistics were performed to map the attrition reasons, and Fisher exact tests were used to determine if these reasons differed depending on the educational track (RQ2). Mixed effects Cox proportional hazard regression models were used to estimate the associations between the use duration of the 3 components during the first week and attrition. An interaction term was added to the regression models to determine whether associations differed by the educational track (RQ3).

Results

After 12 weeks, 95.7% (178/186) of the participants stopped using the app. 30.1% (56/186) of the adolescents only opened the app on the installation day, and 44.1% (82/186) stopped using the app in the first week. Attrition at any given time during the intervention period was higher for adolescents from the nonacademic educational track compared with those from the academic track. The other SES indicators (family affluence and perceived financial situation) did not explain attrition. The most common reasons for nonusage attrition among participants were perceiving that the app did not lead to behavior change, not liking the app, thinking that they already had a sufficiently healthy lifestyle, using other apps, and not being motivated by the environment. Attrition reasons did not differ depending on the educational track. More time spent in the self-regulation and narrative components during the first week was associated with lower attrition, whereas chatbot use duration was not associated with attrition rates. No moderating effects of SES were observed in the latter association.

Conclusions

Nonusage attrition was high, especially among adolescents in the nonacademic educational track. The reported reasons for attrition were diverse, with no statistical differences according to the educational level. The duration of the use of the self-regulation and narrative components during the first week may prevent attrition for both educational tracks.

Trial Registration

ClinicalTrials.gov NCT04719858; http://clinicaltrials.gov/ct2/show/NCT04719858

Testing the Effectiveness of a Blended Intervention to Reduce Suicidal Ideation among School Adolescents in Chile: A Protocol for a Cluster Randomized Controlled Trial

Suicidal ideation is prevalent in adolescents and is a marker for subsequent psychiatric vulnerability and symptom severity. Literature shows that blended care (integrating online and offline components in a treatment process) could improve the effectiveness and adherence of interventions targeting suicidal ideation in adolescents, but the evidence is inconclusive. Thus, we will test the effectiveness of a blended intervention to reduce suicidal ideation (primary outcome) in school settings using a single-blind two-armed cluster randomized controlled trial (cRCT). The internet-based component corresponds to the Reframe-IT, a program encompassing eight online sessions based on cognitive-behavioral therapy (CBT) principles. The face-to-face intervention will be delivered through four CBT sessions. Additionally, we will assess the effect of the intervention on the following secondary outcomes: suicidal attempts, depressive symptoms, hopelessness, emotional regulation, and problem-solving skills. Primary and secondary outcomes will be assessed at post-intervention, 3-month, 6-month, and 12-month follow-up. Finally, we will explore the mediation role of cognitive, emotional, and behavioral correlates of suicide on the effect of the intervention. Results will inform whether the intervention can reduce suicide among school adolescents and be implemented on a large scale in Chile.

Usage Intensity of a Relapse Prevention Program and Its Relation to Symptom Severity in Remitted Patients With Anxiety and Depression: Pre-Post Study

BACKGROUND

Given that relapse is common in patients in remission from anxiety and depressive disorders, relapse prevention is needed in the maintenance phase. Although existing psychological relapse prevention interventions have proven to be effective, they are not explicitly based on patients' preferences. Hence, we developed a blended relapse prevention program based on patients' preferences, which was delivered in primary care practices by mental health professionals (MHPs). This program comprises contact with MHPs, completion of core and optional online modules (including a relapse prevention plan), and keeping a mood and anxiety diary in which patients can monitor their symptoms.

OBJECTIVE

The aims of this study were to provide insight into (1) usage intensity of the program (over time), (2) the course of symptoms during the 9 months of the study, and (3) the association between usage intensity and the course of symptoms.

METHODS

The Guided E-healTh for RElapse prevention in Anxiety and Depression (GET READY) program was guided by 54 MHPs working in primary care practices. Patients in remission from anxiety and depressive disorders were included. Demographic and clinical characteristics, including anxiety and depressive symptoms, were collected via questionnaires at baseline and after 3, 6, and 9 months. Log data were collected to assess the usage intensity of the program.

RESULTS

A total of 113 patients participated in the study. Twenty-seven patients (23.9%) met the criteria for the minimal usage intensity measure. The core modules were used by ≥70% of the patients, while the optional modules were used by <40% of the patients. Usage decreased quickly over time. Anxiety and depressive symptoms remained stable across the total sample; a minority of 15% (12/79) of patients experienced a relapse in their anxiety symptoms, while 10% (8/79) experienced a relapse in their depressive symptoms. Generalized estimating equations analysis indicated a significant association between more frequent face-to-face contact with the MHPs and an increase in both anxiety symptoms (β=.84, 95% CI .39-1.29) and depressive symptoms (β=1.12, 95% CI 0.45-1.79). Diary entries and the number of completed modules were not significantly associated with the course of symptoms.

CONCLUSIONS

Although the core modules of the GET READY program were used by most of the patients and all patients saw an MHP at least once, usage decreased quickly over time. Most patients remained stable while participating in the study. The significant association between the frequency of contact and the course of symptoms most likely indicates that those who received more support had more symptoms, and thus, it is questionable whether the support offered by the program was sufficient to prevent these patients from relapsing.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1186/s12888-019-2034-6.

Adolescent dropout from brief digital mental health interventions within and beyond randomized trials

OBJECTIVE

Many adolescents struggle to access appropriate mental health care due to structural or psychological barriers. Although traditional barriers to participation (e.g., location, cost) are hypothetically reduced or removed in internet interventions, low retention reduces the likelihood that adolescents will receive the intervention dosage intended to produce beneficial effects. It is therefore key to determine what factors are associated with dropout in digital mental health interventions with adolescents both within and beyond the context of research studies.

METHODS

We compare completion rates from two projects evaluating self-guided, online single-session mental health interventions (SSIs) for adolescents. One was a randomized controlled trial (RCT) in which participants were paid for participation. The other was a program evaluation project in which participants were not paid for participation. We additionally compare SSI completion rates across various demographic groups and across baseline hopelessness levels.

RESULTS

There was a statistically significant difference in SSI completion status between the RCT (84.75% full-completers) and the program evaluation (36.86% full-completers), X ² (2, N = 2436) = 583.5, p < 0.05. There were no significant differences in the baseline hopelessness scores across completion statuses in either study. There were no significant differences in full-completion rates across demographic groups in either project.

CONCLUSION

Adolescents may be more likely to complete a brief digital mental health intervention in a paid, research-based context than in an unpaid, naturalistic context. Additionally, it is possible that the brevity of SSIs reduces demographic disparities related to retention by minimizing the time required to complete an intervention.

Participatory Development and Pilot Testing of an Adolescent Health Promotion Chatbot

Background: The use of chatbots may increase engagement with digital behavior change interventions in youth by providing human-like interaction. Following a Person-Based Approach (PBA), integrating user preferences in digital tool development is crucial for engagement, whereas information on youth preferences for health chatbots is currently limited.

Objective: The aim of this study was to gain an in-depth understanding of adolescents' expectations and preferences for health chatbots and describe the systematic development of a health promotion chatbot.

Methods: Three studies in three different stages of PBA were conducted: (1) a qualitative focus group study (n = 36), (2) log data analysis during pretesting (n = 6), and (3) a mixed-method pilot testing (n = 73).

Results: Confidentiality, connection to youth culture, and preferences when referring to other sources were important aspects for youth in chatbots. Youth also wanted a chatbot to provide small talk and broader support (e.g., technical support with the tool) rather than specifically in relation to health behaviors. Despite the meticulous approach of PBA, user engagement with the developed chatbot was modest.

Conclusion: This study highlights that conducting formative research at different stages is an added value and that adolescents have different chatbot preferences than adults. Further improvement to build an engaging chatbot for youth may stem from using living databases.

Overcome Death Anxiety: The Development of an Online Cognitive Behaviour Therapy Programme for Fears of Death

Emerging research suggests that death anxiety is a transdiagnostic construct, which may underpin a number of mental illnesses. Although cognitive behaviour therapy (CBT) has been found to be the most effective treatment for death anxiety, no self-guided treatments for this construct exist at present. Furthermore, there is a growing need for accessible, scalable and cost-effective psychological treatments. To address these gaps, we created Overcome Death Anxiety (ODA), an online CBT-based programme which specifically targets fears of death. ODA was designed to be a fully automated, standalone, yet individualised online treatment. The present study outlines the development and structure of this programme using responses from four users to illustrate feasibility. Research is needed to examine the efficacy and usability of ODA with a larger clinical sample.

Usage activity, perceived usefulness, and satisfaction in a web-based acceptance and commitment therapy program among Finnish ninth-grade adolescents

Understanding adolescent usage activity and experiences in web-based psychological intervention programs helps in developing universal programs that can be adopted for promotion of adolescent well-being and prevention of mental health problems. This study examined the usage activity, perceived usefulness (i.e., learning of mindfulness, acceptance and value-related skills), and program satisfaction of 157 Finnish ninth-grade adolescents, who participated in a school-based five-week universal acceptance and commitment therapy web intervention called Youth Compass. Individual and growth environment-related antecedents were measured before the five-week intervention, adolescents' usage activity during the intervention, and perceived usefulness and satisfaction after the intervention. The results showed that female adolescents and adolescents with high self-regulation were more active program users and had more positive experiences of the program. Most of the adolescents used the program on at least a moderate level and perceived it to be moderately or highly useful and satisfactory. Four subgroups of adolescents were identified based on their usage activity, perceived usefulness, and satisfaction: adolescents in the satisfied group (41%) had average activity and high perceived usefulness and intervention satisfaction, the dissatisfied group (18%) had low activity and very low perceived usefulness and intervention satisfaction, the active group (8%) had very high activity and average perceived usefulness and intervention satisfaction, and the moderate group (33%) had average activity, perceived usefulness and intervention satisfaction. Gender, academic achievement, closeness to mother and teacher, and conflict with teacher were significantly related to subgroup membership. The results suggested that adolescent usage activity, perceived usefulness, and satisfaction with the Youth Compass program may to some extent be predicted based on different factors.

Effectiveness and dissemination of computer-based cognitive behavioral therapy for depressed adolescents: Effective and accessible to whom?

BACKGROUND

The aim of this study was to investigate the effectiveness of a Computer-based Cognitive Behavioral Therapy (CCBT) and identify the characteristics of depressed adolescents that participated in the CCBT program.

METHODS

Screening tests for depression and help-seeking variables were conducted in school-aged Korean adolescents (n= 376, mean age=15.71 years, 53.7% female). The number of adolescents that scored above the threshold for mild depression (PHQ-9, CES-D) was 139. Fifty adolescents agreed to participate in the randomized controlled trial (RCT) of CCBT program. Twenty-five adolescents were randomly assigned to the treatment group, and the other 25 to the waitlist control group. The treatment group engaged in CCBT with therapeutic support. To identify variables affecting the outcomes, the quality of their homework compliance also was assessed.

RESULTS

Participants (n=50) who agreed to participate in the CCBT program demonstrated different help-seeking attitudes - a greater recognition of the need for help and lower interpersonal openness - compared to the adolescents (n=87) who did not participate (t = -2.93, p < .01; t = 3.50, p < .001). The treatment group showed significant improvements in depression, self-esteem, and quality of life compared to the waitlist group. Adolescents with high homework compliance showed a significant decrease in the depression scores compared to adolescents with low homework compliance.

LIMITATIONS

Small sample size, no follow-up assessments.

CONCLUSION

CCBT could be an effective alternative for depressed adolescents, especially those who tend to have low interpersonal openness. To improve the effects of CCBT, therapeutic support needs to be provided.

Characteristics of effective online interventions: implications for adolescents with personality disorder during a global pandemic

In recent years, the necessity of providing online interventions for adolescents, as an alternative to face-to-face interventions, has become apparent due to several barriers some adolescents face in accessing treatment. This need has become more critical with the coronavirus disease 2019 (COVID-19) global pandemic impacting the delivery of psychotherapy and limiting accessibility of face-to-face therapy. Whilst it has been established that face-to-face psychotherapy for adolescents with personality disorder can be effective in reducing the impact these complex mental illnesses have on functioning, online interventions for adolescents are rare, and to our knowledge there are no empirically validated online interventions for personality disorder. The development of novel online interventions are therefore necessary. To inform the development of online interventions for adolescents with personality disorder or symptoms of emerging personality disorder, a two-phase rapid review was conducted. Phase one consisted of a search and examination of existing online mental health programs for adolescents with symptoms of personality disorder, to understand how to best use online platforms. Phase two consisted of a rapid review of empirical literature examining online interventions for adolescents experiencing symptoms of personality disorder to identify characteristics that promote efficacy. There were no online programs specific to personality disorder in adolescence. However, 32 online mental health programs and 41 published empirical studies were included for analysis. Common intervention characteristics included timeframes of one to two months, regular confidential therapist contact, simple interactive online components and modules, and the inclusion of homework or workbook activities to practice new skills. There is an urgent need for online interventions targeting personality dysfunction in adolescence. Several characteristics of effective online interventions for adolescents were identified. These characteristics can help inform the development and implementation of novel online treatments to prevent and reduce the burden and impact of personality disorder, or symptoms of emerging personality disorder, in adolescents. This has implications for the COVID-19 pandemic when access to effective online interventions has become more urgent.

Effectiveness of ICT-based intimate partner violence interventions: a systematic review

BACKGROUND

Intimate Partner Violence is a "global pandemic". Meanwhile, information and communication technologies (ICT), such as the internet, mobile phones, and smartphones, are spreading worldwide, including in low- and middle-income countries. We reviewed the available evidence on the use of ICT-based interventions to address intimate partner violence (IPV), evaluating the effectiveness, acceptability, and suitability of ICT for addressing different aspects of the problem (e.g., awareness, screening, prevention, treatment, mental health).

METHODS

We conducted a systematic review, following PRISMA guidelines, using the following databases: PubMed, PsycINFO, and Web of Science. Key search terms included women, violence, domestic violence, intimate partner violence, information, communication technology, ICT, technology, email, mobile, phone, digital, ehealth, web, computer, online, and computerized. Only articles written in English were included.

RESULTS

Twenty-five studies addressing screening and disclosure, IPV prevention, ICT suitability, support and women's mental health were identified. The evidence reviewed suggests that ICT-based interventions were effective mainly in screening, disclosure, and prevention. However, there is a lack of homogeneity among the studies' outcome measurements and the sample sizes, the control groups used (if any), the type of interventions, and the study recruitment space. Questions addressing safety, equity, and the unintended consequences of the use of ICT in IPV programming are virtually non-existent.

CONCLUSIONS

There is a clear need to develop women-centered ICT design when programming for IPV. Our study showed only one study that formally addressed software usability. The need for more research to address safety, equity, and the unintended consequences of the use of ICT in IPV programming is paramount. Studies addressing long term effects are also needed.

Adherence to e-mental health among youth: Considerations for intervention development and research design

E-mental health programmes have great potential to provide young people with access to mental health support. However, it is commonly reported that adherence to these programmes is low. Low adherence can be problematic, particularly if young people do not receive the full benefits of a programme. In a research trial setting, non-adherence to treatment recommendations can prevent researchers from drawing strong conclusions about effectiveness. Although adherence has been recognised as an issue in need of attention, many of the reviews available are focused on adults and lack clear direction towards what strategies to employ. This paper presents a broad review of the adherence literature, focusing on factors associated with improving adherence to e-mental health among youth. Our view on the key elements to improve adherence identified from the existing literature are presented, and key recommendations for e-mental health intervention design are provided. These include: developing and communicating adherence guidelines based on individuals’ needs and symptom severity, including customisable features to provide a tailored experience and promote a sense of agency, including engagement checks and adopting a user-centred approach by utilising strategies such as co-design. This paper provides guidance to intervention designers and researchers by outlining recommendations and considerations for intervention development and research design.

Engagement with a Web-Based Health Promotion Intervention among Vocational School Students: A Secondary User and Usage Analysis

Engagement with web-based interventions is both generally low and typically declining. Visits and revisits remain a challenge. Based on log data of a web-based cluster randomized controlled trial conducted in vocational schools, the present secondary analysis aimed to identify influencing factors on initially logging in to a health promotion platform among young adults and to examine the engagement over the course of an eight-week intervention. Data of 336 students (62.2% female, age span 18–25) from two intervention arms (web-based intervention and web-based intervention with an additional initial face-to-face contact) was included. Binary logistic regression and log-data visualization were performed. An additional initial face-to-face contact (odds ratio (OR) = 2.971, p = 0.005), female sex (OR = 2.237, p = 0.046) and the health-related skill “dealing with health information” (OR = 2.179, p = 0.030) significantly increased the likelihood of initially logging in. Other variables showed no influence. 16.6% of all potential users logged in at least once, of which 57.4% revisited the platform. Most logins were tracked at the beginning of the intervention and repeated engagement was low. To increase the engagement with web-based interventions, health-related skills should be fostered. In addition, a strategy could be to interlink comparable interventions in vocational schools more regularly with everyday teaching through multi-component interventions.

Factors associated with engagement in online self-help programs among people with suicidal thoughts

BACKGROUND

The effectiveness of internet-based self-help programs for mental health may be limited by low engagement. Identifying factors associated with engagement in online interventions assists in developing strategies to improve efficacy through greater engagement. The aim of the current study was to identify factors associated with engagement among people with suicidal thoughts who completed an online program.

METHOD

418 adults with suicidal ideation were recruited online into a randomized controlled trial of a 6-week internet-based self-help program. Program usage for the intervention and active control conditions was measured as the number of logins and modules accessed. Predictors of program usage and between-group differences were examined, including sociodemographic variables, user preferences and mental health status.

RESULTS

Both the control group and the intervention group accessed approximately three modules (M = 3.1, SD = 2.0 v. M = 2.8, SD = 2.1, respectively), although participants in the intervention group had a significantly higher number of logins (17.3 vs 9.7, p < 0.001). Across both conditions, individuals with more severe suicidal thoughts had better engagement with their respective program. More logins for both programs were also associated with being female, married or in a de-facto relationship, not employed, less severe depression and less willingness to seek help from informal sources.

LIMITATIONS

Metrics of adherence may not directly reflect engagement with the program. There may be additional unmeasured factors associated with engagement.

CONCLUSIONS

The findings suggest that different engagement strategies may be required depending on sociodemographic and clinical characteristics. Tailoring interventions to at-risk subgroups may optimise health and functional outcomes.

Examining the Usage, User Experience, and Perceived Impact of an Internet-Based Cognitive Behavioral Therapy Program for Adolescents With Anxiety: Randomized Controlled Trial

BACKGROUND

Internet-based cognitive behavioral therapy (iCBT) increases treatment access for adolescents with anxiety; however, completion rates of iCBT programs are typically low. Understanding adolescents' experiences with iCBT, what program features and changes in anxiety (minimal clinically important difference [MCID]) are important to them, may help explain and improve iCBT program use and impact.

OBJECTIVE

Within a randomized controlled trial comparing a six-session iCBT program for adolescent anxiety, Being Real, Easing Anxiety: Tools Helping Electronically (Breathe), with anxiety-based resource webpages, we aimed to (1) describe intervention use among adolescents allocated to Breathe or webpages and those who completed postintervention assessments (Breathe or webpage respondents); (2) describe and compare user experiences between groups; and (3) calculate an MCID for anxiety and explore relationships between iCBT use, experiences, and treatment response among Breathe respondents.

METHODS

Enrolled adolescents with self-reported anxiety, aged 13 to 19 years, were randomly allocated to Breathe or webpages. Self-reported demographics and anxiety symptoms (Multidimensional Anxiety Scale for Children-2nd edition [MASC-2]) were collected preintervention. Automatically-captured Breathe or webpage use and self-reported symptoms and experiences (User Experience Questionnaire for Internet-based Interventions) were collected postintervention. Breathe respondents also reported their perceived change in anxiety (Global Rating of Change Scale [GRCS]) following program use. Descriptive statistics summarized usage and experience outcomes, and independent samples t tests and correlations examined relationships between them. The MCID was calculated using the mean MASC-2 change score among Breathe respondents reporting somewhat better anxiety on the GRCS.

RESULTS

Adolescents were mostly female (382/536, 71.3%), aged 16.6 years (SD 1.7), with very elevated anxiety (mean 92.2, SD 18.1). Intervention use was low for adolescents allocated to Breathe (mean 2.2 sessions, SD 2.3; n=258) or webpages (mean 2.1 visits, SD 2.7; n=278), but was higher for Breathe (median 6.0, range 1-6; 81/258) and webpage respondents (median 2.0, range 1-9; 148/278). Total user experience was significantly more positive for Breathe than webpage respondents (P<.001). Breathe respondents reported program design and delivery factors that may have challenged (eg, time constraints and program support) or facilitated (eg, demonstration videos, self-management activities) program use. The MCID was a mean MASC-2 change score of 13.8 (SD 18.1). Using the MCID, a positive treatment response was generated for 43% (35/81) of Breathe respondents. Treatment response was not correlated with respondents' experiences or use of Breathe (P=.32 to P=.88).

CONCLUSIONS

Respondents reported positive experiences and changes in their anxiety with Breathe; however, their reports were not correlated with program use. Breathe respondents identified program design and delivery factors that help explain their experiences and use of iCBT and inform program improvements. Future studies can apply our measures to compare user experiences between internet-based interventions, interpret treatment outcomes and improve treatment decision making for adolescents with anxiety.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT02970734 https://clinicaltrials.gov/ct2/show/NCT02970734.

The Role of Learning Support and Chat-Sessions in Guided Internet-Based Cognitive Behavioral Therapy for Adolescents With Anxiety: A Factorial Design Study

BACKGROUND

Increased awareness of anxiety in adolescents emphasises the need for effective interventions. Internet-based cognitive behavioural therapy (ICBT) could be a resource-effective and evidence-based treatment option, but little is known about how to optimize ICBT or which factors boost outcomes. Recently, the role of knowledge in psychotherapy has received increased focus. Further, chat-sessions are of interest when trying to optimize ICBT for youths. This study aimed to evaluate the role of learning support and chat-sessions during ICBT for adolescent anxiety, using a factorial design.

METHOD

A total of 120 adolescents were randomised to one of four treatment groups, in a 2x2 design with two factors: with or without learning support and/or chat-sessions.

RESULTS

Anxiety and depressive symptoms were reduced (Beck Anxiety Inventory- BAI; Cohen's d =0.72; Beck Depression Inventory- BDI; d =0.97). There was a main effect of learning support on BAI (d =0.38), and learning support increased knowledge gain (d =0.42). There were no main effects or interactions related to the chat-sessions. Treatment effects were maintained at 6-months, but the added effect of learning support had by then vanished.

CONCLUSION

ICBT can be an effective alternative when treating adolescents with anxiety. Learning support could be of importance to enhance short-term treatment effects, and should be investigated further.

Evaluating the Efficacy of Internet-Delivered Cognitive Behavioral Therapy Blended With Synchronous Chat Sessions to Treat Adolescent Depression: Randomized Controlled Trial

Background

Depression is a common and serious problem among adolescents, but few seek or have access to therapy. Internet-delivered cognitive behavioral therapies (ICBTs), developed to increase treatment access, show promise in reducing depression. The inclusion of coach support in treatment is desired and may be needed.

Objective

The aim of this study was to determine the efficacy of an ICBT protocol blended with weekly real-time therapist sessions via chat; blended treatment, for adolescent depression, including major depressive episode (MDE). The protocol has previously been evaluated in a controlled study.

Methods

In a two-arm randomized controlled trial, adolescents 15 to 19 years of age were recruited through a community setting at the national level in Sweden (n=70) and allocated to either 8 weeks of treatment or to minimal attention control. Depression was assessed at baseline, at posttreatment, and at 12 months following treatment (in the intervention group). The primary outcome was self-reported depression level as measured with the Beck Depression Inventory II at posttreatment. The intervention was offered without the need for parental consent.

Results

Over two weeks, 162 adolescents registered and completed the baseline screening. Eligible participants (n=70) were on average 17.5 years of age (SD 1.15), female (96%, 67/70), suffered from MDE (76%, 53/70), had no previous treatment experience (64%, 45/70), and reported guardian(s) to be aware about their depression state (71%, 50/70). The average intervention completion was 74% (11.8 of 16 modules and sessions). Following the treatment, ICBT participants demonstrated a significant decrease in depression symptoms compared with controls (P<.001), corresponding to a large between-group effect (intention-to-treat analysis: d=0.86, 95% CI 0.37-1.35; of completer analysis: d=0.99, 95% CI 0.48-1.51). A significant between-group effect was observed in the secondary depression outcome (P=.003); clinically significant improvement was found in 46% (16/35) of ICBT participants compared with 11% (4/35) in the control group (P=.001).

Conclusions

The results are in line with our previous study, further demonstrating that adolescents with depression can successfully be engaged in and experience significant improvement following ICBT blended with therapist chat sessions. Findings on participants’ age and baseline depression severity are of interest in relation to used study methods.

Trial Registration

ClinicalTrials.gov NCT02363205; https://clinicaltrials.gov/ct2/show/NCT02363205

Addition of MoodGYM to physical treatments for chronic low back pain: A randomized controlled trial

Background

Low back pain (LBP) is prevalent, costly and disabling. A biopsychosocial treatment approach involving physical and cognitive behavioural therapy (CBT) is recommended for those with chronic LBP. It is not known if online psychological coaching tools might have a role in the secondary prevention of LBP related disability. To assess the effectiveness of an internet-delivered psychological program (MoodGYM) in addition to standard physical treatment in patients with chronic non-specific LBP at medium risk of ongoing disability.

Methods

A multisite randomized controlled trial was conducted with 108 participants (aged mean 50.4 ± 13.6 years) with chronic LBP attending one of six private physiotherapy or chiropractic clinics. Disability (Roland Morris Disability Questionnaire) and self-efficacy (Patient Self-Efficacy Questionnaire), were assessed at baseline, post-treatment (8-weeks) with follow-up at six- and twelve-months. Participants were randomized into either the intervention group, MoodGYM plus physical treatments, or the control group which received physical treatments alone.

Results

No statistically significant between group differences were observed for either disability at post-treatment (Effect size (standardised mean difference) 95% CI) RMD - 0.06 (- 0.45,0.31), 6-months RMD 0.01 (- 0.38,0.39) and 12-months - 0.20 (- 0.62,0.17) or self-efficacy at post-treatment PSEQ 0.06 (- 0.31,0.45), 6-months 0.02 (- 0.36,0.41) and 12-months 0.21 (- 0.16,0.63).

Conclusion

There was no additional benefit of an internet-delivered CBT program (MoodGYM) to physical treatments in those with chronic non-specific LBP at medium risk of ongoing disability measured at post-treatment, or at 6 and 12 months.

Trial registration

This trial was prospectively registered with Australian New Zealand Clinical Trials Registry Number (ACTRN) 12615000269538.

Potential Reduction of Symptoms With the Use of Persuasive Systems Design Features in Internet-Based Cognitive Behavioral Therapy Programs for Children and Adolescents With Anxiety: A Realist Synthesis

BACKGROUND

Internet-based cognitive behavioral therapy (iCBT) for children and adolescents is a persuasive system that combines 3 major components to therapy-therapeutic content, technological features, and interactions between the user and program-intended to reduce users' anxiety symptoms. Several reviews report the effectiveness of iCBT; however, iCBT design and delivery components differ widely across programs, which raise important questions about how iCBT effects are produced and can be optimized.

OBJECTIVE

The objective of this study was to review and synthesize the iCBT literature using a realist approach with a persuasive systems perspective to (1) document the design and delivery components of iCBT and (2) generate hypotheses as to how these components may explain changes in anxiety symptoms after completing iCBT.

METHODS

A multi-strategy search identified published and gray literature on iCBT for child and adolescent anxiety up until June 2019. Documents that met our prespecified inclusion criteria were appraised for relevance and methodological rigor. Data extraction was guided by the persuasive systems design (PSD) model. The model describes 28 technological design features, organized into 4 categories that help users meet their health goals: primary task support, dialogue support, system credibility support, and social support. We generated initial hypotheses for how PSD (mechanisms) and program delivery (context of use) features were linked to symptom changes (outcomes) across iCBT programs using realist and meta-ethnographic techniques. These hypothesized context-mechanism-outcome configurations were refined during analysis using evidence from the literature to improve their explanatory value.

RESULTS

A total of 63 documents detailing 15 iCBT programs were included. A total of six iCBT programs were rated high for relevance, and most studies were of moderate-to-high methodological rigor. A total of 11 context-mechanism-outcome configurations (final hypotheses) were generated. Configurations primarily comprised PSD features from the primary task and dialogue support categories. Several key PSD features (eg, self-monitoring, simulation, social role, similarity, social learning, and rehearsal) were consistently reported in programs shown to reduce anxiety; many features were employed simultaneously, suggesting synergy when grouped. We also hypothesized the function of PSD features in generating iCBT impacts. Adjunct support was identified as an important aspect of context that may have complemented certain PSD features in reducing users' anxiety.

CONCLUSIONS

This synthesis generated context-mechanism-outcome configurations (hypotheses) about the potential function, combination, and impact of iCBT program components thought to support desired program effects. We suggest that, when delivered with adjunct support, PSD features may contribute to reduced anxiety for child and adolescent users. Formal testing of the 11 configurations is required to confirm their impact on anxiety-based outcomes. From this we encourage a systematic and deliberate approach to iCBT design and evaluation to increase the pool of evidence-based interventions available to prevent and treat children and adolescents with anxiety.

Use of Web Conferencing Technology for Conducting Online Focus Groups Among Young People With Lived Experience of Suicidal Thoughts: Mixed Methods Research

BACKGROUND

There is an increasing interest in engaging people with lived experience in suicide prevention research. However, young people with suicidal thoughts have been described as a "hard-to-include" population due to time, distance, stigma, and social barriers.

OBJECTIVE

This study aims to investigate whether conducting synchronous Web conferencing technology-based online focus groups (W-OFGs) is a feasible method to engage young people with lived experience of suicidal thoughts in suicide prevention research.

METHODS

Young people aged between 16 and 25 years and living in Sydney, Australia, were recruited through flyers, emails, and social media advertisements. The W-OFGs were established using a Web conferencing technology called GoToMeeting. Participants' response rate, attendance, and feedback of the W-OFGs were analyzed to determine whether the W-OFG system is feasible for suicide prevention research. Researchers' reflections about how to effectively implement the W-OFGs were also reported as part of the results.

RESULTS

In the pre-W-OFG survey, 39 (97.5%) young people (n=40) chose to attend the online focus group. Among the 22 participants who responded to the W-OFG invitations, 15 confirmed that they would attend the W-OFGs, of which 11 participants attended the W-OFGs. Feedback collected from the participants in the W-OFG and the post-W-OFG survey suggested that online focus groups are acceptable to young people in suicide prevention research. Considerations for selecting the Web conferencing platform, conducting the mock W-OFGs, implementing the risk management procedure, inviting participants to the W-OFGs, and hosting and moderating the W-OFGs as well as a few potential ethical and pragmatic challenges in using this method are discussed in this study.

CONCLUSIONS

The Web conferencing technology provides a feasible replacement for conventional methods, particularly for qualitative research involving vulnerable populations and stigmatized topics including suicide prevention. Our results indicate that this modality is an optimal alternative to engage young people in the focus group discussion. Future studies should compare the data collected from the Web conferencing technology and conventional face-to-face methods in suicide prevention research to determine if these two methods are equivalent in data quality from a quantitative approach.

Web-based CBT for the prevention of anxiety symptoms among medical and health science graduate students

Medical and health science graduate students report greater anxiety problems than the general population, but they are less likely to seek treatment due to cultural and logistical barriers. One preventative approach that overcomes these barriers is web-based cognitive behavioral therapy (webCBT). It is unknown whether webCBT is effective for preventing anxiety escalation within this population. A randomized controlled trial was conducted, comparing the effects of webCBT versus a control group (CG). Medical university students (n=594; Mage=27; 67% female; 80% Caucasian) completed online baseline measures and four assigned online activities. Measures were re-administered after approximately three months. There was a small interaction effect between time of assessment and treatment condition. Anxiety severity was lower in the webCBT (M[SD]=2.88[3.36]) versus CG condition (M[SD]=3.69 [3.35]) at follow-up. This effect was moderate for students with mild, versus minimal, anxiety at baseline. The proportion of students with possible anxiety disorder was lower in the webCBT (4.5%) versus CG (8.5%) condition, and the proportion of mildly anxious students with a clinically significant increase in symptoms was lower in the webCBT (10%) versus CG (20%) condition. WebCBT may aid in preventing anxiety escalation in this population, particularly for at-risk students who report mild anxiety symptoms.

Design and Development of the "POD Adventures" Smartphone Game: A Blended Problem-Solving Intervention for Adolescent Mental Health in India

Introduction: Digital technology platforms offer unparalleled opportunities to reach vulnerable adolescents at scale and overcome many barriers that exist around conventional service provision. This paper describes the design and development of POD Adventures, a blended problem-solving game-based intervention for adolescents with or at risk of anxiety, depression and conduct difficulties in India. This intervention was developed as part of the PRemIum for ADolEscents (PRIDE) research programme, which aims to establish a suite of transdiagnostic psychological interventions organized around a stepped care system in Indian secondary schools. Methods and Materials: Intervention development followed a person-centered approach consisting of four iterative activities: (i) review of recent context-specific evidence on mental health needs and preferences for the target population of school-going Indian adolescents, including a multiple stakeholder analysis of school counseling priorities and pilot studies of a brief problem-solving intervention; (ii) new focus group discussions with N = 46 student participants and N = 8 service providers; (iii) co-design workshops with N = 22 student participants and N = 8 service providers; and (iv) user-testing with N = 50 student participants. Participants were aged 12-17 years and recruited from local schools in New Delhi and Goa, including a subgroup with self-identified mental health needs (N = 6). Results: Formative data from existing primary sources, new focus groups and co-design workshops supported a blended format for delivering a brief problem-solving intervention, with counselors supporting use of a game-based app on "offline" smartphones. User-testing with prototypes identified a need for simplification of language, use of concrete examples of concepts and practice elements to enhance engagement. There were also indications that participants most valued relatability and interactivity within real-world stories with judicious support from an in-app guide. The final prototype comprised a set of interactive and gamified vignettes and a structured set of problem-solving questions to consolidate and generalize learning while encouraging real-world application. Discussion: Findings shaped the design of POD Adventures and its delivery as an open-access blended intervention for secondary school students with a felt need for psychological support, consistent with an early intervention paradigm. A randomized controlled trial is planned to evaluate processes and impacts of POD Adventures when delivered for help-seeking students in low-resource school settings.

Smooth Sailing: A Pilot Study of an Online, School-Based, Mental Health Service for Depression and Anxiety

Background: Schools play an important role in supporting young people's mental health, but face challenges identifying and responding to students in need of care. To assist secondary schools, the Black Dog Institute has developed an online, school-based, mental health service (Smooth Sailing). Delivered in the classroom, Smooth Sailing uses a website to screen, assess, allocate, and deliver care for depression and anxiety. The service is based on the principles of stepped care, offering treatments with varied intensity and follow-up by a school counselor when necessary. The current study aimed to evaluate the feasibility, acceptability, and safety of this new type of service among secondary school students. Methods: Between February and June 2017, a single-arm, pre-post, pilot study was conducted among students from four NSW secondary schools. Schools were given access to the service for 6 weeks. Feasibility measures (consent rates and step allocations), acceptability measures (service use and satisfaction) and safety measures (deterioration in help-seeking intention scores and mental health symptoms) were assessed at baseline and completion of the 6-week trial period. Results: A total of 59 students took part in the service pilot (mean age, 14.57 years; SD, 0.89 years; range, 13-16 years). At baseline, 18.64% of students were found to require follow-up from the school counselor, and 80% of these were new cases. Although completion of the online modules was low, service satisfaction was high. At 6 weeks, the mean scores for help-seeking, depression, and anxiety remained relatively stable or improved. Conclusions: The current study presents important findings for the development and implementation of an online mental health service that screens students' mental health and allocates care accordingly, all within the school setting. Although the findings provide some support for the feasibility, acceptability, and safety, service improvements are needed. The modifications outlined are likely to improve the quality of the service and its effectiveness. Trial Registration: Australian New Zealand Clinical Trials Registry (ANZCTR): ACTRN12617000977370.

Impact of a Web Program to Support the Mental Wellbeing of High School Students: A Quasi Experimental Feasibility Study

Little effort has been made to investigate the potential of web programs aimed to support the mental wellbeing of adolescents in school environments in middle-income countries. A quasi-experimental feasibility study was conducted in Thailand with adolescents (N = 180) in three conveniently sampled high schools and with teachers (N = 12) who acted as program tutors. The web program was used in small groups, independently, or it was not used at all. No statistically significant changes were found between the groups regarding depression, stress, or satisfaction. Differences between program users (n = 61) and non-users (n = 48) were not significant. Acceptance was higher among adolescents who used the program independently (n = 40, 73% vs. n = 21, 39%; p = 0.001). Usability feedback did not differ between the groups. Support should be provided in order for programs to be potentially used. More information is needed regarding factors associated with the use of web programs.

A multi-faceted approach to characterizing user behavior and experience in a digital mental health intervention

Digital interventions offer great promise for supporting health-related behavior change. However, there is much that we have yet to learn about how people respond to them. In this study, we present a novel mixed-methods approach to analysis of the complex and rich data that digital interventions collect. We perform secondary analysis of IntelliCare, an intervention in which participants are able to try 14 different mental health apps over the course of eight weeks. The goal of our analysis is to characterize users' app use behavior and experiences, and is rooted in theoretical conceptualizations of engagement as both usage and user experience. In the first aim, we employ cluster analysis to identify subgroups of participants that share similarities in terms of the frequency of their usage of particular apps, and then employ other engagement measures to compare the clusters. We identified four clusters with different app usage patterns: Low Usage, High Usage, Daily Feats Users, and Day to Day users. Each cluster was distinguished by its overall frequency of app use, or the main app that participants used. In the second aim, we developed a computer-assisted text analysis and visualization method - message highlighting - to facilitate comparison of the clusters. Last, we performed a qualitative analysis using participant messages to better understand the mechanisms of change and usability of salient apps from the cluster analysis. Our novel approach, integrating text and visual analytics with more traditional qualitative analysis techniques, can be used to generate insights concerning the behavior and experience of users in digital health contexts, for subsequent personalization and to identify areas for improvement of intervention technologies.

Usability and Engagement Evaluation of an Unguided Online Program for Promoting a Healthy Lifestyle and Reducing the Risk for Eating Disorders and Obesity in the School Setting

Implementing integrated online prevention to reduce the risk of both obesity and eating disorders, in the school setting, is a promising approach. The challenge is to develop highly user-friendly and motivating programs, to foster adherence and effectiveness. The purpose of this study was to evaluate the usability of such a universal prevention program for students aged 14⁻19 years, and to address engagement issues. A mixed-methods approach was chosen, consisting of a think-aloud task, a semi-structured interview, and a questionnaire including items on sociodemographic characteristics and the System Usability Scale (SUS). Usability tests were conducted in two rounds, with five adolescents participating per round. Mean score in the SUS was 92.5 of 100 points (range 85⁻100), in the second round, after some adaptations from the participants' feedback. In the course of the think-aloud tasks and interviews, five major themes emerged-visual design, navigation, mode of transfer, content, and engagement conditions. Interesting headlines, gamification, and monitoring tools are crucial for engagement. Apart from the importance of using the program during school hours, the study showed that problems currently perceived as important by the target group, need to be considered and addressed, prior to offering them prevention programs, which highlights the importance of a user-centered design.

Design and Delivery Features That May Improve the Use of Internet-Based Cognitive Behavioral Therapy for Children and Adolescents With Anxiety: A Realist Literature Synthesis With a Persuasive Systems Design Perspective

Background

Internet-based cognitive behavioral therapy (iCBT) is a persuasive system as its design combines therapeutic content, technological features, and interactions between the user and the program to reduce anxiety for children and adolescents. How iCBT is designed and delivered differs across programs. Although iCBT is considered an effective approach for treating child and adolescent anxiety, rates of program use (eg, module completion) are highly variable for reasons that are not clear. As the extent to which users complete a program can impact anxiety outcomes, understanding what iCBT design and delivery features improve program use is critical for optimizing treatment effects.

Objective

The objectives of this study were to use a realist synthesis approach to explore the design and delivery features of iCBT for children and adolescents with anxiety as described in the literature and to examine their relationship to program use outcomes.

Methods

A search of published and gray literature was conducted up to November 2017. Prespecified inclusion criteria identified research studies, study protocols, and program websites on iCBT for child and adolescent anxiety. Literature was critically appraised for relevance and methodological rigor. The persuasive systems design (PSD) model, a comprehensive framework for designing and evaluating persuasive systems, was used to guide data extraction. iCBT program features were grouped under 4 PSD categories—Primary task support, Dialogue support, System credibility support, and Social support. iCBT design (PSD Mechanisms) and delivery features (Context of use) were linked to program use (Outcomes) using meta-ethnographic methods; these relationships were described as Context-Mechanism-Outcome configurations. For our configurations, we identified key PSD features and delivery contexts that generated moderate-to-high program use based on moderate-to-high quality evidence found across multiple iCBT programs.

Results

A total of 44 documents detailing 10 iCBT programs were included. Seven iCBT programs had at least one document that scored high for relevance; most studies were of moderate-to-high methodological rigor. We developed 5 configurations that highlighted 8 PSD features (Tailoring, Personalization [Primary task supports]; Rewards, Reminders, Social role [Dialogue supports]; and Trustworthiness, Expertise, Authority [System credibility supports]) associated with moderate-to-high program use. Important features of delivery Context were adjunct support (a face-to-face, Web- or email-based communications component) and whether programs targeted the prevention or treatment of anxiety. Incorporating multiple PSD features may have additive or synergistic effects on program use.

Conclusions

The Context-Mechanism-Outcome configurations we developed suggest that, when delivered with adjunct support, certain PSD features contribute to moderate-to-high use of iCBT prevention and treatment programs for children and adolescents with anxiety. Standardization of the definition and measurement of program use, formal testing of individual and combined PSD features, and use of real-world design and testing methods are important next steps to improving how we develop and deliver increasingly useful treatments to target users.

What Works and What Doesn't Work? A Systematic Review of Digital Mental Health Interventions for Depression and Anxiety in Young People

Background: A major challenge in providing mental health interventions for young people is making such interventions accessible and appealing to those most in need. Online and app-based forms of therapy for mental health are burgeoning. It is therefore crucial to identify features that are most effective and engaging for young users. Objectives: This study reports a systematic review and meta-analysis of digital mental health interventions and their effectiveness in addressing anxiety and depression in young people to determine factors that relate to outcomes, adherence, and engagement with such interventions. Methods: A mixed methods approach was taken, including a meta-analysis of 9 randomized controlled trials that compared use of a digital intervention for depression in young people to a no-intervention control group, and 6 comparing the intervention to an active control condition. A thematic analysis and narrative synthesis of 41 studies was also performed. Results: The pooled effect size of digital mental health interventions on depression in comparison to a no-intervention control was small (Cohen's d = 0.33, 95% CI 0.11 to 0.55), while the pooled effect size of studies comparing an intervention group to an active control showed no significant differences (Cohen's d = 0.14, 95% CI -.04 to 0.31). Pooled effect sizes were higher when supervision was involved (studies with no-intervention controls: Cohen's d = 0.52, 95% CI 0.23 to 0.80; studies with active control: Cohen's d = 0.49, 95% CI -0.11, 1.01). Engagement and adherence rates were low. Qualitative analysis revealed that users liked interventions with a game-like feel and relatable, interactive content. Educational materials were perceived as boring, and users were put off by non-appealing interfaces and technical glitches. Conclusions: Digital interventions work better than no intervention to improve depression in young people when results of different studies are pooled together. However, these interventions may only be of clinical significance when use is highly supervised. Digital interventions do not work better than active alternatives regardless of the level of support. Future interventions need to move beyond the use of digital educational materials, considering other ways to attract and engage young people and to ensure relevance and appeal.

Theoretical Perspectives of Adherence to Web-Based Interventions: a Scoping Review

PURPOSE

The purpose of this paper is to review the literature as this relates to theoretical perspectives of adherence to web-based interventions, drawing upon empirical evidence from the fields of psychology, business, information technology and health care.

METHODS

A scoping review of the literature utilising principles outlined by Arksey and O'Malley was undertaken.

RESULTS

Several relevant theoretical perspectives have emerged, eight of which are charted and discussed in this review. These are the Internet Intervention Model, Persuasive Systems Design, the 'PERMA' framework, the Support Accountability Model, the Model of User Engagement, the Technology Acceptance Model, the Unified Theory of Acceptance and Use of IT and the Conceptual Model of User Engagement.

CONCLUSIONS

The findings of the review indicate that an interdisciplinary approach, incorporating a range of technological, environmental and individual factors, may be needed in order to comprehensively explain user adherence to web-based interventions.

Caring For Me and You: the co-production of a computerised cognitive behavioural therapy (cCBT) package for carers of people with dementia

OBJECTIVES

Carers of people with dementia face barriers in accessing therapy for mental health difficulties. Computerised cognitive behavioural therapy (cCBT) packages can be effective in treating a range of presentations; however, tailored packages for carers' unique needs are lacking. Our aim was to design a cCBT package for carers to address the limitations of previous online interventions, by including users and experts as consultants and collaborators throughout the project.

METHOD

We adopted a three-phase approach to the development process. Firstly, a data-gathering phase in which current literature and best practice was reviewed, and semi-structured interviews conducted with service users, academic and clinical experts. Secondly, a co-production and refinement phase with carers testing materials and providing feedback. Thirdly, a pilot field testing phase of service users and the research team testing the package.

RESULTS

The 'Caring For Me and You' package adopted a transdiagnostic approach to take account of the range of difficulties that carers face. The package consisted of 20 short sessions with features built in to engage users and personalise content to meet individuals' needs.

CONCLUSION

User involvement was central to the design of the 'Caring For Me and You' package which is currently being evaluated in a three-arm randomised controlled trial.

Beyond the Trial: Systematic Review of Real-World Uptake and Engagement With Digital Self-Help Interventions for Depression, Low Mood, or Anxiety

Background

Digital self-help interventions (including online or computerized programs and apps) for common mental health issues have been shown to be appealing, engaging, and efficacious in randomized controlled trials. They show potential for improving access to therapy and improving population mental health. However, their use in the real world, ie, as implemented (disseminated) outside of research settings, may differ from that reported in trials, and implementation data are seldom reported.

Objective

This study aimed to review peer-reviewed articles reporting user uptake and/or ongoing use, retention, or completion data (hereafter usage data or, for brevity, engagement) from implemented pure self-help (unguided) digital interventions for depression, anxiety, or the enhancement of mood.

Methods

We conducted a systematic search of the Scopus, Embase, MEDLINE, and PsychINFO databases for studies reporting user uptake and/or usage data from implemented digital self-help interventions for the treatment or prevention of depression or anxiety, or the enhancement of mood, from 2002 to 2017. Additionally, we screened the reference lists of included articles, citations of these articles, and the titles of articles published in Internet Interventions, Journal of Medical Internet Research (JMIR), and JMIR Mental Health since their inception. We extracted data indicating the number of registrations or downloads and usage of interventions.

Results

After the removal of duplicates, 970 papers were identified, of which 10 met the inclusion criteria. Hand searching identified 1 additional article. The included articles reported on 7 publicly available interventions. There was little consistency in the measures reported. The number of registrants or downloads ranged widely, from 8 to over 40,000 per month. From 21% to 88% of users engaged in at least minimal use (eg, used the intervention at least once or completed one module or assessment), whereas 7-42% engaged in moderate use (completing between 40% and 60% of modular fixed-length programs or continuing to use apps after 4 weeks). Indications of completion or sustained use (completion of all modules or the last assessment or continuing to use apps after six weeks or more) varied from 0.5% to 28.6%.

Conclusions

Available data suggest that uptake and engagement vary widely among the handful of implemented digital self-help apps and programs that have reported this, and that usage may vary from that reported in trials. Implementation data should be routinely gathered and reported to facilitate improved uptake and engagement, arguably among the major challenges in digital health.

Engagement With a Trauma Recovery Internet Intervention Explained With the Health Action Process Approach (HAPA): Longitudinal Study

BACKGROUND

There has been a growing trend in the delivery of mental health treatment via technology (ie, electronic health, eHealth). However, engagement with eHealth interventions is a concern, and theoretically based research in this area is sparse. Factors that influence engagement are poorly understood, especially in trauma survivors with symptoms of posttraumatic stress.

OBJECTIVE

The aim of this study was to examine engagement with a trauma recovery eHealth intervention using the Health Action Process Approach theoretical model. Outcome expectancy, perceived need, pretreatment self-efficacy, and trauma symptoms influence the formation of intentions (motivational phase), followed by planning, which mediates the translation of intentions into engagement (volitional phase). We hypothesized the mediational effect of planning would be moderated by level of treatment self-efficacy.

METHODS

Trauma survivors from around the United States used the eHealth intervention for 2 weeks. We collected baseline demographic, social cognitive predictors, and distress symptoms and measured engagement subjectively and objectively throughout the intervention.

RESULTS

The motivational phase model explained 48% of the variance, and outcome expectations (beta=.36), perceived need (beta=.32), pretreatment self-efficacy (beta=.13), and trauma symptoms (beta=.21) were significant predictors of intention (N=440). In the volitional phase, results of the moderated mediation model indicated for low levels of treatment self-efficacy, planning mediated the effects of intention on levels of engagement (B=0.89, 95% CI 0.143-2.605; N=115).

CONCLUSIONS

Though many factors can affect engagement, these results offer a theoretical framework for understanding engagement with an eHealth intervention. This study highlighted the importance of perceived need, outcome expectations, self-efficacy, and baseline distress symptoms in the formation of intentions to use the intervention. For those low in treatment self-efficacy, planning may play an important role in the translation of intentions into engagement. Results of this study may help bring some clarification to the question of what makes eHealth interventions work.

The association between adherence and outcome in an Internet intervention for depression

BACKGROUND

Adherence to Internet interventions is often reported to be rather low and this might adversely impact the effectiveness of these interventions. We investigated if patient characteristics are associated with adherence, and if adherence is associated with treatment outcome in a large RCT of an Internet intervention for depression, the EVIDENT trial.

METHODS

Patients were randomized to either care as usual (CAU) or CAU plus the Internet intervention Deprexis. A total of 509 participants with mild to moderate depressive symptoms were included in the intervention group and of interest for the present study. We assessed depression symptoms pre and post intervention (12 weeks). Patient characteristics, a self-rating screening for mental disorders, attitudes towards online interventions, and quality of life were assessed before randomization.

RESULTS

Adherence in this study was good with on average seven hours of usage time and eight number of sessions spent with the intervention. Some of the patient characteristics (age, sex, depressive symptoms, and confidence in the effectiveness of the program) predicted higher number of sessions in different models (explaining in total between 15 and 25% of variance). Older age (β = .16) and higher depressive symptoms (β = .15) were associated with higher usage duration. Higher adherence to the program predicted a greater symptom reduction in depressive symptoms over 12 weeks (number of sessions: β = .13, usage duration: β = .14), however, this prediction could mostly be explained by receiving guidance (β = .27 and .26).

LIMITATIONS

Receiving guidance and symptom severity at baseline were confounded since only participants with a moderate symptom severity at baseline received e-mail support. Therefore no firm conclusions can be drawn from the association we observed between baseline symptom severity and usage intensity.

CONCLUSIONS

We conclude that older age was associated with adherence and adherence was positively associated with outcome. The effects we have found were small however suggesting that adherence might also be influenced by further variables.

If we build it, will they come? Issues of engagement with digital health interventions for trauma recovery

Exposure to traumatic events is extremely common with nearly 75% reported to have experienced one or more traumatic events worldwide. A significant number of those exposed will develop posttraumatic stress disorder (PTSD) along with depression, anxiety, and substance use disorders. Globally, trauma-related mental health disorders are the leading cause of global disability burden, and many of these disorders are caused, or worsened, by exposure to wars, natural and human-caused disasters, and other traumatic events. Significant barriers to treatment exist including logistical, geographical, financial, stigma, and other attitudinal challenges. One opportune approach to overcoming these barriers is the provision of mental health interventions via technology that can be readily standardized for wide dissemination of evidence-based care. However, engagement with technology-based interventions is a concern and limited participation and high attrition rates are common. This may be especially true for trauma survivors who often experience symptoms of avoidance and hyperarousal. Engagement is regarded as an essential component of intervention efficacy and has been demonstrated to be associated with more positive clinical outcomes, yet theoretically based research in this area is sparse. This review focuses on the complex issue of engagement with digital health interventions (DHIs). Specifically, we review the conceptualization and measurement of engagement, predictors of engagement, and importantly, the relationship of engagement with intervention effectiveness. Finally, a theoretically based model of engagement is proposed that considers the unique challenges of trauma recovery. This review is not intended to provide a systematic or exhaustive set of recommendations, rather it is intended to highlight the challenges of engagement research including its definition, measurement, and modeling. Future engagement research that includes valid and reliable measures of engagement will enable consistent exploration of engagement predictors that can then inform methods for increasing engagement and, ultimately, intervention effectiveness.

Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence

BACKGROUND

In electronic health (eHealth) evaluations, there is increasing attention for studying the actual usage of a technology in relation to the outcomes found, often by studying the adherence to the technology. On the basis of the definition of adherence, we suggest that the following three elements are necessary to determine adherence to eHealth technology: (1) the ability to measure the usage behavior of individuals; (2) an operationalization of intended use; and (3) an empirical, theoretical, or rational justification of the intended use. However, to date, little is known on how to operationalize the intended usage of and the adherence to different types of eHealth technology.

OBJECTIVE

The study aimed to improve eHealth evaluations by gaining insight into when, how, and by whom the concept of adherence has been used in previous eHealth evaluations and finding a concise way to operationalize adherence to and intended use of different eHealth technologies.

METHODS

A systematic review of eHealth evaluations was conducted to gain insight into how the use of the technology was measured, how adherence to different types of technologies was operationalized, and if and how the intended use of the technology was justified. Differences in variables between the use of the technology and the operationalization of adherence were calculated using a chi-square test of independence.

RESULTS

In total, 62 studies were included in this review. In 34 studies, adherence was operationalized as "the more use, the better," whereas 28 studies described a threshold for intended use of the technology as well. Out of these 28, only 6 reported a justification for the intended use. The proportion of evaluations of mental health technologies reporting a justified operationalization of intended use is lagging behind compared with evaluations of lifestyle and chronic care technologies. The results indicated that a justification of intended use does not require extra measurements to determine adherence to the technology.

CONCLUSIONS

The results of this review showed that to date, justifications for intended use are often missing in evaluations of adherence. Evidently, it is not always possible to estimate the intended use of a technology. However, such measures do not meet the definition of adherence and should therefore be referred to as the actual usage of the technology. Therefore, it can be concluded that adherence to eHealth technology is an underdeveloped and often improperly used concept in the existing body of literature. When defining the intended use of a technology and selecting valid measures for adherence, the goal or the assumed working mechanisms should be leading. Adherence can then be standardized, which will improve the comparison of adherence rates to different technologies with the same goal and will provide insight into how adherence to different elements contributed to the outcomes.

A review of web-based support systems for students in higher education

Background

Recent evidence suggests that there is an increasing need for accessible and anonymous services to support higher education (HE) students suffering from psychological and/or academic difficulties. Such difficulties can lead to several negative outcomes, including poor academic performance, sub-optimal mental health, reduced study satisfaction, and dropout from study. Currently, universities in the UK lack financial resources and the on-campus mental health services traditionally offered to students are increasingly economically unsustainable. Compounded by the perceived stigma of using such services, mental health providers have been driven to address the escalating needs of students through online services.

Methods

In this paper, we review online support systems identified through a literature search and a manual search of references in the identified papers. Further systems were identified through web searches, and systems still in development were identified by consultation with researchers in the field. We accessed systems online to extract relevant information, regarding the main difficulties addressed by the systems, the psychological techniques used and any relevant research evidence to support their effectiveness.

Conclusion

A large number of web-based support systems have been developed to support mental health and wellbeing, although few specifically target HE students. Further research is necessary to establish the effectiveness of such interventions in providing a cost-effective alternative to face-to-face therapy, particularly in certain settings such as HE institutions.

How do eHealth Programs for Adolescents With Depression Work? A Realist Review of Persuasive System Design Components in Internet-Based Psychological Therapies

Background

Major depressive disorders are common among adolescents and can impact all aspects of their daily life. Traditional therapies, cognitive behavioral therapy (CBT), and interpersonal psychotherapy (IPT) have been delivered face-to-face. However, Internet-based (online) delivery of these therapies is emerging as an option for adolescents. Internet-based CBT and IPT involve therapeutic content, interaction between the user and the system, and different technological features embedded into the online program (eg, multimedia). Studies of Internet-based CBT and IPT for adolescent depression differ on all three aspects, and variable, positive therapy effects have been reported. A better understanding of the treatment conditions that influence therapy outcomes is important to designing and evaluating these novel therapies.

Objective

Our aim was to examine the technological and program delivery features of Internet-based CBT and IPT for adolescent depression and to document their potential relation to treatment outcomes and program use.

Methods

We performed a realist synthesis. We started with an extensive search of published and gray literature. We included intervention studies that evaluated Internet-based CBT or IPT for adolescent depression. We included mixed-methods and qualitative studies, theoretical papers, and policy/implementation documents if they included a focus on how Internet-based psychological therapy is proposed to work for adolescents with depression/depressive symptoms. We used the Mixed-Methods Appraisal Tool to assess the methodological quality of studies. We used the Persuasive System Design (PSD) model as a framework for data extraction and analysis to examine how Internet-based CBT and IPT, as technology-based systems, influence the attitudes and behaviors of system users. PSD components described for the therapies were linked to reported outcomes using a cross-case comparison method and thematic synthesis.

Results

We identified 19 Internet-based CBT programs in 59 documents. Of those, 71% (42/59) were of moderate to high quality. The PSD features surface credibility (competent “look and feel”), dialogue support (online program + in-person support), liking and similarity (esthetics and content appeal to adolescent users), the reduction and tunneling of therapeutic content (reducing online content into simple tasks, guiding users), and use of self-monitoring were present in therapies that resulted in improved therapy engagement, satisfaction, and adherence, as well as symptom and functional impairments.

Conclusions

When incorporated into Internet-based CBT for adolescent depression, PSD features may improve adolescent adherence, satisfaction, and depression-related outcomes. Testing of these features using hypothesis-driven dismantling approaches is recommended to advance our understanding of how these features contribute to therapy effectiveness.

Young People, Adult Worries: Randomized Controlled Trial and Feasibility Study of the Internet-Based Self-Support Method "Feel the ViBe" for Adolescents and Young Adults Exposed to Family Violence

BACKGROUND

Adolescents and young adults (AYAs) are of special interest in a group of children exposed to family violence (FV). Past-year prevalence of exposure to FV is known to be highest in AYAs and has severe consequences. Peer support is an effective approach to behavior change and the Internet is considered suitable as a mode of delivery.

OBJECTIVE

The study aimed to evaluate both effectiveness and feasibility of a randomized controlled trial (RCT) and feasibility study of the Internet-based self-support method "Feel the ViBe" (FtV) using mixed-methods approach to fully understand the strengths and weaknesses of a new intervention.

METHODS

AYAs aged 12-25 years and exposed to FV were randomized in an intervention group (access to FtV + usual care) and a control group (minimally enhanced usual care) after they self-registered themselves. From June 2012 to July 2014, participants completed the Impact of Event Scale (IES) and Depression (DEP) and Anxiety (ANX) subscales of the Symptom CheckList-90-R (SCL-90) every 6 weeks. The Web Evaluation Questionnaire was completed after 12 weeks. Quantitative usage data were collected using Google analytics and content management system (CMS) logs and data files. A univariate analysis of variance (UNIANOVA) and mixed model analysis (intention-to-treat [ITT], complete case) were used to compare groups. Pre-post t tests were used to find within-group effects. Feasibility measures structurally address the findings. The CONsolidated Standards Of Reporting Trials of Electronic and Mobile HEalth Applications and onLine TeleHealth (CONSORT-EHEALTH) checklist was closely followed.

RESULTS

In total, 31 out of 46 participants in the intervention group and 26 out of 47 participants in the control group started FtV. Seventeen participants (intervention: n=8, control: n=9) completed all questionnaires. Mixed model analysis showed significant differences between groups on the SCL-90 DEP (P=.04) and ANX (P=.049) subscales between 6 and 12 weeks after participation started. UNIANOVA showed no significant differences. Pre-post paired sample t tests showed significant improvements after 12 weeks for the SCL-90 DEP (P=.03) and ANX (P=.046) subscales. Reported mean Web-based time per week was 2.83 with a session time of 36 min. FtV was rated a mean 7.47 (1-10 Likert scale) with a helpfulness score of 3.16 (1-5 Likert scale). All participants felt safe. Two-thirds of the intervention participants started regular health care.

CONCLUSIONS

No changes on the IES were found. SCL-90 DEP and ANX showed promising results; however, the calculated sample size was not reached (n=18). FtV functions best as a first step for adolescents and young adults in an early stage of change. FtV can be easily implemented without extensive resources and fits best in the field of public health care or national governmental care.

TRIAL REGISTRATION

Netherlands National Trial Register (NTR): NTR3692; http://www.trialregister.nl/trialreg/admin/ rctview.asp?TC=3692 (Archived by WebCite at http://www.webcitation.org/6qIeKyjA4).

Assessing adherence to guidelines with administrative data in psychiatric outpatients

RATIONALE, AIMS AND OBJECTIVES

To assess (feasibility) of adherence to treatment guidelines among outpatients with common mental disorders in a routine Dutch clinical outpatient setting for common mental disorders using administrative data.

METHODS

In a retrospective cohort study, we analysed routinely collected administrative data of 5346 patients, treated for mood, anxiety or somatoform disorders with pharmacotherapy, psychotherapy or a combination of both. Available administrative data allowed assessment of guideline adherence with a disorder-independent set of five quality indicators, assessing psychotherapy, pharmacotherapy, a combination of both and routine outcome measurements (ROM) during diagnostic and therapeutic phases. Associations between the socio-demographic variables age, gender, clinical diagnosis and treatment type on the one hand and non-adherence to guidelines were tested using logistic regression analysis.

RESULTS

Patients were aged 39.5 years (SD 13.0) on average. The majority of patients were treated with a combination of pharmacotherapy and psychotherapy (50.1%), followed by psychotherapy (44.2%) and pharmacotherapy (5.6%). The majority of patients were suffering from a mood disorder (50.0%), followed by anxiety (43.9%) and somatoform disorders (6.1%). A diagnosis of anxiety or somatoform disorder was associated with higher odds of suboptimal duration [odds ratio (OR): 1.55 and 1.82[ and suboptimal frequency of psychotherapeutic treatment (OR of 0.89 and 0.63), and absence of ROM in the diagnostic phase (ORs 1.31 and 1.36, respectively) compared with depressive disorders. No ROM in the diagnostic phase was also predicted for by increasing age (ORs for the age categories of 56 and older of 1.48).

CONCLUSIONS

In this proof of principal study, we were able to assess some key indicators assessing adherence to clinical guidelines by using administrative data. Also, we could identify predictors of adherence with simple parameters available in every administrative data. Administrative data could help to monitor and aid guideline adherence in routine care, although quality may vary between settings.

Program Use and Outcome Change in a Web-Based Trauma Intervention: Individual and Social Factors

BACKGROUND

Insight into user adherence to Web-based intervention programs and into its relationship to intervention effect is needed.

OBJECTIVE

The objective of this study was to examine use of a Web-based self-help intervention program, the Chinese version of My Trauma Recovery (CMTR), among Chinese traumatized individuals, and to investigate the relationship between program use and user characteristics before the intervention and change in outcomes after the intervention and at 3-months' follow-up.

METHODS

The sample consisted of 56 urban survivors of different trauma types and 90 rural survivors of the 2008 Sichuan earthquake, who used the CMTR in 1 month on their own or guided by volunteers in a counseling center. Predictors were demographics (sex, age, highest education, marital status, and annual family income), health problems (trauma duration, posttraumatic symptoms, and depression), psychological factors (coping self-efficacy), and social factors (social functioning impairment and social support). Program use was assessed by general program usage (eg, number of visiting days) and program adherence (eg, webpages completed in modules). Outcome measures were the Posttraumatic Diagnostic Scale (PDS), Symptom Checklist 90-Depression (SCL-D), Trauma Coping Self-Efficacy scale (CSE), Crisis Support Scale (CSS), and Social Functioning Impairment questionnaire (SFI) adopted from the CMTR.

RESULTS

(1) Program use: rural participants had a larger total number of visiting days (F1,144=40.50, P<.001) and visited more program modules in 1 month (χ(2)3=73.67, P<.001) than urban participants. (2) Predictors and program use: total number of visiting days was correlated with CSS at pretest (r=.22, P=.009), and total number of completed webpages was associated with SFI at pretest (r=.19, P=.02). Number of webpages completed in modules was correlated with all demographic, disease severity, psychological, and social factors at pretest. (3) Program use and outcomes change: in general, use of the triggers and self-talk modules showed a consistent positive association with improvement in PDS, SCL-D, SFI, and CSE. The relaxation module was associated with positive change in PDS, but with negative change in CSS and SFI. The professional help module was associated with positive change in SCL-D, but its use on the first day was associated with negative change in CSS and CSE. The unhelpful coping module was associated with negative change in SFI. The mastery tools module showed a consistent association with negative change in PDS and SCL-D.

CONCLUSIONS

These findings suggest that both individual (eg, demographic, health problems, psychological) and social factors (eg, social functioning, social support) should be considered when delivering Web-based interventions, particularly in collectivist cultures. Specific program adherence indicators (eg, webpages completed in each module, activity types completed), rather than general program usage indicators (eg, total number or time of visiting), should be developed to examine the effectiveness of various program modules or elements.

CLINICAL TRIAL

Australian New Zealand Clinical Trials Registry: ACTRN12611000951954; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=343399 (Archived by WebCite at http://www.webcitation.org/6G7WyNODk).

Cognitive behavioural therapy (CBT), third-wave CBT and interpersonal therapy (IPT) based interventions for preventing depression in children and adolescents

BACKGROUND

Depression is common in young people. It has a marked negative impact and is associated with self-harm and suicide. Preventing its onset would be an important advance in public health. This is an update of a Cochrane review that was last updated in 2011.

OBJECTIVES

To determine whether evidence-based psychological interventions (including cognitive behavioural therapy (CBT), interpersonal therapy (IPT) and third wave CBT)) are effective in preventing the onset of depressive disorder in children and adolescents.

SEARCH METHODS

We searched the specialised register of the Cochrane Common Mental Disorders Group (CCMDCTR to 11 September 2015), which includes relevant randomised controlled trials from the following bibliographic databases: The Cochrane Library (all years), EMBASE (1974 to date), MEDLINE (1950 to date) and PsycINFO (1967 to date). We searched conference abstracts and reference lists of included trials and reviews, and contacted experts in the field.

SELECTION CRITERIA

We included randomised controlled trials of an evidence-based psychological prevention programme compared with any comparison control for young people aged 5 to 19 years, who did not currently meet diagnostic criteria for depression.

DATA COLLECTION AND ANALYSIS

Two authors independently assessed trials for inclusion and rated their risk of bias. We adjusted sample sizes to take account of cluster designs and multiple comparisons. We contacted trial authors for additional information where needed. We assessed the quality of evidence for the primary outcomes using GRADE.

MAIN RESULTS

We included 83 trials in this review. The majority of trials (67) were carried out in school settings with eight in colleges or universities, four in clinical settings, three in the community and four in mixed settings. Twenty-nine trials were carried out in unselected populations and 53 in targeted populations.For the primary outcome of depression diagnosis at medium-term follow-up (up to 12 months), there were 32 trials with 5965 participants and the risk of having a diagnosis of depression was reduced for participants receiving an intervention compared to those receiving no intervention (risk difference (RD) -0.03, 95% confidence interval (CI) -0.05 to -0.01; P value = 0.01). We rated this evidence as moderate quality according to the GRADE criteria. There were 70 trials (73 trial arms) with 13,829 participants that contributed to the analysis for the primary outcome of depression symptoms (self-rated) at the post-intervention time point, with results showing a small but statistically significant effect (standardised mean difference (SMD) -0.21, 95% CI -0.27 to -0.15; P value < 0.0001). This effect persisted to the short-term assessment point (up to three months) (SMD -0.31, 95% CI -0.45 to -0.17; P value < 0.0001; 16 studies; 1558 participants) and medium-term (4 to 12 months) assessment point (SMD -0.12, 95% CI -0.18 to -0.05; P value = 0.0002; 53 studies; 11,913 participants); however, the effect was no longer evident at the long-term follow-up. We rated this evidence as low to moderate quality according to the GRADE criteria.The evidence from this review is unclear with regard to whether the type of population modified the overall effects; there was statistically significant moderation of the overall effect for depression symptoms (P value = 0.0002), but not for depressive disorder (P value = 0.08). For trials implemented in universal populations there was no effect for depression diagnosis (RD -0.01, 95% CI -0.03 to 0.01) and a small effect for depression symptoms (SMD -0.11, 95% CI -0.17 to -0.05). For trials implemented in targeted populations there was a statistically significantly beneficial effect of intervention (depression diagnosis RD -0.04, 95% CI -0.07 to -0.01; depression symptoms SMD -0.32, 95% CI -0.42 to -0.23). Of note were the lack of attention placebo-controlled trials in targeted populations (none for depression diagnosis and four for depression symptoms). Among trials implemented in universal populations a number used an attention placebo comparison in which the intervention consistently showed no effect.

AUTHORS' CONCLUSIONS

Overall the results show small positive benefits of depression prevention, for both the primary outcomes of self-rated depressive symptoms post-intervention and depression diagnosis up to 12 months (but not beyond). Estimates of numbers needed to treat to benefit (NNTB = 11) compare well with other public health interventions. However, the evidence was of moderate to low quality using the GRADE framework and the results were heterogeneous. Prevention programmes delivered to universal populations showed a sobering lack of effect when compared with an attention placebo control. Interventions delivered to targeted populations, particularly those selected on the basis of depression symptoms, had larger effect sizes, but these seldom used an attention placebo comparison and there are practical difficulties inherent in the implementation of targeted programmes. We conclude that there is still not enough evidence to support the implementation of depression prevention programmes.Future research should focus on current gaps in our knowledge. Given the relative lack of evidence for universal interventions compared with attention placebo controls and the poor results from well-conducted effectiveness trials of universal interventions, in our opinion any future such trials should test a depression prevention programme in an indicated targeted population using a credible attention placebo comparison group. Depressive disorder as the primary outcome should be measured over the longer term, as well as clinician-rated depression. Such a trial should consider scalability as well as the potential for the intervention to do harm.

Adherence to Internet-Based Mobile-Supported Stress Management: A Pooled Analysis of Individual Participant Data From Three Randomized Controlled Trials

Background

Nonadherence to treatment is a prevalent issue in Internet interventions. Guidance from health care professionals has been found to increase treatment adherence rates in Internet interventions for a range of physical and mental disorders. Evaluating different guidance formats of varying intensity is important, particularly with respect to improvement of effectiveness and cost-effectiveness. Identifying predictors of nonadherence allows for the opportunity to better adapt Internet interventions to the needs of participants especially at risk for discontinuing treatment.

Objective

The goal of this study was to investigate the influence of different guidance formats (content-focused guidance, adherence-focused guidance, and administrative guidance) on adherence and to identify predictors of nonadherence in an Internet-based mobile-supported stress management intervention (ie, GET.ON Stress) for employees.

Methods

The data from the groups who received the intervention were pooled from three randomized controlled trials (RCTs) that evaluated the efficacy of the same Internet-based mobile-supported stress management intervention (N=395). The RCTs only differed in terms of the guidance format (content-focused guidance vs waitlist control, adherence-focused guidance vs waitlist control, administrative guidance vs waitlist control). Adherence was defined by the number of completed treatment modules (0-7). An ANOVA was performed to compare the adherence rates from the different guidance formats. Multiple hierarchical linear regression analysis was conducted to evaluate predictors of nonadherence, which included gender, age, education, symptom-related factors, and hope for improvement.

Results

In all, 70.5% (93/132) of the content-focused guidance sample, 68.9% (91/132) of the adherence-focused guidance sample, and 42.0% (55/131) of the participants in the administrative guidance sample completed all treatment modules. Guidance had a significant effect on treatment adherence (F_2,392=11.64, P<.001; ω²=.05). Participants in the content-focused guidance (mean 5.70, SD 2.32) and adherence-focused guidance samples (mean 5.58, SD 2.33) completed significantly more modules than participants in the administrative guidance sample (mean 4.36, SD 2.78; t₂₂₃=4.53, P<.001; r=.29). Content-focused guidance was not significantly associated with higher adherence compared to adherence-focused guidance (t₂₆₂=0.42, P=.67; r=.03). The effect size of r=.03 (95% CI –0.09 to 0.15) did not pass the equivalence margin of r=.20 and the upper bound of the 95% CI lay below the predefined margin, indicating equivalence between adherence-focused guidance and content-focused guidance. Beyond the influence of guidance, none of the predictors significantly predicted nonadherence.

Conclusions

Guidance has been shown to be an influential factor in promoting adherence to an Internet-based mobile-supported stress management intervention. Adherence-focused guidance, which included email reminders and feedback on demand, was equivalent to content-focused guidance with regular feedback while requiring only approximately a quarter of the coaching resources. This could be a promising discovery in terms of cost-effectiveness. However, even after considering guidance, sociodemographic, and symptom-related characteristics, most interindividual differences in nonadherence remain unexplained.

Clinical Trial

DRKS00004749; http://drks-neu.uniklinik-freiburg.de/drks_web/navigate.do?navigationId=trial.HTML&TRIAL _ID=DRKS00004749 (Archived by WebCite at http://www.webcitation.org/6QiDk9Zn8); DRKS00005112; http://drks-neu.uniklinik-freiburg. de/drks_web/navigate.do?navigationId=trial.HTML&TRIAL_ID=DRKS00005112 (Archived by WebCite at http://www.webcitation.org/6QiDysvev); DRKS00005384; http://drks-neu.uniklinik-freiburg.de/ drks_web/navigate.do?navigationId=trial.HTML&TRIAL_ID=DRKS00005384 (Archived by WebCite at http://www.webcitation.org/6QiE0xcpE)

Realising the technological promise of smartphones in addiction research and treatment: An ethical review

BACKGROUND

Smartphone technologies and mHealth applications (or apps) promise unprecedented scope for data collection, treatment intervention, and relapse prevention when used in the field of substance abuse and addiction. This potential also raises new ethical challenges that researchers, clinicians, and software developers must address.

AIMS

This paper aims to identify ethical issues in the current uses of smartphones in addiction research and treatment.

METHODS

A search of three databases (PubMed, Web of Science and PsycInfo) identified 33 studies involving smartphones or mHealth applications for use in the research and treatment of substance abuse and addiction. A content analysis was conducted to identify how smartphones are being used in these fields and to highlight the ethical issues raised by these studies.

RESULTS

Smartphones are being used to collect large amounts of sensitive information, including personal information, geo-location, physiological activity, self-reports of mood and cravings, and the consumption of illicit drugs, alcohol and nicotine. Given that detailed information is being collected about potentially illegal behaviour, we identified the following ethical considerations: protecting user privacy, maximising equity in access, ensuring informed consent, providing participants with adequate clinical resources, communicating clinically relevant results to individuals, and the urgent need to demonstrate evidence of safety and efficacy of the technologies.

CONCLUSIONS

mHealth technology offers the possibility to collect large amounts of valuable personal information that may enhance research and treatment of substance abuse and addiction. To realise this potential researchers, clinicians and app-developers must address these ethical concerns to maximise the benefits and minimise risks of harm to users.

Maximizing the Impact of e-Therapy and Serious Gaming: Time for a Paradigm Shift

Internet interventions for mental health, including serious games, online programs, and apps, hold promise for increasing access to evidence-based treatments and prevention. Many such interventions have been shown to be effective and acceptable in trials; however, uptake and adherence outside of trials is seldom reported, and where it is, adherence at least, generally appears to be underwhelming. In response, an international Collaboration On Maximizing the impact of E-Therapy and Serious Gaming (COMETS) was formed. In this perspectives' paper, we call for a paradigm shift to increase the impact of internet interventions toward the ultimate goal of improved population mental health. We propose four pillars for change: (1) increased focus on user-centered approaches, including both user-centered design of programs and greater individualization within programs, with the latter perhaps utilizing increased modularization; (2) Increased emphasis on engagement utilizing processes such as gaming, gamification, telepresence, and persuasive technology; (3) Increased collaboration in program development, testing, and data sharing, across both sectors and regions, in order to achieve higher quality, more sustainable outcomes with greater reach; and (4) Rapid testing and implementation, including the measurement of reach, engagement, and effectiveness, and timely implementation. We suggest it is time for researchers, clinicians, developers, and end-users to collaborate on these aspects in order to maximize the impact of e-therapies and serious gaming.

Acceptability of Mental Health Apps for Aboriginal and Torres Strait Islander Australians: A Qualitative Study

BACKGROUND

Aboriginal and Torres Strait Islander Australians experience high rates of mental illness and psychological distress compared to their non-Indigenous counterparts. E-mental health tools offer an opportunity for accessible, effective, and acceptable treatment. The AIMhi Stay Strong app and the ibobbly suicide prevention app are treatment tools designed to combat the disproportionately high levels of mental illness and stress experienced within the Aboriginal and Torres Strait Islander community.

OBJECTIVE

This study aimed to explore Aboriginal and Torres Strait Islander community members' experiences of using two culturally responsive e-mental health apps and identify factors that influence the acceptability of these approaches.

METHODS

Using qualitative methods aligned with a phenomenological approach, we explored the acceptability of two culturally responsive e-mental health apps through a series of three 3-hour focus groups with nine Aboriginal and Torres Strait Islander community members. Thematic analysis was conducted and coresearcher and member checking were used to verify findings.

RESULTS

Findings suggest strong support for the concept of e-mental health apps and optimism for their potential. Factors that influenced acceptability related to three key themes: personal factors (eg, motivation, severity and awareness of illness, technological competence, and literacy and language differences), environmental factors (eg, community awareness, stigma, and availability of support), and app characteristics (eg, ease of use, content, graphics, access, and security and information sharing). Specific adaptations, such as local production, culturally relevant content and graphics, a purposeful journey, clear navigation, meaningful language, options to assist people with language differences, offline use, and password protection may aid uptake.

CONCLUSIONS

When designed to meet the needs of Aboriginal and Torres Strait Islander Australians, e-mental health tools add an important element to public health approaches for improving the well-being of Aboriginal and Torres Strait Islander people.