Usability evaluation with mental health professionals and young people to develop an Internet-based cognitive-behaviour therapy program for adolescents with anxiety disorders

Subscribers' Perspectives and Satisfaction with the MoreGoodDays Supportive Text Messaging Program and the Impact of the Program on Self-Rated Clinical Measures

Background: Young adults (18 to 30 years of age) are confronted with numerous challenges, such as academic stressors and peer pressure. The MoreGoodDays program was co-designed with young adults to alleviate psychological issues, improve their mental well-being and provide support for young adults in Alberta during the COVID-19 pandemic and beyond. Objective: The current study aimed to explore subscribers' perspectives and satisfaction with the MoreGoodDays supportive text messaging program and the impact of the program on self-rated clinical measures. Methods: Subscribers of the MoreGoodDays program were invited via a link delivered in a text message to complete online evaluation surveys at six weeks, three months and six months. Program perception and satisfaction questions were adapted from those used to evaluate related programs. Anxiety, depression and PTSD symptoms were respectively assessed using the Generalized Anxiety Disorder-7 scale, the Patient Health Questionnaire-9 scale and the PTSD Civilian Checklist 5, and resilience levels were assessed using the Brief Resilience Scale (BRS). Data were analyzed with SPSS version 26 for Windows utilizing descriptive and inferential statistics. Results: There was a total of 168 respondents across the three follow-up time points (six weeks, three months and six months). The overall mean satisfaction with the MoreGoodDays program was 8.74 (SD = 1.4). A total of 116 (69.1%) respondents agreed or strongly agreed that MoreGoodDays messages helped them cope with stress, and 118 (70.3) agreed the messages helped them cope with loneliness. Similarly, 130 (77.3%) respondents agreed that MoreGoodDays messages made them feel connected to a support system, and 135 (80.4) indicated the program helped to improve their overall mental well-being. In relation to clinical outcomes, the ANOVA test showed no significant differences in mean scores for the PHQ-9, GAD-7 and PCL-C scales and the BRS from baseline to the three follow-up time points. In addition, there was no statistically significant difference in the prevalence of likely GAD, likely MDD, likely PTSD and low resilience at baseline and at six weeks. Conclusions: Notwithstanding the lack of statistically significant clinical improvement in subscribers of the MoreGoodDays program, the high program satisfaction suggests that subscribers accepted the technology-based intervention co-created with young adults, and this offers a vital tool to complement existing programs.

Online Support and Intervention (OSI) for child anxiety: a case series within routine clinical practice

BACKGROUND

Online treatments for child anxiety offer a potentially cost-effective and non-stigmatizing means to widen access to evidence-based treatments and meet the increasing demand on services; however, uptake in routine clinical practice remains a challenge. This study conducted an initial evaluation of the clinical effectiveness, feasibility and acceptability of OSI (Online Support and Intervention for child anxiety) within clinical practice. OSI is a co-designed online therapist-supported, parent-led CBT treatment for pre-adolescent children with anxiety problems.

METHOD

This case series was part of routine service evaluation in a clinic in England where families were offered OSI to treat a primary anxiety difficulty among 7- to 12-year-old children; 24 families were offered OSI, and 23 took it up. Measures of anxiety symptomatology, functional impairment and progress towards therapeutic goals were taken at pre-treatment, post-treatment and 4-week follow-up. Treatment satisfaction and engagement were also measured throughout the intervention.

RESULTS

Mean anxiety symptoms significantly improved to below the clinical cut-off post-treatment, with further reduction at follow-up. Functional impairment also significantly improved and significant progress was made towards treatment goals. The majority of children showed reliable change in anxiety symptoms and reliable recovery by follow-up, and were discharged without needing further treatment for anxiety. Uptake, adherence and engagement in OSI were excellent, and parents reported high levels of satisfaction with the treatment.

CONCLUSIONS

We have provided initial evidence that OSI is feasible, acceptable to families, and appears to be associated with good outcomes within routine clinical practice.

Online Support and Intervention for Child Anxiety (OSI): Development and Usability Testing

BACKGROUND

Internet-based treatments for child anxiety may help to increase access to evidence-based therapies; however, user engagement, uptake, and adherence within routine clinical practice remain as challenges. Involving the intended end users in the development process through user-centered design and usability testing is crucial for maximizing user engagement and adoption of internet-based treatments, but so far this has been lacking for internet-based treatments for child anxiety.

OBJECTIVE

The aim of this study is to develop an internet-based treatment for child anxiety through a process of user-centered design (phase 1) and usability testing (phase 2), based on an existing evidence-based, face-to-face, therapist-supported, parent-led cognitive behavioral therapy intervention. It is intended that the internet-based version of this treatment would consist of a parent website, case management system for clinicians, and mobile game app for children.

METHODS

Parents, children, and clinicians who were familiar with the face-to-face version of the treatment were recruited from 2 National Health Service clinics. In phase 1, participants participated in 3 workshops to gain feedback on the overall concept, explore their wants and needs for the websites and game, generate ideas on how the treatment may look, and gain feedback on initial mock-ups of the websites and game. In phase 2, participants attended 3 individual usability testing sessions where they were presented with working prototypes of the website or game and asked to perform a series of tasks on the website (parents and clinicians) or play the game (children). The frequency and details on usability errors were recorded. Participants were asked for their feedback on the website and game using a standardized usability questionnaire and semistructured interviews. The websites and game were iterated after each round of usability testing in response to this feedback.

RESULTS

In phase 1, participants approved the general concept and rated the initial mock-ups of the website and game positively. In phase 2, working prototypes were rated positively and usability errors declined across the iterations and were mainly cosmetic or minor issues relating to esthetic preference, with few issues regarding ability to navigate the website or technical issues affecting functionality. Feedback from the semistructured interviews further supported the positive response of participants to the website and game, and helped identify areas for improvement during the iteration process. The final iteration of the website and game are presented.

CONCLUSIONS

Taking an iterative approach to development through user-centered design and usability testing has resulted in an internet-based treatment for child anxiety (Online Support and Intervention for child anxiety) that appears to meet the needs and expectations of the intended users (parents, children, and clinicians) and is easy and enjoyable to use.

A smartphone app for the prevention and early intervention of body dysmorphic disorder: Development and evaluation of the content, usability, and aesthetics

Body dysmorphic disorder (BDD) is an impairing condition characterized by excessive appearance concerns that frequently begin in adolescence, thus making this phase an eminent target for prevention and early intervention. We developed a cognitive-behavioral app-based program (AINA) intended for prevention and early intervention of BDD. As part of the iterative development process, perceptions of usability, aesthetics, and content were investigated. A sample of 38 adolescents and young adults aged between 14 and 21 years tested the app in a laboratory setting and completed a survey of diagnostic and user experience questionnaires. Overall, usability, aesthetics, and content of the app received positive evaluations. Regression analyses did not point to any large effects of age, gender, years of education, self-esteem, or BDD symptom severity on user evaluations. On average, participants had no concerns about privacy or data security of the app, indicating that these aspects will presumably not act as barriers to usage. Altogether, the present results are encouraging. Future research needs to examine whether AINA is an efficacious measure for prevention and early intervention of BDD.

Effectiveness, User Engagement and Experience, and Safety of a Mobile App (Lumi Nova) Delivering Exposure-Based Cognitive Behavioral Therapy Strategies to Manage Anxiety in Children via Immersive Gaming Technology: Preliminary Evaluation Study

BACKGROUND

Childhood anxiety disorders are a prevalent mental health problem that can be treated effectively with cognitive behavioral therapy, in which exposure is a key component; however, access to treatment is poor. Mobile-based apps on smartphones or tablets may facilitate the delivery of evidence-based therapy for child anxiety, thereby overcoming the access and engagement barriers of traditional treatment. Apps that deliver therapeutic content via immersive gaming technology could offer an effective, highly engaging, and flexible treatment proposition.

OBJECTIVE

In this paper, we aim to describe a preliminary multi-method evaluation of Lumi Nova, a mobile app intervention targeting mild to moderate anxiety problems in children aged 7-12 years using exposure therapy delivered via an immersive game. The primary objective is to evaluate the effectiveness, user engagement and experience, and safety of the beta version of Lumi Nova.

METHODS

Lumi Nova was co-designed with children, parents, teachers, clinicians, game industry experts, and academic partnerships. In total, 120 community-based children with mild to moderate anxiety and their guardians were enrolled to participate in an 8-week pilot study. The outcome measures captured the app's effectiveness (anxiety symptoms, child-identified goal-based outcomes, and functional impairment), user engagement (game play data and ease-of-use ratings), and safety (mood ratings and adverse events). The outcome measures before and after the intervention were available for 30 children (age: mean 9.8, SD 1.7 years; girls: 18/30, 60%; White: 24/30, 80%). Additional game play data were automatically generated for 67 children (age: mean 9.6, SD 1.53 years; girls: 35/67, 52%; White: 42/67, 63%). Postintervention open-response data from 53% (16/30) of guardians relating to the primary objectives were also examined.

RESULTS

Playing Lumi Nova was effective in reducing anxiety symptom severity over the 8-week period of game play (t₂₉=2.79; P=.009; Cohen d=0.35) and making progress toward treatment goals (z=2.43; P=.02), but there were no improvements in relation to functional impairment. Children found it easy to play the game and engaged safely with therapeutic content. However, the positive effects were small, and there were limitations to the game play data.

CONCLUSIONS

This preliminary study provides initial evidence that an immersive mobile game app may safely benefit children experiencing mild to moderate anxiety. It also demonstrates the value of the rigorous evaluation of digital interventions during the development process to rapidly improve readiness for full market launch.

Establishing a Working Definition of User Experience for eHealth Interventions of Self-reported User Experience Measures With eHealth Researchers and Adolescents: Scoping Review

BACKGROUND

Across eHealth intervention studies involving children, adolescents, and their parents, researchers have measured user experience to assist with intervention development, refinement, and evaluation. To date, no widely accepted definitions or measures of user experience exist to support a standardized approach for evaluation and comparison within or across interventions.

OBJECTIVE

We conduct a scoping review with subsequent Delphi consultation to identify how user experience is defined and measured in eHealth research studies, characterize the measurement tools used, and establish working definitions for domains of user experience that could be used in future eHealth evaluations.

METHODS

We systematically searched electronic databases for published and gray literature available from January 1, 2005, to April 11, 2019. We included studies assessing an eHealth intervention that targeted any health condition and was designed for use by children, adolescents, and their parents. eHealth interventions needed to be web-, computer-, or mobile-based, mediated by the internet with some degree of interactivity. We required studies to report the measurement of user experience as first-person experiences, involving cognitive and behavioral factors reported by intervention users. We appraised the quality of user experience measures in included studies using published criteria: well-established, approaching well-established, promising, or not yet established. We conducted a descriptive analysis of how user experience was defined and measured in each study. Review findings subsequently informed the survey questions used in the Delphi consultations with eHealth researchers and adolescent users for how user experience should be defined and measured.

RESULTS

Of the 8634 articles screened for eligibility, 129 articles and 1 erratum were included in the review. A total of 30 eHealth researchers and 27 adolescents participated in the Delphi consultations. On the basis of the literature and consultations, we proposed working definitions for 6 main user experience domains: acceptability, satisfaction, credibility, usability, user-reported adherence, and perceived impact. Although most studies incorporated a study-specific measure, we identified 10 well-established measures to quantify 5 of the 6 domains of user experience (all except for self-reported adherence). Our adolescent and researcher participants ranked perceived impact as one of the most important domains of user experience and usability as one of the least important domains. Rankings between adolescents and researchers diverged for other domains.

CONCLUSIONS

Findings highlight the various ways in which user experience has been defined and measured across studies and what aspects are most valued by researchers and adolescent users. We propose incorporating the working definitions and available measures of user experience to support consistent evaluation and reporting of outcomes across studies. Future studies can refine the definitions and measurement of user experience, explore how user experience relates to other eHealth outcomes, and inform the design and use of human-centered eHealth interventions.

A Self-Applied Multi-Component Psychological Online Intervention Based on UX, for the Prevention of Complicated Grief Disorder in the Mexican Population During the COVID-19 Outbreak: Protocol of a Randomized Clinical Trial

Background: COVID-19 has taken many lives worldwide and due to this, millions of persons are in grief. When the grief process lasts longer than 6 months, the person is in risk of developing Complicated Grief Disorder (CGD). The CGD is related to serious health consequences. To reduce the probability of developing CGD a preventive intervention could be applied. In developing countries like Mexico, the psychological services are scarce, self-applied interventions could provide support to solve this problem and reduce the health impact even after the pandemic has already finished.

Aims: To design and implement a self-applied intervention composed of 12 modules focused on the decrease of the risk of developing CGD, and increasing the life quality, and as a secondary objective to reduce the symptomatology of anxiety, depression, and increase of sleep quality. The Intervention Duelo COVID (Grief COVID) follows the principles of User Experience (UX) and is designed according to the needs and desires of a sample of the objective participants, to increase the adherence to the self-applied intervention, considered one of the main weaknesses of online interventions.

Methods: A Randomized Controlled Trial will be conducted from the 22nd of December of 2020 to the first of June 2021. The participants will be assigned to an intervention with elements of Cognitive Behavioral Therapy, Acceptance and Commitment Therapy, Mindfulness and Positive Psychology. The control group will be a wait-list condition, that will receive the intervention 1.5–2 months after the pre-measurement were taken. The Power Size Calculation conducted through G^*Power indicated the need for a total of 42 participants, which will be divided by 21 participants in each group. The platform will be delivered through responsive design assuring with this that the intervention will adapt to the screen size of cellphones, tablets, and computers.

Ethics and Dissemination: The study counts with the approval of the Research Ethics Committee of the Autonomous University of Ciudad Juárez, México, and it is registered in Clinical Trials (NCT04638842). The article is sent and registered in clinical trials before the recruitment started. The results will be reported in future conferences, scientific publications, and media.

mGlu5: A double-edged sword for aversive learning related therapeutics

Aversive memories underlie many types of anxiety disorders. One area of research to more effectively treat anxiety disorders has therefore been identifying pharmacological targets to affect memory processes. Among these targets, the metabotropic glutamate 5 receptor (mGlu5) has received attention due to the availability of drugs to utilize its role in learning and memory. In this review, we highlight preclinical studies examining the role of mGlu5 at various stages of aversive learning and its inhibition via extinction in order to gain a better understanding of its therapeutic potential. We suggest that mGlu5 has distinct roles at different stages of memory that not only makes it a tricky target, but a double-edged sword as a therapeutic. However, the selective involvement of mGlu5 in different memory stages allows for certain precision that could be harnessed clinically. We therefore suggest potential applications, limitations, and pitfalls when considering use of mGlu5 modulators as therapeutics. In addition, we recommend future studies to address important gaps in this literature, such as sex and age factors in light of anxiety disorders being more prevalent in those demographics.

An Internet-Based Cognitive Behavioral Program for Adolescents With Anxiety: Pilot Randomized Controlled Trial

BACKGROUND

Internet-based cognitive behavioral therapy (ICBT) is a treatment approach recently developed and studied to provide frontline treatment to adolescents with anxiety disorders.

OBJECTIVE

This study aimed to pilot procedures and obtain data on methodological processes and intervention satisfaction to determine the feasibility of a definitive randomized controlled trial (RCT) to test the effectiveness of a self-managed ICBT program, Breathe (Being Real, Easing Anxiety: Tools Helping Electronically), for adolescents with anxiety concerns.

METHODS

This study employed a two-arm, multisite, pilot RCT. Adolescents aged 13 to 17 years with a self-identified anxiety concern were recruited online from health care settings and school-based mental health care services across Canada between April 2014 and May 2016. We compared 8 weeks of ICBT with ad hoc telephone and email support (Breathe experimental group) to access to a static webpage listing anxiety resources (control group). The primary outcome was the change in self-reported anxiety from baseline to 8 weeks (posttreatment), which was used to determine the sample size for a definitive RCT. Secondary outcomes were recruitment and retention rates, a minimal clinically important difference (MCID) for the primary outcome, intervention acceptability and satisfaction, use of cointerventions, and health care resource use, including a cost-consequence analysis.

RESULTS

Of the 588 adolescents screened, 94 were eligible and enrolled in the study (49 adolescents were allocated to Breathe and 45 were allocated to the control group). Analysis was based on 74% (70/94) of adolescents who completed baseline measures and progressed through the study. Enrolled adolescents were, on average, 15.3 years old (SD 1.2) and female (63/70, 90%). Retention rates at 8 weeks were 28% (13/46; Breathe group) and 58% (24/43; control group). Overall, 39% (14/36) of adolescents provided feedback on completion of the Breathe program. Adolescents' scores on a satisfaction survey indicated a moderate level of satisfaction. All but one adolescent indicated that Breathe was easy to use and they understood all the material presented. The most frequent barrier identified for program completion was difficulty in completing exposure activities. The power analysis indicated that 177 adolescents per group would be needed to detect a medium effect size (d=0.3) between groups in a definitive trial. Data for calculating an MCID or conducting a cost-consequence analysis were insufficient due to a low response rate at 8 weeks.

CONCLUSIONS

Adolescents were moderately satisfied with Breathe. However, program adjustments will be needed to address attrition and reduce perceived barriers to completing key aspects of the program. A definitive RCT to evaluate the effectiveness of the program is feasible if protocol adjustments are made to improve recruitment and retention to ensure timely study completion and increase the completeness of the data at each outcome measurement time point.

TRIAL REGISTRATION

ClinicalTrials.gov NCT02059226; http://clinicaltrials.gov/ct2/show/NCT02059226.

Dimensionality of the system usability scale among professionals using internet-based interventions for depression: a confirmatory factor analysis

BACKGROUND

The System Usability Scale (SUS) is used to measure usability of internet-based Cognitive Behavioural Therapy (iCBT). However, whether the SUS is a valid instrument to measure usability in this context is unclear. The aim of this study is to assess the factor structure of the SUS, measuring usability of iCBT for depression in a sample of professionals. In addition, the psychometric properties (reliability, convergent validity) of the SUS were tested.

METHODS

A sample of 242 professionals using iCBT for depression from 6 European countries completed the SUS. Confirmatory Factor Analysis (CFA) was conducted to test whether a one-factor, two-factor, tone-model or bi-direct model would fit the data best. Reliability was assessed using complementary statistical indices (e.g. omega). To assess convergent validity, the SUS total score was correlated with an adapted Client Satisfaction Questionnaire (CSQ-3).

RESULTS

CFA supported the one-factor, two-factor and tone-model, but the bi-factor model fitted the data best (Comparative Fit Index = 0.992, Tucker Lewis Index = 0.985, Root Mean Square Error of Approximation = 0.055, Standardized Root Mean Square Residual = 0.042 (respectively χ²_diff (9) = 69.82, p < 0.001; χ²_diff (8) ₌ 33.04, p < 0.001). Reliability of the SUS was good (ω = 0.91). The total SUS score correlated moderately with the CSQ-3 (CSQ1 r_s = .49, p < 0.001; CSQ2 r_s = .46, p < 0.001; CSQ3 r_s = .38, p < 0.001), indicating convergent validity.

CONCLUSIONS

Although the SUS seems to have a multidimensional structure, the best model showed that the total sumscore of the SUS appears to be a valid and interpretable measure to assess the usability of internet-based interventions when used by professionals in mental healthcare.

Examining the Usage, User Experience, and Perceived Impact of an Internet-Based Cognitive Behavioral Therapy Program for Adolescents With Anxiety: Randomized Controlled Trial

BACKGROUND

Internet-based cognitive behavioral therapy (iCBT) increases treatment access for adolescents with anxiety; however, completion rates of iCBT programs are typically low. Understanding adolescents' experiences with iCBT, what program features and changes in anxiety (minimal clinically important difference [MCID]) are important to them, may help explain and improve iCBT program use and impact.

OBJECTIVE

Within a randomized controlled trial comparing a six-session iCBT program for adolescent anxiety, Being Real, Easing Anxiety: Tools Helping Electronically (Breathe), with anxiety-based resource webpages, we aimed to (1) describe intervention use among adolescents allocated to Breathe or webpages and those who completed postintervention assessments (Breathe or webpage respondents); (2) describe and compare user experiences between groups; and (3) calculate an MCID for anxiety and explore relationships between iCBT use, experiences, and treatment response among Breathe respondents.

METHODS

Enrolled adolescents with self-reported anxiety, aged 13 to 19 years, were randomly allocated to Breathe or webpages. Self-reported demographics and anxiety symptoms (Multidimensional Anxiety Scale for Children-2nd edition [MASC-2]) were collected preintervention. Automatically-captured Breathe or webpage use and self-reported symptoms and experiences (User Experience Questionnaire for Internet-based Interventions) were collected postintervention. Breathe respondents also reported their perceived change in anxiety (Global Rating of Change Scale [GRCS]) following program use. Descriptive statistics summarized usage and experience outcomes, and independent samples t tests and correlations examined relationships between them. The MCID was calculated using the mean MASC-2 change score among Breathe respondents reporting somewhat better anxiety on the GRCS.

RESULTS

Adolescents were mostly female (382/536, 71.3%), aged 16.6 years (SD 1.7), with very elevated anxiety (mean 92.2, SD 18.1). Intervention use was low for adolescents allocated to Breathe (mean 2.2 sessions, SD 2.3; n=258) or webpages (mean 2.1 visits, SD 2.7; n=278), but was higher for Breathe (median 6.0, range 1-6; 81/258) and webpage respondents (median 2.0, range 1-9; 148/278). Total user experience was significantly more positive for Breathe than webpage respondents (P<.001). Breathe respondents reported program design and delivery factors that may have challenged (eg, time constraints and program support) or facilitated (eg, demonstration videos, self-management activities) program use. The MCID was a mean MASC-2 change score of 13.8 (SD 18.1). Using the MCID, a positive treatment response was generated for 43% (35/81) of Breathe respondents. Treatment response was not correlated with respondents' experiences or use of Breathe (P=.32 to P=.88).

CONCLUSIONS

Respondents reported positive experiences and changes in their anxiety with Breathe; however, their reports were not correlated with program use. Breathe respondents identified program design and delivery factors that help explain their experiences and use of iCBT and inform program improvements. Future studies can apply our measures to compare user experiences between internet-based interventions, interpret treatment outcomes and improve treatment decision making for adolescents with anxiety.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT02970734 https://clinicaltrials.gov/ct2/show/NCT02970734.

Usability of Health Information Websites Designed for Adolescents: Systematic Review, Neurodevelopmental Model, and Design Brief

BACKGROUND

Adolescence is a unique developmental period characterized by biological, social, and cognitive changes, as well as an interest in managing one's own health care. Many adolescents use the internet to seek health care information. However, young people face barriers before they can understand and apply the health information that they access on the web. It is essential that usability of adolescent health websites on the internet is improved to help adolescents overcome these barriers and allow them to engage successfully with web-based health care content.

OBJECTIVE

The aim of this review was to synthesize the usability of specific health information websites. These findings were mapped onto the adolescent neurodevelopmental profile, and a design brief based on the findings was developed to tailor future websites for specific adolescent requirements.

METHODS

A systematic search conducted using PubMed, PsycINFO, and Education Resources Information Center (ERIC) identified 25 studies that assessed the usability of health information websites. Adolescent feedback was collected by a mixture of surveys, focus groups, interviews, and think-aloud procedures.

RESULTS

A majority of the information websites were developed for specific health issues that may be relevant to adolescents. The most preferred website features were interactive content such as games and quizzes, as well as videos, images, audio clips, and animations. Participants also preferred communicating with other adolescents with similar conditions or learning about their experience through real stories and testimonials. Adolescents found it difficult to use health information websites if they contained too much text, were too cluttered, or had features that made it difficult to access. The findings are considered in the context of adolescent social processes, low tolerance of delayed gratification, and attraction to novelty and mapped onto a neurodevelopmental model of adolescence.

CONCLUSIONS

Young people's feedback can determine usability and content that make a health information website easy or informative to use. Neurodevelopmental profiles and the users' specific preferences and skills should be addressed in future development of health information websites for adolescents.

Feasibility and Acceptability of a Mental Health Website for Adults With an Intellectual Disability: Qualitative Evaluation

BACKGROUND

Electronic mental health (e-mental health) programs for people with an intellectual disability are currently underexplored but may provide a way of mitigating some of the barriers that this population faces in accessing appropriate mental health services.

OBJECTIVE

The aim of this study was to examine the feasibility and acceptability of Healthy Mind, an e-mental health program for adults with an intellectual disability developed by the Black Dog Institute, focusing on the design and implementation of the website.

METHODS

A qualitative research design was used, which involved semistructured interviews and focus groups with people with an intellectual disability, support workers, and allied health professionals. People with an intellectual disability were also observed while using the website. A thematic analysis was used to interrogate the interview transcripts and observational field notes.

RESULTS

Participants found the content of the website informative and appreciated the many ways that the website had been made accessible to users. Participants voiced some differing requirements regarding the way information should be presented and accessed on the website. Acknowledging different types of support needs was identified as an important issue for website dissemination.

CONCLUSIONS

The Healthy Mind website promises to provide an excellent tool for people with ID and their supporters. This research has pragmatic implications for the future development and implementation of the program, while contributing to knowledge in the broader fields of e-mental health and inclusive design for people with an intellectual disability.

Combining e-mental health intervention development with human computer interaction (HCI) design to enhance technology-facilitated recovery for people with depression and/or anxiety conditions: An integrative literature review

Computer scientists contend that understanding human computer interaction (HCI) is an important factor in developing successful computer user experiences. Mental health professionals across a range of disciplines are increasingly developing and implementing Internet-based treatments for people with a variety of mental health conditions. Many therapeutic and economic benefits are associated with technology-enabled treatments for a range of mental health disorders. Despite this, the role of HCI and associated design elements remains poorly understood in regard to the impact on patient safety, effectiveness, and to adherence of treatment for computer users who engage with e-mental health interventions. An integrative literature review was conducted to investigate how adequately HCI and user-centred design is incorporated in the development of e-mental health interventions for depression and anxiety, and subsequently reported in literature to inform evidence-based practice. The PRISMA model was used to locate, select, and include 30 relevant articles. The main finding of this review is that Internet-based e-mental health interventions are routinely implemented without sufficiently describing the relevant HCI design features applied. This is a limitation that in turn jeopardizes the assessment validity of e-mental interventions generally, leaving those who administer the interventions with incomplete evidence to support the safe, reliable, dependable, credible, and trustworthy implementation of the interventions. The recommendation arising from this review is that human computer interaction should be carefully considered when mental health nurses and other practitioners adopt e-mental health interventions for therapeutic purposes to assure the quality and safety of e-mental health interventions on offer to patients.

Development and Usability Evaluation of a Desktop Software Application for Pain Assessment in Infants

BACKGROUND

Pain assessment is a key component of pain management and research in infants. We developed software to assist in coding of pain in infants called PAiN (Pain Assessment in Neonates).

AIMS

The aims of this study were to evaluate the usability of PAiN in terms of effectiveness, efficiency, and satisfaction among novice and expert users and to compare the efficiency and satisfaction of PAiN to existing software for coding of infant pain among expert users.

METHODS

A quantitative usability testing approach was conducted with two participant groups, representing novice and expert end-users. Testing included an observed session with each participant completing a pain assessment coding task, followed by administration of the Post Study System Usability Questionnaire and Desirability Toolkit. For comparison, the usability of existing coding software was also evaluated by the expert group.

RESULTS

Twelve novice and six expert users participated. Novice users committed 14 noncritical navigational errors, and experts committed six. For experts, the median time for completing the coding task was 28.6 min in PAiN, compared to 46.5 min using the existing software. The mean Post Study System Usability Questionnaire score among novice (1.89) and expert users (1.40) was not significantly different (P = 0.0917). Among experts, the score for the existing software (4.83) was significantly (P = 0.0277) higher compared to PAiN (1.40). Lower scores indicate more positive responses.

CONCLUSIONS

Users were highly satisfied with PAiN. Experts were more efficient with PAiN compared to the existing software. The study was critical to ensuring that PAiN is error free and easy to use prior to implementation.

Navigating the development and dissemination of internet cognitive behavioral therapy (iCBT) for anxiety disorders in children and young people: A consensus statement with recommendations from the #iCBTLorentz Workshop Group

Initial internet-based cognitive behavioral therapy (iCBT) programs for anxiety disorders in children and young people (CYP) have been developed and evaluated, however these have not yet been widely adopted in routine practice. The lack of guidance and formalized approaches to the development and dissemination of iCBT has arguably contributed to the difficulty in developing iCBT that is scalable and sustainable beyond academic evaluation and that can ultimately be adopted by healthcare providers. This paper presents a consensus statement and recommendations from a workshop of international experts in CYP anxiety and iCBT (#iCBTLorentz Workshop Group) on the development, evaluation, engagement and dissemination of iCBT for anxiety in CYP.

Pregnancy and the Acceptability of Computer-Based Versus Traditional Mental Health Treatments

BACKGROUND

Recent recommendations urge increased depression screening in pregnant and postpartum women, potentially increasing demand for treatment. Computer-based psychotherapy treatments may address some of perinatal women's unique mental health treatment needs and barriers.

MATERIALS AND METHODS

We conducted a quantitative survey of pregnant women (≥12 weeks of gestation) on preferences regarding computer-based therapies compared with traditional therapies (psychotherapy and medication). Nonpregnant women and men served as comparison groups. Participants were provided descriptions of three computer-based therapies: video telehealth therapy (VTT), computer-assisted therapy (CAT), and self-guided online therapy (SGO). Participants were asked to select all options that they would consider for treatment as well as first choice preference. The Patient Health Questionnaire-9 (PHQ-9) assessed current depressive symptomatology, and the Mini International Neuropsychiatric Interview (MINI) assessed psychiatric history.

RESULTS

Participants included pregnant females (n = 111), nonpregnant females (n = 147), and males (n = 54). Among pregnant women, 77.5% (n = 86) indicated that they would consider some form of computer-based therapy for mental health treatment during pregnancy; VTT was the most commonly considered, followed by CAT and SGO. When asked to select their preferred intervention, traditional talk therapy was the first choice among all three groups, controlling for treatment history and PHQ-9 score. About one-third of pregnant women chose some form of computer-based therapy as their top choice.

CONCLUSIONS

While computer-based therapies were acceptable to most pregnant women in this sample, traditional talk therapy was the preferred option. Future research should consider how to tailor computer-based therapies to the unique needs of perinatal women.

Cross-sectional survey evaluating Text4Mood: mobile health program to reduce psychological treatment gap in mental healthcare in Alberta through daily supportive text messages

BACKGROUND

To complement the oversubscribed counselling services in Alberta, the Text4Mood program which delivers daily supportive text messages to subscribers was launched on the 18th of January, 2016. This report presents an evaluation of self-reports of the impact of the program on the mental wellbeing of subscribers.

METHODS

An online link to a survey questionnaire was created by an expert group and delivered via text messages to mobile phones of all 4111 active subscribers of the Text4Mood program as of April 11, 2016.

RESULTS

Overall, 894 subscribers answered the survey (overall response rate 21.7 %). The response rate for individual questions varied and is reported alongside the results. Most respondents were female (83 %, n = 668), Caucasian (83 %, n = 679), and diagnosed with a psychiatric disorder (38 %, n = 307), including Depression (25.4 %, n = 227) and Anxiety (20 %, n = 177). Overall, 52 % (n = 461) signed up for Text4Mood to help elevate their mood and 24.5 % (n = 219) signed up to help them worry less. Most respondents felt the text messages made them more hopeful about managing issues in their lives (81.7 %, n = 588), feel in charge of managing depression and anxiety (76.7 %, n = 552), and feel connected to a support system (75.2 %, n = 542). The majority of respondents felt Text4Mood improved their overall mental well-being (83.1 %, n = 598).

CONCLUSION

Supportive text messages are a feasible and acceptable way of delivering adjunctive psychological interventions to the general public with mental health problems. Given that text messages are affordable, readily available, and can be delivered to thousands of people simultaneously, they present an opportunity to help close the psychological treatment gap for mental health patients in Alberta and elsewhere.