Evaluation of an On-Demand Mental Health System for Depression Symptoms: Retrospective Observational Study

Functional and Nonfunctional Requirements of Virtual Clinic Mobile Applications: A Systematic Review

Introduction: The Virtual Clinic Mobile Application (VCMA) is a valuable tool for managing and remotely monitoring patients with various medical conditions. It can alleviate the strain on outpatient services and offer follow-up options for patients who do not require a physical examination. A thorough understanding of recent literature can assist in identifying suitable functionalities for new development and future improvement of current applications (apps). This review study is aimed at identifying functional and nonfunctional requirements for VCMA. Methods: This study conducted a systematic search using databases such as PubMed, Scopus, ISI Web of Science, Science Direct, ProQuest, and IEEE to gather requirements of VCMA articles published in English from the inception of the databases up to April 2022. Out of a total of 1223 articles, 76 met the inclusion criteria. These articles were then analyzed using conventional content analysis to extract and categorize their requirements. Results: Two main themes and 8 subthemes in terms of VCMA requirements were extracted as follows: (1) functional requirements with 3 subthemes (demographic data documentation, health record, general features of the user interface (UI)); (2) nonfunctional requirements with 5 subthemes (usability, accessibility, compatibility, efficiency, and security). Conclusion: The findings highlight the importance of mHealth solutions for virtual care and the need for the development of apps based on the extracted functional and nonfunctional requirements for VCMA; however, controlled trials are necessary. It is recommended that transparent reporting of mHealth interventions be prioritized to enable effective interpretation of the extracted data.

Association of Digital Engagement With Relaxation Tools and Stress Level Reduction: Retrospective Cohort Study

BACKGROUND

Stress is an emotional response caused by external triggers and is a high-prevalence global problem affecting mental and physical health. Several different digital therapeutic solutions are effective for stress management. However, there is limited understanding of the association between relaxation components and stress levels when using a digital app.

OBJECTIVE

This study investigated the contribution of relaxation tools to stress levels over time. We hypothesized that participation in breathing exercises and cognitive behavioral therapy-based video sessions would be associated with a reduction in stress levels. We also hypothesized a significant reduction specifically in participants' perceived sense of burden and lack of productivity when engaged with breathing exercises and video sessions.

METHODS

Stress levels were evaluated in a real-world data cohort using a behavioral health app for digital intervention and monitoring change. This retrospective real-world analysis of users on a mobile platform-based treatment followed users (N=490) who started with moderate and above levels of stress and completed at least 2 stress assessments. The levels of stress were tracked throughout the first 10 weeks. A piecewise mixed effects model was applied to model the trajectories of weekly stress mean scores in 2 time segments (1-6 weeks and 6-10 weeks). Next, a simple slope analysis was used for interpreting interactions probing the moderators: breathing exercises and video sessions. Piecewise mixed-effects models were also used to model the trajectories of specific perceived stress item rates in the stress questionnaire in the 2 segments (1-6 weeks and 6-10 weeks) and whether they are moderated by the relaxation engagements. Simple slope analysis was also used here for the interpretation of the interactions.

RESULTS

Analysis revealed a significant decrease in stress symptoms (β=-.25; 95% CI -0.32 to -0.17; P<.001) during the period of 1-6 weeks of app use that was maintained during the period of 6-10 weeks. Breathing exercises significantly moderated the reduction in stress symptoms during the period of 1-6 weeks (β=-.07; 95% CI -0.13 to -0.01; P=.03), while engagement in digital video sessions did not moderate stress scores. Engagement in digital video sessions, as well as breathing exercises, significantly moderated the reduction in perceived sense of burden and lack of productivity during weeks 1-6 and remained stable during weeks 6-10 on both items.

CONCLUSIONS

This study sheds light on the association between stress level reduction and specific components of engagement in a digital health app, breathing exercises, and cognitive behavioral therapy-based video sessions. Our findings provide a basis for further investigation of current and moderating factors that contribute to the personalization of digital intervention. In addition, results may aid in developing a more comprehensive understanding of how digital intervention tools work for mental health and for whom they are most effective.

Specifying the Efficacy of Digital Therapeutic Tools for Depression and Anxiety: Retrospective, 2-Cohort, Real-World Analysis

BACKGROUND

Depression and anxiety are the main sources of work and social disabilities as well as health-related problems around the world. Digital therapeutic solutions using cognitive behavioral therapy have demonstrated efficacy in depression and anxiety. A common goal of digital health apps is to increase user digital engagement to improve outcomes. However, there is a limited understanding of the association between digital platform components and clinical outcomes.

OBJECTIVE

The aim of the study is to investigate the contribution of specific digital engagement tools to mental health conditions. We hypothesized that participation in coaching sessions and breathing exercises would be associated with a reduction in depression and anxiety.

METHODS

Depression and general anxiety symptoms were evaluated in real-world data cohorts using the digital health platform for digital intervention and monitoring change. This retrospective real-world analysis of users on a mobile platform-based treatment followed two cohorts of people: (1) users who started with moderate levels of depression and completed at least 2 depression assessments (n=519) and (2) users who started with moderate levels of anxiety and completed at least 2 anxiety assessments (n=474). Levels of depression (Patient Health Questionnaire-9) and anxiety (Generalized Anxiety Disorder-7) were tracked throughout the first 16 weeks. A piecewise mixed-effects model was applied to model the trajectories of the Patient Health Questionnaire-9 and the Generalized Anxiety Disorder-7 mean scores in 2 segments (1-6 weeks and 7-16 weeks). Finally, simple slope analysis was used for the interpretation of the interactions probing the moderators: coaching sessions and breathing exercises in both depression and anxiety cohorts.

RESULTS

Analysis revealed a significant decrease in depression symptoms (β=-.37, 95% CI -0.46 to 0.28; P≤.001) during the period of weeks 1-6 of app use, which was maintained during the period of 7-16 weeks. Coach interaction significantly moderated the reduction in depression symptoms during the period of weeks 1-6 (β=-.03, 95% CI -0.05 to -0.001; P=.02). A significant decrease in anxiety symptoms (β=-.41, 95% CI -0.50 to -0.33; P≤.001) was revealed during the period of 1-6 weeks, which was maintained during the period of 7-16 weeks. Breathing exercises significantly moderated the reduction in anxiety symptoms during the period of 1-6 weeks (β=-.07, 95% CI -0.14 to -0.01; P=.04).

CONCLUSIONS

This study demonstrated general improvement followed by a period of stability of depression and anxiety symptoms associated with cognitive behavioral therapy-based digital intervention. Interestingly, engagement with a coaching session but not a breathing exercise was associated with a reduction in depression symptoms. Moreover, breathing exercise but not engagement with a coaching session was associated with a reduction of anxiety symptoms. These findings emphasize the importance of using a personalized approach to behavioral health during digital health interventions.

Real world effectiveness of digital mental health services during the COVID-19 pandemic

Background

The COVID-19 pandemic created an unprecedented need for mental health services that can be remotely delivered. Digital mental health services that offer personalized care recommendations hold promise to efficiently expand service, but evidence of the effectiveness of digitally delivered mental health care in real-world settings remains limited.

Methods

A retrospective cohort of adults (N = 1,852) receiving care through a digital mental health platform with elevated depressive symptoms during the COVID-19 pandemic was analyzed to estimate changes in subjective well-being and clinical improvement in depressive symptoms (using the World Health Organization-Five [WHO-5] Well-Being Index), as well as compare the relative effectiveness and cost of different care utilization patterns.

Results

The average improvement in WHO-5 score was 10.1 points (CI: 9.3–10.9, p<0.001) at follow-up, which constituted a medium effect size (d = 0.73). The odds of clinical improvement in depressive symptoms were significantly greater among those who utilized telecoaching (aOR = 2.45, 95%CI: 1.91–3.15, p < .001), teletherapy (aOR = 2.01, 95%CI: 1.57–2.57, p < .001), and both services (aOR = 2.28, 95%CI: 1.67–3.11, p < .001) compared to those who only utilized assessments, adjusting for baseline WHO-5 score, age, sex, and number of days between baseline and follow-up assessments. The average estimated cost of care for telecoaching was $124 per individual, which was significantly less than teletherapy ($413) or both services ($559).

Conclusion

Digitally delivered care with a therapist and/or coach was effective in improving subjective well-being and clinical improvement in depressive symptoms. Although clinical outcomes were similar across utilization patterns, the cost of care was lowest among those utilizing telecoaching.

Analysis of Start-Up Digital Mental Health Platforms for Enterprise: Opportunities for Enhancing Communication between Managers and Employees

The COVID-19 pandemic has resulted in employees being exposed to transformational stressors from within and outside the organization. This has created an opportunity for employee mental health solutions. Indeed, there has been a rapid growth in start-ups offering clinical mental health services via a digital health platform. These platforms servicing enterprise employee mental health needs have not been evaluated with respect to their ability to enhance management communication. Hence, the aims of the present study are to explore communication and service attributes across a sample of five operational leading commercial start-up platforms for mental service delivery to employees. We have observed that all platform models focused on providing on-demand mental health consultation services. Existing platforms fail to adequately support management communication for mental health solutions across 80% of platforms reviewed. We recommend that industry start-ups should understand the need for management engagement with digital mental health platforms. Digital mental health platform solutions in the workplace are ideally supported by valuing leadership communication. A culture around mental health will create sustainability in digital mental health solutions for an organization.

Changes in Resilience Following Engagement with A Virtual Mental Health System: A Real World Observational Study (Preprint)

Background

Objective

Methods

Results

Conclusions

Association between Care Modality and Utilization with Treatment Response among Members Accessing Virtual Mental Health Services: A Real-World Observational Study (Preprint)

Background

There is a growing bottleneck in mental health care, as the demand for services has outpaced the availability of mental health professionals. Consequently, many health systems have shifted to teletherapy as a scalable approach to increasing accessibility to care. Within these care models, various treatment modalities (eg, coaching and clinical care) are used to deliver support for anxiety and depression. However, more research is needed to better understand the differences in treatment responses.

Objective

The purpose of this study was to examine the association between different care modalities and the levels of use with symptom score changes for members seeking virtual care services.

Methods

We conducted an observational study of 4219 members who accessed Ginger, an on-demand mental health service, between September 2020 and September 2021. Using a mobile app, members can access text-based behavioral health coaching and virtual clinical services. This study focused on members with clinically elevated depression or anxiety levels at baseline. Logistic regressions were used to assess the association between care modalities and the levels of use with treatment response in depression and anxiety, using the Patient Health Questionnaire and Generalized Anxiety Disorder Assessment, respectively.

Results

Of the 4219 members, 1623 (38.47%) demonstrated a full response to depression, and 1684 (39.91%) demonstrated a full response to anxiety. Members who completed care (ie, text-based coaching, virtual clinical therapy, hybrid of coaching, and clinical care) beyond the introductory session showed significantly increased odds of a full response compared with those who completed only limited care. Members who completed a hybrid of care had the highest odds of improvement; the odds of showing a full response in depression were 2.31 times higher (95% CI 1.91-2.80; P<.001) and in anxiety were 2.23 times higher (95% CI 1.84-2.70; P<.001) compared with members who completed limited care. For members who completed only coaching or clinical care, the largest effects were observed among those with high use. For members who completed a hybrid care program, we observed similar treatment responses across all levels of use.

Conclusions

Our real-world study found that members who completed text-based coaching achieved full treatment responses at similar rates compared with members who completed virtual clinical care and members who completed a hybrid of care. There were no significant differences in the predicted probabilities of full treatment response between coaching and clinical care. Generally, the odds for a full response were highest among members with high use within each care modality; however, there were no differences in full-response treatment odds across levels of use with hybrid care. The results support the utility of digital behavioral health interventions and further highlight text-based coaching protocols as an accessible and suitable option when considering virtual care for treating anxiety and depression.

Changes in healthcare costs following engagement with a virtual mental health system: a matched cohort study of healthcare claims data

The COVID-19 pandemic has exacerbated the pressing need for mental health services. Digital mental health interventions could increase access to care and be an effective approach to reducing anxiety and depression at scale; however, research on their impact on healthcare expenditure is in the nascent stage and requires further investigation. The current study used claims data to examine the associations between use of an on-demand digital mental health platform and healthcare utilization costs compared to a matched control cohort. The study found that there were no significant differences between cohorts in total healthcare costs and pharmacy costs. There was a 16.8% reduction in outpatient costs (p=.08). On-demand digital mental health interventions can serve as a scalable approach to addressing the current mental health demands and potentially lower outpatient costs.

Understanding the Users with Chronic Pain on AI CBT Mental Health App (Wysa): A Mixed-Methods Retrospective Observational Study (Preprint)

Background

Digital health interventions can bridge barriers in access to treatment among individuals with chronic pain.

Objective

This study aimed to evaluate the perceived needs, engagement, and effectiveness of the mental health app Wysa with regard to mental health outcomes among real-world users who reported chronic pain and engaged with the app for support.

Methods

Real-world data from users (N=2194) who reported chronic pain and associated health conditions in their conversations with the mental health app were examined using a mixed methods retrospective observational study. An inductive thematic analysis was used to analyze the conversational data of users with chronic pain to assess perceived needs, along with comparative macro-analyses of conversational flows to capture engagement within the app. Additionally, the scores from a subset of users who completed a set of pre-post assessment questionnaires, namely Patient Health Questionnaire-9 (PHQ-9) (n=69) and Generalized Anxiety Disorder Assessment-7 (GAD-7) (n=57), were examined to evaluate the effectiveness of Wysa in providing support for mental health concerns among those managing chronic pain.

Results

The themes emerging from the conversations of users with chronic pain included health concerns, socioeconomic concerns, and pain management concerns. Findings from the quantitative analysis indicated that users with chronic pain showed significantly greater app engagement (P<.001) than users without chronic pain, with a large effect size (Vargha and Delaney A=0.76-0.80). Furthermore, users with pre-post assessments during the study period were found to have significant improvements in group means for both PHQ-9 and GAD-7 symptom scores, with a medium effect size (Cohen d=0.60-0.61).

Conclusions

The findings indicate that users look for tools that can help them address their concerns related to mental health, pain management, and sleep issues. The study findings also indicate the breadth of the needs of users with chronic pain and the lack of support structures, and suggest that Wysa can provide effective support to bridge the gap.

Health-Related Quality of Life among Members using an On-Demand Behavioral Health Platform: A Pilot Observational Study (Preprint)

Background

Despite the well-known adverse health conditions and negative economic outcomes associated with mental health problems, accessing treatment is difficult due to reasons such as availability and cost. As a solution, digital mental health services have flooded the industry, and new studies are quickly emerging that support their potential as an accessible and cost-effective way to improve mental health outcomes. However, many mental health platforms typically use clinical tools such as the Patient Health Questionnaire-9 (PHQ-9) or General Anxiety Disorder-7 (GAD-7). Yet, many individuals that seek out care do not have clinical symptomatology and thus, traditional clinical measures may not adequately capture symptom improvement in general well-being. As an alternative, this study used the health-related quality of life (HRQoL) tool from the Centers for Disease Control and Prevention “Healthy Days” measure. This subjective measure of well-being is an effective way to capture HRQoL and might be better suited as an outcome measure for treatments that include both clinical and subclinical individuals.

Objective

The purpose of this study was to describe changes in HRQoL in clinical and subclinical members assessing virtual care and to examine the association between text-based behavioral coaching and virtual clinical sessions with changes in HRQoL.

Methods

A total of 288 members completed the 4-item HRQoL measure at baseline and at 1 month following use of the Ginger on demand behavioral health platform. Baseline anxiety and depression levels were collected using the GAD-7 and PHQ-9, respectively.

Results

Members completed on average 1.92 (SD 2.16) coaching sessions and 0.91 (SD 1.37) clinical sessions during the assessment month. Paired samples t tests revealed significant reductions in the average number of unhealthy mental health days between baseline (mean 16, SD 8.77 days) and follow-up (mean 13.2, SD 9.02 days; t₂₈₇=5.73; P<.001), and in the average number of days adversely impacted (mean_baseline 10.9, mean_follow-up 8.19; t₂₈₇=6.26; P<.001). Both subclinical members (t₁₀₃=3.04; P=.003) and clinical members (t₁₈₃=5.5; P<.001) demonstrated significant improvements through reductions in adversely impacted days over a month. Clinical members also demonstrated significant improvements through reductions in unhealthy mental health days (t₁₈₃=5.82; P<.001). Finally, member engagement with virtual clinical sessions significantly predicted changes in unhealthy mental health days (B=–0.96; P=.04).

Conclusions

To our knowledge, this study is one of the first to use the HRQoL measure as an outcome in an evaluation of a digital behavioral health platform. Using real-world longitudinal data, our preliminary yet promising results show that short-term engagement with virtual care can be an effective means to improve HRQoL for members with subclinical and clinical symptoms. Further follow-up of reported HRQoL over several months is needed.

Resilience in 2021: Descriptive analysis of individuals accessing virtual mental health services (Preprint)

Background

Psychological resilience has been extensively studied by developmental researchers, and there is a growing body of literature regarding its role in psychiatry and psychopathology research and practice. This study contributes to this growing literature by providing real-world evidence on the relationship between resilience and clinical symptoms among a large sample of employed Americans.

Objective

This study aimed to describe resilience levels in individuals accessing Ginger, a virtual mental health system, in addition to the association of resilience with demographic characteristics, baseline depression, and anxiety symptoms.

Methods

We conducted a retrospective observational study of 9165 members who signed up for Ginger and completed a baseline survey between January 1 and August 5, 2021. We used multivariate regression models to test for associations between baseline resilience and other member characteristics.

Results

Baseline resilience scores centered on a mean of 23.84 (SD 6.56) and median of 24 (IQR 8) out of 40, with 81.0% (7424/9165) of the sample having low resilience at baseline. Despite having relatively higher resilience scores, members with no or mild depression or anxiety still had low resilience scores on average. Self-reported suicidal ideation was associated with lower resilience.

Conclusions

Overall, members had low baseline resilience, similar to resilience levels observed in trauma survivors in prior studies. Younger members and those with higher levels of depression and anxiety at intake reported lower levels of resilience at baseline. Notably, members with no or mild depression or anxiety still had low resilience scores on average, suggesting a need for mental health support among individuals who might not typically be recommended for treatment based on traditional clinical assessments, such as the 9-item Patient Health Questionnaire (PHQ-9) and the 7-item Generalized Anxiety Disorder scale (GAD-7). Two suggestions for topics of future research are to develop treatment recommendations based on the Connor-Davidson Resilience Scale and to understand the interaction between resilience levels and symptom-based outcome measures, such as the PHQ-9 and the GAD-7.

Utilization of Telehealth Services in Libya in Response to the COVID-19 Pandemic: Cross-sectional Analysis

Background

Health care systems in transitional countries have witnessed unprecedented challenges related to adequate and continuous health care provision during the COVID-19 pandemic. In many countries, including Libya, institutions and organizations have begun to implement telehealth technology for the first time. This serves to establish an alternative modality for direct physician-patient interviews to reduce the risk of COVID-19 transmission.

Objective

This study aimed to assess the usability of telehealth services in Libya and to provide an overview of the current COVID-19 scenario.

Methods

In this cross-sectional study, an anonymous web-based survey was administered to Libyan residents between April and May 2020. Participants were contacted through text messaging, emails, and social media. The survey items yielded information on the sociodemographic characteristics, availability and accessibility of health care services, effects of the COVID-19 pandemic on health care services, mental health status, and the feasibility and application of the telehealth system.

Results

We obtained 2512 valid responses, of which 1721 (68.5%) were from females. The participants were aged 28.2 (SD 7.6) years, of whom 2333 (92.9%) were aged <40 years, and 1463 (58.2%) were single. Regarding the health care services and their accessibility, 786 (31.1%) participants reported having a poor health status in general, and 492 (19.6%) reported having a confirmed diagnosis of at least one chronic disease. Furthermore, 498 (19.9%) participants reported varying degrees of difficulty in accessing health care centers, and 1558 (62.0%) could not access their medical records. Additionally, 1546 (61.6%) participants experienced problems in covering medical costs, and 1429 (56.9%) avoided seeking medical care owing to financial concerns. Regarding the feasibility of the telehealth system, approximately half of the participants reported that telehealth services were useful during the COVID-19 pandemic, and 1545 (61.5%) reported that the system was an effective means of communication and of obtaining health care services. Furthermore, 1435 (57.1%) participants felt comfortable using the telehealth system, and 1129 (44.9%) felt that they were able to express themselves effectively. Moreover, 1389 (55.3%) participants found the system easy to understand, and 1354 (53.9%) reported having excellent communication with physicians through the telehealth system. However, only 1018 (40.5%) participants reported that communication was better with the telehealth system than with traditional methods.

Conclusions

Our study revealed high levels of usability and willingness to use the telemedicine system as an alternative modality to in-person consultations among the Libyan residents in this study. This system is advantageous because it helps overcome health care costs, increases access to prompt medical care and follow-up evaluation, and reduces the risk of COVID-19 transmission. However, internet connectivity and electricity issues could be a substantial barrier for many resource-limited communities, and further studies should address such obstacles.

Association Between Care Utilization and Anxiety Outcomes in an On-Demand Mental Health System: Retrospective Observational Study

Background

Anxiety is an extremely prevalent condition, and yet, it has received notably less attention than depression and other mental health conditions from a research, clinical, and public health perspective. The COVID-19 pandemic has only exacerbated growing concerns about the burden of anxiety due to the confluence of physical health risks, economic stressors, social isolation, and general disruption of daily activities.

Objective

This study examines differences in anxiety outcomes by care modality (coaching, teletherapy and telepsychiatry, and combined care) within an on-demand mental health system. We also explore the association between levels of engagement within each care modality and odds of improvement in symptoms of anxiety.

Methods

We conducted a retrospective observational study of individuals who accessed Ginger, an on-demand mental health system. Data were collected from 1611 Ginger members between January 1, 2018, and December 31, 2019. We used logistic regression to assess the association between care modality and improvement in anxiety symptoms. Within each modality, we assessed the association between level of engagement and improvement.

Results

Of 1611 Ginger members, 761 (47.0%) experienced a decrease in anxiety symptoms, as measured by a change from a positive to a negative 2-item Generalized Anxiety Disorder (GAD-2) screen. Among members who still screened positive at follow-up (865/1611, 53%), a total of 192 members (11.9%) experienced a clinically significant score reduction in the full GAD-7 (ie, a score reduction of >5 points), even though their GAD-2 scores were still positive. All modalities showed increased odds of improvement compared to those who were not engaged with coaching or clinical services (“app-only”). Higher GAD-7 intake scores were also associated with decreased odds of improvement.

Conclusions

This study found increased odds of anxiety improvement for all care modalities compared to those who did not engage in care, with larger effect sizes for higher utilization within all care modalities. Additionally, there is a promising observation that those engaged in combined care (teletherapy and text-based coaching) had the greatest odds of anxiety improvement. Future directions include more detailed classifications of utilization patterns and an exploration of explanations and solutions for lower-utilization members.