Heterogeneity of Treatment Effects in Internet- and Mobile-Based Interventions for Depression: A Systematic Review and Meta-Analysis

Importance

While the effects of internet- and mobile-based interventions (IMIs) for depression have been extensively studied, no systematic evidence is available regarding the heterogeneity of treatment effects (HTEs), indicating to what extent patient-by-treatment interactions exist and personalized treatment models might be necessary.

Objective

To investigate the HTEs in IMIs for depression as well as their efficacy and effectiveness.

Data Sources

A systematic search in Embase, MEDLINE, Central, and PsycINFO for randomized clinical trials and supplementary reference searches was conducted on October 13, 2019, and updated March 25, 2022. The search string included various terms related to digital psychotherapy, depression, and randomized clinical trials.

Study Selection

Titles, abstracts, and full texts were reviewed by 2 independent researchers. Studies of all populations with at least 1 intervention group receiving an IMI for depression and at least 1 control group were eligible, if they assessed depression severity as a primary outcome and followed a randomized clinical trial (RCT) design.

Data Extraction and Synthesis

This study followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses reporting guidelines. Risk of bias was evaluated using the Cochrane Risk of Bias Tool. HTE was investigated using logarithmic variance ratios (lnVR) and effect sizes using Hedges g. Three-level bayesian meta-regressions were conducted.

Main Outcomes and Measures

Heterogeneity of treatment effects was the primary outcome of this study; magnitudes of treatment effect sizes were the secondary outcome. Depression severity was measured by different self-report and clinician-rated scales in the included RCTs.

Results

The systematic review of 102 trials included 19 758 participants (mean [SD] age, 39.9 [10.58] years) with moderate depression severity (mean [SD] in Patient Health Questionnaire-9 score, 12.81 [2.93]). No evidence for HTE in IMIs was found (lnVR = -0.02; 95% credible interval [CrI], -0.07 to 0.03). However, HTE was higher in more severe depression levels (β̂ = 0.04; 95% CrI, 0.01 to 0.07). The effect size of IMI was medium (g = -0.56; 95% CrI, -0.46 to -0.66). An interaction effect between guidance and baseline severity was found (β̂ = -0.24, 95% CrI, -0.03 to -0.46).

Conclusions and Relevance

In this systematic review and meta-analysis of RCTs, no evidence for increased patient-by-treatment interaction in IMIs among patients with subthreshold to mild depression was found. Guidance did not increase effect sizes in this subgroup. However, the association of baseline severity with HTE and its interaction with guidance indicates a more sensitive, guided, digital precision approach would benefit individuals with more severe symptoms. Future research in this population is needed to explore personalization strategies and fully exploit the potential of IMI.

Quality assessment of mHealth apps: a scoping review

Introduction

The number of mHealth apps has increased rapidly during recent years. Literature suggests a number of problems and barriers to the adoption of mHealth apps, including issues such as validity, usability, as well as data privacy and security. Continuous quality assessment and assurance systems might help to overcome these barriers. Aim of this scoping review was to collate literature on quality assessment tools and quality assurance systems for mHealth apps, compile the components of the tools, and derive overarching quality dimensions, which are potentially relevant for the continuous quality assessment of mHealth apps.

Methods

Literature searches were performed in Medline, EMBASE and PsycInfo. Articles in English or German language were included if they contained information on development, application, or validation of generic concepts of quality assessment or quality assurance of mHealth apps. Screening and extraction were carried out by two researchers independently. Identified quality criteria and aspects were extracted and clustered into quality dimensions.

Results

A total of 70 publications met inclusion criteria. Included publications contain information on five quality assurance systems and further 24 quality assessment tools for mHealth apps. Of these 29 systems/tools, 8 were developed for the assessment of mHealth apps for specific diseases, 16 for assessing mHealth apps for all fields of health and another five are not restricted to health apps. Identified quality criteria and aspects were extracted and grouped into a total of 14 quality dimensions, namely "information and transparency", "validity and (added) value", "(medical) safety", "interoperability and compatibility", "actuality", "engagement", "data privacy and data security", "usability and design", "technology", "organizational aspects", "social aspects", "legal aspects", "equity and equality", and "cost(-effectiveness)".

Discussion

This scoping review provides a broad overview of existing quality assessment and assurance systems. Many of the tools included cover only a few dimensions and aspects and therefore do not allow for a comprehensive quality assessment or quality assurance. Our findings can contribute to the development of continuous quality assessment and assurance systems for mHealth apps.

Systematic Review Registration

https://www.researchprotocols.org/2022/7/e36974/, International Registered Report Identifier, IRRID (DERR1-10.2196/36974).

[Apps for tinnitus? A systematic review on quality, intervention components, and behavior change techniques]

BACKGROUND

Various smartphone applications (apps) for people with tinnitus are available and promise tinnitus relief. Yet, it is difficult for people suffering from tinnitus and healthcare professionals to estimate their quality, potential, or risks. The current study aims to generate an overview of available tinnitus apps in the German language and to offer orientation for research and healthcare providers.

METHOD

The most prominent stores were searched systematically (November 2020-April 2021; Google Play Store and Apple App Store). Apps specifically developed for tinnitus were evaluated by two independent raters using multiple approaches: a) a quality screening was performed using the German version of the Mobile App Rating Scale (MARS-G), b) intervention components were assessed using a newly developed list of categories, and c) implemented strategies for active tinnitus management were analyzed using behavior change techniques (BCTs).

RESULTS

The search yielded 1073 apps, of which 21 apps were analyzed. The apps' overall quality as assessed by MARS‑G was average (M = 3.37, SD = 039). A lot of apps offered sounds (n = 18) and information (n = 9) or assessed tinnitus characteristics (n = 13). Out of 93 BCTs, 24 were identified at least once. Only one app was evaluated in non-randomized trials.

CONCLUSION

Although a variety of apps are available, most of them focus on a few intervention components (e.g., sounds or information). Therefore, apps do not exploit their potential to impart important evidence-based content for tinnitus management. The app evaluation using multiple approaches points out potential for improvement.

Stress Management Apps: Systematic Search and Multidimensional Assessment of Quality and Characteristics

BACKGROUND

Chronic stress poses risks for physical and mental well-being. Stress management interventions have been shown to be effective, and stress management apps (SMAs) might help to transfer strategies into everyday life.

OBJECTIVE

This review aims to provide a comprehensive overview of the quality and characteristics of SMAs to give potential users or health professionals a guideline when searching for SMAs in common app stores.

METHODS

SMAs were identified with a systematic search in the European Google Play Store and Apple App Store. SMAs were screened and checked according to the inclusion criteria. General characteristics and quality were assessed by 2 independent raters using the German Mobile Application Rating Scale (MARS-G). The MARS-G assesses quality (range 1 to 5) on the following four dimensions: (1) engagement, (2) functionality, (3) esthetics, and (4) information. In addition, the theory-based stress management strategies, evidence base, long-term availability, and common characteristics of the 5 top-rated SMAs were assessed and derived.

RESULTS

Of 2044 identified apps, 121 SMAs were included. Frequently implemented strategies (also in the 5 top-rated SMAs) were psychoeducation, breathing, and mindfulness, as well as the use of monitoring and reminder functions. Of the 121 SMAs, 111 (91.7%) provided a privacy policy, but only 44 (36.4%) required an active confirmation of informed consent. Data sharing with third parties was disclosed in only 14.0% (17/121) of the SMAs. The average quality of the included apps was above the cutoff score of 3.5 (mean 3.59, SD 0.50). The MARS-G dimensions yielded values above this cutoff score (functionality: mean 4.14, SD 0.47; esthetics: mean 3.76, SD 0.73) and below this score (information: mean 3.42, SD 0.46; engagement: mean 3.05, SD 0.78). Most theory-based stress management strategies were regenerative stress management strategies. The evidence base for 9.1% (11/121) of the SMAs could be identified, indicating significant group differences in several variables (eg, stress or depressive symptoms) in favor of SMAs. Moreover, 38.0% (46/121) of the SMAs were no longer available after a 2-year period.

CONCLUSIONS

The moderate information quality, scarce evidence base, constraints in data privacy and security features, and high volatility of SMAs pose challenges for users, health professionals, and researchers. However, owing to the scalability of SMAs and the few but promising results regarding their effectiveness, they have a high potential to reach and help a broad audience. For a holistic stress management approach, SMAs could benefit from a broader repertoire of strategies, such as more instrumental and mental stress management strategies. The common characteristics of SMAs with top-rated quality can be used as guidance for potential users and health professionals, but owing to the high volatility of SMAs, enhanced evaluation frameworks are needed.

[Scientific evidence and user quality in mobile health applications for people with cognitive impairments and their caregivers]

INTRODUCTION

The range of health-related apps is large, but the scientific evidence for them is uncertain. The aim of this study is to evaluate the methodological quality of German-language mobile health apps for people with dementia and their caregivers.

METHODS

The app search was conducted according to the PRISMA-P guidelines in the application stores (Google Play Store and Apple App Store) using the terms "Demenz", "Alzheimer", "Kognition" and "Kognitive Beeinträchtigung". A systematic literature search with subsequent assessment of the scientific evidence was performed. The user quality assessment was conducted using "The German Version of the Mobile App Rating Scale" (MARS-G).

RESULTS

Scientific studies have been published for only 6 of the 20 apps identified. A total of 13 studies were included in the evaluation, whereby the app itself was the subject of investigation in only two publications. In addition, methodological weaknesses were often observed such as small group sizes, short study duration and / or insufficient comparative treatment. The overall quality of the apps can be rated as acceptable with a mean MARS rating of 3.38. Seven apps were able to achieve a score of over 4.0 and thus a good rating, but just as many apps fell below the acceptable limit of 3.0.

DISCUSSION

The contents of most apps have not been scientifically tested. This identified lack of evidence is consistent with the information in the literature in other indication areas. A systematic and transparent evaluation of health applications is necessary to protect end-users and better support their selection process.

Help for insomnia from the app store? A standardized rating of mobile health applications claiming to target insomnia

A large number of mobile health applications claiming to target insomnia are available in commercial app stores. However, limited information on the quality of these mobile health applications exists. The present study aimed to systematically search the European Google Play and Apple App Store for mobile health applications targeting insomnia, and evaluate the quality, content, evidence base and potential therapeutic benefit. Eligible mobile health applications were evaluated by two independent reviewers using the Mobile Application Rating Scale-German, which ranges from 1 - inadequate to 5 - excellent. Of 2236 identified mobile health applications, 53 were included in this study. Most mobile health applications (68%) had a moderate overall quality. Concerning the four main subscales of the Mobile Application Rating Scale-German, functionality was rated highest (M = 4.01, SD = 0.52), followed by information quality (M = 3.49, SD = 0.72), aesthetics (M = 3.31, SD = 1.04) and engagement (M = 3.02, SD = 1.03). While scientific evidence was identified for 10 mobile health applications (19%), only one study employed a randomized controlled design. Fifty mobile health applications featured sleep hygiene/psychoeducation (94%), 27 cognitive therapy (51%), 26 relaxation methods (49%), 24 stimulus control (45%), 16 sleep restriction (30%) and 24 sleep diaries (45%). Mobile health applications may have the potential to improve the care of insomnia. Yet, data on the effectiveness of mobile health applications are scarce, and this study indicates a large variance in the quality of the mobile health applications. Thus, independent information platforms are needed to provide healthcare seekers and providers with reliable information on the quality and content of mobile health applications.

A mobile-based aftercare intervention to increase self-esteem in inpatients diagnosed with depression: A randomized controlled trial

OBJECTIVE

In this randomized controlled trial, we investigated the effectiveness, side effects and user satisfaction of the self-help smartphone app "MCT & More" among inpatients with a diagnosis of depression after their discharge from a psychiatric hospital over a period of 4 weeks.

METHODS

A total of 159 inpatients were recruited in four German psychiatric hospitals three days before hospital discharge (intervention group: n = 79; treatment as usual: n = 80). Based on the vulnerability model (low self-esteem contributes to depression), self-esteem represented the primary outcome, quality of life and depressive symptoms the secondary outcomes.

RESULTS

Intention-to-treat analyzes showed no statistical significance for the primary and secondary outcome parameters, except for the subscale self-competence in favor of the intervention group (with a small effect size of d = 0.35), in the context of an exploratory approach (post hoc). The more positive the attitude toward mobile-based interventions and the more positive the treatment expectations, the more frequently the app was used (r = .35, p = .008; r = .34, p = .009).

CONCLUSION

Further symptom reduction could not be obtained. However, the results suggest that an effect on improvement in self-competence could be achieved by low-threshold aftercare programs. Future studies should include long-term assessments to examine the impact of mobile-based aftercare on relapse.Trial registration: DRKS00022559.

Mobile Apps for the Management of Gastrointestinal Diseases: Systematic Search and Evaluation Within App Stores

Background

Gastrointestinal diseases are associated with substantial cost in health care. In times of the COVID-19 pandemic and further digitalization of gastrointestinal tract health care, mobile health apps could complement routine health care. Many gastrointestinal health care apps are already available in the app stores, but the quality, data protection, and reliability often remain unclear.

Objective

This systematic review aimed to evaluate the quality characteristics as well as the privacy and security measures of mobile health apps for the management of gastrointestinal diseases.

Methods

A web crawler systematically searched for mobile health apps with a focus on gastrointestinal diseases. The identified mobile health apps were evaluated using the Mobile Application Rating Scale (MARS). Furthermore, app characteristics, data protection, and security measures were collected. Classic user star rating was correlated with overall mobile health app quality.

Results

The overall quality of the mobile health apps (N=109) was moderate (mean 2.90, SD 0.52; on a scale ranging from 1 to 5). The quality of the subscales ranged from low (mean 1.89, SD 0.66) to good (mean 4.08, SD 0.57). The security of data transfer was ensured only by 11 (10.1%) mobile health apps. None of the mobile health apps had an evidence base. The user star rating did not correlate with the MARS overall score or with the individual subdimensions of the MARS (all P>.05).

Conclusions

Mobile health apps might have a positive impact on diagnosis, therapy, and patient guidance in gastroenterology in the future. We conclude that, to date, data security and proof of efficacy are not yet given in currently available mobile health apps.

A systematic quality rating of available mobile health apps for borderline personality disorder

BACKGROUND

Mobile health apps (MHAs) may offer a mean to overcome treatment barriers in Borderline Personality Disorder (BPD) mental health care. However, MHAs for BPD on the market lack transparency and quality assessment.

METHODS

European app stores were systematically searched, and two independent trained reviewers extracted relevant MHAs. Employed methods and privacy and security details documentation of included MHAs were extracted. MHAs were then assessed and rated using the German version of the standardized Mobile Application Rating Scale (MARS-G). Mean values and standard deviations of all subscales (engagement, functionality, aesthetics, information, and therapeutic gain) and correlations with user ratings were calculated.

RESULTS

Of 2977 identified MHAs, 16 were included, showing average quality across the four main subscales (M = 3.25, SD = 0.68). Shortcomings were observed with regard to engagement (M = 2.87, SD = 0.99), potential therapeutic gain (M = 2.67, SD = 0.83), existing evidence base (25.0% of included MHAs were tested empirically), and documented privacy and security details. No significant correlations were found between user ratings and the overall total score of the MARS-G or MARS-G main subscales.

CONCLUSIONS

Available MHAs for BPD vary in quality and evidence on their efficacy, effectiveness, and possible adverse events is scarce. More substantial efforts to ensure the quality of MHAs available for patients and a focus on transparency, particularly regarding privacy and security documentation, are necessary.

Standardized evaluation of the quality and persuasiveness of mobile health applications for diabetes management

This study evaluates diabetes self-management mobile health applications available from European app stores with respect to quality, concordance with recommended self-management tasks and implementation of persuasive system design principles. The European Play Store and Apple App Store were systematically searched and relevant apps were tested. Two raters independently assessed app quality using the Mobile Application Rating Scale and conducted a content analysis of provided persuasive system design principles and self-management tasks. A total of 2,269 mobile health applications were identified and 120 could be included in the evaluation. The overall quality was rated as moderate M = 3.20 (SD = 0.39, min = 2.31, max = 4.62), with shortcomings in the subcategories of engagement (M = 2.80, SD = 0.67) and information quality (M = 2.26, SD = 0.48). Scientific evidence is available for 8% of the apps. The reviewed apps implemented a median of three persuasive system design principles (range 0-15) and targeted a median of 4.5 (range 1-8) self-management tasks, however, with a lack of information about psychosocial coping strategies. Most available diabetes self-management apps lack a scientific evidence base. Persuasive system design features are underrepresented and may form a promising tool to improve app quality. Furthermore, the interaction of physical and behavioral health should be improved in existing diabetes self-management mobile health applications.

Mobile Apps for Hematological Conditions: Review and Content Analysis Using the Mobile App Rating Scale

Background

Hematological conditions are prevalent disorders that are associated with significant comorbidities and have a major impact on patient care. Concerning new tools for the care of these patients, the number of health apps aimed at hematological patients is growing. Currently, there are no quality analyses or classifications of apps for patients diagnosed with hematological conditions.

Objective

The aim of this study is to analyze the characteristics and quality of apps designed for patients diagnosed with hematological conditions by using the Mobile App Rating Scale (MARS).

Methods

We performed an observational, cross-sectional descriptive study of all smartphone apps for patients diagnosed with hematological conditions. A search was conducted in March 2021 using the following terms: anemia, blood cancer, blood disorder, hematological cancer, hematological malignancy, hematological tumor, hematology, hemophilia, hemorrhage, lymphoma, leukemia, multiple myeloma, thalassemia, thrombocytopenia, and thrombosis. The apps identified were downloaded and evaluated by 2 independent researchers. General characteristics were registered, and quality was analyzed using MARS scores. Interrater reliability was measured by using the Cohen κ coefficient.

Results

We identified 2100 apps in the initial search, and 4.19% (88/2100) of apps met the inclusion criteria and were analyzed. Of the 88 apps, 61% (54/88) were available on Android, 30% (26/88) were available on iOS, and 9% (8/88) were available on both platforms. Moreover, 7% (6/88) required payment, and 49% (43/88) were updated in the last year. Only 26% (23/88) of the apps were developed with the participation of health professionals. Most apps were informative (60/88, 68%), followed by preventive (23/88, 26%) and diagnostic (5/88, 6%). Most of the apps were intended for patients with anemia (23/88, 26%). The mean MARS score for the overall quality of the 88 apps was 3.03 (SD 1.14), ranging from 1.19 (lowest-rated app) to 4.86 (highest-rated app). Only 47% (41/88) of the apps obtained a MARS score of over 3 points (acceptable quality). Functionality was the best-rated section, followed by aesthetics, engagement, information, and app subjective quality. The five apps with the highest MARS score were the following: Multiple Myeloma Manager, Hodgkin Lymphoma Manager, Focus On Lymphoma, ALL Manager, and CLL Manager. The analysis by operating system, developer, and cost revealed statistically significant differences in MARS scores (P<.001, P<.001, and P=.049, respectively). The interrater agreement between the 2 reviewers was substantial (k=0.78).

Conclusions

There is great heterogeneity in the quality of apps for patients with hematological conditions. More than half of the apps do not meet acceptable criteria for quality and content. Most of them only provide information about the pathology, lacking interactivity and personalization options. The participation of health professionals in the development of these apps is low, although it is narrowly related to better quality.

Diagnostic Performance of an App-Based Symptom Checker in Mental Disorders: Comparative Study in Psychotherapy Outpatients

BACKGROUND

Digital technologies have become a common starting point for health-related information-seeking. Web- or app-based symptom checkers aim to provide rapid and accurate condition suggestions and triage advice but have not yet been investigated for mental disorders in routine health care settings.

OBJECTIVE

This study aims to test the diagnostic performance of a widely available symptom checker in the context of formal diagnosis of mental disorders when compared with therapists' diagnoses based on structured clinical interviews.

METHODS

Adult patients from an outpatient psychotherapy clinic used the app-based symptom checker Ada-check your health (ADA; Ada Health GmbH) at intake. Accuracy was assessed as the agreement of the first and 1 of the first 5 condition suggestions of ADA with at least one of the interview-based therapist diagnoses. In addition, sensitivity, specificity, and interrater reliabilities (Gwet first-order agreement coefficient [AC1]) were calculated for the 3 most prevalent disorder categories. Self-reported usability (assessed using the System Usability Scale) and acceptance of ADA (assessed using an adapted feedback questionnaire) were evaluated.

RESULTS

A total of 49 patients (30/49, 61% women; mean age 33.41, SD 12.79 years) were included in this study. Across all patients, the interview-based diagnoses matched ADA's first condition suggestion in 51% (25/49; 95% CI 37.5-64.4) of cases and 1 of the first 5 condition suggestions in 69% (34/49; 95% CI 55.4-80.6) of cases. Within the main disorder categories, the accuracy of ADA's first condition suggestion was 0.82 for somatoform and associated disorders, 0.65 for affective disorders, and 0.53 for anxiety disorders. Interrater reliabilities ranged from low (AC1=0.15 for anxiety disorders) to good (AC1=0.76 for somatoform and associated disorders). The usability of ADA was rated as high in the System Usability Scale (mean 81.51, SD 11.82, score range 0-100). Approximately 71% (35/49) of participants would have preferred a face-to-face over an app-based diagnostic.

CONCLUSIONS

Overall, our findings suggest that a widely available symptom checker used in the formal diagnosis of mental disorders could provide clinicians with a list of condition suggestions with moderate-to-good accuracy. However, diagnostic performance was heterogeneous between disorder categories and included low interrater reliability. Although symptom checkers have some potential to complement the diagnostic process as a screening tool, the diagnostic performance should be tested in larger samples and in comparison with further diagnostic instruments.

Unveiling mechanisms of change in digital interventions for depression: Study protocol for a systematic review and individual participant data meta-analysis

INTRODUCTION

The efficacy and effectiveness of digital interventions for depression are both well-established. However, precise effect size estimates for mediators transmitting the effects of digital interventions are not available; and integrative insights on the specific mechanisms of change in internet- and mobile-based interventions (IMIs)-as related to key features like delivery type, accompanying support and theoretical foundation-are largely pending.

OBJECTIVE

We will conduct a systematic review and individual participant data meta-analysis (IPD-MA) evaluating the mediators associated with therapeutic change in various IMIs for depression in adults.

METHODS

We will use three electronic databases (i.e., Embase, Medline/PubMed, PsycINFO) as well as an already established database of IPD to identify relevant published and unpublished studies. We will include (1) randomized controlled trials that examine (2) mediators of (3) guided and unguided (4) IMIs with (5) various theoretical orientations for (6) adults with (7) clinically relevant symptoms of depression (8) compared to an active or passive control condition (9) with depression symptom severity as primary outcome. Study selection, data extraction, as well as quality and risk of bias (RoB) assessment will be done independently by two reviewers. Corresponding authors of eligible primary studies will be invited to share their IPD for this meta-analytic study. In a 1-stage IPD-MA, mediation analyses (e.g., on potential mediators like self-efficacy, emotion regulation or problem solving) will be performed using a multilevel structural equation modeling approach within a random-effects framework. Indirect effects will be estimated, with multiple imputation for missing data; the overall model fit will be evaluated and statistical heterogeneity will be assessed. Furthermore, we will investigate if indirect effects are moderated by different variables on participant- (e.g., age, sex/gender, symptom severity), study- (e.g., quality, studies evaluating the temporal ordering of changes in mediators and outcomes), and intervention-level (e.g., theoretical foundation, delivery type, guidance).

DISCUSSION

This systematic review and IPD-MA will generate comprehensive information on the differential strength of mediators and associated therapeutic processes in digital interventions for depression. The findings might contribute to the empirically-informed advancement of psychotherapeutic interventions, leading to more effective interventions and improved treatment outcomes in digital mental health. Besides, with our novel approach to mediation analyses with IPD-MA, we might also add to a methodological progression of evidence-synthesis in psychotherapy process research.

STUDY REGISTRATION WITH OPEN SCIENCE FRAMEWORK OSF

https://osf.io/md7pq/.

Considerations of diversity, equity, and inclusion in mental health apps: A scoping review of evaluation frameworks

Mental health applications or apps are a promising approach to reduce the pervasive unmet mental health need observed among marginalized groups. However, these groups face unique challenges to engage in and benefit from these interventions, and apps that consider issues of diversity, equity, and inclusion (DEI) may be better positioned to reach them. App evaluation frameworks emerge as crucial tools for researchers, clinicians, and users to select evidence-based apps. Nevertheless, it is unclear the extent to which existing assessment tools capture DEI factors. The present scoping review identified 68 studies that employed one or more assessment tools to evaluate a mental health app, leading to 44 unique app evaluation frameworks. Results showed that most frameworks were developed after 2015, and only 58% of them considered at least one DEI criterion. Frameworks that performed exceptionally well were those that combined multiple standardized and validated measures. This lack of consideration for DEI variables may limit the ability of app-based interventions to serve marginalized communities, or even worse, create new disparities. Therefore, we provide recommendations to improve current app evaluation frameworks' cultural robustness and clinical utility, maximizing their effectiveness when working with individuals from marginalized communities.

[E-Mental Health and healthcare apps in Germany]

Digitalization trends are having an impact on mental healthcare. Online interventions can promote mental health and complement existing mental healthcare services. Effective online interventions have been developed for a variety of mental health disorders and, overall, patient and practitioner acceptance of such programs is high. The Digital Healthcare Act provides the legal framework for the use of healthcare apps in German routine care. After approval by the Federal Institute for Drugs and Medical Devices, the costs of certain healthcare apps are now covered by statutory health insurers. However, digital technologies have rarely been used in mental healthcare to date. Reasons include a low level of awareness of such programs as well as a large number of untested applications. Specified quality criteria can provide better orientation for patients and healthcare providers. Further implementation efforts are necessary in order to fully use the potential of digital support options in psychiatric and psychotherapeutic care for the benefit of patients.

"Help in a Heartbeat?": A Systematic Evaluation of Mobile Health Applications (Apps) for Coronary Heart Disease

For patients with coronary heart disease (CHD) lifestyle changes and disease management are key aspects of treatment that could be facilitated by mobile health applications (MHA). However, the quality and functions of MHA for CHD are largely unknown, since reviews are missing. Therefore, this study assessed the general characteristics, quality, and functions of MHA for CHD. Hereby, the Google Play and Apple App stores were systematically searched using a web crawler. The general characteristics and quality of MHA were rated with the Mobile Application Rating Scale (MARS) by two independent raters. From 3078 identified MHA, 38 met the pre-defined criteria and were included in the assessment. Most MHA were affiliated with commercial companies (52.63%) and lacked an evidence-base. An overall average quality of MHA (M = 3.38, SD = 0.36) was found with deficiencies in information quality and engagement. The most common functions were provision of information and CHD risk score calculators. Further functions included reminders (e.g., for medication or exercises), feedback, and health management support. Most MHA (81.58%) had one or two functions and MHA with more features had mostly higher MARS ratings. In summary, this review demonstrated that a number of potentially helpful MHA for patients with CHD are commercially available. However, there is a lack of scientific evidence documenting their usability and clinical potential. Since it is difficult for patients and healthcare providers to find suitable and high-quality MHA, databases with professionally reviewed MHA are required.

Mobile-based interventions for common mental disorders in youth: a systematic evaluation of pediatric health apps

BACKGROUND

The access to empirically-supported treatments for common mental disorders in children and adolescents is often limited. Mental health apps might extend service supplies, as they are deemed to be cost-efficient, scalable and appealing for youth. However, little is known about the quality of available apps. Therefore, we aimed to systematically evaluate current mobile-based interventions for pediatric anxiety, depression and posttraumatic stress disorder (PTSD).

METHODS

Systematic searches were conducted in Google Play Store and Apple App Store to identify relevant apps. To be eligible for inclusion, apps needed to be: (1) designed to target either anxiety, depression or PTSD in youth (0-18 years); (2) developed for children, adolescents or caregivers; (3) provided in English or German; (4) operative after download. The quality of eligible apps was assessed with two standardized rating systems (i.e., Mobile App Rating Scale (MARS) and ENLIGHT) independently by two reviewers.

RESULTS

Overall, the searches revealed 3806 apps, with 15 mental health apps (0.39%) fulfilling our inclusion criteria. The mean overall scores suggested a moderate app quality (MARS: M = 3.59, SD = 0.50; ENLIGHT: M = 3.22, SD = 0.73). Moreover, only one app was evaluated in an RCT. The correlation of both rating scales was high (r = .936; p < .001), whereas no significant correlations were found between rating scales and user ratings (p > .05).

CONCLUSIONS

Our results point to a rather poor overall app quality, and indicate an absence of scientific-driven development and lack of methodologically sound evaluation of apps. Thus, future high-quality research is required, both in terms of theoretically informed intervention development and assessment of mental health apps in RCTs. Furthermore, institutionalized best-practices that provide central information on different aspects of apps (e.g., effectiveness, safety, and data security) for patients, caregivers, stakeholders and mental health professionals are urgently needed.

A Systematic Evaluation of Mobile Health Applications for the Prevention of Suicidal Behavior or Non-suicidal Self-injury

People with suicidal ideation and non-suicidal self-injury (NSSI) behavior face numerous barriers to help-seeking, which worsened during the COVID-19 pandemic. Mobile health applications (MHA) are discussed as one solution to improve healthcare. However, the commercial app markets are growing unregulated and rapidly, leading to an inscrutable market. This study evaluates the quality, features, functions, and prevention strategies of MHA for people with suicidal ideation and NSSI. An automatic search engine identified MHA for suicidal behavior and NSSI in the European commercial app stores. MHA quality and general characteristics were assessed using the Mobile Application Rating Scale (MARS). MHA of high quality (top 25%) were examined in detail and checked for consistency with established suicide prevention strategies. Of 10,274 identified apps, 179 MHA met the predefined inclusion criteria. Average MHA quality was moderate (M = 3.56, SD = 0.40). Most MHA provided emergency contact, but lacked security features. High-quality MHA were broadly consistent with the best-practice guidelines. The search revealed apps containing potentially harmful and triggering content, and no randomized controlled trial of any included MHA was found. Despite a large heterogeneity in the quality of MHA, high-quality MHA for suicidal behavior and NSSI are available in European commercial app stores. However, a lack of a scientific evidence base poses potential threats to users.

A Mobile-Based Intervention to Increase Self-esteem in Students With Depressive Symptoms: Randomized Controlled Trial

Background

Depressive symptoms are one of the most common and ever-increasing mental health problems among students worldwide. Conventional treatment options, particularly psychotherapy, do not reach all students in need of help. Internet- and mobile-based interventions are promising alternatives for narrowing the treatment gap.

Objective

In the framework of a randomized controlled trial, we aim to investigate the effectiveness, acceptance, and side effects of a self-help smartphone app (MCT & More) based on cognitive behavioral therapy, mindfulness, acceptance and commitment therapy, and metacognitive training in a sample of students with self-reported depressive symptoms. Furthermore, we were interested in examining the influence of treatment expectations and attitudes toward internet- and mobile-based interventions on treatment adherence and effectiveness.

Methods

A total of 400 students were recruited via open access websites and randomized to either the intervention group (n=200), who received access to the self-help smartphone app MCT & More for a period of 4 weeks, or to a wait-list control group (n=200). The Patient Health Questionnaire-9 (depression) served as the primary outcome parameter, and the Rosenberg Self-esteem Scale (self-esteem) and the global item of the World Health Organization Quality of Life-abbreviated version (quality of life) served as the secondary outcome parameters. The Attitudes Towards Psychological Online Interventions was used to measure attitudes toward internet- and mobile-based interventions. Outcome expectations were assessed using the Patient Questionnaire on Therapy Expectation and Evaluation, and side effects were assessed using the Inventory for Assessing Negative Effects of Psychotherapy.

Results

Per-protocol (PP), complete-case, and intention-to-treat analyses showed a significantly higher reduction in depressive symptoms (PP: F_1,222=3.98; P=.047; d=0.26) and a significantly higher increase in self-esteem (PP: F_1,220=8.79; P=.003; d=0.40) in the intervention group than in the wait-list control group. Most participants regularly used the self-help smartphone app (91/120, 75.8%, at least once a week). The more positive the attitude toward internet- and mobile-based interventions (r=0.260; P=.004) and the more positive the outcome expectation (r=0.236; P=.009), the more frequently the self-help smartphone app was used.

Conclusions

The effectiveness of the self-help smartphone app MCT & More was demonstrated among students with depressive symptoms compared with a wait-list control group. The app could be offered regularly as a low-threshold intervention to enhance students’ health.

Trial Registration

German Clinical Trials Register DRKS00020941; https://tinyurl.com/pr84w6er

Medical Device Regulation Efforts for mHealth Apps during the COVID-19 Pandemic—An Experience Report of Corona Check and Corona Health

Within the healthcare environment, mobile health (mHealth) applications (apps) are becoming more and more important. The number of new mHealth apps has risen steadily in the last years. Especially the COVID-19 pandemic has led to an enormous amount of app releases. In most countries, mHealth applications have to be compliant with several regulatory aspects to be declared a “medical app”. However, the latest applicable medical device regulation (MDR) does not provide more details on the requirements for mHealth applications. When developing a medical app, it is essential that all contributors in an interdisciplinary team—especially software engineers—are aware of the specific regulatory requirements beforehand. The development process, however, should not be stalled due to integration of the MDR. Therefore, a developing framework that includes these aspects is required to facilitate a reliable and quick development process. The paper at hand introduces the creation of such a framework on the basis of the Corona Health and Corona Check apps. The relevant regulatory guidelines are listed and summarized as a guidance for medical app developments during the pandemic and beyond. In particular, the important stages and challenges faced that emerged during the entire development process are highlighted.

Quality of Physical Activity Apps: Systematic Search in App Stores and Content Analysis

Background

Physical inactivity is a major contributor to the development and persistence of chronic diseases. Mobile health apps that foster physical activity have the potential to assist in behavior change. However, the quality of the mobile health apps available in app stores is hard to assess for making informed decisions by end users and health care providers.

Objective

This study aimed at systematically reviewing and analyzing the content and quality of physical activity apps available in the 2 major app stores (Google Play and App Store) by using the German version of the Mobile App Rating Scale (MARS-G). Moreover, the privacy and security measures were assessed.

Methods

A web crawler was used to systematically search for apps promoting physical activity in the Google Play store and App Store. Two independent raters used the MARS-G to assess app quality. Further, app characteristics, content and functions, and privacy and security measures were assessed. The correlation between user star ratings and MARS was calculated. Exploratory regression analysis was conducted to determine relevant predictors for the overall quality of physical activity apps.

Results

Of the 2231 identified apps, 312 met the inclusion criteria. The results indicated that the overall quality was moderate (mean 3.60 [SD 0.59], range 1-4.75). The scores of the subscales, that is, information (mean 3.24 [SD 0.56], range 1.17-4.4), engagement (mean 3.19 [SD 0.82], range 1.2-5), aesthetics (mean 3.65 [SD 0.79], range 1-5), and functionality (mean 4.35 [SD 0.58], range 1.88-5) were obtained. An efficacy study could not be identified for any of the included apps. The features of data security and privacy were mainly not applied. Average user ratings showed significant small correlations with the MARS ratings (r=0.22, 95% CI 0.08-0.35; P<.001). The amount of content and number of functions were predictive of the overall quality of these physical activity apps, whereas app store and price were not.

Conclusions

Apps for physical activity showed a broad range of quality ratings, with moderate overall quality ratings. Given the present privacy, security, and evidence concerns inherent to most rated apps, their medical use is questionable. There is a need for open-source databases of expert quality ratings to foster informed health care decisions by users and health care providers.

Mental Health Applications for Primary and Secondary Prevention of Common Mental Disorders: Attitudes of German Employees

Background: Web-based and mobile mental health applications for the prevention and treatment of common mental disorders (CMDs) are on the rise. Under certain circumstances they have proved to be effective for a range of conditions (e.g., depression). Objective: There is not sufficient evidence regarding the benefits and barriers especially for mobile phone apps and for programs in the field of primary prevention. Studies on the acceptance of potential users of mental health apps yielded mixed outcomes. In a large survey we investigated the attitudes of employees toward mental health apps and various traditional mental health services. Our main research question in this contribution focuses on the acceptance of apps compared to other measures and the moderating influence of individual characteristics. Methods: The standardized survey was completed by members of an online access panel with different job types. A set of 33 self-developed items, including three questions on e-health, captured the perceived relevance of prevention at the (A) occupational, (B) individual, and (C) societal level. On the basis of an exploratory factor analysis, mean scores for mapping seven (sub-)dimensions were constructed and compared using the Wilcoxon test. The influence of potential predictors was analyzed in linear regression models. Results: The data of 610 respondents were analyzed (response rate 75%). Support from mental health applications was rated significantly less important compared to all other dimensions at the levels (A) to (C). Respondents were more likely to use mental health apps if they felt literate with electronic devices, perceived a high relevance of work-related demands as causal factors for CMDs, stated they would be ashamed of having a CMD, and would be willing to begin psychotherapy if recommended. Discussion and Conclusions: The results confirm the critical attitudes of potential mental health app users found in other studies. Since users with a negative attitude toward e-health might have a higher risk for dropout and non-adherence as well as lower intervention effects, well-designed educational strategies should be carried out beforehand.

Influences on the Uptake of Health and Well-being Apps and Curated App Portals: Think-Aloud and Interview Study

BACKGROUND

Health and well-being smartphone apps can provide a cost-effective solution to addressing unhealthy behaviors. The selection of these apps tends to occur in commercial app stores, where thousands of health apps are available. Their uptake is often influenced by popularity indicators. However, these indicators are not necessarily associated with app effectiveness or evidence-based content. Alternative routes to app selection are increasingly available, such as via curated app portals, but little is known about people's experiences of them.

OBJECTIVE

The aim of this study is to explore how people select health apps on the internet and their views on curated app portals.

METHODS

A total of 18 UK-based adults were recruited through social media and asked during an in-person meeting to verbalize their thoughts while searching for a health or well-being app on the internet on a platform of their choice. The search was then repeated on 2 curated health app portals: the National Health Service Apps Library and the Public Health England One You App portal. This was followed by semistructured interviews. Data were analyzed using framework analysis, informed by the Capability, Opportunity, Motivation-Behavior model and the Theoretical Domains Framework.

RESULTS

Searching for health and well-being apps on the internet was described as a minefield. App uptake appeared to be influenced by participants' capabilities such as app literacy skills and health and app awareness, and opportunities including the availability of apps, app esthetics, the price of an app, and social influences. Motivation factors that seemed to affect the uptake were perceived competence, time efficiency, perceived utility and accuracy of an app, transparency about data protection, commitment and social identity, and a wide range of emotions. Social influences and the perceived utility of an app were highlighted as particularly important. Participants were not previously aware of curated portals but found the concept appealing. Curated health app portals appeared to engender trust and alleviate data protection concerns. Although apps listed on these were perceived as more trustworthy, their presentation was considered disappointing. This disappointment seemed to stem from the functionality of the portals, lack of user guidance, and lack of tailored content to an individual's needs.

CONCLUSIONS

The uptake of health and well-being apps appears to be primarily affected by social influences and the perceived utility of an app. App uptake via curated health app portals perceived as credible may mitigate concerns related to data protection and accuracy, but their implementation must better meet user needs and expectations.

Evidence Synthesis of Digital Interventions to Mitigate the Negative Impact of the COVID-19 Pandemic on Public Mental Health: Rapid Meta-review

Background

Accumulating evidence suggests the COVID-19 pandemic has negative effects on public mental health. Digital interventions that have been developed and evaluated in recent years may be used to mitigate the negative consequences of the pandemic. However, evidence-based recommendations on the use of existing telemedicine and internet-based (eHealth) and app-based mobile health (mHealth) interventions are lacking.

Objective

The aim of this study was to investigate the theoretical and empirical base, user perspective, safety, effectiveness, and cost-effectiveness of digital interventions related to public mental health provision (ie, mental health promotion, prevention, and treatment of mental disorders) that may help to reduce the consequences of the COVID-19 pandemic.

Methods

A rapid meta-review was conducted. The MEDLINE, PsycINFO, and CENTRAL databases were searched on May 11, 2020. Study inclusion criteria were broad and considered systematic reviews and meta-analyses that investigated digital tools for health promotion, prevention, or treatment of mental health conditions and determinants likely affected by the COVID-19 pandemic.

Results

Overall, 815 peer-reviewed systematic reviews and meta-analyses were identified, of which 83 met the inclusion criteria. Our findings suggest that there is good evidence on the usability, safety, acceptance/satisfaction, and effectiveness of eHealth interventions. Evidence on mHealth apps is promising, especially if social components (eg, blended care) and strategies to promote adherence are incorporated. Although most digital interventions focus on the prevention or treatment of mental disorders, there is some evidence on mental health promotion. However, evidence on process quality, cost-effectiveness, and long-term effects is very limited.

Conclusions

There is evidence that digital interventions are particularly suited to mitigating psychosocial consequences at the population level. In times of physical distancing, quarantine, and restrictions on social contacts, decision makers should develop digital strategies for continued mental health care and invest time and efforts in the development and implementation of mental health promotion and prevention programs.

Social isolation, mental health, and use of digital interventions in youth during the COVID-19 pandemic: A nationally representative survey

Background

Public health measures to curb SARS-CoV-2 transmission rates may have negative psychosocial consequences in youth. Digital interventions may help to mitigate these effects. We investigated the associations between social isolation, COVID-19-related cognitive preoccupation, worries, and anxiety, objective social risk indicators, and psychological distress, as well as use of, and attitude toward, mobile health (mHealth) interventions in youth.

Methods

Data were collected as part of the “Mental Health And Innovation During COVID-19 Survey”—a cross-sectional panel study including a representative sample of individuals aged 16–25 years (N = 666; M_age = 21.3; assessment period: May 5, 2020 to May 16, 2020).

Results

Overall, 38% of youth met criteria for moderate or severe psychological distress. Social isolation worries and anxiety, and objective risk indicators were associated with psychological distress, with evidence of dose–response relationships for some of these associations. For instance, psychological distress was progressively more likely to occur as levels of social isolation increased (reporting “never” as reference group: “occasionally”: adjusted odds ratio [aOR] 9.1, 95% confidence interval [CI] 4.3–19.1, p < 0.001; “often”: aOR 22.2, CI 9.8–50.2, p < 0.001; “very often”: aOR 42.3, CI 14.1–126.8, p < 0.001). There was evidence that psychological distress, worries, and anxiety were associated with a positive attitude toward using mHealth interventions, whereas psychological distress, worries, and anxiety were associated with actual use.

Conclusions

Public health measures during pandemics may be associated with poor mental health outcomes in youth. Evidence-based digital interventions may help mitigate the negative psychosocial impact without risk of viral infection given there is an objective need and subjective demand.

Mobile Apps for Older Adults: Systematic Search and Evaluation Within Online Stores

Background

Through the increasingly aging population, the health care system is confronted with various challenges such as expanding health care costs. To manage these challenges, mobile apps may represent a cost-effective and low-threshold approach to support older adults.

Objective

This systematic review aimed to evaluate the quality, characteristics, as well as privacy and security measures of mobile apps for older adults in the European commercial app stores.

Methods

In the European Google Play and App Store, a web crawler systematically searched for mobile apps for older adults. The identified mobile apps were evaluated by two independent reviewers using the German version of the Mobile Application Rating Scale. A correlation between the user star rating and overall rating was calculated. An exploratory regression analysis was conducted to determine whether the obligation to pay fees predicted overall quality.

Results

In total, 83 of 1217 identified mobile apps were included in the analysis. Generally, the mobile apps for older adults were of moderate quality (mean 3.22 [SD 0.68]). Four mobile apps (5%) were evidence-based; 49% (41/83) had no security measures. The user star rating correlated significantly positively with the overall rating (r=.30, P=.01). Obligation to pay fees could not predict overall quality.

Conclusions

There is an extensive quality range within mobile apps for older adults, indicating deficits in terms of information quality, data protection, and security precautions, as well as a lack of evidence-based approaches. Central databases are needed to identify high-quality mobile apps.

Stay Present with Your Phone: A Systematic Review and Standardized Rating of Mindfulness Apps in European App Stores

BACKGROUND

Mindfulness-based interventions show positive effects on physical and mental health. For a better integration of mindfulness techniques in daily life, the use of apps may be promising. However, only a few studies have examined the quality of mindfulness apps using a validated standardized instrument. This review aims to evaluate the content, quality, and privacy features of mindfulness-focused apps from European commercial app stores.

METHODS

An automated search engine (webcrawler) was used to identify mindfulness-focused apps in the European Apple App- and Google Play store. Content, quality, and privacy features were evaluated by two independent reviewers using the Mobile Application Rating Scale (MARS). The MARS assesses the subscales engagement, functionality, aesthetics, and information quality.

RESULTS

Out of 605 identified apps, 192 met the inclusion criteria. The overall quality was moderate (M = 3.66, SD = 0.48). Seven apps were tested in a randomized controlled trial (RCT). Most of the apps showed a lack of data security and no privacy policy. The five apps with the highest ratings are from a credible source, include a privacy policy, and are also based on standardized mindfulness and behavior change techniques.

CONCLUSIONS

The plethora of often low-quality apps in commercial app stores makes it difficult for users to identify a suitable app. Above that, the lack of scientific verification of effectiveness and shortcomings in privacy protection and security poses potential risks. So far, the potential of mindfulness-focused apps is not exploited in commercial app stores.

Psych-APP-Therapie: Smartphonebasierte Interventionen in der Psychotherapie – Eine systematische Übersichtsarbeit

<b><i>Hintergrund:</i></b> Technologiebasierte Interventionen haben in der Psychotherapie an Bedeutung gewonnen. Ein versorgungsrelevanter Ansatz sind Mental Health Apps. Ziel dieser systematischen Übersichtsarbeit ist es (1) international eva­luierte Apps zu den Störungsbildern Depressionen, Angststörungen und Essstörungen zu identifizieren, (2) deren Verfügbarkeit in deutschen App-Stores sowie (3) in deutscher Sprache zu prüfen und (4) ihre Effektivitätsergebnisse aus randomisiert-kontrollierten (Pilot-)Studien (RCTs) darzustellen. <b><i>Methode:</i></b> Die Übersichtsarbeit wurde in Anlehnung an das PRISMA Statement durchgeführt und ausgewertet. Eine systematische Recherche (2007–2018) der Datenbanken PubMed, PsychINFO sowie PSYNDEX wurde durchgeführt. Zudem fand eine Beurteilung der methodischen Qualität sowie der Effektivitätsergebnisse der (Pilot-)RCTs statt. <b><i>Ergebnisse:</i></b> Es wurden 2’571 Abstracts identifiziert und 47 Publikationen eingeschlossen (<i>N</i> = 32 unterschiedliche Apps; <i>N</i> = 24 [Pilot-]RCTs). Die Qualität der (Pilot-)RCTs ist überwiegend als gut bis moderat einzustufen. Die Ergebnisse waren heterogen (keine bis große Effekte [Cohens <i>d</i>] zwischen den Gruppen: –0,01; KI [–0,36; 0,34] bis 1,49; KI [1,00; 1,99]). Vier Apps mit einer Evaluation durch (Pilot-)RCTs sind in den deutschen App-Stores verfügbar – eine in deutscher Sprache. <b><i>Schlussfolgerungen:</i></b> Es liegt international eine Vielzahl von ersten App-Evaluationen zu den Störungsbildern vor, die Verfügbarkeit ausreichend evalu­ierter deutschsprachiger Apps in den deutschen App-Stores ist aber extrem limitiert. Englischsprachige, bereits evalu­ierte Apps könnten in das Deutsche übersetzt und – genauso wie schon verfügbare, aber nicht evaluierte deutschsprachige Apps – in RCTs inkl. Katamnesedaten evaluiert werden. So könnten smartphonebasierte Interventionen im Rahmen des “Digitalen-Versorgungs-Gesetzes” als ergänzendes Element in der Psychotherapie an Bedeutung gewinnen.

[Internet-based psychotherapeutic interventions]

Over the past few years, research and application of internet-based psychotherapeutic interventions has grown rapidly. This kind of new therapeutic format offers a variety of chances for treating patients with psychotherapeutic disorders, but also arouses skepticism and concerns. This overview focuses on different forms of internet-based psychotherapeutic interventions, reflects the current state of research, and points out new areas of development as well as its implementation in daily practice.

Adherence to Established Treatment Guidelines Among Unguided Digital Interventions for Depression: Quality Evaluation of 28 Web-Based Programs and Mobile Apps

Background

Web-based interventions for depression have been widely tested for usability and functioning. However, the few studies that have addressed the therapeutic quality of these interventions have mainly focused on general aspects without consideration of specific quality factors related to particular treatment components. Clinicians and scientists are calling for standardized assessment criteria for web-based interventions to enable effective and trustworthy patient care. Therefore, an extensive evaluation of web-based interventions at the level of individual treatment components based on therapeutic guidelines and manuals is needed.

Objective

The objective of this study was to evaluate the quality of unguided web-based interventions for depression at the level of individual treatment components based on their adherence to current gold-standard treatment guidelines and manuals.

Methods

A comprehensive online search of popular app stores and search engines in January 2018 revealed 11 desktop programs and 17 smartphone apps that met the inclusion criteria. Programs and apps were included if they were available for German users, interactive, unguided, and targeted toward depression. All programs and apps were tested by three independent researchers following a standardized procedure with a predefined symptom trajectory. During the testing, all web-based interventions were rated with a standardized list of criteria based on treatment guidelines and manuals for depression.

Results

Overall interrater reliability for all raters was substantial with an intraclass correlation coefficient of 0.73 and Gwet AC1 value of 0.80. The main features of web-based interventions included mood tracking (24/28, 86%), psychoeducation (21/28, 75%), cognitive restructuring (21/28, 75%), crisis management (20/28, 71%), behavioral activation (19/29, 68%), and relaxation training (18/28, 64%). Overall, therapeutic meaningfulness was rated higher for desktop programs (mean 4.13, SD 1.17) than for smartphone apps (mean 2.92, SD 1.46).

Conclusions

Although many exercises from manuals are included in web-based interventions, the necessary therapeutic depth of the interventions is often not reached, and risk management is frequently lacking. There is a need for further research targeting general principles for the development and evaluation of therapeutically sound web-based interventions for depression.

The German Version of the Mobile App Rating Scale (MARS-G): Development and Validation Study

BACKGROUND

The number of mobile health apps (MHAs), which are developed to promote healthy behaviors, prevent disease onset, manage and cure diseases, or assist with rehabilitation measures, has exploded. App store star ratings and descriptions usually provide insufficient or even false information about app quality, although they are popular among end users. A rigorous systematic approach to establish and evaluate the quality of MHAs is urgently needed. The Mobile App Rating Scale (MARS) is an assessment tool that facilitates the objective and systematic evaluation of the quality of MHAs. However, a German MARS is currently not available.

OBJECTIVE

The aim of this study was to translate and validate a German version of the MARS (MARS-G).

METHODS

The original 19-item MARS was forward and backward translated twice, and the MARS-G was created. App description items were extended, and 104 MHAs were rated twice by eight independent bilingual researchers, using the MARS-G and MARS. The internal consistency, validity, and reliability of both scales were assessed. Mokken scale analysis was used to investigate the scalability of the overall scores.

RESULTS

The retranslated scale showed excellent alignment with the original MARS. Additionally, the properties of the MARS-G were comparable to those of the original MARS. The internal consistency was good for all subscales (ie, omega ranged from 0.72 to 0.91). The correlation coefficients (r) between the dimensions of the MARS-G and MARS ranged from 0.93 to 0.98. The scalability of the MARS (H=0.50) and MARS-G (H=0.48) were good.

CONCLUSIONS

The MARS-G is a reliable and valid tool for experts and stakeholders to assess the quality of health apps in German-speaking populations. The overall score is a reliable quality indicator. However, further studies are needed to assess the factorial structure of the MARS and MARS-G.

'Help for trauma from the app stores?' A systematic review and standardised rating of apps for Post-Traumatic Stress Disorder (PTSD)

Background: Mobile health applications (apps) are considered to complement traditional psychological treatments for Post-Traumatic Stress Disorder (PTSD). However, the use for clinical practice and quality of available apps is unknown. Objective: To assess the general characteristics, therapeutic background, content, and quality of apps for PTSD and to examine their concordance with established PTSD treatment and self-help methods. Method: A web crawler systematically searched for apps targeting PTSD in the British Google Play and Apple iTunes stores. Two independent researchers rated the apps using the Mobile App Rating Scale (MARS). The content of high-quality apps was checked for concordance with psychological treatment and self-help methods extracted from current literature on PTSD treatment. Results: Out of 555 identified apps, 69 met the inclusion criteria. The overall app quality based on the MARS was medium (M = 3.36, SD = 0.65). Most apps (50.7%) were based on cognitive behavioural therapy and offered a wide range of content, including established psychological PTSD treatment methods such as processing of trauma-related emotions and beliefs, relaxation exercises, and psychoeducation. Notably, data protection and privacy standards were poor in most apps and only one app (1.4%) was scientifically evaluated in a randomized controlled trial. Conclusions: High-quality apps based on established psychological treatment techniques for PTSD are available in commercial app stores. However, users are confronted with great difficulties in identifying useful high-quality apps and most apps lack an evidence-base. Commercial distribution channels do not exploit the potential of apps to complement the psychological treatment of PTSD.

Standalone smartphone apps for mental health-a systematic review and meta-analysis

While smartphone usage is ubiquitous, and the app market for smartphone apps targeted at mental health is growing rapidly, the evidence of standalone apps for treating mental health symptoms is still unclear. This meta-analysis investigated the efficacy of standalone smartphone apps for mental health. A comprehensive literature search was conducted in February 2018 on randomized controlled trials investigating the effects of standalone apps for mental health in adults with heightened symptom severity, compared to a control group. A random-effects model was employed. When insufficient comparisons were available, data was presented in a narrative synthesis. Outcomes included assessments of mental health disorder symptom severity specifically targeted at by the app. In total, 5945 records were identified and 165 full-text articles were screened for inclusion by two independent researchers. Nineteen trials with 3681 participants were included in the analysis: depression (k = 6), anxiety (k = 4), substance use (k = 5), self-injurious thoughts and behaviors (k = 4), PTSD (k = 2), and sleep problems (k = 2). Effects on depression (Hedges’ g = 0.33, 95%CI 0.10–0.57, P = 0.005, NNT = 5.43, I² = 59%) and on smoking behavior (g = 0.39, 95%CI 0.21–0.57, NNT = 4.59, P ≤ 0.001, I² = 0%) were significant. No significant pooled effects were found for anxiety, suicidal ideation, self-injury, or alcohol use (g = −0.14 to 0.18). Effect sizes for single trials ranged from g = −0.05 to 0.14 for PTSD and g = 0.72 to 0.84 for insomnia. Although some trials showed potential of apps targeting mental health symptoms, using smartphone apps as standalone psychological interventions cannot be recommended based on the current level of evidence.

German Mobile Apps in Rheumatology: Review and Analysis Using the Mobile Application Rating Scale (MARS)

Background

Chronic rheumatic diseases need long-term treatment and professional supervision. Mobile apps promise to improve the lives of patients and physicians. In routine practice, however, rheumatology apps are largely unknown and little is known about their quality and safety.

Objective

The aim of this study was to provide an overview of mobile rheumatology apps currently available in German app stores, evaluate app quality using the Mobile Application Rating Scale (MARS), and compile brief, ready-to-use descriptions for patients and rheumatologists.

Methods

The German App Store and Google Play store were systematically searched to identify German rheumatology mobile apps for patient and physician use. MARS was used to independently assess app quality by 8 physicians, 4 using Android and 4 using iOS smartphones. Apps were randomly assigned so that 4 apps were rated by all raters and the remaining apps were rated by two Android and two iOS users. Furthermore, brief app descriptions including app developers, app categories, and features were compiled to inform potential users and developers.

Results

In total, 128 and 63 apps were identified in the German Google Play and App Store, respectively. After removing duplicates and only including apps that were available in both stores, 28 apps remained. Sixteen apps met the inclusion criteria, which were (1) German language, (2) availability in both app stores, (3) targeting patients or physicians as users, and (4) clearly including rheumatology or rheumatic diseases as subject matter. Exclusion criteria were (1) congress apps and (2) company apps with advertisements. Nine apps addressed patients and 7 apps addressed physicians. No clinical studies to support the effectiveness and safety of apps could be found. Pharmaceutical companies were the main developers of two apps. Rheuma Auszeit was the only app mainly developed by a patient organization. This app had the highest overall MARS score (4.19/5). Three out of 9 patient apps featured validated questionnaires. The median overall MARS score was 3.85/5, ranging from 2.81/5 to 4.19/5. One patient-targeted and one physician-targeted app had MARS scores >4/5. No significant rater gender or platform (iOS/Android) differences could be observed. The overall correlation between app store ratings and MARS scores was low and inconsistent between platforms.

Conclusions

To our knowledge, this is the first study that systematically identified and evaluated mobile apps in rheumatology for patients and physicians available in German app stores. We found a lack of supporting clinical studies, use of validated questionnaires, and involvement of academic developers. Overall app quality was heterogeneous. To create high-quality apps, closer cooperation led by patients and physicians is vital.