The Current State and Diagnostic Accuracy of Digital Mental Health Assessment Tools for Psychiatric Disorders: Protocol for a Systematic Review and Meta-analysis

Heart Rate Variability in Psychiatric Disorders: A Systematic Review

Introduction

Heart rate variability (HRV) is a measure of the fluctuation in time interval between consecutive heart beats. Decreased heart rate variability has been shown to have associations with autonomic dysfunction in psychiatric conditions such as depression, substance abuse, anxiety, and schizophrenia, although its use as a prognostic tool remains highly debated. This study aims to review the current literature on heart rate variability as a diagnostic and prognostic tool in psychiatric populations.

Methods

A literature search was conducted using the MEDLINE, EMBASE, Cochrane, and PsycINFO libraries to identify full-text studies involving adult psychiatric populations that reported HRV measurements. From 1647 originally identified, 31 studies were narrowed down through an abstract and full-text screen. Studies were excluded if they enrolled adolescents or children, used animal models, enrolled patients with another primary diagnosis other than psychiatric as outlined by the diagnostic and statistical manual of mental disorders (DSM) V, or if they assessed HRV in the context of treatment rather than diagnosis. Study quality assessment was conducted using a modified Downs and Blacks quality assessment tool for observational rather than interventional studies. Data were reported in four tables: 1) summarizing study characteristics, 2) methods of HRV detection, 3) key findings and statistics, and 4) quality assessment.

Results

There is significant variability between studies in their methodology of recording as well as reporting HRV, which makes it difficult to meaningfully interpret data that is clinically applicable due to the presence of significant bias in existing studies. The presence of an association between HRV and the severity of various psychiatric disorders, however, remains promising.

Conclusion

Future studies should be done to further explore how HRV parameters may be used to enhance the diagnosis and prognosis of several psychiatric disorders.

The Current State and Validity of Digital Assessment Tools for Psychiatry: Systematic Review

BACKGROUND

Given the role digital technologies are likely to play in the future of mental health care, there is a need for a comprehensive appraisal of the current state and validity (ie, screening or diagnostic accuracy) of digital mental health assessments.

OBJECTIVE

The aim of this review is to explore the current state and validity of question-and-answer-based digital tools for diagnosing and screening psychiatric conditions in adults.

METHODS

This systematic review was based on the Population, Intervention, Comparison, and Outcome framework and was carried out in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. MEDLINE, Embase, Cochrane Library, ASSIA, Web of Science Core Collection, CINAHL, and PsycINFO were systematically searched for articles published between 2005 and 2021. A descriptive evaluation of the study characteristics and digital solutions and a quantitative appraisal of the screening or diagnostic accuracy of the included tools were conducted. Risk of bias and applicability were assessed using the revised tool for the Quality Assessment of Diagnostic Accuracy Studies 2.

RESULTS

A total of 28 studies met the inclusion criteria, with the most frequently evaluated conditions encompassing generalized anxiety disorder, major depressive disorder, and any depressive disorder. Most of the studies used digitized versions of existing pen-and-paper questionnaires, with findings revealing poor to excellent screening or diagnostic accuracy (sensitivity=0.32-1.00, specificity=0.37-1.00, area under the receiver operating characteristic curve=0.57-0.98) and a high risk of bias for most of the included studies.

CONCLUSIONS

The field of digital mental health tools is in its early stages, and high-quality evidence is lacking.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/25382.

Digital Assessment Tools Using Animation Features to Quantify Alcohol Consumption: Systematic App Store and Literature Review

Background

Accurate and user-friendly assessment tools for quantifying alcohol consumption are a prerequisite for effective interventions to reduce alcohol-related harm. Digital assessment tools (DATs) that allow the description of consumed alcoholic drinks through animation features may facilitate more accurate reporting than conventional approaches.

Objective

This review aims to identify and characterize freely available DATs in English or Russian that use animation features to support the quantitative assessment of alcohol consumption (alcohol DATs) and determine the extent to which such tools have been scientifically evaluated in terms of feasibility, acceptability, and validity.

Methods

Systematic English and Russian searches were conducted in iOS and Android app stores and via the Google search engine. Information on the background and content of eligible DATs was obtained from app store descriptions, websites, and test completions. A systematic literature review was conducted in Embase, MEDLINE, PsycINFO, and Web of Science to identify English-language studies reporting the feasibility, acceptability, and validity of animation-using alcohol DATs. Where possible, the evaluated DATs were accessed and assessed. Owing to the high heterogeneity of study designs, results were synthesized narratively.

Results

We identified 22 eligible alcohol DATs in English, 3 (14%) of which were also available in Russian. More than 95% (21/22) of tools allowed the choice of a beverage type from a visually displayed selection. In addition, 36% (8/22) of tools enabled the choice of a drinking vessel. Only 9% (2/22) of tools allowed the simulated interactive pouring of a drink. For none of the tools published evaluation studies were identified in the literature review. The systematic literature review identified 5 exploratory studies evaluating the feasibility, acceptability, and validity of 4 animation-using alcohol DATs, 1 (25%) of which was available in the searched app stores. The evaluated tools reached moderate to high scores on user rating scales and showed fair to high convergent validity when compared with established assessment methods.

Conclusions

Animation-using alcohol DATs are available in app stores and on the web. However, they often use nondynamic features and lack scientific background information. Explorative study data suggest that such tools might enable the user-friendly and valid assessment of alcohol consumption and could thus serve as a building block in the reduction of alcohol-attributable health burden worldwide.

Trial Registration

PROSPERO International Prospective Register of Systematic Reviews CRD42020172825; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42020172825

Learnings from user feedback of a novel digital mental health assessment

Digital mental health interventions (DMHI) have the potential to address barriers to face-to-face mental healthcare. In particular, digital mental health assessments offer the opportunity to increase access, reduce strain on services, and improve identification. Despite the potential of DMHIs there remains a high drop-out rate. Therefore, investigating user feedback may elucidate how to best design and deliver an engaging digital mental health assessment. The current study aimed to understand 1304 user perspectives of (1) a newly developed digital mental health assessment to determine which features users consider to be positive or negative and (2) the Composite International Diagnostic Interview (CIDI) employed in a previous large-scale pilot study. A thematic analysis method was employed to identify themes in feedback to three question prompts related to: (1) the questions included in the digital assessment, (2) the homepage design and reminders, and (3) the assessment results report. The largest proportion of the positive and negative feedback received regarding the questions included in the assessment (n = 706), focused on the quality of the assessment (n = 183, 25.92% and n = 284, 40.23%, respectively). Feedback for the homepage and reminders (n = 671) was overwhelmingly positive, with the largest two themes identified being positive usability (i.e., ease of use; n = 500, 74.52%) and functionality (i.e., reminders; n = 278, 41.43%). The most frequently identified negative theme in results report feedback (n = 794) was related to the report content (n = 309, 38.92%), with users stating it was lacking in-depth information. Nevertheless, the most frequent positive theme regarding the results report feedback was related to wellbeing outcomes (n = 145, 18.26%), with users stating the results report, albeit brief, encouraged them to seek professional support. Interestingly, despite some negative feedback, most users reported that completing the digital mental health assessment has been worthwhile (n = 1,017, 77.99%). Based on these findings, we offer recommendations to address potential barriers to user engagement with a digital mental health assessment. In summary, we recommend undertaking extensive co-design activities during the development of digital assessment tools, flexibility in answering modalities within digital assessment, customizable additional features such as reminders, transparency of diagnostic decision making, and an actionable results report with personalized mental health resources.