Toward clinical digital phenotyping: a timely opportunity to consider purpose, quality, and safety

Predicting Mood Based on the Social Context Measured Through the Experience Sampling Method, Digital Phenotyping, and Social Networks

Social interactions are essential for well-being. Therefore, researchers increasingly attempt to capture an individual's social context to predict well-being, including mood. Different tools are used to measure various aspects of the social context. Digital phenotyping is a commonly used technology to assess a person's social behavior objectively. The experience sampling method (ESM) can capture the subjective perception of specific interactions. Lastly, egocentric networks are often used to measure specific relationship characteristics. These different methods capture different aspects of the social context over different time scales that are related to well-being, and combining them may be necessary to improve the prediction of well-being. Yet, they have rarely been combined in previous research. To address this gap, our study investigates the predictive accuracy of mood based on the social context. We collected intensive within-person data from multiple passive and self-report sources over a 28-day period in a student sample (Participants: N = 11, ESM measures: N = 1313). We trained individualized random forest machine learning models, using different predictors included in each model summarized over different time scales. Our findings revealed that even when combining social interactions data using different methods, predictive accuracy of mood remained low. The average coefficient of determination over all participants was 0.06 for positive and negative affect and ranged from - 0.08 to 0.3, indicating a large amount of variance across people. Furthermore, the optimal set of predictors varied across participants; however, predicting mood using all predictors generally yielded the best predictions. While combining different predictors improved predictive accuracy of mood for most participants, our study highlights the need for further work using larger and more diverse samples to enhance the clinical utility of these predictive modeling approaches.

Interpretable video-based tracking and quantification of parkinsonism clinical motor states

Quantification of motor symptom progression in Parkinson's disease (PD) patients is crucial for assessing disease progression and for optimizing therapeutic interventions, such as dopaminergic medications and deep brain stimulation. Cumulative and heuristic clinical experience has identified various clinical signs associated with PD severity, but these are neither objectively quantifiable nor robustly validated. Video-based objective symptom quantification enabled by machine learning (ML) introduces a potential solution. However, video-based diagnostic tools often have implementation challenges due to expensive and inaccessible technology, and typical "black-box" ML implementations are not tailored to be clinically interpretable. Here, we address these needs by releasing a comprehensive kinematic dataset and developing an interpretable video-based framework that predicts high versus low PD motor symptom severity according to MDS-UPDRS Part III metrics. This data driven approach validated and robustly quantified canonical movement features and identified new clinical insights, not previously appreciated as related to clinical severity, including pinkie finger movements and lower limb and axial features of gait. Our framework is enabled by retrospective, single-view, seconds-long videos recorded on consumer-grade devices such as smartphones, tablets, and digital cameras, thereby eliminating the requirement for specialized equipment. Following interpretable ML principles, our framework enforces robustness and interpretability by integrating (1) automatic, data-driven kinematic metric evaluation guided by pre-defined digital features of movement, (2) combination of bi-domain (body and hand) kinematic features, and (3) sparsity-inducing and stability-driven ML analysis with simple-to-interpret models. These elements ensure that the proposed framework quantifies clinically meaningful motor features useful for both ML predictions and clinical analysis.

From wearable sensor data to digital biomarker development: ten lessons learned and a framework proposal

Wearable sensor technologies are becoming increasingly relevant in health research, particularly in the context of chronic disease management. They generate real-time health data that can be translated into digital biomarkers, which can provide insights into our health and well-being. Scientific methods to collect, interpret, analyze, and translate health data from wearables to digital biomarkers vary, and systematic approaches to guide these processes are currently lacking. This paper is based on an observational, longitudinal cohort study, BarKA-MS, which collected wearable sensor data on the physical rehabilitation of people living with multiple sclerosis (MS). Based on our experience with BarKA-MS, we provide and discuss ten lessons we learned in relation to digital biomarker development across key study phases. We then summarize these lessons into a guiding framework (DACIA) that aims to informs the use of wearable sensor data for digital biomarker development and chronic disease management for future research and teaching.

Integration of passive sensing technology to enhance delivery of psychological interventions for mothers with depression: the StandStrong study

Psychological interventions delivered by non-specialist providers have shown mixed results for treating maternal depression. mHealth solutions hold the possibility for unobtrusive behavioural data collection to identify challenges and reinforce change in psychological interventions. We conducted a proof-of-concept study using passive sensing integrated into a depression intervention delivered by non-specialists to twenty-four adolescents and young mothers (30% 15-17 years old; 70% 18-25 years old) with infants (< 12 months old) in rural Nepal. All mothers showed a reduction in depression symptoms as measured with the Beck Depression Inventory. There were trends toward increased movement away from the house (greater distance measured through GPS data) and more time spent away from the infant (less time in proximity measured with the Bluetooth beacon) as the depression symptoms improved. There was considerable heterogeneity in these changes and other passively collected data (speech, physical activity) throughout the intervention. This proof-of-concept demonstrated that passive sensing can be feasibly used in low-resource settings and can personalize psychological interventions. Care must be taken when implementing such an approach to ensure confidentiality, data protection, and meaningful interpretation of data to enhance psychological interventions.

Use of Machine Learning Algorithms Based on Text, Audio, and Video Data in the Prediction of Anxiety and Posttraumatic Stress in General and Clinical Populations: A Systematic Review

Research in machine learning (ML) algorithms using natural behavior (i.e., text, audio, and video data) suggests that these techniques could contribute to personalization in psychology and psychiatry. However, a systematic review of the current state of the art is missing. Moreover, individual studies often target ML experts who may overlook potential clinical implications of their findings. In a narrative accessible to mental health professionals, we present a systematic review conducted in 5 psychology and 2 computer science databases. We included 128 studies that assessed the predictive power of ML algorithms using text, audio, and/or video data in the prediction of anxiety and posttraumatic stress disorder. Most studies (n = 87) were aimed at predicting anxiety, while the remainder (n = 41) focused on posttraumatic stress disorder. They were mostly published since 2019 in computer science journals and tested algorithms using text (n = 72) as opposed to audio or video. Studies focused mainly on general populations (n = 92) and less on laboratory experiments (n = 23) or clinical populations (n = 13). Methodological quality varied, as did reported metrics of the predictive power, hampering comparison across studies. Two-thirds of studies, which focused on both disorders, reported acceptable to very good predictive power (including high-quality studies only). The results of 33 studies were uninterpretable, mainly due to missing information. Research into ML algorithms using natural behavior is in its infancy but shows potential to contribute to diagnostics of mental disorders, such as anxiety and posttraumatic stress disorder, in the future if standardization of methods, reporting of results, and research in clinical populations are improved.

Digital Phenotyping for Stress, Anxiety, and Mild Depression: Systematic Literature Review

BACKGROUND

Unaddressed early-stage mental health issues, including stress, anxiety, and mild depression, can become a burden for individuals in the long term. Digital phenotyping involves capturing continuous behavioral data via digital smartphone devices to monitor human behavior and can potentially identify milder symptoms before they become serious.

OBJECTIVE

This systematic literature review aimed to answer the following questions: (1) what is the evidence of the effectiveness of digital phenotyping using smartphones in identifying behavioral patterns related to stress, anxiety, and mild depression? and (2) in particular, which smartphone sensors are found to be effective, and what are the associated challenges?

METHODS

We used the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) process to identify 36 papers (reporting on 40 studies) to assess the key smartphone sensors related to stress, anxiety, and mild depression. We excluded studies conducted with nonadult participants (eg, teenagers and children) and clinical populations, as well as personality measurement and phobia studies. As we focused on the effectiveness of digital phenotyping using smartphones, results related to wearable devices were excluded.

RESULTS

We categorized the studies into 3 major groups based on the recruited participants: studies with students enrolled in universities, studies with adults who were unaffiliated to any particular organization, and studies with employees employed in an organization. The study length varied from 10 days to 3 years. A range of passive sensors were used in the studies, including GPS, Bluetooth, accelerometer, microphone, illuminance, gyroscope, and Wi-Fi. These were used to assess locations visited; mobility; speech patterns; phone use, such as screen checking; time spent in bed; physical activity; sleep; and aspects of social interactions, such as the number of interactions and response time. Of the 40 included studies, 31 (78%) used machine learning models for prediction; most others (n=8, 20%) used descriptive statistics. Students and adults who experienced stress, anxiety, or depression visited fewer locations, were more sedentary, had irregular sleep, and accrued increased phone use. In contrast to students and adults, less mobility was seen as positive for employees because less mobility in workplaces was associated with higher performance. Overall, travel, physical activity, sleep, social interaction, and phone use were related to stress, anxiety, and mild depression.

CONCLUSIONS

This study focused on understanding whether smartphone sensors can be effectively used to detect behavioral patterns associated with stress, anxiety, and mild depression in nonclinical participants. The reviewed studies provided evidence that smartphone sensors are effective in identifying behavioral patterns associated with stress, anxiety, and mild depression.

On the proportion of patients who experience a prodrome prior to psychosis onset: A systematic review and meta-analysis

BACKGROUND

Preventing or delaying the onset of psychosis requires identification of those at risk for developing psychosis. For predictive purposes, the prodrome - a constellation of symptoms which may occur before the onset of psychosis - has been increasingly recognized as having utility. However, it is unclear what proportion of patients experience a prodrome or how this varies based on the multiple definitions used.

METHODS

We conducted a systematic review and meta-analysis of studies of patients with psychosis with the objective of determining the proportion of patients who experienced a prodrome prior to psychosis onset. Inclusion criteria included a consistent prodrome definition and reporting the proportion of patients who experienced a prodrome. We excluded studies of only patients with a prodrome or solely substance-induced psychosis, qualitative studies without prevalence data, conference abstracts, and case reports/case series. We searched Ovid MEDLINE, Embase (Ovid), APA PsycInfo (Ovid), Web of Science Core Collection (Clarivate), Cochrane Database of Systematic Reviews, Cochrane Central Register of Controlled Trials, APA PsycBooks (Ovid), ProQuest Dissertation & Thesis, on March 3, 2021. Studies were assessed for quality using the Critical Appraisal Checklist for Prevalence Studies. Narrative synthesis and proportion meta-analysis were used to estimate prodrome prevalence. I2 and predictive interval were used to assess heterogeneity. Subgroup analyses were used to probe sources of heterogeneity. (PROSPERO ID: CRD42021239797).

RESULTS

Seventy-one articles were included, representing 13,774 patients. Studies varied significantly in terms of methodology and prodrome definition used. The random effects proportion meta-analysis estimate for prodrome prevalence was 78.3% (95% CI = 72.8-83.2); heterogeneity was high (I2 97.98% [95% CI = 97.71-98.22]); and the prediction interval was wide (95% PI = 0.411-0.936). There were no meaningful differences in prevalence between grouped prodrome definitions, and subgroup analyses failed to reveal a consistent source of heterogeneity.

CONCLUSIONS

This is the first meta-analysis on the prevalence of a prodrome prior to the onset of first episode psychosis. The majority of patients (78.3%) were found to have experienced a prodrome prior to psychosis onset. However, findings are highly heterogenous across study and no definitive source of heterogeneity was found despite extensive subgroup analyses. As most studies were retrospective in nature, recall bias likely affects these results. While the large majority of patients with psychosis experience a prodrome in some form, it is unclear if the remainder of patients experience no prodrome, or if ascertainment methods employed in the studies were not sensitive to their experiences. Given widespread investment in indicated prevention of psychosis through prospective identification and intervention during the prodrome, a resolution of this question as well as a consensus definition of the prodrome is much needed in order to effectively direct and organize services, and may be accomplished through novel, densely sampled and phenotyped prospective cohort studies that aim for representative sampling across multiple settings.

Digital Phenotypes for Early Detection of Internet Gaming Disorder in Adolescent Students: Explorative Data-Driven Study

BACKGROUND

Limited awareness, social stigma, and access to mental health professionals hinder early detection and intervention of internet gaming disorder (IGD), which has emerged as a significant concern among young individuals. Prevalence estimates vary between 0.7% and 15.6%, and its recognition in the International Classification of Diseases, 11th Revision and Diagnostic and Statistical Manual of Mental Disorders, 5th Edition underscores its impact on academic functioning, social isolation, and mental health challenges.

OBJECTIVE

This study aimed to uncover digital phenotypes for the early detection of IGD among adolescents in learning settings. By leveraging sensor data collected from student tablets, the overarching objective is to incorporate these digital indicators into daily school activities to establish these markers as a mental health screening tool, facilitating the early identification and intervention for IGD cases.

METHODS

A total of 168 voluntary participants were engaged, consisting of 85 students with IGD and 83 students without IGD. There were 53% (89/168) female and 47% (79/168) male individuals, all within the age range of 13-14 years. The individual students learned their Korean literature and mathematics lessons on their personal tablets, with sensor data being automatically collected. Multiple regression with bootstrapping and multivariate ANOVA were used, prioritizing interpretability over predictability, for cross-validation purposes.

RESULTS

A negative correlation between IGD Scale (IGDS) scores and learning outcomes emerged (r166=-0.15; P=.047), suggesting that higher IGDS scores were associated with lower learning outcomes. Multiple regression identified 5 key indicators linked to IGD, explaining 23% of the IGDS score variance: stroke acceleration (β=.33; P<.001), time interval between keys (β=-0.26; P=.01), word spacing (β=-0.25; P<.001), deletion (β=-0.24; P<.001), and horizontal length of strokes (β=-0.21; P=.02). Multivariate ANOVA cross-validated these findings, revealing significant differences in digital phenotypes between potential IGD and non-IGD groups. The average effect size, measured by Cohen d, across the indicators was 0.40, indicating a moderate effect. Notable distinctions included faster stroke acceleration (Cohen d=0.68; P=<.001), reduced word spacing (Cohen d=.57; P=<.001), decreased deletion behavior (Cohen d=0.33; P=.04), and longer horizontal strokes (Cohen d=0.34; P=.03) in students with potential IGD compared to their counterparts without IGD.

CONCLUSIONS

The aggregated findings show a negative correlation between IGD and learning performance, highlighting the effectiveness of digital markers in detecting IGD. This underscores the importance of digital phenotyping in advancing mental health care within educational settings. As schools adopt a 1-device-per-student framework, digital phenotyping emerges as a promising early detection method for IGD. This shift could transform clinical approaches from reactive to proactive measures.

Remote Wearable Neuroimaging Devices for Health Monitoring and Neurophenotyping: A Scoping Review

Digital health tracking is a source of valuable insights for public health research and consumer health technology. The brain is the most complex organ, containing information about psychophysical and physiological biomarkers that correlate with health. Specifically, recent developments in electroencephalogram (EEG), functional near-infra-red spectroscopy (fNIRS), and photoplethysmography (PPG) technologies have allowed the development of devices that can remotely monitor changes in brain activity. The inclusion criteria for the papers in this review encompassed studies on self-applied, remote, non-invasive neuroimaging techniques (EEG, fNIRS, or PPG) within healthcare applications. A total of 23 papers were reviewed, comprising 17 on using EEGs for remote monitoring and 6 on neurofeedback interventions, while no papers were found related to fNIRS and PPG. This review reveals that previous studies have leveraged mobile EEG devices for remote monitoring across the mental health, neurological, and sleep domains, as well as for delivering neurofeedback interventions. With headsets and ear-EEG devices being the most common, studies found mobile devices feasible for implementation in study protocols while providing reliable signal quality. Moderate to substantial agreement overall between remote and clinical-grade EEGs was found using statistical tests. The results highlight the promise of portable brain-imaging devices with regard to continuously evaluating patients in natural settings, though further validation and usability enhancements are needed as this technology develops.

A Perspective on Crowdsourcing and Human-in-the-Loop Workflows in Precision Health

Modern machine learning approaches have led to performant diagnostic models for a variety of health conditions. Several machine learning approaches, such as decision trees and deep neural networks, can, in principle, approximate any function. However, this power can be considered to be both a gift and a curse, as the propensity toward overfitting is magnified when the input data are heterogeneous and high dimensional and the output class is highly nonlinear. This issue can especially plague diagnostic systems that predict behavioral and psychiatric conditions that are diagnosed with subjective criteria. An emerging solution to this issue is crowdsourcing, where crowd workers are paid to annotate complex behavioral features in return for monetary compensation or a gamified experience. These labels can then be used to derive a diagnosis, either directly or by using the labels as inputs to a diagnostic machine learning model. This viewpoint describes existing work in this emerging field and discusses ongoing challenges and opportunities with crowd-powered diagnostic systems, a nascent field of study. With the correct considerations, the addition of crowdsourcing to human-in-the-loop machine learning workflows for the prediction of complex and nuanced health conditions can accelerate screening, diagnostics, and ultimately access to care.

Digital health applications for eating disorders treatment

Eating disorders (EDs) are characterized by multifaceted etiologies, difficulties in accessing care (especially in regional locations), and variable responsiveness to treatments. Digital technologies are viewed as an important innovation in the assessment and treatment of EDs. We discuss current implementation of these innovations as well as important future directions for the field.

Digital Phenotyping, Wearables, and Outcomes

There is a significant need for robust and objective outcome assessments in spine surgery. Constant monitoring via smartphones and wearable devices has the potential to fill this role by providing an in-depth picture of human well-being, creating an unprecedented amount of objective data to augment clinical decision-making. The metrics obtained from continuous patient monitoring increase the amount and ecological validity of data relevant to spine surgery. This can provide physicians with patient and disease-specific medical information, facilitating personalized patient care.

MoodSensing: A smartphone app for digital phenotyping and assessment of bipolar disorder

BACKGROUND

Daily life tracking has proven to be of great help in the assessment of patients with bipolar disorder. Although there are many smartphone apps for tracking bipolar disorder, most of them lack academic verification, privacy policy and long-term maintenance.

METHODS

Our developed app, MoodSensing, aims to collect users' digital phenotyping for assessment of bipolar disorder. The data collection was approved by the Institutional Review Board. This study collaborated with professional clinicians to ensure that the app meets both clinical needs and user experience requirements. Based on the collected digital phenotyping, deep learning techniques were applied to forecast participants' weekly HAM-D and YMRS scale scores.

RESULTS

In experiments, the data collected by our app can effectively predict the scale scores, reaching the mean absolute error of 0.84 and 0.22 on the scales. The statistical data also demonstrate the increase in user engagement.

CONCLUSIONS

Our analysis reveals that the developed MoodSensing app can not only provide a good user experience, but also the recorded data have certain discriminability for clinical assessment. Our app also provides relevant policies to protect user privacy, and has been launched in the Apple Store and Google Play Store.

Benchmarking Mental Health Status Using Passive Sensor Data: Protocol for a Prospective Observational Study

BACKGROUND

Computational psychiatry has the potential to advance the diagnosis, mechanistic understanding, and treatment of mental health conditions. Promising results from clinical samples have led to calls to extend these methods to mental health risk assessment in the general public; however, data typically used with clinical samples are neither available nor scalable for research in the general population. Digital phenotyping addresses this by capitalizing on the multimodal and widely available data created by sensors embedded in personal digital devices (eg, smartphones) and is a promising approach to extending computational psychiatry methods to improve mental health risk assessment in the general population.

OBJECTIVE

Building on recommendations from existing computational psychiatry and digital phenotyping work, we aim to create the first computational psychiatry data set that is tailored to studying mental health risk in the general population; includes multimodal, sensor-based behavioral features; and is designed to be widely shared across academia, industry, and government using gold standard methods for privacy, confidentiality, and data integrity.

METHODS

We are using a stratified, random sampling design with 2 crossed factors (difficulties with emotion regulation and perceived life stress) to recruit a sample of 400 community-dwelling adults balanced across high- and low-risk for episodic mental health conditions. Participants first complete self-report questionnaires assessing current and lifetime psychiatric and medical diagnoses and treatment, and current psychosocial functioning. Participants then complete a 7-day in situ data collection phase that includes providing daily audio recordings, passive sensor data collected from smartphones, self-reports of daily mood and significant events, and a verbal description of the significant daily events during a nightly phone call. Participants complete the same baseline questionnaires 6 and 12 months after this phase. Self-report questionnaires will be scored using standard methods. Raw audio and passive sensor data will be processed to create a suite of daily summary features (eg, time spent at home).

RESULTS

Data collection began in June 2022 and is expected to conclude by July 2024. To date, 310 participants have consented to the study; 149 have completed the baseline questionnaire and 7-day intensive data collection phase; and 61 and 31 have completed the 6- and 12-month follow-up questionnaires, respectively. Once completed, the proposed data set will be made available to academic researchers, industry, and the government using a stepped approach to maximize data privacy.

CONCLUSIONS

This data set is designed as a complementary approach to current computational psychiatry and digital phenotyping research, with the goal of advancing mental health risk assessment within the general population. This data set aims to support the field's move away from siloed research laboratories collecting proprietary data and toward interdisciplinary collaborations that incorporate clinical, technical, and quantitative expertise at all stages of the research process.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/53857.

Multimodal digital assessment of depression with actigraphy and app in Hong Kong Chinese

There is an emerging potential for digital assessment of depression. In this study, Chinese patients with major depressive disorder (MDD) and controls underwent a week of multimodal measurement including actigraphy and app-based measures (D-MOMO) to record rest-activity, facial expression, voice, and mood states. Seven machine-learning models (Random Forest [RF], Logistic regression [LR], Support vector machine [SVM], K-Nearest Neighbors [KNN], Decision tree [DT], Naive Bayes [NB], and Artificial Neural Networks [ANN]) with leave-one-out cross-validation were applied to detect lifetime diagnosis of MDD and non-remission status. Eighty MDD subjects and 76 age- and sex-matched controls completed the actigraphy, while 61 MDD subjects and 47 controls completed the app-based assessment. MDD subjects had lower mobile time (P = 0.006), later sleep midpoint (P = 0.047) and Acrophase (P = 0.024) than controls. For app measurement, MDD subjects had more frequent brow lowering (P = 0.023), less lip corner pulling (P = 0.007), higher pause variability (P = 0.046), more frequent self-reference (P = 0.024) and negative emotion words (P = 0.002), lower articulation rate (P < 0.001) and happiness level (P < 0.001) than controls. With the fusion of all digital modalities, the predictive performance (F1-score) of ANN for a lifetime diagnosis of MDD was 0.81 and 0.70 for non-remission status when combined with the HADS-D item score, respectively. Multimodal digital measurement is a feasible diagnostic tool for depression in Chinese. A combination of multimodal measurement and machine-learning approach has enhanced the performance of digital markers in phenotyping and diagnosis of MDD.

Neuroscience meets behavior: A systematic literature review on magnetic resonance imaging of the brain combined with real-world digital phenotyping

A primary goal of neuroscience is to understand the relationship between the brain and behavior. While magnetic resonance imaging (MRI) examines brain structure and function under controlled conditions, digital phenotyping via portable automatic devices (PAD) quantifies behavior in real-world settings. Combining these two technologies may bridge the gap between brain imaging, physiology, and real-time behavior, enhancing the generalizability of laboratory and clinical findings. However, the use of MRI and data from PADs outside the MRI scanner remains underexplored. Herein, we present a Preferred Reporting Items for Systematic Reviews and Meta-Analysis systematic literature review that identifies and analyzes the current state of research on the integration of brain MRI and PADs. PubMed and Scopus were automatically searched using keywords covering various MRI techniques and PADs. Abstracts were screened to only include articles that collected MRI brain data and PAD data outside the laboratory environment. Full-text screening was then conducted to ensure included articles combined quantitative data from MRI with data from PADs, yielding 94 selected papers for a total of N = 14,778 subjects. Results were reported as cross-frequency tables between brain imaging and behavior sampling methods and patterns were identified through network analysis. Furthermore, brain maps reported in the studies were synthesized according to the measurement modalities that were used. Results demonstrate the feasibility of integrating MRI and PADs across various study designs, patient and control populations, and age groups. The majority of published literature combines functional, T1-weighted, and diffusion weighted MRI with physical activity sensors, ecological momentary assessment via PADs, and sleep. The literature further highlights specific brain regions frequently correlated with distinct MRI-PAD combinations. These combinations enable in-depth studies on how physiology, brain function and behavior influence each other. Our review highlights the potential for constructing brain-behavior models that extend beyond the scanner and into real-world contexts.

N-of-1 medicine

ABSTRACT

The fields of precision and personalised medicine have led to promising advances in tailoring treatment to individual patients. Examples include genome/molecular alteration-guided drug selection, single-patient gene therapy design and synergy-based drug combination development, and these approaches can yield substantially diverse recommendations. Therefore, it is important to define each domain and delineate their commonalities and differences in an effort to develop novel clinical trial designs, streamline workflow development, rethink regulatory considerations, create value in healthcare and economics assessments, and other factors. These and other segments are essential to recognise the diversity within these domains to accelerate their respective workflows towards practice-changing healthcare. To emphasise these points, this article elaborates on the concept of digital health and digital medicine-enabled N-of-1 medicine, which individualises combination regimen and dosing using a patient's own data. We will conclude with recommendations for consideration when developing novel workflows based on emerging digital-based platforms.

Digital Phenotyping for Real-Time Monitoring of Nonsuicidal Self-Injury: Protocol for a Prospective Observational Study

BACKGROUND

Nonsuicidal self-injury (NSSI) is a major global health concern. The limitations of traditional clinical and laboratory-based methodologies are recognized, and there is a pressing need to use novel approaches for the early detection and prevention of NSSI. Unfortunately, there is still a lack of basic knowledge of a descriptive nature on NSSI, including when, how, and why self-injury occurs in everyday life. Digital phenotyping offers the potential to predict and prevent NSSI by assessing objective and ecological measurements at multiple points in time.

OBJECTIVE

This study aims to identify real-time predictors and explain an individual's dynamic course of NSSI.

METHODS

This study will use a hybrid approach, combining elements of prospective observational research with non-face-to-face study methods. This study aims to recruit a cohort of 150 adults aged 20 to 29 years who have self-reported engaging in NSSI on 5 or more days within the past year. Participants will be enrolled in a longitudinal study conducted at 3-month intervals, spanning 3 long-term follow-up phases. The ecological momentary assessment (EMA) technique will be used via a smartphone app. Participants will be prompted to complete a self-injury and suicidality questionnaire and a mood appraisal questionnaire 3 times a day for a duration of 14 days. A wrist-worn wearable device will be used to collect heart rate, step count, and sleep patterns from participants. Dynamic structural equation modeling and machine learning approaches will be used.

RESULTS

Participant recruitment and data collection started in October 2023. Data collection and analysis are expected to be completed by December 2024. The results will be published in a peer-reviewed journal and presented at scientific conferences.

CONCLUSIONS

The insights gained from this study will not only shed light on the underlying mechanisms of NSSI but also pave the way for the development of tailored and culturally sensitive treatment options that can effectively address this major mental health concern.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/53597.

Returning Individual Research Results from Digital Phenotyping in Psychiatry

Psychiatry is rapidly adopting digital phenotyping and artificial intelligence/machine learning tools to study mental illness based on tracking participants' locations, online activity, phone and text message usage, heart rate, sleep, physical activity, and more. Existing ethical frameworks for return of individual research results (IRRs) are inadequate to guide researchers for when, if, and how to return this unprecedented number of potentially sensitive results about each participant's real-world behavior. To address this gap, we convened an interdisciplinary expert working group, supported by a National Institute of Mental Health grant. Building on established guidelines and the emerging norm of returning results in participant-centered research, we present a novel framework specific to the ethical, legal, and social implications of returning IRRs in digital phenotyping research. Our framework offers researchers, clinicians, and Institutional Review Boards (IRBs) urgently needed guidance, and the principles developed here in the context of psychiatry will be readily adaptable to other therapeutic areas.

Track Thyself? The Value and Ethics of Self-knowledge Through Technology

Novel technological devices, applications, and algorithms can provide us with a vast amount of personal information about ourselves. Given that we have ethical and practical reasons to pursue self-knowledge, should we use technology to increase our self-knowledge? And which ethical issues arise from the pursuit of technologically sourced self-knowledge? In this paper, I explore these questions in relation to bioinformation technologies (health and activity trackers, DTC genetic testing, and DTC neurotechnologies) and algorithmic profiling used for recommender systems, targeted advertising, and technologically supported decision-making. First, I distinguish between impersonal, critical, and relational self-knowledge. Relational self-knowledge is a so far neglected dimension of self-knowledge which is introduced in this paper. Next, I investigate the contribution of these technologies to the three types of self-knowledge and uncover the connected ethical concerns. Technology can provide a lot of impersonal self-knowledge, but we should focus on the quality of the information which tends to be particularly insufficient for marginalized groups. In terms of critical self-knowledge, the nature of technologically sourced personal information typically impedes critical engagement. The value of relational self-knowledge speaks in favour of transparency of information technology, notably for algorithms that are involved in decision-making about individuals. Moreover, bioinformation technologies and digital profiling shape the concepts and norms that define us. We should ensure they not only serve commercial interests but our identity and self-knowledge interests.

Predicting cognitive scores from wearable-based digital physiological features using machine learning: data from a clinical trial in mild cognitive impairment

BACKGROUND

Continuous assessment and remote monitoring of cognitive function in individuals with mild cognitive impairment (MCI) enables tracking therapeutic effects and modifying treatment to achieve better clinical outcomes. While standardized neuropsychological tests are inconvenient for this purpose, wearable sensor technology collecting physiological and behavioral data looks promising to provide proxy measures of cognitive function. The objective of this study was to evaluate the predictive ability of digital physiological features, based on sensor data from wrist-worn wearables, in determining neuropsychological test scores in individuals with MCI.

METHODS

We used the dataset collected from a 10-week single-arm clinical trial in older adults (50-70 years old) diagnosed with amnestic MCI (N = 30) who received a digitally delivered multidomain therapeutic intervention. Cognitive performance was assessed before and after the intervention using the Neuropsychological Test Battery (NTB) from which composite scores were calculated (executive function, processing speed, immediate memory, delayed memory and global cognition). The Empatica E4, a wrist-wearable medical-grade device, was used to collect physiological data including blood volume pulse, electrodermal activity, and skin temperature. We processed sensors' data and extracted a range of physiological features. We used interpolated NTB scores for 10-day intervals to test predictability of scores over short periods and to leverage the maximum of wearable data available. In addition, we used individually centered data which represents deviations from personal baselines. Supervised machine learning was used to train models predicting NTB scores from digital physiological features and demographics. Performance was evaluated using "leave-one-subject-out" and "leave-one-interval-out" cross-validation.

RESULTS

The final sample included 96 aggregated data intervals from 17 individuals. In total, 106 digital physiological features were extracted. We found that physiological features, especially measures of heart rate variability, correlated most strongly to the executive function compared to other cognitive composites. The model predicted the actual executive function scores with correlation r = 0.69 and intra-individual changes in executive function scores with r = 0.61.

CONCLUSIONS

Our findings demonstrated that wearable-based physiological measures, primarily HRV, have potential to be used for the continuous assessments of cognitive function in individuals with MCI.

Multimodal digital phenotyping of diet, physical activity, and glycemia in Hispanic/Latino adults with or at risk of type 2 diabetes

Digital phenotyping refers to characterizing human bio-behavior through wearables, personal devices, and digital health technologies. Digital phenotyping in populations facing a disproportionate burden of type 2 diabetes (T2D) and health disparities continues to lag compared to other populations. Here, we report our study demonstrating the application of multimodal digital phenotyping, i.e., the simultaneous use of CGM, physical activity monitors, and meal tracking in Hispanic/Latino individuals with or at risk of T2D. For 14 days, 36 Hispanic/Latino adults (28 female, 14 with non-insulin treated T2D) wore a continuous glucose monitor (CGM) and a physical activity monitor (Actigraph) while simultaneously logging meals using the MyFitnessPal app. We model meal events and daily digital biomarkers representing diet, physical activity choices, and corresponding glycemic response. We develop a digital biomarker for meal events that differentiates meal events into normal and elevated categories. We examine the contribution of daily digital biomarkers of elevated meal event count and step count on daily time-in-range 54-140 mg/dL (TIR54-140) and average glucose. After adjusting for step count, a change in elevated meal event count from zero to two decreases TIR54-140 by 4.0% (p = 0.003). An increase in 1000 steps in post-meal step count also reduces the meal event glucose response by 641 min mg/dL (p = 0.0006) and reduces the odds of an elevated meal event by 55% (p < 0.0001). The proposed meal event digital biomarkers may provide an opportunity for non-pharmacologic interventions for Hispanic/Latino adults facing a disproportionate burden of T2D.

The Role of a Smart Health Ecosystem in Transforming the Management of Chronic Health Conditions

The effective management of chronic conditions requires an approach that promotes a shift in care from the clinic to the home, improves the efficiency of health care systems, and benefits all users irrespective of their needs and preferences. Digital health can provide a solution to this challenge, and in this paper, we provide our vision for a smart health ecosystem. A smart health ecosystem leverages the interoperability of digital health technologies and advancements in big data and artificial intelligence for data collection and analysis and the provision of support. We envisage that this approach will allow a comprehensive picture of health, personalization, and tailoring of behavioral and clinical support; drive theoretical advancements; and empower people to manage their own health with support from health care professionals. We illustrate the concept with 2 use cases and discuss topics for further consideration and research, concluding with a message to encourage people with chronic conditions, their caregivers, health care professionals, policy and decision makers, and technology experts to join their efforts and work toward adopting a smart health ecosystem.

Aerobic exercise interventions to address impaired quality of life in patients with pituitary tumors

Patients with pituitary tumors may experience persistent fatigue and reduced physical activity, based on subjective measures after treatment. These symptoms may persist despite gross total resection of their tumors and biochemical normalization of pituitary function. While reduced quality of life has been commonly acknowledged in pituitary tumor patients, there is a lack of studies on what interventions may be best implemented to ameliorate these issues, particularly when hormonal levels have otherwise normalized. Aerobic exercise programs have been previously described to ameliorate symptoms of chronic fatigue and reduced physical capacity across a variety of pathologies in the literature. As such, a prescribed aerobic exercise program may be an underrecognized but potentially impactful intervention to address quality of life in pituitary tumor patients. This review seeks to summarize the existing literature on aerobic exercise interventions in patients with pituitary tumors. In addition, future areas of study are discussed, including tailoring exercise programs to the hormonal status of the patient and incorporating more objective measures in monitoring response to interventions.

Digital Phenotyping: Data-Driven Psychiatry to Redefine Mental Health

The term "digital phenotype" refers to the digital footprint left by patient-environment interactions. It has potential for both research and clinical applications but challenges our conception of health care by opposing 2 distinct approaches to medicine: one centered on illness with the aim of classifying and curing disease, and the other centered on patients, their personal distress, and their lived experiences. In the context of mental health and psychiatry, the potential benefits of digital phenotyping include creating new avenues for treatment and enabling patients to take control of their own well-being. However, this comes at the cost of sacrificing the fundamental human element of psychotherapy, which is crucial to addressing patients' distress. In this viewpoint paper, we discuss the advances rendered possible by digital phenotyping and highlight the risk that this technology may pose by partially excluding health care professionals from the diagnosis and therapeutic process, thereby foregoing an essential dimension of care. We conclude by setting out concrete recommendations on how to improve current digital phenotyping technology so that it can be harnessed to redefine mental health by empowering patients without alienating them.

Challenges and best practices for digital unstructured data enrichment in health research: A systematic narrative review

Digital data play an increasingly important role in advancing health research and care. However, most digital data in healthcare are in an unstructured and often not readily accessible format for research. Unstructured data are often found in a format that lacks standardization and needs significant preprocessing and feature extraction efforts. This poses challenges when combining such data with other data sources to enhance the existing knowledge base, which we refer to as digital unstructured data enrichment. Overcoming these methodological challenges requires significant resources and may limit the ability to fully leverage their potential for advancing health research and, ultimately, prevention, and patient care delivery. While prevalent challenges associated with unstructured data use in health research are widely reported across literature, a comprehensive interdisciplinary summary of such challenges and possible solutions to facilitate their use in combination with structured data sources is missing. In this study, we report findings from a systematic narrative review on the seven most prevalent challenge areas connected with the digital unstructured data enrichment in the fields of cardiology, neurology and mental health, along with possible solutions to address these challenges. Based on these findings, we developed a checklist that follows the standard data flow in health research studies. This checklist aims to provide initial systematic guidance to inform early planning and feasibility assessments for health research studies aiming combining unstructured data with existing data sources. Overall, the generality of reported unstructured data enrichment methods in the studies included in this review call for more systematic reporting of such methods to achieve greater reproducibility in future studies.

Digital intervention for public health: searching for implementing characteristics, concepts and recommendations: scoping review

Studying the impact of digital interventions on public health can help ensure that the offered services produce the desired results. In order to address these factors, the subsequent study uses a scope review to evaluate the state of the field while concentrating on ideas and suggestions that represent factors that have been crucial in the management of digital intervention for public health. To shed light on the traits, ideas and suggestions related to public health digital intervention, a scoping review was carried out. Five electronic databases were used to locate pertinent research that were published before February 2022. All texts were examined, and study abstracts were scrutinized to determine their eligibility. The last analysis of this study included fifteen publications; five reviews, four qualitative studies, two quantitative studies, one viewpoint study, one mixed-method study, one perspective study, and one interventional study. The key ideas for digital interventions in population management and health studies are presented in this overview. Many concepts, implementation characteristics and recommendations have been raised which highlight the future role of these interventions to enhance public engagement and health equity.

Digital Therapeutics as a New Therapeutic Modality: A Review from the Perspective of Clinical Pharmacology

The promise of transforming digital technologies into treatments is what drives the development of digital therapeutics (DTx), generally known as software applications embedded within accessible technologies-such as smartphones-to treat, manage, or prevent a pathological condition. Whereas DTx solutions that successfully demonstrate effectiveness and safety could drastically improve the life of patients in multiple therapeutic areas, there is a general consensus that generating therapeutic evidence for DTx presents challenges and open questions. We believe there are three main areas where the application of clinical pharmacology principles from the drug development field could benefit DTx development: the characterization of the mechanism of action, the optimization of the intervention, and, finally, its dosing. We reviewed DTx studies to explore how the field is approaching these topics and to better characterize the challenges associated with them. This leads us to emphasize the role that the application of clinical pharmacology principles could play in the development of DTx and to advocate for a development approach that merges such principles from development of traditional therapeutics with important considerations from the highly attractive and fast-paced world of digital solutions.

Acceptability of Personal Sensing Among People With Alcohol Use Disorder: Observational Study

BACKGROUND

Personal sensing may improve digital therapeutics for mental health care by facilitating early screening, symptom monitoring, risk prediction, and personalized adaptive interventions. However, further development and the use of personal sensing requires a better understanding of its acceptability to people targeted for these applications.

OBJECTIVE

We aimed to assess the acceptability of active and passive personal sensing methods in a sample of people with moderate to severe alcohol use disorder using both behavioral and self-report measures. This sample was recruited as part of a larger grant-funded project to develop a machine learning algorithm to predict lapses.

METHODS

Participants (N=154; n=77, 50% female; mean age 41, SD 11.9 years; n=134, 87% White and n=150, 97% non-Hispanic) in early recovery (1-8 weeks of abstinence) were recruited to participate in a 3-month longitudinal study. Participants were modestly compensated for engaging with active (eg, ecological momentary assessment [EMA], audio check-in, and sleep quality) and passive (eg, geolocation, cellular communication logs, and SMS text message content) sensing methods that were selected to tap into constructs from the Relapse Prevention model by Marlatt. We assessed 3 behavioral indicators of acceptability: participants' choices about their participation in the study at various stages in the procedure, their choice to opt in to provide data for each sensing method, and their adherence to a subset of the active methods (EMA and audio check-in). We also assessed 3 self-report measures of acceptability (interference, dislike, and willingness to use for 1 year) for each method.

RESULTS

Of the 192 eligible individuals screened, 191 consented to personal sensing. Most of these individuals (169/191, 88.5%) also returned 1 week later to formally enroll, and 154 participated through the first month follow-up visit. All participants in our analysis sample opted in to provide data for EMA, sleep quality, geolocation, and cellular communication logs. Out of 154 participants, 1 (0.6%) did not provide SMS text message content and 3 (1.9%) did not provide any audio check-ins. The average adherence rate for the 4 times daily EMA was .80. The adherence rate for the daily audio check-in was .54. Aggregate participant ratings indicated that all personal sensing methods were significantly more acceptable (all P<.001) compared with neutral across subjective measures of interference, dislike, and willingness to use for 1 year. Participants did not significantly differ in their dislike of active methods compared with passive methods (P=.23). However, participants reported a higher willingness to use passive (vs active) methods for 1 year (P=.04).

CONCLUSIONS

These results suggest that active and passive sensing methods are acceptable for people with alcohol use disorder over a longer period than has previously been assessed. Important individual differences were observed across people and methods, indicating opportunities for future improvement.

Out of their minds? Externalist challenges for using AI in forensic psychiatry

Harnessing the power of machine learning (ML) and other Artificial Intelligence (AI) techniques promises substantial improvements across forensic psychiatry, supposedly offering more objective evaluations and predictions. However, AI-based predictions about future violent behaviour and criminal recidivism pose ethical challenges that require careful deliberation due to their social and legal significance. In this paper, we shed light on these challenges by considering externalist accounts of psychiatric disorders which stress that the presentation and development of psychiatric disorders is intricately entangled with their outward environment and social circumstances. We argue that any use of predictive AI in forensic psychiatry should not be limited to neurobiology alone but must also consider social and environmental factors. This thesis has practical implications for the design of predictive AI systems, especially regarding the collection and processing of training data, the selection of ML methods, and the determination of their explainability requirements.

Understanding Mental Health Clinicians' Perceptions and Concerns Regarding Using Passive Patient-Generated Health Data for Clinical Decision-Making: Qualitative Semistructured Interview Study

BACKGROUND

Digital health-tracking tools are changing mental health care by giving patients the ability to collect passively measured patient-generated health data (PGHD; ie, data collected from connected devices with little to no patient effort). Although there are existing clinical guidelines for how mental health clinicians should use more traditional, active forms of PGHD for clinical decision-making, there is less clarity on how passive PGHD can be used.

OBJECTIVE

We conducted a qualitative study to understand mental health clinicians' perceptions and concerns regarding the use of technology-enabled, passively collected PGHD for clinical decision-making. Our interviews sought to understand participants' current experiences with and visions for using passive PGHD.

METHODS

Mental health clinicians providing outpatient services were recruited to participate in semistructured interviews. Interview recordings were deidentified, transcribed, and qualitatively coded to identify overarching themes.

RESULTS

Overall, 12 mental health clinicians (n=11, 92% psychiatrists and n=1, 8% clinical psychologist) were interviewed. We identified 4 overarching themes. First, passive PGHD are patient driven-we found that current passive PGHD use was patient driven, not clinician driven; participating clinicians only considered passive PGHD for clinical decision-making when patients brought passive data to clinical encounters. The second theme was active versus passive data as subjective versus objective data-participants viewed the contrast between active and passive PGHD as a contrast between interpretive data on patients' mental health and objective information on behavior. Participants believed that prioritizing passive over self-reported, active PGHD would reduce opportunities for patients to reflect upon their mental health, reducing treatment engagement and raising questions about how passive data can best complement active data for clinical decision-making. Third, passive PGHD must be delivered at appropriate times for action-participants were concerned with the real-time nature of passive PGHD; they believed that it would be infeasible to use passive PGHD for real-time patient monitoring outside clinical encounters and more feasible to use passive PGHD during clinical encounters when clinicians can make treatment decisions. The fourth theme was protecting patient privacy-participating clinicians wanted to protect patient privacy within passive PGHD-sharing programs and discussed opportunities to refine data sharing consent to improve transparency surrounding passive PGHD collection and use.

CONCLUSIONS

Although passive PGHD has the potential to enable more contextualized measurement, this study highlights the need for building and disseminating an evidence base describing how and when passive measures should be used for clinical decision-making. This evidence base should clarify how to use passive data alongside more traditional forms of active PGHD, when clinicians should view passive PGHD to make treatment decisions, and how to protect patient privacy within passive data-sharing programs. Clear evidence would more effectively support the uptake and effective use of these novel tools for both patients and their clinicians.

Digital Phenotyping: A Game Changer for the Broiler Industry

In response to escalating global demand for poultry, the industry grapples with an array of intricate challenges, from enhancing productivity to improving animal welfare and attenuating environmental impacts. This comprehensive review explores the transformative potential of digital phenotyping, an emergent technological innovation at the cusp of dramatically reshaping broiler production. The central aim of this study is to critically examine digital phenotyping as a pivotal solution to these multidimensional industry conundrums. Our investigation spotlights the profound implications of 'digital twins' in the burgeoning field of broiler genomics, where the production of exact digital counterparts of physical entities accelerates genomics research and its practical applications. Further, this review probes into the ongoing advancements in the research and development of a context-sensitive, multimodal digital phenotyping platform, custom-built to monitor broiler health. This paper critically evaluates this platform's potential in revolutionizing health monitoring, fortifying the resilience of broiler production, and fostering a harmonious balance between productivity and sustainability. Subsequently, the paper provides a rigorous assessment of the unique challenges that may surface during the integration of digital phenotyping within the industry. These span from technical and economic impediments to ethical deliberations, thus offering a comprehensive perspective. The paper concludes by highlighting the game-changing potential of digital phenotyping in the broiler industry and identifying potential future directions for the field, underlining the significance of continued research and development in unlocking digital phenotyping's full potential. In doing so, it charts a course towards a more robust, sustainable, and productive broiler industry. The insights garnered from this study hold substantial value for a broad spectrum of stakeholders in the broiler industry, setting the stage for an imminent technological evolution in poultry production.

Improvement in Quality of Life With the Use of a Technological System Among Patients With Chronic Disease Followed Up in Primary Care (TeNDER Project): Protocol for a Randomized Controlled Trial

BACKGROUND

Among chronic diseases, cognitive, neurological, and cardiovascular impairments are becoming increasingly prevalent, generating a shift in health and social needs. Technology can create an ecosystem of care integrated with microtools based on biosensors for motion, location, voice, and expression detection that can help people with chronic diseases. A technological system capable of identifying symptoms, signs, or behavioral patterns could provide notification of the development of complications of disease. This would help the self-care of patients with chronic disease and save health care costs, promoting the autonomy and empowerment of patients and their caregivers, improving their quality of life (QoL), and providing health professionals with monitoring tools.

OBJECTIVE

The main objective of this study is to evaluate the effectiveness of a technological system (the TeNDER system) to improve quality of life in patients with chronic diseases: Alzheimer disease, Parkinson disease, and cardiovascular disease.

METHODS

A multicenter, randomized, parallel-group clinical trial will be conducted with a follow-up of 2 months. The scope of the study will be the primary care health centers of the Community of Madrid belonging to the Spanish public health system. The study population will be patients diagnosed with Parkinson disease, Alzheimer disease, and cardiovascular disease; their caregivers; and health professionals. The sample size will be 534 patients (380 in the intervention group). The intervention will consist of the use of the TeNDER system. The system will monitor the patients by means of biosensors, and their data will be integrated into the TeNDER app. With the information provided, the TeNDER system will generate health reports that can be consulted by patients, caregivers, and health professionals. Sociodemographic variables and technological affinity will be measured, as will views on the usability of and satisfaction with the TeNDER system. The dependent variable will be the mean difference in QoL score between the intervention and control groups at 2 months. To study the effectiveness of the TeNDER system in improving QoL in patients, an explanatory linear regression model will be constructed. All analyses will be performed with the 95% CI and robust estimators.

RESULTS

Ethics approval for this project was received on September 11, 2019. The trial was registered on August 14, 2020. Recruitment commenced in April 2021, and the expected results will be available during 2023 or 2024.

CONCLUSIONS

This clinical trial among patients with highly prevalent chronic illnesses and the people most involved in their care will provide a more realistic view of the situation experienced by people with long-term illness and their support networks. The TeNDER system is in continuous development based on a study of the needs of the target population and on feedback during its use from the users: patients, caregivers, and primary care health professionals.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05681065; https://clinicaltrials.gov/ct2/show/NCT05681065.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/47331.

The use of advanced technology and statistical methods to predict and prevent suicide

In the past decade, two themes have emerged across suicide research. First, according to meta-analyses, the ability to predict and prevent suicidal thoughts and behaviours is weaker than would be expected for the size of the field. Second, review and commentary papers propose that technological and statistical methods (such as smartphones, wearables, digital phenotyping and machine learning) might become solutions to this problem. In this Review, we aim to strike a balance between the pessimistic picture presented by these meta-analyses and the optimistic picture presented by review and commentary papers about the promise of advanced technological and statistical methods to improve the ability to understand, predict and prevent suicide. We divide our discussion into two broad categories. First, we discuss the research aimed at assessment, with the goal of better understanding or more accurately predicting suicidal thoughts and behaviours. Second, we discuss the literature that focuses on prevention of suicidal thoughts and behaviours. Ecological momentary assessment, wearables and other technological and statistical advances hold great promise for predicting and preventing suicide, but there is much yet to do.

Associations Between Smartphone Keystroke Metadata and Mental Health Symptoms in Adolescents: Findings From the Future Proofing Study

BACKGROUND

Mental disorders are prevalent during adolescence. Among the digital phenotypes currently being developed to monitor mental health symptoms, typing behavior is one promising candidate. However, few studies have directly assessed associations between typing behavior and mental health symptom severity, and whether these relationships differs between genders.

OBJECTIVE

In a cross-sectional analysis of a large cohort, we tested whether various features of typing behavior derived from keystroke metadata were associated with mental health symptoms and whether these relationships differed between genders.

METHODS

A total of 934 adolescents from the Future Proofing study undertook 2 typing tasks on their smartphones through the Future Proofing app. Common keystroke timing and frequency features were extracted across tasks. Mental health symptoms were assessed using the Patient Health Questionnaire-Adolescent version, the Children's Anxiety Scale-Short Form, the Distress Questionnaire 5, and the Insomnia Severity Index. Bivariate correlations were used to test whether keystroke features were associated with mental health symptoms. The false discovery rates of P values were adjusted to q values. Machine learning models were trained and tested using independent samples (ie, 80% train 20% test) to identify whether keystroke features could be combined to predict mental health symptoms.

RESULTS

Keystroke timing features showed a weak negative association with mental health symptoms across participants. When split by gender, females showed weak negative relationships between keystroke timing features and mental health symptoms, and weak positive relationships between keystroke frequency features and mental health symptoms. The opposite relationships were found for males (except for dwell). Machine learning models using keystroke features alone did not predict mental health symptoms.

CONCLUSIONS

Increased mental health symptoms are weakly associated with faster typing, with important gender differences. Keystroke metadata should be collected longitudinally and combined with other digital phenotypes to enhance their clinical relevance.

TRIAL REGISTRATION

Australian and New Zealand Clinical Trial Registry, ACTRN12619000855123; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=377664&isReview=true.

Prospective acceptability of digital phenotyping among pregnant and parenting people with opioid use disorder: A multisite qualitative study

Background

While medications for opioid use disorder (MOUD) effectively treat OUD during pregnancy and the postpartum period, poor treatment retention is common. Digital phenotyping, or passive sensing data captured from personal mobile devices, namely smartphones, provides an opportunity to understand behaviors, psychological states, and social influences contributing to perinatal MOUD non-retention. Given this novel area of investigation, we conducted a qualitative study to determine the acceptability of digital phenotyping among pregnant and parenting people with opioid use disorder (PPP-OUD).

Methods

This study was guided by the Theoretical Framework of Acceptability (TFA). Within a clinical trial testing a behavioral health intervention for PPP-OUD, we used purposeful criterion sampling to recruit 11 participants who delivered a child in the past 12  months and received OUD treatment during pregnancy or the postpartum period. Data were collected through phone interviews using a structured interview guide based on four TFA constructs (affective attitude, burden, ethicality, self-efficacy). We used framework analysis to code, chart, and identify key patterns within the data.

Results

Participants generally expressed positive attitudes about digital phenotyping and high self-efficacy and low anticipated burden to participate in studies that collect smartphone-based passive sensing data. Nonetheless, concerns were noted related to data privacy/security and sharing location information. Differences in participant assessments of burden were related to length of time required and level of remuneration to participate in a study. Interviewees voiced broad support for participating in a digital phenotyping study with known/trusted individuals but expressed concerns about third-party data sharing and government monitoring.

Conclusion

Digital phenotyping methods were acceptable to PPP-OUD. Enhancements in acceptability include allowing participants to maintain control over which data are shared, limiting frequency of research contacts, aligning compensation with participant burden, and outlining data privacy/security protections on study materials.

Multimodal predictions of treatment outcome in major depression: A comparison of data-driven predictors with importance ratings by clinicians

BACKGROUND

Reliable prediction models of treatment outcome in Major Depressive Disorder (MDD) are currently lacking in clinical practice. Data-driven outcome definitions, combining data from multiple modalities and incorporating clinician expertise might improve predictions.

METHODS

We used unsupervised machine learning to identify treatment outcome classes in 1060 MDD inpatients. Subsequently, classification models were created on clinical and biological baseline information to predict treatment outcome classes and compared to the performance of two widely used classical outcome definitions. We also related the findings to results from an online survey that assessed which information clinicians use for outcome prognosis.

RESULTS

Three and four outcome classes were identified by unsupervised learning. However, data-driven outcome classes did not result in more accurate prediction models. The best prediction model was targeting treatment response in its standard definition and reached accuracies of 63.9 % in the test sample, and 59.5 % and 56.9 % in the validation samples. Top predictors included sociodemographic and clinical characteristics, while biological parameters did not improve prediction accuracies. Treatment history, personality factors, prior course of the disorder, and patient attitude towards treatment were ranked as most important indicators by clinicians.

LIMITATIONS

Missing data limited the power to identify biological predictors of treatment outcome from certain modalities.

CONCLUSIONS

So far, the inclusion of available biological measures in addition to psychometric and clinical information did not improve predictive value of the models, which was overall low. Optimized biomarkers, stratified predictions and the inclusion of clinical expertise may improve future prediction models.

Reinventing mental health care in youth through mobile approaches: Current status and future steps

In this perspective, we aim to bring together research on mobile assessments and interventions in the context of mental health care in youth. After the COVID-19 pandemic, one out of five young people is experiencing mental health problems worldwide. New ways to face this burden are now needed. Young people search for low-burden services in terms of costs and time, paired with high flexibility and easy accessibility. Mobile applications meet these principles by providing new ways to inform, monitor, educate, and enable self-help, thus reinventing mental health care in youth. In this perspective, we explore the existing literature reviews on mobile assessments and interventions in youth through data collected passively (e.g., digital phenotyping) and actively (e.g., using Ecological Momentary Assessments—EMAs). The richness of such approaches relies on assessing mental health dynamically by extending beyond the confines of traditional methods and diagnostic criteria, and the integration of sensor data from multiple channels, thus allowing the cross-validation of symptoms through multiple information. However, we also acknowledge the promises and pitfalls of such approaches, including the problem of interpreting small effects combined with different data sources and the real benefits in terms of outcome prediction when compared to gold-standard methods. We also explore a new promising and complementary approach, using chatbots and conversational agents, that encourages interaction while tracing health and providing interventions. Finally, we suggest that it is important to continue to move beyond the ill-being framework by giving more importance to intervention fostering well-being, e.g., using positive psychology.

Association Between the Severity of Depressive Symptoms and Human-Smartphone Interactions: Longitudinal Study

BACKGROUND

Various behavioral sensing research studies have found that depressive symptoms are associated with human-smartphone interaction behaviors, including lack of diversity in unique physical locations, entropy of time spent in each location, sleep disruption, session duration, and typing speed. These behavioral measures are often tested against the total score of depressive symptoms, and the recommended practice to disaggregate within- and between-person effects in longitudinal data is often neglected.

OBJECTIVE

We aimed to understand depression as a multidimensional process and explore the association between specific dimensions and behavioral measures computed from passively sensed human-smartphone interactions. We also aimed to highlight the nonergodicity in psychological processes and the importance of disaggregating within- and between-person effects in the analysis.

METHODS

Data used in this study were collected by Mindstrong Health, a telehealth provider that focuses on individuals with serious mental illness. Depressive symptoms were measured by the Diagnostic and Statistical Manual of Mental Disorders Fifth Edition (DSM-5) Self-Rated Level 1 Cross-Cutting Symptom Measure-Adult Survey every 60 days for a year. Participants' interactions with their smartphones were passively recorded, and 5 behavioral measures were developed and were expected to be associated with depressive symptoms according to either theoretical proposition or previous empirical evidence. Multilevel modeling was used to explore the longitudinal relations between the severity of depressive symptoms and these behavioral measures. Furthermore, within- and between-person effects were disaggregated to accommodate the nonergodicity commonly found in psychological processes.

RESULTS

This study included 982 records of DSM Level 1 depressive symptom measurements and corresponding human-smartphone interaction data from 142 participants (age range 29-77 years; mean age 55.1 years, SD 10.8 years; 96 female participants). Loss of interest in pleasurable activities was associated with app count (γ₁₀=-0.14; P=.01; within-person effect). Depressed mood was associated with typing time interval (γ₀₅=0.88; P=.047; within-person effect) and session duration (γ₀₅=-0.37; P=.03; between-person effect).

CONCLUSIONS

This study contributes new evidence for associations between human-smartphone interaction behaviors and the severity of depressive symptoms from a dimensional perspective, and it highlights the importance of considering the nonergodicity of psychological processes and analyzing the within- and between-person effects separately.

Digital mental health: challenges and next steps

Digital innovations in mental health offer great potential, but present unique challenges. Using a consensus development panel approach, an expert, international, cross-disciplinary panel met to provide a framework to conceptualise digital mental health innovations, research into mechanisms and effectiveness and approaches for clinical implementation. Key questions and outputs from the group were agreed by consensus, and are presented and discussed in the text and supported by case examples in an accompanying appendix. A number of key themes emerged. (1) Digital approaches may work best across traditional diagnostic systems: we do not have effective ontologies of mental illness and transdiagnostic/symptom-based approaches may be more fruitful. (2) Approaches in clinical implementation of digital tools/interventions need to be creative and require organisational change: not only do clinicians and patients need training and education to be more confident and skilled in using digital technologies to support shared care decision-making, but traditional roles need to be extended, with clinicians working alongside digital navigators and non-clinicians who are delivering protocolised treatments. (3) Designing appropriate studies to measure the effectiveness of implementation is also key: including digital data raises unique ethical issues, and measurement of potential harms is only just beginning. (4) Accessibility and codesign are needed to ensure innovations are long lasting. (5) Standardised guidelines for reporting would ensure effective synthesis of the evidence to inform clinical implementation. COVID-19 and the transition to virtual consultations have shown us the potential for digital innovations to improve access and quality of care in mental health: now is the ideal time to act.

Mood and implicit confidence independently fluctuate at different time scales

Mood is an important ingredient of decision-making. Human beings are immersed into a sea of ​​emotions where episodes of high mood alternate with episodes of low mood. While changes in mood are well characterized, little is known about how these fluctuations interact with metacognition, and in particular with confidence about our decisions. We evaluated how implicit measurements of confidence are related with mood states of human participants through two online longitudinal experiments involving mood self-reports and visual discrimination decision-making tasks. Implicit confidence was assessed on each session by monitoring the proportion of opt-out trials when an opt-out option was available, as well as the median reaction time on standard correct trials as a secondary proxy of confidence. We first report a strong coupling between mood, stress, food enjoyment, and quality of sleep reported by participants in the same session. Second, we confirmed that the proportion of opt-out responses as well as reaction times in non-opt-out trials provided reliable indices of confidence in each session. We introduce a normative measure of overconfidence based on the pattern of opt-out selection and the signal-detection-theory framework. Finally and crucially, we found that mood, sleep quality, food enjoyment, and stress level are not consistently coupled with these implicit confidence markers, but rather they fluctuate at different time scales: mood-related states display faster fluctuations (over one day or half-a-day) than confidence level (two-and-a-half days). Therefore, our findings suggest that spontaneous fluctuations of mood and confidence in decision making are independent in the healthy adult population.

A digital innovation typology: Navigating the complexity of emerging technologies to negotiate health systems research with young people

Objective

This study aims to explore young people's perspectives of emerging technologies and health systems research in an adolescent health community of practice.

Methods

The context of this integrated knowledge translation study is the Wellbeing Health & Youth Centre of Research Excellence in Adolescent Health. A theory-building, non-systematic review was conducted to examine the concepts and interrelationships of emerging technologies associated with digital innovation and health systems. This typology informed the design of an online workshop with young people to explore their views, concerns, and ideas about health systems research.

Results

A digital innovation typology was identified to differentiate and explain emerging technology concepts and interrelationships that can be applied to the health systems context. Aligned with this typology, youth perspectives about digital health challenges and opportunities were identified to support future research, policy, and practice.

Conclusion

The integrated findings from this study can assist the navigation of complex emerging technologies, and the negotiation of equitable health systems research, between youth and adult stakeholders. Further, with these typology-related resources, mutual learning and the public involvement of young people in health systems research and priority setting agendas can be supported.

Taking modern psychiatry into the metaverse: Integrating augmented, virtual, and mixed reality technologies into psychiatric care

The landscape of psychiatry is ever evolving and has recently begun to be influenced more heavily by new technologies. One novel technology which may have particular application to psychiatry is the metaverse, a three-dimensional digital social platform accessed via augmented, virtual, and mixed reality (AR/VR/MR). The metaverse allows the interaction of users in a virtual world which can be measured and manipulated, posing at once exciting new possibilities and significant potential challenges and risks. While the final form of the nascent metaverse is not yet clear, the immersive simulation and holographic mixed reality-based worlds made possible by the metaverse have the potential to redefine neuropsychiatric care for both patients and their providers. While a number of applications for this technology can be envisioned, this article will focus on leveraging the metaverse in three specific domains: medical education, brain stimulation, and biofeedback. Within medical education, the metaverse could allow for more precise feedback to students performing patient interviews as well as the ability to more easily disseminate highly specialized technical skills, such as those used in advanced neurostimulation paradigms. Examples of potential applications in brain stimulation and biofeedback range from using AR to improve precision targeting of non-invasive neuromodulation modalities to more innovative practices, such as using physiological and behavioral measures derived from interactions in VR environments to directly inform and personalize treatment parameters for patients. Along with promising future applications, we also discuss ethical implications and data security concerns that arise when considering the introduction of the metaverse and related AR/VR technologies to psychiatric research and care.

Predicting treatment outcome in depression: an introduction into current concepts and challenges

Improving response and remission rates in major depressive disorder (MDD) remains an important challenge. Matching patients to the treatment they will most likely respond to should be the ultimate goal. Even though numerous studies have investigated patient-specific indicators of treatment efficacy, no (bio)markers or empirical tests for use in clinical practice have resulted as of now. Therefore, clinical decisions regarding the treatment of MDD still have to be made on the basis of questionnaire- or interview-based assessments and general guidelines without the support of a (laboratory) test. We conducted a narrative review of current approaches to characterize and predict outcome to pharmacological treatments in MDD. We particularly focused on findings from newer computational studies using machine learning and on the resulting implementation into clinical decision support systems. The main issues seem to rest upon the unavailability of robust predictive variables and the lacking application of empirical findings and predictive models in clinical practice. We outline several challenges that need to be tackled on different stages of the translational process, from current concepts and definitions to generalizable prediction models and their successful implementation into digital support systems. By bridging the addressed gaps in translational psychiatric research, advances in data quantity and new technologies may enable the next steps toward precision psychiatry.

Detecting subtle signs of depression with automated speech analysis in a non-clinical sample

BACKGROUND

Automated speech analysis has gained increasing attention to help diagnosing depression. Most previous studies, however, focused on comparing speech in patients with major depressive disorder to that in healthy volunteers. An alternative may be to associate speech with depressive symptoms in a non-clinical sample as this may help to find early and sensitive markers in those at risk of depression.

METHODS

We included n = 118 healthy young adults (mean age: 23.5 ± 3.7 years; 77% women) and asked them to talk about a positive and a negative event in their life. Then, we assessed the level of depressive symptoms with a self-report questionnaire, with scores ranging from 0-60. We transcribed speech data and extracted acoustic as well as linguistic features. Then, we tested whether individuals below or above the cut-off of clinically relevant depressive symptoms differed in speech features. Next, we predicted whether someone would be below or above that cut-off as well as the individual scores on the depression questionnaire. Since depression is associated with cognitive slowing or attentional deficits, we finally correlated depression scores with performance in the Trail Making Test.

RESULTS

In our sample, n = 93 individuals scored below and n = 25 scored above cut-off for clinically relevant depressive symptoms. Most speech features did not differ significantly between both groups, but individuals above cut-off spoke more than those below that cut-off in the positive and the negative story. In addition, higher depression scores in that group were associated with slower completion time of the Trail Making Test. We were able to predict with 93% accuracy who would be below or above cut-off. In addition, we were able to predict the individual depression scores with low mean absolute error (3.90), with best performance achieved by a support vector machine.

CONCLUSIONS

Our results indicate that even in a sample without a clinical diagnosis of depression, changes in speech relate to higher depression scores. This should be investigated in more detail in the future. In a longitudinal study, it may be tested whether speech features found in our study represent early and sensitive markers for subsequent depression in individuals at risk.

A computational approach to measure the linguistic characteristics of psychotherapy timing, responsiveness, and consistency

Although individual psychotherapy is generally effective for a range of mental health conditions, little is known about the moment-to-moment language use of effective therapists. Increased access to computational power, coupled with a rise in computer-mediated communication (telehealth), makes feasible the large-scale analyses of language use during psychotherapy. Transparent methodological approaches are lacking, however. Here we present novel methods to increase the efficiency of efforts to examine language use in psychotherapy. We evaluate three important aspects of therapist language use - timing, responsiveness, and consistency - across five clinically relevant language domains: pronouns, time orientation, emotional polarity, therapist tactics, and paralinguistic style. We find therapist language is dynamic within sessions, responds to patient language, and relates to patient symptom diagnosis but not symptom severity. Our results demonstrate that analyzing therapist language at scale is feasible and may help answer longstanding questions about specific behaviors of effective therapists.

Use of electronic medical records to monitor the safe and effective prescribing of medicinal cannabis: is it feasible?

BACKGROUND

General practitioners are well positioned to contribute to the pharmacovigilance of medical cannabis via the general practice electronic medical record (EMR). The aim of this research is to interrogate de-identified patient data from the Patron primary care data repository for reports of medicinal cannabis to ascertain the feasibility of using EMRs to monitor medicinal cannabis prescribing in Australia.

METHODS

EMR rule-based digital phenotyping of 1 164 846 active patients from 109 practices was undertaken to investigate reports of medicinal cannabis use from September 2017 to September 2020.

RESULTS

Eighty patients with 170 prescriptions of medicinal cannabis were identified in the Patron repository. Reasons for prescription included anxiety, multiple sclerosis, cancer, nausea, and Crohn's disease. Nine patients showed symptoms of a possible adverse event, including depression, motor vehicle accident, gastrointestinal symptoms, and anxiety.

CONCLUSIONS

The recording of medicinal cannabis effects in the patient EMR provides potential for medicinal cannabis monitoring in the community. This is especially feasible if monitoring were to be embedded into general practitioner workflow.

Modern views of machine learning for precision psychiatry

In light of the National Institute of Mental Health (NIMH)'s Research Domain Criteria (RDoC), the advent of functional neuroimaging, novel technologies and methods provide new opportunities to develop precise and personalized prognosis and diagnosis of mental disorders. Machine learning (ML) and artificial intelligence (AI) technologies are playing an increasingly critical role in the new era of precision psychiatry. Combining ML/AI with neuromodulation technologies can potentially provide explainable solutions in clinical practice and effective therapeutic treatment. Advanced wearable and mobile technologies also call for the new role of ML/AI for digital phenotyping in mobile mental health. In this review, we provide a comprehensive review of ML methodologies and applications by combining neuroimaging, neuromodulation, and advanced mobile technologies in psychiatry practice. We further review the role of ML in molecular phenotyping and cross-species biomarker identification in precision psychiatry. We also discuss explainable AI (XAI) and neuromodulation in a closed human-in-the-loop manner and highlight the ML potential in multi-media information extraction and multi-modal data fusion. Finally, we discuss conceptual and practical challenges in precision psychiatry and highlight ML opportunities in future research.