The relationship between text message sentiment and self-reported depression

Digital phenotyping of depression during pregnancy using self-report data

BACKGROUND

Depression is a common pregnancy complication yet is often under-detected and, subsequently, undertreated. Data collected through mobile health tools may be used to support the identification of depression symptoms in pregnancy.

METHODS

An observational cohort study of 2062 pregnancies collected self-reports of patient history, mood, pregnancy-specific symptoms, and written language using a prenatal support app. These app inputs were used to model depression risk in subsequent 30- and 60-day periods throughout pregnancy. A selective inference lasso modeling approach examined the individual and additive value of each type of patient-reported app input.

RESULTS

Depression models ranged in predictive power (AUC value of 0.64-0.83), depending on the type of inputs. The most predictive model included personal history, daily mood, and acute pregnancy-related symptoms (e.g., severe vomiting, cramping). Across models, daily mood was the strongest indicator of depression symptoms in the following month. Models that retained natural language inputs typically improved predictive accuracy and offered insight into the lived context associated with experiencing depression.

LIMITATIONS

Our findings are not generalizable beyond a digitally literate patient population that is self-motivated to report data during pregnancy.

CONCLUSIONS

Simple patient reported data, including sparse language, shared directly via digital tools may support earlier depression symptom identification and a more nuanced understanding of depression context.

Digital biomarkers in depression: A systematic review and call for standardization and harmonization of feature engineering

BACKGROUND

General physicians misclassify depression in more than half of the cases. Researchers have explored the feasibility of leveraging passively collected data points, also called digital biomarkers, to provide more granular understanding of depression phenotypes as well as a more objective assessment of disease.

METHOD

This paper provides a systematic review following the PRISMA guidelines (Page et al., 2021) to understand which digital biomarkers might be relevant for passive screening of depression. Pubmed and PsycInfo were systematically searched for studies published from 2019 to early 2024, resulting in 161 records assessed for eligibility. Excluded were intervention studies, studies focusing on a different disease or those with a lack of passive data collection. 74 studies remained for a quality assessment, after which 27 studies were included.

RESULTS

The review shows that depressed participants' real-life behavior such as reduced communication with others can be tracked by passive data. Machine learning models for the classification of depression have shown accuracies up to 0.98, surpassing the quality of many standardized assessment methods.

LIMITATIONS

Inconsistency of outcome reporting of current studies does not allow for drawing statistical conclusions regarding effectiveness of individual included features. The Covid-19 pandemic might have impacted the ongoing studies between 2020 and 2022.

CONCLUSION

While digital biomarkers allow real-life tracking of participant's behavior and symptoms, further work is required to align the feature engineering of digital biomarkers. With shown high accuracies of assessments, connecting digital biomarkers with clinical practice can be a promising method of detecting symptoms of depression automatically.

Detecting adolescent depression through passive monitoring of linguistic markers in smartphone communication

BACKGROUND

Cross sectional studies have identified linguistic correlates of major depressive disorder (MDD) in smartphone communication. However, it is unclear whether monitoring these linguistic characteristics can detect when an individual is experiencing MDD, which would facilitate timely intervention.

METHODS

Approximately 1.2 million messages typed into smartphone social communication apps (e.g. texting, social media) were passively collected from 90 adolescents with a range of depression severity over a 12-month period. Sentiment (i.e. positive vs. negative valence of text), proportions of first-person singular pronouns (e.g. 'I'), and proportions of absolutist words (e.g. 'all') were computed for each message and converted to weekly aggregates temporally aligned with weekly MDD statuses obtained from retrospective interviews. Idiographic, multilevel logistic regression models tested whether within-person deviations in these linguistic features were associated with the probability of concurrently meeting threshold for MDD.

RESULTS

Using more first-person singular pronouns in smartphone communication relative to one's own average was associated with higher odds of meeting threshold for MDD in the concurrent week (OR = 1.29; p = .007). Sentiment (OR = 1.07; p = .54) and use of absolutist words (OR = 0.99; p = .90) were not related to weekly MDD.

CONCLUSIONS

Passively monitoring use of first-person singular pronouns in adolescents' smartphone communication may help detect MDD, providing novel opportunities for early intervention.

Measuring algorithmic bias to analyze the reliability of AI tools that predict depression risk using smartphone sensed-behavioral data

AI tools intend to transform mental healthcare by providing remote estimates of depression risk using behavioral data collected by sensors embedded in smartphones. While these tools accurately predict elevated depression symptoms in small, homogenous populations, recent studies show that these tools are less accurate in larger, more diverse populations. In this work, we show that accuracy is reduced because sensed-behaviors are unreliable predictors of depression across individuals: sensed-behaviors that predict depression risk are inconsistent across demographic and socioeconomic subgroups. We first identified subgroups where a developed AI tool underperformed by measuring algorithmic bias, where subgroups with depression were incorrectly predicted to be at lower risk than healthier subgroups. We then found inconsistencies between sensed-behaviors predictive of depression across these subgroups. Our findings suggest that researchers developing AI tools predicting mental health from sensed-behaviors should think critically about the generalizability of these tools, and consider tailored solutions for targeted populations.

Measuring algorithmic bias to analyze the reliability of AI tools that predict depression risk using smartphone sensed-behavioral data

AI tools intend to transform mental healthcare by providing remote estimates of depression risk using behavioral data collected by sensors embedded in smartphones. While these tools accurately predict elevated symptoms in small, homogenous populations, recent studies show that these tools are less accurate in larger, more diverse populations. In this work, we show that accuracy is reduced because sensed-behaviors are unreliable predictors of depression across individuals; specifically the sensed-behaviors that predict depression risk are inconsistent across demographic and socioeconomic subgroups. We first identified subgroups where a developed AI tool underperformed by measuring algorithmic bias, where subgroups with depression were incorrectly predicted to be at lower risk than healthier subgroups. We then found inconsistencies between sensed-behaviors predictive of depression across these subgroups. Our findings suggest that researchers developing AI tools predicting mental health from behavior should think critically about the generalizability of these tools, and consider tailored solutions for targeted populations.

Differential temporal utility of passively sensed smartphone features for depression and anxiety symptom prediction: a longitudinal cohort study

While studies show links between smartphone data and affective symptoms, we lack clarity on the temporal scale, specificity (e.g., to depression vs. anxiety), and person-specific (vs. group-level) nature of these associations. We conducted a large-scale (n = 1013) smartphone-based passive sensing study to identify within- and between-person digital markers of depression and anxiety symptoms over time. Participants (74.6% female; M age = 40.9) downloaded the LifeSense app, which facilitated continuous passive data collection (e.g., GPS, app and device use, communication) across 16 weeks. Hierarchical linear regression models tested the within- and between-person associations of 2-week windows of passively sensed data with depression (PHQ-8) or generalized anxiety (GAD-7). We used a shifting window to understand the time scale at which sensed features relate to mental health symptoms, predicting symptoms 2 weeks in the future (distal prediction), 1 week in the future (medial prediction), and 0 weeks in the future (proximal prediction). Spending more time at home relative to one's average was an early signal of PHQ-8 severity (distal β = 0.219, p = 0.012) and continued to relate to PHQ-8 at medial (β = 0.198, p = 0.022) and proximal (β = 0.183, p = 0.045) windows. In contrast, circadian movement was proximally related to (β = -0.131, p = 0.035) but did not predict (distal β = 0.034, p = 0.577; medial β = -0.089, p = 0.138) PHQ-8. Distinct communication features (i.e., call/text or app-based messaging) related to PHQ-8 and GAD-7. Findings have implications for identifying novel treatment targets, personalizing digital mental health interventions, and enhancing traditional patient-provider interactions. Certain features (e.g., circadian movement) may represent correlates but not true prospective indicators of affective symptoms. Conversely, other features like home duration may be such early signals of intra-individual symptom change, indicating the potential utility of prophylactic intervention (e.g., behavioral activation) in response to person-specific increases in these signals.

Specific associations of passively sensed smartphone data with future symptoms of avoidance, fear, and physiological distress in social anxiety

Background

Prior literature links passively sensed information about a person's location, movement, and communication with social anxiety. These findings hold promise for identifying novel treatment targets, informing clinical care, and personalizing digital mental health interventions. However, social anxiety symptoms are heterogeneous; to identify more precise targets and tailor treatments, there is a need for personal sensing studies aimed at understanding differential predictors of the distinct subdomains of social anxiety. Our objective was to conduct a large-scale smartphone-based sensing study of fear, avoidance, and physiological symptoms in the context of trait social anxiety over time.

Methods

Participants (n = 1013; 74.6 % female; M age = 40.9) downloaded the LifeSense app, which collected continuous passive data (e.g., GPS, communication, app and device use) over 16 weeks. We tested a series of multilevel linear regression models to understand within- and between-person associations of 2-week windows of passively sensed smartphone data with fear, avoidance, and physiological distress on the self-reported Social Phobia Inventory (SPIN). A shifting sensor lag was applied to examine how smartphone features related to SPIN subdomains 2 weeks in the future (distal prediction), 1 week in the future (medial prediction), and 0 weeks in the future (proximal prediction).

Results

A decrease in time visiting novel places was a strong between-person predictor of social avoidance over time (distal β = -0.886, p = .002; medial β = -0.647, p = .029; proximal β = -0.818, p = .007). Reductions in call- and text-based communications were associated with social avoidance at both the between- (distal β = -0.882, p = .002; medial β = -0.932, p = .001; proximal β = -0.918, p = .001) and within- (distal β = -0.191, p = .046; medial β = -0.213, p = .028) person levels, as well as between-person fear of social situations (distal β = -0.860, p < .001; medial β = -0.892, p < .001; proximal β = -0.886, p < .001) over time. There were fewer significant associations of sensed data with physiological distress. Across the three subscales, smartphone data explained 9-12 % of the variance in social anxiety.

Conclusion

Findings have implications for understanding how social anxiety manifests in daily life, and for personalizing treatments. For example, a signal that someone is likely to begin avoiding social situations may suggest a need for alternative types of exposure-based interventions compared to a signal that someone is likely to begin experiencing increased physiological distress. Our results suggest that as a prophylactic means of targeting social avoidance, it may be helpful to deploy interventions involving social exposures in response to decreases in time spent visiting novel places.

Momentary Depressive Feeling Detection Using X (Formerly Twitter) Data: Contextual Language Approach

BACKGROUND

Depression and momentary depressive feelings are major public health concerns imposing a substantial burden on both individuals and society. Early detection of momentary depressive feelings is highly beneficial in reducing this burden and improving the quality of life for affected individuals. To this end, the abundance of data exemplified by X (formerly Twitter) presents an invaluable resource for discerning insights into individuals' mental states and enabling timely detection of these transitory depressive feelings.

OBJECTIVE

The objective of this study was to automate the detection of momentary depressive feelings in posts using contextual language approaches.

METHODS

First, we identified terms expressing momentary depressive feelings and depression, scaled their relevance to depression, and constructed a lexicon. Then, we scraped posts using this lexicon and labeled them manually. Finally, we assessed the performance of the Bidirectional Encoder Representations From Transformers (BERT), A Lite BERT (ALBERT), Robustly Optimized BERT Approach (RoBERTa), Distilled BERT (DistilBERT), convolutional neural network (CNN), bidirectional long short-term memory (BiLSTM), and machine learning (ML) algorithms in detecting momentary depressive feelings in posts.

RESULTS

This study demonstrates a notable distinction in performance between binary classification, aimed at identifying posts conveying depressive sentiments and multilabel classification, designed to categorize such posts across multiple emotional nuances. Specifically, binary classification emerges as the more adept approach in this context, outperforming multilabel classification. This outcome stems from several critical factors that underscore the nuanced nature of depressive expressions within social media. Our results show that when using binary classification, BERT and DistilBERT (pretrained transfer learning algorithms) may outperform traditional ML algorithms. Particularly, DistilBERT achieved the best performance in terms of area under the curve (96.71%), accuracy (97.4%), sensitivity (97.57%), specificity (97.22%), precision (97.30%), and F1-score (97.44%). DistilBERT obtained an area under the curve nearly 12% points higher than that of the best-performing traditional ML algorithm, convolutional neural network. This study showed that transfer learning algorithms are highly effective in extracting knowledge from posts, detecting momentary depressive feelings, and highlighting their superiority in contextual analysis.

CONCLUSIONS

Our findings suggest that contextual language approaches-particularly those rooted in transfer learning-are reliable approaches to automate the early detection of momentary depressive feelings and can be used to develop social media monitoring tools for identifying individuals who may be at risk of depression. The implications are far-reaching because these approaches stand poised to inform the creation of social media monitoring tools and are pivotal for identifying individuals susceptible to depression. By intervening proactively, these tools possess the potential to slow the progression of depressive feelings, effectively mitigating the societal load of depression and fostering improved mental health. In addition to highlighting the capabilities of automated sentiment analysis, this study illuminates its pivotal role in advancing global public health.

Capturing mood dynamics through adolescent smartphone social communication

Most adolescents with depression remain undiagnosed and untreated-missed opportunities that are costly from both personal and public health perspectives. A promising approach to detecting adolescent depression in real-time and at a large scale is through their social communication on the smartphone (e.g., text messages, social media posts). Past research has shown that language from online social communication reliably indicates interindividual differences in depression. To move toward detecting the emergence of depression symptoms intraindividually, the present study tested whether sentiment (i.e., words connoting positive and negative affect) from smartphone social communication prospectively predicted daily mood fluctuations in 83 adolescents (Mage = 16.49, 73.5% female) with a wide range of depression severity. Participants completed daily mood ratings across a 90-day period, during which 354,278 messages were passively collected from social communication apps. Greater positive sentiment (i.e., more positive weighted composite valence score and a greater proportion of words expressing positive sentiment) predicted more positive next-day mood, controlling for previous-day mood. Moreover, greater proportions of positive and negative sentiment were, respectively, associated with lower anhedonia and greater dysphoria symptoms measured at baseline. Exploratory analyses of nonaffective linguistic features showed that greater use of social engagement words (e.g., friends and affiliation) and emojis (primarily consisting of hearts) predicted more positive changes in mood. Collectively, findings suggest that language from smartphone social communication can detect mood fluctuations in adolescents, laying the foundation for language-based tools to identify periods of heightened depression risk. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Understanding Mental Health Clinicians' Perceptions and Concerns Regarding Using Passive Patient-Generated Health Data for Clinical Decision-Making: Qualitative Semistructured Interview Study

BACKGROUND

Digital health-tracking tools are changing mental health care by giving patients the ability to collect passively measured patient-generated health data (PGHD; ie, data collected from connected devices with little to no patient effort). Although there are existing clinical guidelines for how mental health clinicians should use more traditional, active forms of PGHD for clinical decision-making, there is less clarity on how passive PGHD can be used.

OBJECTIVE

We conducted a qualitative study to understand mental health clinicians' perceptions and concerns regarding the use of technology-enabled, passively collected PGHD for clinical decision-making. Our interviews sought to understand participants' current experiences with and visions for using passive PGHD.

METHODS

Mental health clinicians providing outpatient services were recruited to participate in semistructured interviews. Interview recordings were deidentified, transcribed, and qualitatively coded to identify overarching themes.

RESULTS

Overall, 12 mental health clinicians (n=11, 92% psychiatrists and n=1, 8% clinical psychologist) were interviewed. We identified 4 overarching themes. First, passive PGHD are patient driven-we found that current passive PGHD use was patient driven, not clinician driven; participating clinicians only considered passive PGHD for clinical decision-making when patients brought passive data to clinical encounters. The second theme was active versus passive data as subjective versus objective data-participants viewed the contrast between active and passive PGHD as a contrast between interpretive data on patients' mental health and objective information on behavior. Participants believed that prioritizing passive over self-reported, active PGHD would reduce opportunities for patients to reflect upon their mental health, reducing treatment engagement and raising questions about how passive data can best complement active data for clinical decision-making. Third, passive PGHD must be delivered at appropriate times for action-participants were concerned with the real-time nature of passive PGHD; they believed that it would be infeasible to use passive PGHD for real-time patient monitoring outside clinical encounters and more feasible to use passive PGHD during clinical encounters when clinicians can make treatment decisions. The fourth theme was protecting patient privacy-participating clinicians wanted to protect patient privacy within passive PGHD-sharing programs and discussed opportunities to refine data sharing consent to improve transparency surrounding passive PGHD collection and use.

CONCLUSIONS

Although passive PGHD has the potential to enable more contextualized measurement, this study highlights the need for building and disseminating an evidence base describing how and when passive measures should be used for clinical decision-making. This evidence base should clarify how to use passive data alongside more traditional forms of active PGHD, when clinicians should view passive PGHD to make treatment decisions, and how to protect patient privacy within passive data-sharing programs. Clear evidence would more effectively support the uptake and effective use of these novel tools for both patients and their clinicians.

The Perceived Utility of Smartphone and Wearable Sensor Data in Digital Self-tracking Technologies for Mental Health

Mental health symptoms are commonly discovered in primary care. Yet, these settings are not set up to provide psychological treatment. Digital interventions can play a crucial role in stepped care management of patients' symptoms where patients are offered a low intensity intervention, and treatment evolves to incorporate providers if needed. Though digital interventions often use smartphone and wearable sensor data, little is known about patients' desires to use these data to manage mental health symptoms. In 10 interviews with patients with symptoms of depression and anxiety, we explored their: symptom self-management, current and desired use of sensor data, and comfort sharing such data with providers. Findings support the use digital interventions to manage mental health, yet they also highlight a misalignment in patient needs and current efforts to use sensors. We outline considerations for future research, including extending design thinking to wraparound services that may be necessary to truly reduce healthcare burden.

Enabling Early Health Care Intervention by Detecting Depression in Users of Web-Based Forums using Language Models: Longitudinal Analysis and Evaluation

Background

Major depressive disorder is a common mental disorder affecting 5% of adults worldwide. Early contact with health care services is critical for achieving accurate diagnosis and improving patient outcomes. Key symptoms of major depressive disorder (depression hereafter) such as cognitive distortions are observed in verbal communication, which can also manifest in the structure of written language. Thus, the automatic analysis of text outputs may provide opportunities for early intervention in settings where written communication is rich and regular, such as social media and web-based forums.

Objective

The objective of this study was 2-fold. We sought to gauge the effectiveness of different machine learning approaches to identify users of the mass web-based forum Reddit, who eventually disclose a diagnosis of depression. We then aimed to determine whether the time between a forum post and a depression diagnosis date was a relevant factor in performing this detection.

Methods

A total of 2 Reddit data sets containing posts belonging to users with and without a history of depression diagnosis were obtained. The intersection of these data sets provided users with an estimated date of depression diagnosis. This derived data set was used as an input for several machine learning classifiers, including transformer-based language models (LMs).

Results

Bidirectional Encoder Representations from Transformers (BERT) and MentalBERT transformer-based LMs proved the most effective in distinguishing forum users with a known depression diagnosis from those without. They each obtained a mean F₁-score of 0.64 across the experimental setups used for binary classification. The results also suggested that the final 12 to 16 weeks (about 3-4 months) of posts before a depressed user's estimated diagnosis date are the most indicative of their illness, with data before that period not helping the models detect more accurately. Furthermore, in the 4- to 8-week period before the user's estimated diagnosis date, their posts exhibited more negative sentiment than any other 4-week period in their post history.

Conclusions

Transformer-based LMs may be used on data from web-based social media forums to identify users at risk for psychiatric conditions such as depression. Language features picked up by these classifiers might predate depression onset by weeks to months, enabling proactive mental health care interventions to support those at risk for this condition.

Using natural language from a smartphone pregnancy app to identify maternal depression

Depression is highly prevalent in pregnancy, yet it often goes undiagnosed and untreated. Language can be an indicator of psychological well-being. This longitudinal, observational cohort study of 1,274 pregnancies examined written language shared in a prenatal smartphone app. Natural language feature of text entered in the app (e.g. in a journaling feature) throughout the course of participants' pregnancies were used to model subsequent depression symptoms. Language features were predictive of incident depression symptoms in a 30-day window (AUROC = 0.72) and offer insights into topics most salient in the writing of individuals experiencing those symptoms. When natural language inputs were combined with self-reported current mood, a stronger predictive model was produced (AUROC = 0.84). Pregnancy apps are a promising way to illuminate experiences contributing to depression symptoms. Even sparse language and simple patient-reports collected directly from these tools may support earlier, more nuanced depression symptom identification.

Prospective associations of text-message-based sentiment with symptoms of depression, generalized anxiety, and social anxiety

OBJECTIVE

Language patterns may elucidate mechanisms of mental health conditions. To inform underlying theory and risk models, we evaluated prospective associations between in vivo text messaging language and differential symptoms of depression, generalized anxiety, and social anxiety.

METHODS

Over 16 weeks, we collected outgoing text messages from 335 adults. Using Linguistic Inquiry and Word Count (LIWC), NRC Emotion Lexicon, and previously established depression and stress dictionaries, we evaluated the degree to which language features predict symptoms of depression, generalized anxiety, or social anxiety the following week using hierarchical linear models. To isolate the specificity of language effects, we also controlled for the effects of the two other symptom types.

RESULTS

We found significant relationships of language features, including personal pronouns, negative emotion, cognitive and biological processes, and informal language, with common mental health conditions, including depression, generalized anxiety, and social anxiety (ps < .05). There was substantial overlap between language features and the three mental health outcomes. However, after controlling for other symptoms in the models, depressive symptoms were uniquely negatively associated with language about anticipation, trust, social processes, and affiliation (βs: -.10 to -.09, ps < .05), whereas generalized anxiety symptoms were positively linked with these same language features (βs: .12-.13, ps < .001). Social anxiety symptoms were uniquely associated with anger, sexual language, and swearing (βs: .12-.13, ps < .05).

CONCLUSION

Language that confers both common (e.g., personal pronouns and negative emotion) and specific (e.g., affiliation, anticipation, trust, and anger) risk for affective disorders is perceptible in prior week text messages, holding promise for understanding cognitive-behavioral mechanisms and tailoring digital interventions.