Natural Language Processing Reveals Vulnerable Mental Health Support Groups and Heightened Health Anxiety on Reddit During COVID-19: Observational Study

Leveraging Social Media to Predict COVID-19-Induced Disruptions to Mental Well-Being Among University Students: Modeling Study

BACKGROUND

Large-scale crisis events such as COVID-19 often have secondary impacts on individuals' mental well-being. University students are particularly vulnerable to such impacts. Traditional survey-based methods to identify those in need of support do not scale over large populations and they do not provide timely insights. We pursue an alternative approach through social media data and machine learning. Our models aim to complement surveys and provide early, precise, and objective predictions of students disrupted by COVID-19.

OBJECTIVE

This study aims to demonstrate the feasibility of language on private social media as an indicator of crisis-induced disruption to mental well-being.

METHODS

We modeled 4124 Facebook posts provided by 43 undergraduate students, spanning over 2 years. We extracted temporal trends in the psycholinguistic attributes of their posts and comments. These trends were used as features to predict how COVID-19 disrupted their mental well-being.

RESULTS

The social media-enabled model had an F1-score of 0.79, which was a 39% improvement over a model trained on the self-reported mental state of the participant. The features we used showed promise in predicting other mental states such as anxiety, depression, social, isolation, and suicidal behavior (F1-scores varied between 0.85 and 0.93). We also found that selecting the windows of time 7 months after the COVID-19-induced lockdown presented better results, therefore, paving the way for data minimization.

CONCLUSIONS

We predicted COVID-19-induced disruptions to mental well-being by developing a machine learning model that leveraged language on private social media. The language in these posts described psycholinguistic trends in students' online behavior. These longitudinal trends helped predict mental well-being disruption better than models trained on correlated mental health questionnaires. Our work inspires further research into the potential applications of early, precise, and automatic warnings for individuals concerned about their mental health in times of crisis.

World Psychiatric Association-Asian Journal of Psychiatry Commission on Public Mental Health

Although there is considerable evidence showing that the prevention of mental illnesses and adverse outcomes and mental health promotion can help people lead better and more functional lives, public mental health remains overlooked in the broader contexts of psychiatry and public health. Likewise, in undergraduate and postgraduate medical curricula, prevention and mental health promotion have often been ignored. However, there has been a recent increase in interest in public mental health, including an emphasis on the prevention of psychiatric disorders and improving individual and community wellbeing to support life trajectories, from childhood through to adulthood and into older age. These lifespan approaches have significant potential to reduce the onset of mental illnesses and the related burdens for the individual and communities, as well as mitigating social, economic, and political costs. Informed by principles of social justice and respect for human rights, this may be especially important for addressing salient problems in communities with distinct vulnerabilities, where prominent disadvantages and barriers for care delivery exist. Therefore, this Commission aims to address these topics, providing a narrative overview of relevant literature and suggesting ways forward. Additionally, proposals for improving mental health and preventing mental illnesses and adverse outcomes are presented, particularly amongst at-risk populations.

Using Large Language Models to Understand Suicidality in a Social Media-Based Taxonomy of Mental Health Disorders: Linguistic Analysis of Reddit Posts

Background

Rates of suicide have increased by over 35% since 1999. Despite concerted efforts, our ability to predict, explain, or treat suicide risk has not significantly improved over the past 50 years.

Objective

The aim of this study was to use large language models to understand natural language use during public web-based discussions (on Reddit) around topics related to suicidality.

Methods

We used large language model-based sentence embedding to extract the latent linguistic dimensions of user postings derived from several mental health-related subreddits, with a focus on suicidality. We then applied dimensionality reduction to these sentence embeddings, allowing them to be summarized and visualized in a lower-dimensional Euclidean space for further downstream analyses. We analyzed 2.9 million posts extracted from 30 subreddits, including r/SuicideWatch, between October 1 and December 31, 2022, and the same period in 2010.

Results

Our results showed that, in line with existing theories of suicide, posters in the suicidality community (r/SuicideWatch) predominantly wrote about feelings of disconnection, burdensomeness, hopeless, desperation, resignation, and trauma. Further, we identified distinct latent linguistic dimensions (well-being, seeking support, and severity of distress) among all mental health subreddits, and many of the resulting subreddit clusters were in line with a statistically driven diagnostic classification system-namely, the Hierarchical Taxonomy of Psychopathology (HiTOP)-by mapping onto the proposed superspectra.

Conclusions

Overall, our findings provide data-driven support for several language-based theories of suicide, as well as dimensional classification systems for mental health disorders. Ultimately, this novel combination of natural language processing techniques can assist researchers in gaining deeper insights about emotions and experiences shared on the web and may aid in the validation and refutation of different mental health theories.

Graph Attention-Based Curriculum Learning for Mental Healthcare Classification

Current research has examined the use of user-generated data from online media to identify and diagnose depression as a serious mental health issue that can significantly impact an individual's daily life. To this end, many studies examined words in personal statements to identify depression. In addition to aiding in the diagnosis and treatment of depression, this study uses and utilizes a Graph Attention Network (GAT) model for the classification of depression from online media. The model is based on masked self-attention layers, that assigns different weight to each node in a neighborhood without costly matrix operations. In addition, an emotion lexicon was extended using hypernyms to improve the model performance. Furthermore, embedding of the model was used to illustrate the contribution of the activated words to each symptom and to obtain qualitative agreement from psychiatrists. This technique uses previously learned embedding to illustrate the contribution of activated words to depressive symptoms in online forums. A significant improvement was observed in the model's performance through the use of the lexicon extension method, resulting in an increase in the ROC performance. The performance was also enhanced by an increase in vocabulary and the adoption of a graph-based curriculum. The lexicon expansion method involves the generation of additional words with similar semantic attributes, utilizing similarity metrics to reinforce lexical features. The graph-based curriculum learning also utilized to handle more challenging training samples, allowing the model to develop increasing expertise in learning complex correlations between input data and output labels.

Paving the way for COVID survivors' psychosocial rehabilitation: Mining topics, sentiments, and their trajectories over time from Reddit

Objective: This study examined major themes and sentiments and their trajectories and interactions over time using subcategories of Reddit data. The aim was to facilitate decision-making for psychosocial rehabilitation. Materials and Methods: We utilized natural language processing techniques, including topic modeling and sentiment analysis, on a dataset consisting of more than 38,000 topics, comments, and posts collected from a subreddit dedicated to the experiences of people who tested positive for COVID-19. In this longitudinal exploratory analysis, we studied the dynamics between the most dominant topics and subjects' emotional states over an 18-month period. Results: Our findings highlight the evolution of the textual and sentimental status of major topics discussed by COVID survivors over an extended period of time during the pandemic. We particularly studied pre- and post-vaccination eras as a turning point in the timeline of the pandemic. The results show that not only does the relevance of topics change over time, but the emotions attached to them also vary. Major social events, such as the administration of vaccines or enforcement of nationwide policies, are also reflected through the discussions and inquiries of social media users. In particular, the emotional state (i.e., sentiments and polarity of their feelings) of those who have experienced COVID personally. Discussion: Cumulative societal knowledge regarding the COVID-19 pandemic impacts the patterns with which people discuss their experiences, concerns, and opinions. The subjects' emotional state with respect to different topics was also impacted by extraneous factors and events, such as vaccination. Conclusion: By mining major topics, sentiments, and trajectories demonstrated in COVID-19 survivors' interactions on Reddit, this study contributes to the emerging body of scholarship on COVID-19 survivors' mental health outcomes, providing insights into the design of mental health support and rehabilitation services for COVID-19 survivors.

Identifying Functional Status Impairment in People Living With Dementia Through Natural Language Processing of Clinical Documents: Cross-Sectional Study

BACKGROUND

Assessment of activities of daily living (ADLs) and instrumental ADLs (iADLs) is key to determining the severity of dementia and care needs among older adults. However, such information is often only documented in free-text clinical notes within the electronic health record and can be challenging to find.

OBJECTIVE

This study aims to develop and validate machine learning models to determine the status of ADL and iADL impairments based on clinical notes.

METHODS

This cross-sectional study leveraged electronic health record clinical notes from Mass General Brigham's Research Patient Data Repository linked with Medicare fee-for-service claims data from 2007 to 2017 to identify individuals aged 65 years or older with at least 1 diagnosis of dementia. Notes for encounters both 180 days before and after the first date of dementia diagnosis were randomly sampled. Models were trained and validated using note sentences filtered by expert-curated keywords (filtered cohort) and further evaluated using unfiltered sentences (unfiltered cohort). The model's performance was compared using area under the receiver operating characteristic curve and area under the precision-recall curve (AUPRC).

RESULTS

The study included 10,000 key-term-filtered sentences representing 441 people (n=283, 64.2% women; mean age 82.7, SD 7.9 years) and 1000 unfiltered sentences representing 80 people (n=56, 70% women; mean age 82.8, SD 7.5 years). Area under the receiver operating characteristic curve was high for the best-performing ADL and iADL models on both cohorts (>0.97). For ADL impairment identification, the random forest model achieved the best AUPRC (0.89, 95% CI 0.86-0.91) on the filtered cohort; the support vector machine model achieved the highest AUPRC (0.82, 95% CI 0.75-0.89) for the unfiltered cohort. For iADL impairment, the Bio+Clinical bidirectional encoder representations from transformers (BERT) model had the highest AUPRC (filtered: 0.76, 95% CI 0.68-0.82; unfiltered: 0.58, 95% CI 0.001-1.0). Compared with a keyword-search approach on the unfiltered cohort, machine learning reduced false-positive rates from 4.5% to 0.2% for ADL and 1.8% to 0.1% for iADL.

CONCLUSIONS

In this study, we demonstrated the ability of machine learning models to accurately identify ADL and iADL impairment based on free-text clinical notes, which could be useful in determining the severity of dementia.

The Effect of COVID-19 on Middle-Aged Adults' Mental Health: A Mixed-Method Case-Control Study on the Moderating Effect of Cognitive Reserve

The COVID-19 pandemic has increased the vulnerability of adults to mental health effects, and the study of protective factors has become crucial. Cognitive reserve (CR) is a well-known protective factor against cognitive decline and several health factors; however, its protective effect on mental health during the pandemic has been rarely addressed. Thus, this study explored, through a mixed-method design, the effect of CR on perceived distress and PTSD-like symptoms in middle-aged participants who have survived severe COVID-19 and a matched control group. A total of 432 participants filled out self-report measures of CR, PTSD, depression, and anxiety, and were also asked to provide narration about their COVID-19-related experience. COVID-19 significantly affected the chances of reporting different mental health symptoms; levels of CR played a protective role in reducing their severity. Moreover, adults with higher CR seemed to be more realistic, focusing less on positive emotions, and elaborating more on the sense of anxiety when describing their experience: this might be an indication of a lower use of suppression to regulate emotions. Practical implications of these findings and future directions have been also discussed.

When the clock chimes: The impact of on-the-hour effects on user anxiety content generation in social media platforms

BACKGROUND

The growth of social media platforms has created a plethora of user-generated content, and social media has become an important channel of users to express their emotions. Although many studies have explored the influencing factors on user-generated content, there is an insufficient understanding the impact temporal cues on mental health content generation.

OBJECTIVE

This study aimed to explore how the on-the-hour time points affect users' anxiety content generation on social media platforms. Further, this study investigates the difference between weekdays and weekends, and the moderating effects of regional economic levels.

METHODS

We collected information on 2,543,902 user-generated anxiety-related posts from a leading social media platform in China. Then, we used fixed effect models to analyze the relationship between on-the-hour time points and user anxiety content generation.

RESULTS

The results show that on-the-hour time points affect user anxiety-related content generation, especially at the beginning of each hour (β = 894.564, p < 0.01). And the impact is greater on weekdays (β = 774.695, p < 0.01) than on weekends (β = 119.869, p < 0.01). Furthermore, regional economic moderates the impact, the better the economic condition, the greater the impact.

LIMITATIONS

Limitations include incomplete coverage of patient types and a single anxiety dictionary.

CONCLUSIONS

This study uncovers the relationship between temporal cues and user-generated anxiety content, providing new insights into the mental illness observation, and provides insights for mental health services providers and designers of online social platforms.

Tracking pregnant women's mental health through social media: an analysis of reddit posts

Objectives

Present an artificial intelligence-enabled pipeline for estimating the prevalence of depression and general anxiety among pregnant women using texts from their social media posts. Use said pipeline to analyze mental health trends on subreddits frequented by pregnant women and report on interesting insights that could be helpful for policy-makers, clinicians, etc.

Materials and methods

We used pretrained transformer-based models to build a natural language processing pipeline that can automatically detect depressed pregnant women on social media and carry out topic modeling to detect their concerns.

Results

We detected depressed posts by pregnant women on Reddit and validated the performance of the depression classification model by carrying out topic modeling to reveal that depressive topics were detected. The proportion of potentially depressed surprisingly reduced during the pandemic (2020 and 2021). Queries related to antidepressants, such as Zoloft, and potential ways of managing mental health dominated discourse before the pandemic (2018 and 2019), whereas queries about pelvic pain and associated stress dominated the discourse during the pandemic.

Discussion and Conclusion

Supportive online communities could be a factor in alleviating stress related to the pandemic, hence the reduction in the proportion of depressed users during the pandemic. Stress during the pandemic has been associated with pelvic pain among pregnant women, and this trend is confirmed through topic modeling of depressive posts during the pandemic.

Understanding Mental Health Issues in Different Subdomains of Social Networking Services: Computational Analysis of Text-Based Reddit Posts

BACKGROUND

Users increasingly use social networking services (SNSs) to share their feelings and emotions. For those with mental disorders, SNSs can also be used to seek advice on mental health issues. One available SNS is Reddit, in which users can freely discuss such matters on relevant health diagnostic subreddits.

OBJECTIVE

In this study, we analyzed the distinctive linguistic characteristics in users' posts on specific mental disorder subreddits (depression, anxiety, bipolar disorder, borderline personality disorder, schizophrenia, autism, and mental health) and further validated their distinctiveness externally by comparing them with posts of subreddits not related to mental illness. We also confirmed that these differences in linguistic formulations can be learned through a machine learning process.

METHODS

Reddit posts uploaded by users were collected for our research. We used various statistical analysis methods in Linguistic Inquiry and Word Count (LIWC) software, including 1-way ANOVA and subsequent post hoc tests, to see sentiment differences in various lexical features within mental health-related subreddits and against unrelated ones. We also applied 3 supervised and unsupervised clustering methods for both cases after extracting textual features from posts on each subreddit using bidirectional encoder representations from transformers (BERT) to ensure that our data set is suitable for further machine learning or deep learning tasks.

RESULTS

We collected 3,133,509 posts of 919,722 Reddit users. The results using the data indicated that there are notable linguistic differences among the subreddits, consistent with the findings of prior research. The findings from LIWC analyses revealed that patients with each mental health issue show significantly different lexical and semantic patterns, such as word count or emotion, throughout their online social networking activities, with P<.001 for all cases. Furthermore, distinctive features of each subreddit group were successfully identified through supervised and unsupervised clustering methods, using the BERT embeddings extracted from textual posts. This distinctiveness was reflected in the Davies-Bouldin scores ranging from 0.222 to 0.397 and the silhouette scores ranging from 0.639 to 0.803 in the former case, with scores of 1.638 and 0.729, respectively, in the latter case.

CONCLUSIONS

By taking a multifaceted approach, analyzing textual posts related to mental health issues using statistical, natural language processing, and machine learning techniques, our approach provides insights into aspects of recent lexical usage and information about the linguistic characteristics of patients with specific mental health issues, which can inform clinicians about patients' mental health in diagnostic terms to aid online intervention. Our findings can further promote research areas involving linguistic analysis and machine learning approaches for patients with mental health issues by identifying and detecting mentally vulnerable groups of people online.

Scoping the Priorities and Concerns of Parents: Infodemiology Study of Posts on Mumsnet and Reddit

BACKGROUND

Health technology innovation is increasingly supported by a bottom-up approach to priority setting, aiming to better reflect the concerns of its intended beneficiaries. Web-based forums provide parents with an outlet to share concerns, advice, and information related to parenting and the health and well-being of their children. They provide a rich source of data on parenting concerns and priorities that could inform future child health research and innovation.

OBJECTIVE

The aim of the study is to identify common concerns expressed on 2 major web-based forums and cluster these to identify potential family health concern topics as indicative priority areas for future research and innovation.

METHODS

We text-mined the r/Parenting subreddit (69,846 posts) and the parenting section of Mumsnet (99,848 posts) to create a large corpus of posts. A generative statistical model (latent Dirichlet allocation) was used to identify the most discussed topics in the corpus, and content analysis was applied to identify the parenting concerns found in a subset of posts.

RESULTS

A model with 25 topics produced the highest coherence and a wide range of meaningful parenting concern topics. The most frequently expressed parenting concerns are related to their child's sleep, self-care, eating (and food), behavior, childcare context, and the parental context including parental conflict. Topics directly associated with infants, such as potty training and bottle feeding, were more common on Mumsnet, while parental context and screen time were more common on r/Parenting.

CONCLUSIONS

Latent Dirichlet allocation topic modeling can be applied to gain a rapid, yet meaningful overview of parent concerns expressed on a large and diverse set of social media posts and used to complement traditional insight gathering methods. Parents framed their concerns in terms of children's everyday health concerns, generating topics that overlap significantly with established family health concern topics. We provide evidence of the range of family health concerns found at these sources and hope this can be used to generate material for use alongside traditional insight gathering methods.

Association of Health Care Work With Anxiety and Depression During the COVID-19 Pandemic: Structural Topic Modeling Study

BACKGROUND

Stressors for health care workers (HCWs) during the COVID-19 pandemic have been manifold, with high levels of depression and anxiety alongside gaps in care. Identifying the factors most tied to HCWs' psychological challenges is crucial to addressing HCWs' mental health needs effectively, now and for future large-scale events.

OBJECTIVE

In this study, we used natural language processing methods to examine deidentified psychotherapy transcripts from telemedicine treatment during the initial wave of COVID-19 in the United States. Psychotherapy was delivered by licensed therapists while HCWs were managing increased clinical demands and elevated hospitalization rates, in addition to population-level social distancing measures and infection risks. Our goal was to identify specific concerns emerging in treatment for HCWs and to compare differences with matched non-HCW patients from the general population.

METHODS

We conducted a case-control study with a sample of 820 HCWs and 820 non-HCW matched controls who received digitally delivered psychotherapy in 49 US states in the spring of 2020 during the first US wave of the COVID-19 pandemic. Depression was measured during the initial assessment using the Patient Health Questionnaire-9, and anxiety was measured using the General Anxiety Disorder-7 questionnaire. Structural topic models (STMs) were used to determine treatment topics from deidentified transcripts from the first 3 weeks of treatment. STM effect estimators were also used to examine topic prevalence in patients with moderate to severe anxiety and depression.

RESULTS

The median treatment enrollment date was April 15, 2020 (IQR March 31 to April 27, 2020) for HCWs and April 19, 2020 (IQR April 5 to April 27, 2020) for matched controls. STM analysis of deidentified transcripts identified 4 treatment topics centered on health care and 5 on mental health for HCWs. For controls, 3 STM topics on pandemic-related disruptions and 5 on mental health were identified. Several STM treatment topics were significantly associated with moderate to severe anxiety and depression, including working on the hospital unit (topic prevalence 0.035, 95% CI 0.022-0.048; P<.001), mood disturbances (prevalence 0.014, 95% CI 0.002-0.026; P=.03), and sleep disturbances (prevalence 0.016, 95% CI 0.002-0.030; P=.02). No significant associations emerged between pandemic-related topics and moderate to severe anxiety and depression for non-HCW controls.

CONCLUSIONS

The study provides large-scale quantitative evidence that during the initial wave of the COVID-19 pandemic, HCWs faced unique work-related challenges and stressors associated with anxiety and depression, which required dedicated treatment efforts. The study further demonstrates how natural language processing methods have the potential to surface clinically relevant markers of distress while preserving patient privacy.

Using Social Media to Help Understand Patient-Reported Health Outcomes of Post-COVID-19 Condition: Natural Language Processing Approach

BACKGROUND

While scientific knowledge of post-COVID-19 condition (PCC) is growing, there remains significant uncertainty in the definition of the disease, its expected clinical course, and its impact on daily functioning. Social media platforms can generate valuable insights into patient-reported health outcomes as the content is produced at high resolution by patients and caregivers, representing experiences that may be unavailable to most clinicians.

OBJECTIVE

In this study, we aimed to determine the validity and effectiveness of advanced natural language processing approaches built to derive insight into PCC-related patient-reported health outcomes from social media platforms Twitter and Reddit. We extracted PCC-related terms, including symptoms and conditions, and measured their occurrence frequency. We compared the outputs with human annotations and clinical outcomes and tracked symptom and condition term occurrences over time and locations to explore the pipeline's potential as a surveillance tool.

METHODS

We used bidirectional encoder representations from transformers (BERT) models to extract and normalize PCC symptom and condition terms from English posts on Twitter and Reddit. We compared 2 named entity recognition models and implemented a 2-step normalization task to map extracted terms to unique concepts in standardized terminology. The normalization steps were done using a semantic search approach with BERT biencoders. We evaluated the effectiveness of BERT models in extracting the terms using a human-annotated corpus and a proximity-based score. We also compared the validity and reliability of the extracted and normalized terms to a web-based survey with more than 3000 participants from several countries.

RESULTS

UmlsBERT-Clinical had the highest accuracy in predicting entities closest to those extracted by human annotators. Based on our findings, the top 3 most commonly occurring groups of PCC symptom and condition terms were systemic (such as fatigue), neuropsychiatric (such as anxiety and brain fog), and respiratory (such as shortness of breath). In addition, we also found novel symptom and condition terms that had not been categorized in previous studies, such as infection and pain. Regarding the co-occurring symptoms, the pair of fatigue and headaches was among the most co-occurring term pairs across both platforms. Based on the temporal analysis, the neuropsychiatric terms were the most prevalent, followed by the systemic category, on both social media platforms. Our spatial analysis concluded that 42% (10,938/26,247) of the analyzed terms included location information, with the majority coming from the United States, United Kingdom, and Canada.

CONCLUSIONS

The outcome of our social media-derived pipeline is comparable with the results of peer-reviewed articles relevant to PCC symptoms. Overall, this study provides unique insights into patient-reported health outcomes of PCC and valuable information about the patient's journey that can help health care providers anticipate future needs.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1101/2022.12.14.22283419.

Artificial intelligence in psychiatry research, diagnosis, and therapy

Psychiatric disorders are now responsible for the largest proportion of the global burden of disease, and even more challenges have been seen during the COVID-19 pandemic. Artificial intelligence (AI) is commonly used to facilitate the early detection of disease, understand disease progression, and discover new treatments in the fields of both physical and mental health. The present review provides a broad overview of AI methodology and its applications in data acquisition and processing, feature extraction and characterization, psychiatric disorder classification, potential biomarker detection, real-time monitoring, and interventions in psychiatric disorders. We also comprehensively summarize AI applications with regard to the early warning, diagnosis, prognosis, and treatment of specific psychiatric disorders, including depression, schizophrenia, autism spectrum disorder, attention-deficit/hyperactivity disorder, addiction, sleep disorders, and Alzheimer's disease. The advantages and disadvantages of AI in psychiatry are clarified. We foresee a new wave of research opportunities to facilitate and improve AI technology and its long-term implications in psychiatry during and after the COVID-19 era.

Characteristics of Intimate Partner Violence and Survivor's Needs During the COVID-19 Pandemic: Insights From Subreddits Related to Intimate Partner Violence

Intimate partner violence (IPV) increased during the COVID-19 pandemic. Collecting actionable IPV-related data from conventional sources (e.g., medical records) was challenging during the pandemic, generating a need to obtain relevant data from non-conventional sources, such as social media. Social media, like Reddit, is a preferred medium of communication for IPV survivors to share their experiences and seek support with protected anonymity. Nevertheless, the scope of available IPV-related data on social media is rarely documented. Thus, we examined the availability of IPV-related information on Reddit and the characteristics of the reported IPV during the pandemic. Using natural language processing, we collected publicly available Reddit data from four IPV-related subreddits between January 1, 2020 and March 31, 2021. Of 4,000 collected posts, we randomly sampled 300 posts for analysis. Three individuals on the research team independently coded the data and resolved the coding discrepancies through discussions. We adopted quantitative content analysis and calculated the frequency of the identified codes. 36% of the posts (n = 108) constituted self-reported IPV by survivors, of which 40% regarded current/ongoing IPV, and 14% contained help-seeking messages. A majority of the survivors' posts reflected psychological aggression, followed by physical violence. Notably, 61.4% of the psychological aggression involved expressive aggression, followed by gaslighting (54.3%) and coercive control (44.3%). Survivors' top three needs during the pandemic were hearing similar experiences, legal advice, and validating their feelings/reactions/thoughts/actions. Albeit limited, data from bystanders (survivors' friends, family, or neighbors) were also available. Rich data reflecting IPV survivors' lived experiences were available on Reddit. Such information will be useful for IPV surveillance, prevention, and intervention.

Acceptability of Personal Sensing Among People With Alcohol Use Disorder: Observational Study

BACKGROUND

Personal sensing may improve digital therapeutics for mental health care by facilitating early screening, symptom monitoring, risk prediction, and personalized adaptive interventions. However, further development and the use of personal sensing requires a better understanding of its acceptability to people targeted for these applications.

OBJECTIVE

We aimed to assess the acceptability of active and passive personal sensing methods in a sample of people with moderate to severe alcohol use disorder using both behavioral and self-report measures. This sample was recruited as part of a larger grant-funded project to develop a machine learning algorithm to predict lapses.

METHODS

Participants (N=154; n=77, 50% female; mean age 41, SD 11.9 years; n=134, 87% White and n=150, 97% non-Hispanic) in early recovery (1-8 weeks of abstinence) were recruited to participate in a 3-month longitudinal study. Participants were modestly compensated for engaging with active (eg, ecological momentary assessment [EMA], audio check-in, and sleep quality) and passive (eg, geolocation, cellular communication logs, and SMS text message content) sensing methods that were selected to tap into constructs from the Relapse Prevention model by Marlatt. We assessed 3 behavioral indicators of acceptability: participants' choices about their participation in the study at various stages in the procedure, their choice to opt in to provide data for each sensing method, and their adherence to a subset of the active methods (EMA and audio check-in). We also assessed 3 self-report measures of acceptability (interference, dislike, and willingness to use for 1 year) for each method.

RESULTS

Of the 192 eligible individuals screened, 191 consented to personal sensing. Most of these individuals (169/191, 88.5%) also returned 1 week later to formally enroll, and 154 participated through the first month follow-up visit. All participants in our analysis sample opted in to provide data for EMA, sleep quality, geolocation, and cellular communication logs. Out of 154 participants, 1 (0.6%) did not provide SMS text message content and 3 (1.9%) did not provide any audio check-ins. The average adherence rate for the 4 times daily EMA was .80. The adherence rate for the daily audio check-in was .54. Aggregate participant ratings indicated that all personal sensing methods were significantly more acceptable (all P<.001) compared with neutral across subjective measures of interference, dislike, and willingness to use for 1 year. Participants did not significantly differ in their dislike of active methods compared with passive methods (P=.23). However, participants reported a higher willingness to use passive (vs active) methods for 1 year (P=.04).

CONCLUSIONS

These results suggest that active and passive sensing methods are acceptable for people with alcohol use disorder over a longer period than has previously been assessed. Important individual differences were observed across people and methods, indicating opportunities for future improvement.

Comparing the Discussion of Telehealth in Two Social Media Platforms: Social Listening Analysis

Background

Social media is used as a source of information and platform to discuss health care; however, there is little research on discussion of telehealth in social media. Past research has looked at individual platforms, but a comparison of discussion on two platforms (Reddit and Twitter) has not been performed. Understanding telehealth-related social media discourse and the differences between platforms may provide insights into how telehealth is characterized online and which platforms provide patient perspectives. The COVID-19 pandemic provides a unique case study to examine how social media users approached both Reddit and Twitter during an international health crisis. This study used natural language processing tools and two social media platforms to (1) characterize and contrast each platform's telehealth-related posts according to themes and (2) assess the frequency of telehealth and telehealth-related terms posts before and during the onset of the COVID-19 pandemic.

Methods

We collected 6 years (2016 through 2021) of social media posts from Twitter and Reddit. The themes of the corpus were extracted using hashtags, subreddits, and Latent Dirichlet Allocation (LDA) and were analyzed using descriptive statistics.

Results

Both Twitter and Reddit showed exponential growth in the use of the term "telehealth" and telehealth-related terms in early 2020. The use of telehealth-related terms and discussion of COVID-19 coincided in both social media sites; however, other themes were discussed, including how to use telehealth. Reddit LDA clusters showed greatest usage of "telehealth" when associated with using or suggesting telehealth for receiving therapy, counseling, or psychoanalysis while Twitter focused on sharing telehealth news, products, and services.

Discussion

Twitter and Reddit had extensive growth in the use of telehealth-related terms after the COVID-19 pandemic. Twitter and Reddit showed themes connecting COVID-19 to telehealth, especially in reference to services, therapy, and counseling, however, Reddit had more discussion suggesting use of telehealth services or requesting peer insights into how to use telehealth as compared with Twitter, which appeared more focused on telehealth as a business or product.

"Help! I need some music!": Analysing music discourse & depression on Reddit

Individuals choose varying music listening strategies to fulfill particular mood-regulation goals. However, ineffective musical choices and a lack of cognizance of the effects thereof can be detrimental to their well-being and may lead to adverse outcomes like anxiety or depression. In our study, we use the social media platform Reddit to perform a large-scale analysis to unearth the several music-mediated mood-regulation goals that individuals opt for in the context of depression. A mixed-methods approach involving natural language processing techniques followed by qualitative analysis was performed on all music-related posts to identify the various music-listening strategies and group them into healthy and unhealthy associations. Analysis of the music content (acoustic features and lyrical themes) accompanying healthy and unhealthy associations showed significant differences. Individuals resorting to unhealthy strategies gravitate towards low-valence tracks. Moreover, lyrical themes associated with unhealthy strategies incorporated tracks with low optimism, high blame, and high self-reference. Our findings demonstrate that being mindful of the objectives of using music, the subsequent effects thereof, and aligning both for well-being outcomes is imperative for comprehensive understanding of the effectiveness of music.

Emotional Expression on Social Media Support Forums for Substance Cessation: Observational Study of Text-Based Reddit Posts

BACKGROUND

Substance use disorder is characterized by distinct cognitive processes involved in emotion regulation as well as unique emotional experiences related to the relapsing cycle of drug use and recovery. Web-based communities and the posts they generate represent an unprecedented resource for studying subjective emotional experiences, capturing population types and sizes not typically available in the laboratory. Here, we mined text data from Reddit, a social media website that hosts discussions from pseudonymous users on specific topic forums, including forums for individuals who are trying to abstain from using drugs, to explore the putative specificity of the emotional experience of substance cessation.

OBJECTIVE

An important motivation for this study was to investigate transdiagnostic clues that could ultimately be used for mental health outreach. Specifically, we aimed to characterize the emotions associated with cessation of 3 major substances and compare them to emotional experiences reported in nonsubstance cessation posts, including on forums related to psychiatric conditions of high comorbidity with addiction.

METHODS

Raw text from 2 million posts made, respectively, in the fall of 2020 (discovery data set) and fall of 2019 (replication data set) were obtained from 394 forums hosted by Reddit through the application programming interface. We quantified emotion word frequencies in 3 substance cessation forums for alcohol, nicotine, and cannabis topic categories and performed comparisons with general forums. Emotion word frequencies were classified into distinct categories and represented as a multidimensional emotion vector for each forum. We further quantified the degree of emotional resemblance between different forums by computing cosine similarity on these vectorized representations. For substance cessation posts with self-reported time since last use, we explored changes in the use of emotion words as a function of abstinence duration.

RESULTS

Compared to posts from general forums, substance cessation posts showed more expressions of anxiety, disgust, pride, and gratitude words. "Anxiety" emotion words were attenuated for abstinence durations >100 days compared to shorter durations (t12=3.08, 2-tailed; P=.001). The cosine similarity analysis identified an emotion profile preferentially expressed in the cessation posts across substances, with lesser but still prominent similarities to posts about social anxiety and attention-deficit/hyperactivity disorder. These results were replicated in the 2019 (pre-COVID-19) data and were distinct from control analyses using nonemotion words.

CONCLUSIONS

We identified a unique subjective experience phenotype of emotions associated with the cessation of 3 major substances, replicable across 2 time periods, with changes as a function of abstinence duration. Although to a lesser extent, this phenotype also quantifiably resembled the emotion phenomenology of other relevant subjective experiences (social anxiety and attention-deficit/hyperactivity disorder). Taken together, these transdiagnostic results suggest a novel approach for the future identification of at-risk populations, allowing for the development and deployment of specific and timely interventions.

Investigating COVID-19's Impact on Mental Health: Trend and Thematic Analysis of Reddit Users' Discourse

BACKGROUND

The COVID-19 pandemic has resulted in heightened levels of depression, anxiety, and other mental health issues due to sudden changes in daily life, such as economic stress, social isolation, and educational irregularity. Accurately assessing emotional and behavioral changes in response to the pandemic can be challenging, but it is essential to understand the evolving emotions, themes, and discussions surrounding the impact of COVID-19 on mental health.

OBJECTIVE

This study aims to understand the evolving emotions and themes associated with the impact of COVID-19 on mental health support groups (eg, r/Depression and r/Anxiety) on Reddit (Reddit Inc) during the initial phase and after the peak of the pandemic using natural language processing techniques and statistical methods.

METHODS

This study used data from the r/Depression and r/Anxiety Reddit communities, which consisted of posts contributed by 351,409 distinct users over a period spanning from 2019 to 2022. Topic modeling and Word2Vec embedding models were used to identify key terms associated with the targeted themes within the data set. A range of trend and thematic analysis techniques, including time-to-event analysis, heat map analysis, factor analysis, regression analysis, and k-means clustering analysis, were used to analyze the data.

RESULTS

The time-to-event analysis revealed that the first 28 days following a major event could be considered a critical window for mental health concerns to become more prominent. The theme trend analysis revealed key themes such as economic stress, social stress, suicide, and substance use, with varying trends and impacts in each community. The factor analysis highlighted pandemic-related stress, economic concerns, and social factors as primary themes during the analyzed period. Regression analysis showed that economic stress consistently demonstrated the strongest association with the suicide theme, whereas the substance theme had a notable association in both data sets. Finally, the k-means clustering analysis showed that in r/Depression, the number of posts related to the "depression, anxiety, and medication" cluster decreased after 2020, whereas the "social relationships and friendship" cluster showed a steady decrease. In r/Anxiety, the "general anxiety and feelings of unease" cluster peaked in April 2020 and remained high, whereas the "physical symptoms of anxiety" cluster showed a slight increase.

CONCLUSIONS

This study sheds light on the impact of COVID-19 on mental health and the related themes discussed in 2 web-based communities during the pandemic. The results offer valuable insights for developing targeted interventions and policies to support individuals and communities in similar crises.

Attention-Enabled Ensemble Deep Learning Models and Their Validation for Depression Detection: A Domain Adoption Paradigm

Depression is increasingly prevalent, leading to higher suicide risk. Depression detection and sentimental analysis of text inputs in cross-domain frameworks are challenging. Solo deep learning (SDL) and ensemble deep learning (EDL) models are not robust enough. Recently, attention mechanisms have been introduced in SDL. We hypothesize that attention-enabled EDL (aeEDL) architectures are superior compared to attention-not-enabled SDL (aneSDL) or aeSDL models. We designed EDL-based architectures with attention blocks to build eleven kinds of SDL model and five kinds of EDL model on four domain-specific datasets. We scientifically validated our models by comparing "seen" and "unseen" paradigms (SUP). We benchmarked our results against the SemEval (2016) sentimental dataset and established reliability tests. The mean increase in accuracy for EDL over their corresponding SDL components was 4.49%. Regarding the effect of attention block, the increase in the mean accuracy (AUC) of aeSDL over aneSDL was 2.58% (1.73%), and the increase in the mean accuracy (AUC) of aeEDL over aneEDL was 2.76% (2.80%). When comparing EDL vs. SDL for non-attention and attention, the mean aneEDL was greater than aneSDL by 4.82% (3.71%), and the mean aeEDL was greater than aeSDL by 5.06% (4.81%). For the benchmarking dataset (SemEval), the best-performing aeEDL model (ALBERT+BERT-BiLSTM) was superior to the best aeSDL (BERT-BiLSTM) model by 3.86%. Our scientific validation and robust design showed a difference of only 2.7% in SUP, thereby meeting the regulatory constraints. We validated all our hypotheses and further demonstrated that aeEDL is a very effective and generalized method for detecting symptoms of depression in cross-domain settings.

Changing word meanings in biomedical literature reveal pandemics and new technologies

While we often think of words as having a fixed meaning that we use to describe a changing world, words are also dynamic and changing. Scientific research can also be remarkably fast-moving, with new concepts or approaches rapidly gaining mind share. We examined scientific writing, both preprint and pre-publication peer-reviewed text, to identify terms that have changed and examine their use. One particular challenge that we faced was that the shift from closed to open access publishing meant that the size of available corpora changed by over an order of magnitude in the last two decades. We developed an approach to evaluate semantic shift by accounting for both intra- and inter-year variability using multiple integrated models. This analysis revealed thousands of change points in both corpora, including for terms such as 'cas9', 'pandemic', and 'sars'. We found that the consistent change-points between pre-publication peer-reviewed and preprinted text are largely related to the COVID-19 pandemic. We also created a web app for exploration that allows users to investigate individual terms ( https://greenelab.github.io/word-lapse/ ). To our knowledge, our research is the first to examine semantic shift in biomedical preprints and pre-publication peer-reviewed text, and provides a foundation for future work to understand how terms acquire new meanings and how peer review affects this process.

A systematic review of the use of topic models for short text social media analysis

Recently, research on short text topic models has addressed the challenges of social media datasets. These models are typically evaluated using automated measures. However, recent work suggests that these evaluation measures do not inform whether the topics produced can yield meaningful insights for those examining social media data. Efforts to address this issue, including gauging the alignment between automated and human evaluation tasks, are hampered by a lack of knowledge about how researchers use topic models. Further problems could arise if researchers do not construct topic models optimally or use them in a way that exceeds the models' limitations. These scenarios threaten the validity of topic model development and the insights produced by researchers employing topic modelling as a methodology. However, there is currently a lack of information about how and why topic models are used in applied research. As such, we performed a systematic literature review of 189 articles where topic modelling was used for social media analysis to understand how and why topic models are used for social media analysis. Our results suggest that the development of topic models is not aligned with the needs of those who use them for social media analysis. We have found that researchers use topic models sub-optimally. There is a lack of methodological support for researchers to build and interpret topics. We offer a set of recommendations for topic model researchers to address these problems and bridge the gap between development and applied research on short text topic models.

Supplementary Information

The online version contains supplementary material available at 10.1007/s10462-023-10471-x.

COVID-19 prevention behaviour is differentially motivated by primary psychopathy, grandiose narcissism and vulnerable Dark Triad traits

Dark Triad traits (psychopathy, narcissism) are associated with nonadherence to COVID-19 prevention measures such as social distancing and wearing face masks, although the psychological mechanisms underpinning this relationship remain unclear. In contrast, high threat-sensitivity may motivate compliance, and maybe seen in relation to vulnerable dark traits (secondary psychopathy, vulnerable narcissism and borderline personality disorder). The relationship between vulnerable dark traits and COVID-19 prevention behaviour has not been examined. During April 2021, participants (n = 263) completed an online psychometric study assessing engagement with COVID-19 prevention behaviour, traditional DT traits (primary psychopathy; grandiose narcissism) and vulnerable DT traits. Potential indirect effects were fear of COVID-19, perceived coronavirus severity, belief in COVID-19 conspiracy theories and altruism. Model of path analysis identified predictors of engagement in disease prevention behaviour. Primary psychopathy, grandiose narcissism, secondary psychopathy and BPD were associated with less COVID-19 prevention behaviour, with an indirect effect of reduced coronavirus severity. Grandiose narcissism and BPD were also motivated by COVID-19 conspiracy theories, and increased prevention behaviour when fear of COVID-19 was higher. No direct or indirect effects were observed for vulnerable narcissism. The current study is the first to elucidate psychological mechanisms linking vulnerable dark traits with COVID-19 prevention behaviour.

Self-reported Xylazine Experiences: A Mixed Methods Study of Reddit Subscribers

Objectives

Xylazine is an alpha-2 agonist increasingly prevalent in the illicit drug supply. Our objectives were to curate information about xylazine through social media from People Who Use Drugs (PWUDs). Specifically, we sought to answer the following: 1) what are the demographics of Reddit subscribers reporting exposure to xylazine? 2) is xylazine a desired additive? and 3) what adverse effects of xylazine are PWUDs experiencing?

Methods

Natural Language Processing (NLP) was used to identify mentions of "xylazine" from posts by Reddit subscribers who also posted on drug-related subreddits. Posts were qualitatively evaluated for xylazine-related themes. A survey was developed to gather additional information about the Reddit subscribers. This survey was posted on subreddits that were identified by NLP to contain xylazine-related discussions from March 2022 to October 2022.

Results

76 posts mentioning xylazine were extracted via NLP from 765,616 posts by 16,131 Reddit subscribers (January 2018 to August 2021). People on Reddit described xylazine as an unwanted adulterant in their opioid supply. 61 participants completed the survey. Of those that disclosed their location, 25/50 (50%) participants reported locations in the Northeastern United States. The most common eoute of xylazine use was intranasal use (57%). 31/59 (53%) reported experiencing xylazine withdrawal. Frequent adverse events reported were prolonged sedation (81%) and increased skin wounds (43%).

Conclusions

Among respondents on these Reddit forums, xylazine appears to be an unwanted adulterant. PWUDs may be experiencing adverse effects such as prolonged sedation and xylazine withdrawal. This appeared to be more common in the Northeast.

How localized are computational templates? A machine learning approach

A commonly held background assumption about the sciences is that they connect along borders characterized by ontological or explanatory relationships, usually given in the order of mathematics, physics, chemistry, biology, psychology, and the social sciences. Interdisciplinary work, in this picture, arises in the connecting regions of adjacent disciplines. Philosophical research into interdisciplinary model transfer has increasingly complicated this picture by highlighting additional connections orthogonal to it. But most of these works have been done through case studies, which due to their strong focus struggle to provide foundations for claims about large-scale relations between multiple scientific disciplines. As a supplement, in this contribution, we propose to philosophers of science the use of modern science mapping techniques to trace connections between modeling techniques in large literature samples. We explain in detail how these techniques work, and apply them to a large, contemporary, and multidisciplinary data set (n=383.961 articles). Through the comparison of textual to mathematical representations, we suggest formulaic structures that are particularly common among different disciplines and produce first results indicating the general strength and commonality of such relationships.

Trends in Language Use During the COVID-19 Pandemic and Relationship Between Language Use and Mental Health: Text Analysis Based on Free Responses From a Longitudinal Study

BACKGROUND

The COVID-19 pandemic and its associated restrictions have been a major stressor that has exacerbated mental health worldwide. Qualitative data play a unique role in documenting mental states through both language features and content. Text analysis methods can provide insights into the associations between language use and mental health and reveal relevant themes that emerge organically in open-ended responses.

OBJECTIVE

The aim of this web-based longitudinal study on mental health during the early COVID-19 pandemic was to use text analysis methods to analyze free responses to the question, "Is there anything else you would like to tell us that might be important that we did not ask about?" Our goals were to determine whether individuals who responded to the item differed from nonresponders, to determine whether there were associations between language use and psychological status, and to characterize the content of responses and how responses changed over time.

METHODS

A total of 3655 individuals enrolled in the study were asked to complete self-reported measures of mental health and COVID-19 pandemic-related questions every 2 weeks for 6 months. Of these 3655 participants, 2497 (68.32%) provided at least 1 free response (9741 total responses). We used various text analysis methods to measure the links between language use and mental health and to characterize response themes over the first year of the pandemic.

RESULTS

Response likelihood was influenced by demographic factors and health status: those who were male, Asian, Black, or Hispanic were less likely to respond, and the odds of responding increased with age and education as well as with a history of physical health conditions. Although mental health treatment history did not influence the overall likelihood of responding, it was associated with more negative sentiment, negative word use, and higher use of first-person singular pronouns. Responses were dynamically influenced by psychological status such that distress and loneliness were positively associated with an individual's likelihood to respond at a given time point and were associated with more negativity. Finally, the responses were negative in valence overall and exhibited fluctuations linked with external events. The responses covered a variety of topics, with the most common being mental health and emotion, social or physical distancing, and policy and government.

CONCLUSIONS

Our results identify trends in language use during the first year of the pandemic and suggest that both the content of responses and overall sentiments are linked to mental health.

Depression and the risk factors for isolated infectious disease fever patients in the hospital during the COVID-19

Objectives

To compare and analyze the incidence of anxiety and depression of infectious disease fever patients in hospitalized isolation and home isolation during the COVID-19 pandemic, as well as the risk factors for the negative emotions of hospitalized isolation patients.

Methods

Forty isolated infectious disease fever patients in Baoding No.1 Hospital were randomly selected as the study group, and the other 40 isolated infectious disease fever patients at home were randomly selected as the control group from March 2020 to August 2020. The scores and prevalence of depression and anxiety between the two groups were compared and analyzed. The logistic regression analysis was used to judge and analyze the negative psychological factors of hospitalized isolation patients such as depression and anxiety.

Result

The HAMA and HAMD-17 scores of study group are significantly higher than those of control group (HAMA, p=0.00; HAMD-17, p=0.01). The prevalence of anxiety and depression in the study group was significantly higher than that in the control group (p=0.03, p=0.04). The gender (p=0.002), economic status (p=0.004) and isolation attitude (p=0.023) are the related factors of anxiety, among which economic status is the protective factor, while women and resistant attitude are the risk factors. Economic status (p=0.003) and isolation attitude (p=0.001) are the related factors of depression, among which economic status is the protective factor, and resistant attitude is the risk factor.

Conclusion

The prevalence and severity of anxiety and depression in hospitalized isolation patients due to infectious disease fever are significantly higher than those of home isolation patients. The focus groups are women, with bad economic status and poor isolation attitude. Necessary psychological counseling and social support should be provided to these groups to reduce negative emotions and increase the experience of isolated patients.

COVID-19-Related Changes to Drug-Selling Networks and Their Effects on People Who Use Illicit Opioids

OBJECTIVE

The COVID-19 pandemic has significantly affected people's ability to buy, sell, and obtain items that they use in their daily lives. It may have had a particularly negative effect on the ability of people who use illicit opioids to obtain them because the networks they relied on are illicit and not part of the formal economy. Our objective in this research was to examine if, and how, disruptions related to COVID-19 of illicit opioid markets have affected people who use illicit opioids.

METHOD

We collected 300 posts--including replies to posts--related to the intersection of COVID-19 and opioid use from Reddit.com, a forum that has several discussion threads (i.e., subreddits) dedicated to opioids. We then coded posts from the two most popular opioid subreddits during the early pandemic period (March 5, 2020-May 13, 2020) using an inductive/deductive approach.

RESULTS

We found two themes related to active opioid use during the early pandemic: (a) changes in drug supply and difficulty obtaining opioids, and (b) buying less-trustworthy drugs from lesser-known sources.

CONCLUSIONS

Our findings suggest that COVID-19 has created market conditions that place people who use opioids at risk of adverse outcomes, such as fatal overdose.

Prediction for odor gas generation from domestic waste based on machine learning

Domestic waste is prone to produce a variety of volatile organic compounds (VOCs), which often has unpleasant odors. A key process in treating odor gases is predicting the production of odors from domestic waste. In this study, four factors of domestic waste (weight, wet composition, temperature, and fermentation time) were adopted to be the prediction indicators in the prediction for domestic waste odor gases. Machine learning models (Random Forest, XGBoost, LightGBM) were established using the odor intensity values of 512 odor gases from domestic waste. Based on these data, the regression prediction with supervised machine learning was achieved, in which three different algorithmic models were evaluated for prediction performance. A Random Forest model with a R² value of 0.8958 demonstrated the most accurate prediction of the production of domestic waste odor gas based on our data. Furthermore, the prediction results in the Random Forest model were further discussed based on the microbial fermentation of domestic waste. In addition to enhancing our knowledge of the production of odor from domestic waste, we also explore the application of machine learning to odor pollution in our study.

The effect of neurolinguistic programming on academic achievement, emotional intelligence, and critical thinking of EFL learners

Neurolinguistic programming (NLP) is a method of personal communication. This study aimed to determine the effect of NLP strategies on academic achievement, emotional intelligence, and critical thinking. Although NLP has been studied, more studies still need to be conducted on this variable contributing to language learning success. This experimental study was conducted with a pretest-posttest design with the control group in 2021. Sampling was conducted through the multistage cluster random sampling (MCRS) method, and based on the Cambridge placement test (2010), 50 students proved to be at an advanced level and participated in this study. To test the hypotheses, an ANCOVA test was employed. Participants were randomly divided into two control (25 people) and experimental groups (25 people). They were performed on the experimental group during 12 sessions of 90 min of the strategic training in NLP. In the experimental group, the mean and std of critical thinking was 16.24 ± 2.59 in the pretest, which increased to 18.88 ± 2.77 in the posttest; the mean and std of academic achievement was 155.02 ± 15.90 in the pretest, which rose to 171.70 ± 10.83 in the posttest and the mean and std of emotional intelligence was 96.51 ± 12.44 in the pretest, which increased to 118.28 ± 6.18 in the posttest. The results of data analysis by covariance method showed that NLP was practical on learners' academic achievement, emotional intelligence, and critical thinking. Justifications and implications for the study's findings and suggestions for further research are presented.

Early Warning Model of College Students' Psychological Crises Based on Big Data Mining and SEM

In recent years, the psychological problems of college students could not be ignored, as they have seriously affected the growth of students and the normal teaching order of colleges and universities. However, there exists a strong noise in college students' psychological sample data set and a strong correlation between its data. Aiming to solve this problem, this paper proposes a psychological crisis warning method for college students based on big data mining and structural equation model (SEM). This method is oriented to massive user data in social networks. Particle swarm optimization is introduced to improve the random forest algorithm, and the original data is labeled to alleviate the impact of data noise on the recognition accuracy. The simulation example comes from an efficient actual data set in the southern China. The experimental results show that the proposed method can achieve an efficient analysis of actual complex data, and can provide reliable psychological auxiliary diagnosis for practitioners.

Potential Impact of the COVID-19 Pandemic on Public Perception of Water Pipes on Reddit: Observational Study

Background

Socializing is one of the main motivations for water pipe smoking. Restrictions on social gatherings during the COVID-19 pandemic might have influenced water pipe smokers' behaviors. As one of the most popular social media platforms, Reddit has been used to study public opinions and user experiences.

Objective

In this study, we aimed to examine the influence of the COVID-19 pandemic on public perception and discussion of water pipe tobacco smoking using Reddit data.

Methods

We collected Reddit posts between December 1, 2018, and June 30, 2021, from a Reddit archive (PushShift) using keywords such as "waterpipe," "hookah," and "shisha." We examined the temporal trend in Reddit posts mentioning water pipes and different locations (such as homes and lounges or bars). The temporal trend was further tested using interrupted time series analysis. Sentiment analysis was performed to study the change in sentiment of water pipe-related posts before and during the pandemic. Topic modeling using latent Dirichlet allocation (LDA) was used to examine major topics discussed in water pipe-related posts before and during the pandemic.

Results

A total of 45,765 nonpromotion water pipe-related Reddit posts were collected and used for data analysis. We found that the weekly number of Reddit posts mentioning water pipes significantly increased at the beginning of the COVID-19 pandemic (P<.001), and gradually decreased afterward (P<.001). In contrast, Reddit posts mentioning water pipes and lounges or bars showed an opposite trend. Compared to the period before the COVID-19 pandemic, the average number of Reddit posts mentioning lounges or bars was lower at the beginning of the pandemic but gradually increased afterward, while the average number of Reddit posts mentioning the word "home" remained similar during the COVID-19 pandemic (P=.29). While water pipe-related posts with a positive sentiment were dominant (12,526/21,182, 59.14% before the pandemic; 14,686/24,583, 59.74% after the pandemic), there was no change in the proportion of water pipe-related posts with different sentiments before and during the pandemic (P=.19, P=.26, and P=.65 for positive, negative, and neutral posts, respectively). Most topics related to water pipes on Reddit were similar before and during the pandemic. There were more discussions about the opening and closing of hookah lounges or bars during the pandemic.

Conclusions

This study provides a first evaluation of the possible impact of the COVID-19 pandemic on public perceptions of and discussions about water pipes on Reddit.

Linguistic Analysis of Online Domestic Violence Testimonies in the Context of COVID-19

Worldwide, an increase in cases and severity of domestic violence (DV) has been reported as a result of social distancing measures implemented to decrease the spreading of the Coronavirus Disease (COVID-19). As one's language can provide insight in one's mental health, this pre-registered study analyzed word use in a DV online support group, aiming to investigate the impact of the COVID-19 pandemic on DV victims in an ex post facto research design. Words reflecting social support and leisure activities were investigated as protective factors against linguistic indicators of depression in 5,856 posts from the r/domesticviolence subreddit and two neutral comparison subreddits (r/changemyview & r/femalefashionadvice). In the DV support group, the average number of daily posts increased significantly by 22% from pre- to mid-pandemic. Confirmatory analysis was conducted following a registered pre-analysis plan. DV victims used significantly more linguistic indicators of depression than individuals in the comparison groups. This did not change with the onset of COVID-19. The use of negative emotion words was negatively related to the use of social support words (Spearman's rho correlation coefficient [rho] = -0.110) and words referring to leisure activities (rho = -0.137). Pre-occupation with COVID-19 was associated with the use of negative emotion words (rho = 0.148). We conclude that language of DV victims is characterized by indicators of depression and this characteristic is stable over time. Concerns with COVID-19 could contribute to negative emotions, whereas social support and leisure activities could function to some degree as protective factors. A potential weakness of this study is its cross-sectional design and the lack of experimental control. Future studies could make use of natural language processing and other advanced methods of linguistic analysis to learn about the mental health of DV victims.

Mental toll on working women during the COVID-19 pandemic: An exploratory study using Reddit data

COVID-19 has led to an unprecedented surge in unemployment associated with increased anxiety, stress, and loneliness impacting the well-being of various groups of people (based on gender and age). Given the increased unemployment rate, this study intends to understand if the different dimensions of well-being change across age and gender. By quantifying sentiment, stress, and loneliness with natural language processing tools and one-way, between-group multivariate analysis of variance (MANOVA) using Reddit data, we assessed the differences in well-being characteristics for age groups and gender. We see a noticeable increase in the number of mental health-related subreddits for younger women since March 2020 and the trigger words used by them indicate poor mental health caused by relationship and career challenges posed by the pandemic. The MANOVA results show that women under 30 have significantly (p = 0.05) higher negative sentiment, stress, and loneliness levels than other age and gender groups. The results suggest that younger women express their vulnerability on social media more strongly than older women or men. The huge disruption of job routines caused by COVID-19 alongside inadequate relief and benefit programs has wrecked the economy and forced millions of women and families to the edge of bankruptcy. Women had to choose between being home managers and financial providers due to the countrywide shutdown of schools and day-cares. These findings open opportunities to reconsider how policy supports women's responsibilities.

Examining COVID-19 vaccine attitude using SEM-Artificial Neural Networks approach: a case from Reddit community

As new coronavirus variants continue to emerge, in order to better address vaccine-related concerns and promote vaccine uptake in the next few years, the role played by online communities in shaping individuals’ vaccine attitudes has become an important lesson for public health practitioners and policymakers to learn. Examining the mechanism that underpins the impact of participating in online communities on the attitude toward COVID-19 vaccines, this study adopted a two-stage hybrid structural equation modeling (SEM)-artificial neural networks (ANN) approach to analyze the survey responses from 1037 Reddit community members. Findings from SEM demonstrated that in leading up to positive COVID-19 vaccine attitudes, sense of online community mediates the positive effects of perceived emotional support and social media usage, and perceived social norm mediates the positive effect of sense of online community as well as the negative effect of political conservatism. Health self-efficacy plays a moderating role between perceived emotional support and perceived social norm of COVID-19 vaccination. Results from the ANN model showed that online community members’ perceived social norm of COVID-19 vaccination acts as the most important predictor of positive COVID-19 vaccine attitudes. This study highlights the importance of harnessing online communities in designing COVID-related public health interventions and accelerating normative change in relation to vaccination.

Connectedness in the time of COVID-19: Reddit as a source of support for coping with suicidal thinking

The COVID-19 pandemic is adversely impacting suicidality at a population level, with consequences resulting from a variety of pandemic-driven disruptions, including social activities and connectedness. This paper uses a single case study design to explore how members of the Reddit r/COVID19_support community create a sense of connectedness among those who have suicidal thoughts due to the pandemic. Data were gathered from posts to the r/COVID19_support subreddit forum from February 2020 through December 2020. The second step of Klonsky and May's (2015) Three-Step Theory (3ST) of suicide, connectedness as a key protective factor, was used as the theoretical framework. This study explored r/COVID19_support's constructed environment, users' dialogical interactions, and the four primary tenets of connectedness as proposed by Klonsky and May - Purpose and Meaning, Relationships, Religiosity, and Employment. Findings demonstrate a deep sense of connectedness for online community members. Relationships and Purpose and Meaning featured as the most salient sources of connectedness within this subreddit, whereas Religiosity was rarely discussed, and Employment was often spoken of in negative terms (i.e., creating mental distress, rather than facilitating connectedness). Contributors' responses offered various opportunities for connectedness both on- and off-line. Safe online spaces, such as r/COVID19_support, can serve as a protective factor amid suicidality, facilitating connectedness, and thereby helping to curtail suicidal thoughts from advancing to suicidal actions. This subreddit and similar online spaces can benefit specific populations who may otherwise find it challenging to access services or who wish to remain anonymous.

Digital Phenotyping Data to Predict Symptom Improvement and App Personalization: Protocol for a Prospective Study

Background

Smartphone apps that capture surveys and sensors are increasingly being leveraged to collect data on clinical conditions. In mental health, this data could be used to personalize psychiatric support offered by apps so that they are more effective and engaging. Yet today, few mental health apps offer this type of support, often because of challenges associated with accurately predicting users’ actual future mental health.

Objective

In this protocol, we present a study design to explore engagement with mental health apps in college students, using the Technology Acceptance Model as a theoretical framework, and assess the accuracy of predicting mental health changes using digital phenotyping data.

Methods

There are two main goals of this study. First, we present a logistic regression model fit on data from a prior study on college students and prospectively test this model on a new student cohort to assess its accuracy. Second, we will provide users with data-driven activity suggestions every 4 days to determine whether this type of personalization will increase engagement or attitudes toward the app compared to those receiving no personalized recommendations.

Results

The study was completed in the spring of 2022, and the manuscript is currently in review at JMIR Publications.

Conclusions

This is one of the first digital phenotyping algorithms to be prospectively validated. Overall, our results will inform the potential of digital phenotyping data to serve as tailoring data in adaptive interventions and to increase rates of engagement.

International Registered Report Identifier (IRRID)

PRR1-10.2196/37954

Artificial intelligence-based analytics for impacts of COVID-19 and online learning on college students’ mental health

COVID-19, the disease caused by the novel coronavirus (SARS-CoV-2), first emerged in Wuhan, China late in December 2019. Not long after, the virus spread worldwide and was declared a pandemic by the World Health Organization in March 2020. This caused many changes around the world and in the United States, including an educational shift towards online learning. In this paper, we seek to understand how the COVID-19 pandemic and the increase in online learning impact college students’ emotional wellbeing. We use several machine learning and statistical models to analyze data collected by the Faculty of Public Administration at the University of Ljubljana, Slovenia in conjunction with an international consortium of universities, other higher education institutions, and students’ associations. Our results indicate that features related to students’ academic life have the largest impact on their emotional wellbeing. Other important factors include students’ satisfaction with their university’s and government’s handling of the pandemic as well as students’ financial security.

The Role of Natural Language Processing during the COVID-19 Pandemic: Health Applications, Opportunities, and Challenges

The COVID-19 pandemic is the most devastating public health crisis in at least a century and has affected the lives of billions of people worldwide in unprecedented ways. Compared to pandemics of this scale in the past, societies are now equipped with advanced technologies that can mitigate the impacts of pandemics if utilized appropriately. However, opportunities are currently not fully utilized, particularly at the intersection of data science and health. Health-related big data and technological advances have the potential to significantly aid the fight against such pandemics, including the current pandemic's ongoing and long-term impacts. Specifically, the field of natural language processing (NLP) has enormous potential at a time when vast amounts of text-based data are continuously generated from a multitude of sources, such as health/hospital systems, published medical literature, and social media. Effectively mitigating the impacts of the pandemic requires tackling challenges associated with the application and deployment of NLP systems. In this paper, we review the applications of NLP to address diverse aspects of the COVID-19 pandemic. We outline key NLP-related advances on a chosen set of topics reported in the literature and discuss the opportunities and challenges associated with applying NLP during the current pandemic and future ones. These opportunities and challenges can guide future research aimed at improving the current health and social response systems and pandemic preparedness.

COVID-19 sentiment analysis using college subreddit data

BACKGROUND

The COVID-19 pandemic has affected our society and human well-being in various ways. In this study, we investigate how the pandemic has influenced people's emotions and psychological states compared to a pre-pandemic period using real-world data from social media.

METHOD

We collected Reddit social media data from 2019 (pre-pandemic) and 2020 (pandemic) from the subreddits communities associated with eight universities. We applied the pre-trained Robustly Optimized BERT pre-training approach (RoBERTa) to learn text embedding from the Reddit messages, and leveraged the relational information among posted messages to train a graph attention network (GAT) for sentiment classification. Finally, we applied model stacking to combine the prediction probabilities from RoBERTa and GAT to yield the final classification on sentiment. With the model-predicted sentiment labels on the collected data, we used a generalized linear mixed-effects model to estimate the effects of pandemic and in-person teaching during the pandemic on sentiment.

RESULTS

The results suggest that the odds of negative sentiments in 2020 (pandemic) were 25.7% higher than the odds in 2019 (pre-pandemic) with a p-value < 0.001; and the odds of negative sentiments associated in-person learning were 48.3% higher than with remote learning in 2020 with a p-value of 0.029.

CONCLUSIONS

Our study results are consistent with the findings in the literature on the negative impacts of the pandemic on people's emotions and psychological states. Our study contributes to the growing real-world evidence on the various negative impacts of the pandemic on our society; it also provides a good example of using both ML techniques and statistical modeling and inference to make better use of real-world data.

Perspectives of the COVID-19 Pandemic on Reddit: Comparative Natural Language Processing Study of the United States, the United Kingdom, Canada, and Australia

Background

Since COVID-19 was declared a pandemic by the World Health Organization on March 11, 2020, the disease has had an unprecedented impact worldwide. Social media such as Reddit can serve as a resource for enhancing situational awareness, particularly regarding monitoring public attitudes and behavior during the crisis. Insights gained can then be utilized to better understand public attitudes and behaviors during the COVID-19 crisis, and to support communication and health-promotion messaging.

Objective

The aim of this study was to compare public attitudes toward the 2020-2021 COVID-19 pandemic across four predominantly English-speaking countries (the United States, the United Kingdom, Canada, and Australia) using data derived from the social media platform Reddit.

Methods

We utilized a topic modeling natural language processing method (more specifically latent Dirichlet allocation). Topic modeling is a popular unsupervised learning technique that can be used to automatically infer topics (ie, semantically related categories) from a large corpus of text. We derived our data from six country-specific, COVID-19–related subreddits (r/CoronavirusAustralia, r/CoronavirusDownunder, r/CoronavirusCanada, r/CanadaCoronavirus, r/CoronavirusUK, and r/coronavirusus). We used topic modeling methods to investigate and compare topics of concern for each country.

Results

Our consolidated Reddit data set consisted of 84,229 initiating posts and 1,094,853 associated comments collected between February and November 2020 for the United States, the United Kingdom, Canada, and Australia. The volume of posting in COVID-19–related subreddits declined consistently across all four countries during the study period (February 2020 to November 2020). During lockdown events, the volume of posts peaked. The UK and Australian subreddits contained much more evidence-based policy discussion than the US or Canadian subreddits.

Conclusions

This study provides evidence to support the contention that there are key differences between salient topics discussed across the four countries on the Reddit platform. Further, our approach indicates that Reddit data have the potential to provide insights not readily apparent in survey-based approaches.

Emotional discourse analysis of COVID-19 patients and their mental health: A text mining study

COVID-19 has caused negative emotional responses in patients, with significant mental health consequences for the infected population. The need for an in-depth analysis of the emotional state of COVID-19 patients is imperative. This study employed semi-structured interviews and the text mining method to investigate features in lived experience narratives of COVID-19 patients and healthy controls with respect to five basic emotions. The aim was to identify differences in emotional status between the two matched groups of participants. The results indicate generally higher complexity and more expressive emotional language in healthy controls than in COVID-19 patients. Specifically, narratives of fear, happiness, and sadness by COVID-19 patients were significantly shorter as compared to healthy controls. Regarding lexical features, COVID-19 patients used more emotional words, in particular words of fear, disgust, and happiness, as opposed to those used by healthy controls. Emotional disorder symptoms of COVID-19 patients at the lexical level tended to focus on the emotions of fear and disgust. They narrated more in relation to self or family while healthy controls mainly talked about others. Our automatic emotional discourse analysis potentially distinguishes clinical status of COVID-19 patients versus healthy controls, and can thus be used to predict mental health disorder symptoms in COVID-19 patients.

Social media mining under the COVID-19 context: Progress, challenges, and opportunities

Social media platforms allow users worldwide to create and share information, forging vast sensing networks that allow information on certain topics to be collected, stored, mined, and analyzed in a rapid manner. During the COVID-19 pandemic, extensive social media mining efforts have been undertaken to tackle COVID-19 challenges from various perspectives. This review summarizes the progress of social media data mining studies in the COVID-19 contexts and categorizes them into six major domains, including early warning and detection, human mobility monitoring, communication and information conveying, public attitudes and emotions, infodemic and misinformation, and hatred and violence. We further document essential features of publicly available COVID-19 related social media data archives that will benefit research communities in conducting replicable and reproducible studies. In addition, we discuss seven challenges in social media analytics associated with their potential impacts on derived COVID-19 findings, followed by our visions for the possible paths forward in regard to social media-based COVID-19 investigations. This review serves as a valuable reference that recaps social media mining efforts in COVID-19 related studies and provides future directions along which the information harnessed from social media can be used to address public health emergencies.

Psycholinguistic changes in the communication of adolescent users in a suicidal ideation online community during the COVID-19 pandemic

Since the outbreak of the COVID-19 pandemic, increases in suicidal ideation and suicide attempts in adolescents have been registered. Many adolescents experiencing suicidal ideation turn to online communities for social support. In this retrospective observational study, we investigated the communication-language style, contents and user activity-in 7975 unique posts and 51,119 comments by N = 2862 active adolescent users in a large suicidal ideation support community (SISC) on the social media website reddit.com in the onset period of the COVID-19 pandemic. We found significant relative changes in language style markers for hopelessness such as negative emotion words (+ 10.00%) and positive emotion words (- 3.45%) as well as for social disengagement such as social references (- 8.63%) and 2nd person pronouns (- 33.97%) since the outbreak of the pandemic. Using topic modeling with Latent Dirichlet Allocation (LDA), we identified significant changes in content for the topics Hopelessness (+ 23.98%), Suicide Methods (+ 17.11%), Social Support (- 14.91%), and Reaching Out to users (- 28.97%). Changes in user activity point to an increased expression of mental health issues and decreased engagement with other users. The results indicate a potential shift in communication patterns with more adolescent users expressing their suicidal ideation rather than relating with or supporting other users during the COVID-19 pandemic.

Exploring Reddit conversations about mental health difficulties among college students during the COVID-19 pandemic

Objective: We aimed to explore conversations about mental health difficulties by Reddit users who posted within college subreddits during the COVID-19 pandemic. Participants: Data were collected from the subreddits of 22 California campuses, representing 113,579 anonymous members. Using the following search terms, we retrieved 577 posts (ie, 268 original posts and 309 replies): COVID, Coronavirus, Quarantine, Pandemic, Anxiety, Anxious, Depressed, Depression, Overwhelmed, Stress, and Stressed. Methods: We used inductive, thematic data analysis to explore themes within posts and replies dated from 3/16/2020 to 3/16/2021. Results: We identified the following themes: 1) the COVID-19 pandemic has negatively impacted engagement with learning; 2) remote learning has exacerbated students' mental health difficulties; and 3) students provide and receive social support online. Conclusions: These findings have implications that are particularly relevant as campuses are faced with continuous decisions related to repopulation.

Can machine learning models predict maternal and newborn healthcare providers' perception of safety during the COVID-19 pandemic? A cross-sectional study of a global online survey

BACKGROUND

Maternal and newborn healthcare providers are essential professional groups vulnerable to physical and psychological risks associated with the COVID-19 pandemic. This study uses machine learning algorithms to create a predictive tool for maternal and newborn healthcare providers' perception of being safe in the workplace globally during the pandemic.

METHODS

We used data collected between 24 March and 5 July 2020 through a global online survey of maternal and newborn healthcare providers. The questionnaire was available in 12 languages. To predict healthcare providers' perception of safety in the workplace, we used features collected in the questionnaire, in addition to publicly available national economic and COVID-19-related factors. We built, trained and tested five machine learning models: Support Vector Machine (SVM), Random Forest (RF), XGBoost, CatBoost and Artificial Neural Network (ANN) for classification and regression. We extracted from RF models the relative contribution of features in output prediction.

RESULTS

Models included data from 941 maternal and newborn healthcare providers from 89 countries. ML models performed well in classification and regression tasks, whereby RF had 82% cross-validated accuracy for classification, and CatBoost with 0.46 cross-validated root mean square error for regression. In both classification and regression, the most important features contributing to output prediction were classified as three themes: (1) information accessibility, clarity and quality; (2) availability of support and means of protection; and (3) COVID-19 epidemiology.

CONCLUSION

This study identified salient features contributing to maternal and newborn healthcare providers perception of safety in the workplace. The developed tool can be used by health systems globally to allow real-time learning from data collected during a health system shock. By responding in real-time to the needs of healthcare providers, health systems could prevent potential negative consequences on the quality of care offered to women and newborns.

Turning data into better mental health: Past, present, and future

In this mini-review, we discuss the fundamentals of using technology in mental health diagnosis and tracking. We highlight those principles using two clinical concepts: (1) cravings and relapse in the context of addictive disorders and (2) anhedonia in the context of depression. This manuscript is useful for both clinicians wanting to understand the scope of technology use in psychiatry and for computer scientists and engineers wishing to assess psychiatric frameworks useful for diagnosis and treatment. The increase in smartphone ownership and internet connectivity, as well as the accelerated development of wearable devices, have made the observation and analysis of human behavior patterns possible. This has, in turn, paved the way to understand mental health conditions better. These technologies have immense potential in facilitating the diagnosis and tracking of mental health conditions; they also allow the implementation of existing behavioral treatments in new contexts (e.g., remotely, online, and in rural/underserved areas), and the possibility to develop new treatments based on new understanding of behavior patterns. The path to understand how to best use technology in mental health includes the need to match interdisciplinary frameworks from engineering/computer sciences and psychiatry. Thus, we start our review by introducing bio-behavioral sensing, the types of information available, and what behavioral patterns they may reflect and be related to in psychiatric diagnostic frameworks. This information is linked to the use of functional imaging, highlighting how imaging modalities can be considered "ground truth" for mental health/psychiatric dimensions, given the heterogeneity of clinical presentations, and the difficulty of determining what symptom corresponds to what disease. We then discuss how mental health/psychiatric dimensions overlap, yet differ from, psychiatric diagnoses. Using two clinical examples, we highlight the potential agreement areas in assessment/management of anhedonia and cravings. These two dimensions were chosen because of their link to two very prevalent diseases worldwide: depression and addiction. Anhedonia is a core symptom of depression, which is one of the leading causes of disability worldwide. Cravings, the urge to use a substance or perform an action (e.g., shopping, internet), is the leading step before relapse. Lastly, through the manuscript, we discuss potential mental health dimensions.