Natural Language Processing of Social Media as Screening for Suicide Risk

"Instead, You're Going to a Friend": Evaluation of a Community-Developed, Peer-Delivered Online Crisis Prevention Intervention

OBJECTIVE

Online communities promote social connection and can be used for formal peer support and crisis intervention. Although some communities have programs to support their members' mental health, few programs have been formally evaluated. The authors present findings from a mixed-methods evaluation of the Stack Up Overwatch Program (StOP), a digital peer support intervention delivered in an online gaming community.

METHODS

Data were collected from members of the Stack Up Discord server between June and October 2020 and included chat messages, survey responses, encounter forms (documenting information from private interactions between users and peer supporters), and interviews with peer support team members. The authors analyzed data on demographic characteristics, mental health and crises, use of and experiences with StOP, and chat posts. Thematic analysis and descriptive statistics were combined in a joint display table, with mixed-methods findings explained in narrative form.

RESULTS

The findings show that StOP provides users in crisis with a source of mental health support when other options have been exhausted and that military and veteran users valued the connections and friendships they formed while using it. Participants reported that StOP met needs for support and connection when formal services were inaccessible or did not meet their needs, and volunteer peer supporters detailed how StOP's design facilitates use of the intervention. Volunteering offered members of the peer support team a "family feeling" facilitated by the unique chat room structure.

CONCLUSIONS

Community-based crisis prevention programs administered through chat rooms may provide valuable support to both users and peer support providers.

Cohort profile: The Social media, smartphone use and Self-harm in Young People (3S-YP) study-A prospective, observational cohort study of young people in contact with mental health services

OBJECTIVES

The Social media, Smartphone use and Self-Harm (3S-YP) study is a prospective observational cohort study to investigate the mechanisms underpinning associations between social media and smartphone use and self-harm in a clinical youth sample. We present here a comprehensive description of the cohort from baseline data and an overview of data available from baseline and follow-up assessments.

METHODS

Young people aged 13-25 years were recruited from a mental health trust in England and followed up for 6 months. Self-report data was collected at baseline and monthly during follow-up and linked with electronic health records (EHR) and user-generated data.

FINDINGS

A total of 362 young people enrolled and provided baseline questionnaire data. Most participants had a history of self-harm according to clinical (n = 295, 81.5%) and broader definitions (n = 296, 81.8%). At baseline, there were high levels of current moderate/severe anxiety (n = 244; 67.4%), depression (n = 255; 70.4%) and sleep disturbance (n = 171; 47.2%). Over half used social media and smartphones after midnight on weekdays (n = 197, 54.4%; n = 215, 59.4%) and weekends (n = 241, 66.6%; n = 263, 72.7%), and half met the cut-off for problematic smartphone use (n = 177; 48.9%). Of the cohort, we have questionnaire data at month 6 from 230 (63.5%), EHR data from 345 (95.3%), social media data from 110 (30.4%) and smartphone data from 48 (13.3%).

CONCLUSION

The 3S-YP study is the first prospective study with a clinical youth sample, for whom to investigate the impact of digital technology on youth mental health using novel data linkages. Baseline findings indicate self-harm, anxiety, depression, sleep disturbance and digital technology overuse are prevalent among clinical youth. Future analyses will explore associations between outcomes and exposures over time and compare self-report with user-generated data in this cohort.

Examining the Gateway Hypothesis and Mapping Substance Use Pathways on Social Media: Machine Learning Approach

BACKGROUND

Substance misuse presents significant global public health challenges. Understanding transitions between substance types and the timing of shifts to polysubstance use is vital to developing effective prevention and recovery strategies. The gateway hypothesis suggests that high-risk substance use is preceded by lower-risk substance use. However, the source of this correlation is hotly contested. While some claim that low-risk substance use causes subsequent, riskier substance use, most people using low-risk substances also do not escalate to higher-risk substances. Social media data hold the potential to shed light on the factors contributing to substance use transitions.

OBJECTIVE

By leveraging social media data, our study aimed to gain a better understanding of substance use pathways. By identifying and analyzing the transitions of individuals between different risk levels of substance use, our goal was to find specific linguistic cues in individuals' social media posts that could indicate escalating or de-escalating patterns in substance use.

METHODS

We conducted a large-scale analysis using data from Reddit, collected between 2015 and 2019, consisting of over 2.29 million posts and approximately 29.37 million comments by around 1.4 million users from subreddits. These data, derived from substance use subreddits, facilitated the creation of a risk transition data set reflecting the substance use behaviors of over 1.4 million users. We deployed deep learning and machine learning techniques to predict the escalation or de-escalation transitions in risk levels, based on initial transition phases documented in posts and comments. We conducted a linguistic analysis to analyze the language patterns associated with transitions in substance use, emphasizing the role of n-gram features in predicting future risk trajectories.

RESULTS

Our results showed promise in predicting the escalation or de-escalation transition in risk levels, based on the historical data of Reddit users created on initial transition phases among drug-related subreddits, with an accuracy of 78.48% and an F1-score of 79.20%. We highlighted the vital predictive features, such as specific substance names and tools indicative of future risk escalations. Our linguistic analysis showed that terms linked with harm reduction strategies were instrumental in signaling de-escalation, whereas descriptors of frequent substance use were characteristic of escalating transitions.

CONCLUSIONS

This study sheds light on the complexities surrounding the gateway hypothesis of substance use through an examination of web-based behavior on Reddit. While certain findings validate the hypothesis, indicating a progression from lower-risk substances such as marijuana to higher-risk ones, a significant number of individuals did not show this transition. The research underscores the potential of using machine learning with social media analysis to predict substance use transitions. Our results point toward future directions for leveraging social media data in substance use research, underlining the importance of continued exploration before suggesting direct implications for interventions.

Suicide prevention in Hong Kong: pushing boundaries while building bridges

Hong Kong is a natural laboratory for studying suicides-small geographic footprint, bustling economic activity, rapidly changing socio-demographic transitions, and cultural crossroads. Its qualities also intensify the challenges posed when seeking to prevent them. In this viewpoint, we showed the research and practices of suicide prevention efforts made by the Hong Kong Jockey Club Centre for Suicide Research and Prevention (CSRP), which provide the theoretical underpinning of suicide prevention and empirical evidence. CSRP adopted a multi-level public health approach (universal, selective and indicated), and has collaboratively designed, implemented, and evaluated numerous programs that have demonstrated effectiveness in suicide prevention and mental well-being promotion. The center serves as a hub and a catalyst for creating, identifying, deploying, and evaluating suicide prevention initiatives, which have the potential to reduce regional suicides rates when taken to scale and sustained.

A Linguistic Analysis of Instagram Captions Between Adolescent Suicide Decedents and Living Controls

Background: Suicide rates continue to rise for adolescents in the United States. 62% of teenagers use Instagram, and as technology and research in this domain advance, social media posts could provide insights into near-term adolescent risk states and could inform new strategies for suicide prevention. This study analyzed language in captions of teenagers' Instagram accounts in the 3 months before suicide and compared caption language to matched living controls. Method: The study identified 89 teenagers who died by suicide using obituaries and news reports and 89 matched living control teenagers. Linguistic Inquiry and Word Count (LIWC) software was used to test for differences in specific language categories across linguistic, psychological, and topical categories (e.g., word count, tone, grammar, affective, cognitive, social, punctuation marks, etc.). Results: Significant differences between suicide decedents and living controls were found. Adolescent suicide decedents used more words per sentence, more references to sadness, male individuals, drives, and leisure and fewer verbs and references to they, affiliation, achievement, and power. Limitations: Methodological limitations include the use of only public accounts, small sample size, occasional short posts, and lack of adjustment for multiple testing. Conclusion: Although the sample size is relatively small and only included youth with public accounts, we identified differences in Instagram caption language between adolescents who died by suicide as compared to living controls.

The Promises and Possibilities of Artificial Intelligence in the Delivery of Behavior Analytic Services

Artificial intelligence (AI) has begun to affect nearly every aspect of our daily lives and nearly every industry and profession. Many readers of this journal likely work in one or more areas of behavioral health. For readers who work in behavioral health and who are interested in AI, the purpose of this article is to highlight the pervasiveness of AI research being conducted around many facets of behavioral health service delivery. To do this, we first provide a brief overview of some of the areas within AI and the types of problems each area of AI attempts to solve. We then outline the prototypical client journey in behavioral healthcare beginning with diagnosis/assessment and ending with intervention withdrawal or ongoing monitoring. Next, for each stage in the client journey, we highlight several areas that parallel existing behavior analytic practice where researchers have begun to use AI, often to improve the efficiency of service delivery or to learn new things that improve the effectiveness of behavioral health services. Finally, for those whose appetite has been whet for getting involved with AI, we close by describing three roles they might consider trying out and that parallel the three main domains of behavior analysis. These three roles are an AI tool designer (akin to EAB), AI tool implementer (akin to ABA), or AI tool supporter (akin to practice).

Exploring the Potential of Artificial Intelligence in Adolescent Suicide Prevention: Current Applications, Challenges, and Future Directions

ObjectiveThe global surge in adolescent suicide necessitates the development of innovative and efficacious preventive measures. Traditionally, various approaches have been used, but with limited success. However, with the rapid advancements in artificial intelligence (AI), new possibilities have emerged. This paper reviews the potentials and challenges of integrating AI into suicide prevention strategies, focusing on adolescents. Method: This narrative review assesses the impact of AI on suicide prevention strategies, the strategies and cases of AI applications in adolescent suicide prevention, as well as the challenges faced. Through searches on the PubMed, web of science, PsycINFO, and EMBASE databases, 19 relevant articles were included in the review. Results: AI has significantly improved risk assessment and predictive modeling for identifying suicidal behavior. It has enabled the analysis of textual data through natural language processing and fostered novel intervention strategies. Although AI applications, such as chatbots and monitoring systems, show promise, they must navigate challenges like data privacy and ethical considerations. The research underscores the potential of AI to enhance future suicide prevention efforts through personalized interventions and integration with emerging technologies. Conclusion: AI possesses transformative potential for adolescent suicide prevention by offering targeted and adaptive solutions, while they also raise crucial ethical and practical considerations. Looking forward, AI can play a critical role in mitigating adolescent suicide rates, marking a new frontier in mental health care.

What can we learn from a Chinese social media used by glaucoma patients?

PURPOSE

Our study aims to discuss glaucoma patients' needs and Internet habits using big data analysis and Natural Language Processing (NLP) based on deep learning (DL).

METHODS

In this retrospective study, we used web crawler technology to crawl glaucoma-related topic posts from the glaucoma bar of Baidu Tieba, China. According to the contents of topic posts, we classified them into posts with seeking medical advice and without seeking medical advice (social support, expressing emotions, sharing knowledge, and others). Word Cloud and frequency statistics were used to analyze the contents and visualize the keywords of topic posts. Two DL models, Bidirectional Long Short-Term Memory (Bi-LSTM) and Bidirectional Encoder Representations from Transformers (BERT), were trained to identify the posts seeking medical advice. The evaluation matrices included: accuracy, F1 value, and the area under the ROC curve (AUC).

RESULTS

A total of 10,892 topic posts were included, among them, most were seeking medical advice (N = 7071, 64.91%), and seeking advice regarding symptoms or examination (N = 4913, 45.11%) dominated the majority. The following were searching for social support (N = 2362, 21.69%), expressing emotions (N = 497, 4.56%), and sharing knowledge (N = 527, 4.84%) in sequence. The word cloud analysis results showed that ocular pressure, visual field, examination, and operation were the most frequent words. The accuracy, F1 score, and AUC were 0.891, 0.891, and 0.931 for the BERT model, 0.82, 0.821, and 0.890 for the Bi-LSTM model.

CONCLUSION

Social media can help enhance the patient-doctor relationship by providing patients' concerns and cognition about glaucoma in China. NLP can be a powerful tool to reflect patients' focus on diseases. DL models performed well in classifying Chinese medical-related texts, which could play an important role in public health monitoring.

Helicopter parenting through the lens of reddit: A text mining study

The study aimed to understand Reddit users' experience with helicopter parenting through first-hand accounts. Text mining and natural language processing techniques were employed to extract data from the subreddit r/helicopterparents. A total of 713 original posts were processed from unstructured texts to tidy formats. Latent Dirichlet Allocation (LDA), a popular topic modeling method, was used to discover hidden themes within the corpus. The data revealed common environmental contexts of helicopter parenting (i.e., school, college, work, and home) and its implication on college decisions, privacy, and social relationships. These collectively suggested the importance of autonomy-supportive parenting and mindfulness interventions as viable solutions to the problems posed by helicopter parenting. In addition, findings lent support to past research that has identified more maternal than paternal models of helicopter parenting. Further research on the implications of the COVID-19 pandemic on helicopter parenting is warranted.

Comparing Naturalistic Mental Health Expressions on Student Loan Debts Using Reddit and Twitter

PURPOSE

The primary objective of this study was to identify patterns in users' naturalistic expressions on student loans on two social media platforms. The secondary objective was to examine how these patterns, sentiments, and emotions associated with student loans differ in user posts indicating mental illness.

MATERIAL AND METHOD

Data for this study were collected from Reddit and Twitter (2009-2020, n = 85,664) using certain key terms of student loans along with first-person pronouns as a triangulating measure of posts by individuals. Unsupervised and supervised machine learning models were used to analyze the text data.

RESULTS

Results suggested 50 topics in reddit finance and 40 each in reddit mental health communities and Twitter. Statistically significant associations were found between mental illness statuses and sentiments and emotions. Posts expressing mental illness showed more negative sentiments and were more likely to express sadness and fear.

DISCUSSION AND CONCLUSION

Patterns in social media discussions indicate both academic and non-academic consequences of having student debt, including users' desire to know more about their debts. Interventions should address the skill and information gaps between what is desired by the borrowers and what is offered to them in understanding and managing their debts. Cognitive burden created by student debts manifest itself on social media and can be used as an important marker to develop a nuanced understanding of people's expressions on a variety of socioeconomic issues. Higher volumes of negative sentiments and emotions of sadness, fear, and anger warrant immediate attention of policymakers and practitioners to reduce the cognitive burden of student debts.

Assessing Vulnerability to Surges in Suicide-Related Tweets Using Japan Census Data: Case-Only Study

BACKGROUND

As the use of social media becomes more widespread, its impact on health cannot be ignored. However, limited research has been conducted on the relationship between social media and suicide. Little is known about individuals' vulnerable to suicide, especially when social media suicide information is extremely prevalent.

OBJECTIVE

This study aims to identify the characteristics underlying individuals' vulnerability to suicide brought about by an increase in suicide-related tweets, thereby contributing to public health.

METHODS

A case-only design was used to investigate vulnerability to suicide using individual data of people who died by suicide and tweet data from January 1, 2011, through December 31, 2014. Mortality data were obtained from Japanese government statistics, and tweet data were provided by a commercial service. Tweet data identified the days when suicide-related tweets surged, and the date-keyed merging was performed by considering 3 and 7 lag days. For the merged data set for analysis, the logistic regression model was fitted with one of the personal characteristics of interest as a dependent variable and the dichotomous exposure variable. This analysis was performed to estimate the interaction between the surges in suicide-related tweets and personal characteristics of the suicide victims as case-only odds ratios (ORs) with 95% CIs. For the sensitivity analysis, unexpected deaths other than suicide were considered.

RESULTS

During the study period, there were 159,490 suicides and 115,072 unexpected deaths, and the number of suicide-related tweets was 2,804,999. Following the 3-day lag of a highly tweeted day, there were significant interactions for those who were aged 40 years or younger (OR 1.09, 95% CI 1.03-1.15), male (OR 1.12, 95% CI 1.07-1.18), divorced (OR 1.11, 95% CI 1.03 1.19), unemployed (OR 1.12, 95% CI 1.02-1.22), and living in urban areas (OR 1.26, 95% CI 1.17 1.35). By contrast, widowed individuals had significantly lower interactions (OR 0.83, 95% CI 0.77-0.89). Except for unemployment, significant relationships were also observed for the 7-day lag. For the sensitivity analysis, no significant interactions were observed for other unexpected deaths in the 3-day lag, and only the widowed had a significantly larger interaction than those who were married (OR 1.08, 95% CI 1.02-1.15) in the 7-day lag.

CONCLUSIONS

This study revealed the interactions of personal characteristics associated with susceptibility to suicide-related tweets. In addition, a few significant relationships were observed in the sensitivity analysis, suggesting that such an interaction is specific to suicide deaths. In other words, individuals with these characteristics, such as being young, male, unemployed, and divorced, may be vulnerable to surges in suicide-related tweets. Thus, minimizing public health strain by identifying people who are vulnerable and susceptible to a surge in suicide-related information on the internet is necessary.

Twitter-based gender recognition using transformers

Social media contains useful information about people and society that could help advance research in many different areas of health (e.g. by applying opinion mining, emotion/sentiment analysis and statistical analysis) such as mental health, health surveillance, socio-economic inequality and gender vulnerability. User demographics provide rich information that could help study the subject further. However, user demographics such as gender are considered private and are not freely available. In this study, we propose a model based on transformers to predict the user's gender from their images and tweets. The image-based classification model is trained in two different methods: using the profile image of the user and using various image contents posted by the user on Twitter. For the first method a Twitter gender recognition dataset, publicly available on Kaggle and for the second method the PAN-18 dataset is used. Several transformer models, i.e. vision transformers (ViT), LeViT and Swin Transformer are fine-tuned for both of the image datasets and then compared. Next, different transformer models, namely, bidirectional encoders representations from transformers (BERT), RoBERTa and ELECTRA are fine-tuned to recognize the user's gender by their tweets. This is highly beneficial, because not all users provide an image that indicates their gender. The gender of such users could be detected from their tweets. The significance of the image and text classification models were evaluated using the Mann-Whitney U test. Finally, the combination model improved the accuracy of image and text classification models by 11.73 and 5.26% for the Kaggle dataset and by 8.55 and 9.8% for the PAN-18 dataset, respectively. This shows that the image and text classification models are capable of complementing each other by providing additional information to one another. Our overall multimodal method has an accuracy of 88.11% for the Kaggle and 89.24% for the PAN-18 dataset and outperforms state-of-the-art models. Our work benefits research that critically require user demographic information such as gender to further analyze and study social media content for health-related issues.

Suicide risk detection using artificial intelligence: the promise of creating a benchmark dataset for research on the detection of suicide risk

Suicide is a leading cause of death that demands cross-disciplinary research efforts to develop and deploy suicide risk screening tools. Such tools, partly informed by influential suicide theories, can help identify individuals at the greatest risk of suicide and should be able to predict the transition from suicidal thoughts to suicide attempts. Advances in artificial intelligence have revolutionized the development of suicide screening tools and suicide risk detection systems. Thus, various types of AI systems, including text-based systems, have been proposed to identify individuals at risk of suicide. Although these systems have shown acceptable performance, most of them have not incorporated suicide theories in their design. Furthermore, directly applying suicide theories may be difficult because of the diversity and complexity of these theories. To address these challenges, we propose an approach to develop speech- and language-based suicide risk detection systems. We highlight the promise of establishing a benchmark textual and vocal dataset using a standardized speech and language assessment procedure, and research designs that distinguish between the risk factors for suicide attempt above and beyond those for suicidal ideation alone. The benchmark dataset could be used to develop trustworthy machine learning or deep learning-based suicide risk detection systems, ultimately constructing a foundation for vocal and textual-based suicide risk detection systems.

Mental health at different stages of cancer survival: a natural language processing study of Reddit posts

Introduction

The purpose of this study was to use text-based social media content analysis from cancer-specific subreddits to evaluate depression and anxiety-loaded content. Natural language processing, automatic, and lexicon-based methods were employed to perform sentiment analysis and identify depression and anxiety-loaded content.

Methods

Data was collected from 187 Reddit users who had received a cancer diagnosis, were currently undergoing treatment, or had completed treatment. Participants were split according to survivorship status into short-term, transition, and long-term cancer survivors. A total of 72524 posts were analyzed across the three cancer survivor groups.

Results

The results showed that short-term cancer survivors had significantly more depression-loaded posts and more anxiety-loaded words than long-term survivors, with no significant differences relative to the transition period. The topic analysis showed that long-term survivors, more than other stages of survivorship, have resources to share their experiences with suicidal ideation and mental health issues while providing support to their survivor community.

Discussion

The results indicate that Reddit texts seem to be an indicator of when the stressor is active and mental health issues are triggered. This sets the stage for Reddit to become a platform for screening and first-hand intervention delivery. Special attention should be dedicated to short-term survivors.

Public Surveillance of Social Media for Suicide Using Advanced Deep Learning Models in Japan: Time Series Study From 2012 to 2022

BACKGROUND

Social media platforms have been increasingly used to express suicidal thoughts, feelings, and acts, raising public concerns over time. A large body of literature has explored the suicide risks identified by people's expressions on social media. However, there is not enough evidence to conclude that social media provides public surveillance for suicide without aligning suicide risks detected on social media with actual suicidal behaviors. Corroborating this alignment is a crucial foundation for suicide prevention and intervention through social media and for estimating and predicting suicide in countries with no reliable suicide statistics.

OBJECTIVE

This study aimed to corroborate whether the suicide risks identified on social media align with actual suicidal behaviors. This aim was achieved by tracking suicide risks detected by 62 million tweets posted in Japan over a 10-year period and assessing the locational and temporal alignment of such suicide risks with actual suicide behaviors recorded in national suicide statistics.

METHODS

This study used a human-in-the-loop approach to identify suicide-risk tweets posted in Japan from January 2013 to December 2022. This approach involved keyword-filtered data mining, data scanning by human efforts, and data refinement via an advanced natural language processing model termed Bidirectional Encoder Representations from Transformers. The tweet-identified suicide risks were then compared with actual suicide records in both temporal and spatial dimensions to validate if they were statistically correlated.

RESULTS

Twitter-identified suicide risks and actual suicide records were temporally correlated by month in the 10 years from 2013 to 2022 (correlation coefficient=0.533; P<.001); this correlation coefficient is higher at 0.652 when we advanced the Twitter-identified suicide risks 1 month earlier to compare with the actual suicide records. These 2 indicators were also spatially correlated by city with a correlation coefficient of 0.699 (P<.001) for the 10-year period. Among the 267 cities with the top quintile of suicide risks identified from both tweets and actual suicide records, 73.5% (n=196) of cities overlapped. In addition, Twitter-identified suicide risks were at a relatively lower level after midnight compared to a higher level in the afternoon, as well as a higher level on Sundays and Saturdays compared to weekdays.

CONCLUSIONS

Social media platforms provide an anonymous space where people express their suicidal thoughts, ideation, and acts. Such expressions can serve as an alternative source to estimating and predicting suicide in countries without reliable suicide statistics. It can also provide real-time tracking of suicide risks, serving as an early warning for suicide. The identification of areas where suicide risks are highly concentrated is crucial for location-based mental health planning, enabling suicide prevention and intervention through social media in a spatially and temporally explicit manner.

From benchmark to bedside: transfer learning from social media to patient-provider text messages for suicide risk prediction

OBJECTIVE

Compared to natural language processing research investigating suicide risk prediction with social media (SM) data, research utilizing data from clinical settings are scarce. However, the utility of models trained on SM data in text from clinical settings remains unclear. In addition, commonly used performance metrics do not directly translate to operational value in a real-world deployment. The objectives of this study were to evaluate the utility of SM-derived training data for suicide risk prediction in a clinical setting and to develop a metric of the clinical utility of automated triage of patient messages for suicide risk.

MATERIALS AND METHODS

Using clinical data, we developed a Bidirectional Encoder Representations from Transformers-based suicide risk detection model to identify messages indicating potential suicide risk. We used both annotated and unlabeled suicide-related SM posts for multi-stage transfer learning, leveraging customized contemporary learning rate schedules. We also developed a novel metric estimating predictive models' potential to reduce follow-up delays with patients in distress and used it to assess model utility.

RESULTS

Multi-stage transfer learning from SM data outperformed baseline approaches by traditional classification performance metrics, improving performance from 0.734 to a best F1 score of 0.797. Using this approach for automated triage could reduce response times by 15 minutes per urgent message.

DISCUSSION

Despite differences in data characteristics and distribution, publicly available SM data benefit clinical suicide risk prediction when used in conjunction with contemporary transfer learning techniques. Estimates of time saved due to automated triage indicate the potential for the practical impact of such models when deployed as part of established suicide prevention interventions.

CONCLUSIONS

This work demonstrates a pathway for leveraging publicly available SM data toward improving risk assessment, paving the way for better clinical care and improved clinical outcomes.

Methodologies for Monitoring Mental Health on Twitter: Systematic Review

BACKGROUND

The use of social media data to predict mental health outcomes has the potential to allow for the continuous monitoring of mental health and well-being and provide timely information that can supplement traditional clinical assessments. However, it is crucial that the methodologies used to create models for this purpose are of high quality from both a mental health and machine learning perspective. Twitter has been a popular choice of social media because of the accessibility of its data, but access to big data sets is not a guarantee of robust results.

OBJECTIVE

This study aims to review the current methodologies used in the literature for predicting mental health outcomes from Twitter data, with a focus on the quality of the underlying mental health data and the machine learning methods used.

METHODS

A systematic search was performed across 6 databases, using keywords related to mental health disorders, algorithms, and social media. In total, 2759 records were screened, of which 164 (5.94%) papers were analyzed. Information about methodologies for data acquisition, preprocessing, model creation, and validation was collected, as well as information about replicability and ethical considerations.

RESULTS

The 164 studies reviewed used 119 primary data sets. There were an additional 8 data sets identified that were not described in enough detail to include, and 6.1% (10/164) of the papers did not describe their data sets at all. Of these 119 data sets, only 16 (13.4%) had access to ground truth data (ie, known characteristics) about the mental health disorders of social media users. The other 86.6% (103/119) of data sets collected data by searching keywords or phrases, which may not be representative of patterns of Twitter use for those with mental health disorders. The annotation of mental health disorders for classification labels was variable, and 57.1% (68/119) of the data sets had no ground truth or clinical input on this annotation. Despite being a common mental health disorder, anxiety received little attention.

CONCLUSIONS

The sharing of high-quality ground truth data sets is crucial for the development of trustworthy algorithms that have clinical and research utility. Further collaboration across disciplines and contexts is encouraged to better understand what types of predictions will be useful in supporting the management and identification of mental health disorders. A series of recommendations for researchers in this field and for the wider research community are made, with the aim of enhancing the quality and utility of future outputs.

A machine learning approach to identifying suicide risk among text-based crisis counseling encounters

Introduction

With the increasing utilization of text-based suicide crisis counseling, new means of identifying at risk clients must be explored. Natural language processing (NLP) holds promise for evaluating the content of crisis counseling; here we use a data-driven approach to evaluate NLP methods in identifying client suicide risk.

Methods

De-identified crisis counseling data from a regional text-based crisis encounter and mobile tipline application were used to evaluate two modeling approaches in classifying client suicide risk levels. A manual evaluation of model errors and system behavior was conducted.

Results

The neural model outperformed a term frequency-inverse document frequency (tf-idf) model in the false-negative rate. While 75% of the neural model's false negative encounters had some discussion of suicidality, 62.5% saw a resolution of the client's initial concerns. Similarly, the neural model detected signals of suicidality in 60.6% of false-positive encounters.

Discussion

The neural model demonstrated greater sensitivity in the detection of client suicide risk. A manual assessment of errors and model performance reflected these same findings, detecting higher levels of risk in many of the false-positive encounters and lower levels of risk in many of the false negatives. NLP-based models can detect the suicide risk of text-based crisis encounters from the encounter's content.

Attitudes of Covid-19 patients toward sharing their health data: A survey-based study to understand security and privacy concerns

Background and Aims

Many people around the world, especially at the time of the Covid-19 outbreak, are concerned about their e-health data. The aim of this study was to investigate the attitudes of patients with Covid-19 toward sharing their health data for research and their concerns about security and privacy.

Methods

This survey is a cross-sectional study conducted through an electronic researcher-made questionnaire from February to May 2021. Convenience sampling was applied to select the participants and all 475 patients were referred to two to Afzalipour and Shahid Bahonar hospitals were invited to the study. According to the inclusion and exclusion criteria, 204 patients were included in the study and completed the questionnaire. Descriptive statistics (frequency, mean, and standard deviation) were used to analyze the questionnaire data. SPSS 23.0 was used for data analysis.

Results

Participants tended to share information about "comments provided by individuals on websites" (68.6%), "fitness tracker data" (64.19%), and "online shopping history" (63.21%) before death. Participants also tended to share information about "electronic medical records data" (36.75%), "genetic data" (24.99%), and "Instagram data" (24.99%) after death. "Fraud or misuse of personal information" (4.48 [±1.27]) was the most common concern of participants regarding the virtual world. "Unauthorized access to the account" (4.38 [±0.73]), "violation of the privacy of personal information" (4.26 [±0.85]), and "violation of the patient privacy and personal information confidentially" (4.26 [±0.85]) were the most of the unauthorized security incidents that occurred online for participants.

Conclusion

Patients with Covid-19 were concerned about releasing information they shared on websites and social networks. Therefore, people should be made aware of the reliability of websites and social media so that their security and privacy are not affected.

Digital self-harm and suicidality among adolescents

BACKGROUND

Research on digital self-harm - the anonymous online posting, sending, or otherwise sharing of hurtful content about oneself - is still in its infancy. Yet unexplored is whether digital self-harm is related to suicidal ideation or suicide attempts.

METHODS

In the current study, survey data were collected in 2019 from a national sample of 4972 American middle and high school students (M_age  = 14.5; 50% female). Logistic regression analysis was used to assess whether lifetime engagement in two different indicators of digital self-harm was associated with suicidal thoughts and attempts within the past year.

RESULTS

Logistic regression analysis showed that engagement in digital self-harm was associated with a five- to sevenfold increase in the likelihood of reporting suicidal thoughts and a nine- to 15-fold increase in the likelihood of a suicide attempt.

CONCLUSIONS

Results suggest a connection between digital self-harm and suicidality. As such, health professionals must screen for digital self-harm to address underlying mental health problems among youth that may occur prior to or alongside suicidality, and parents/caregivers must convey to children that they are available to dialog, support, and assist with the root issues that may eventually manifest as digital self-harm.

Application of Natural Language Processing (NLP) in Detecting and Preventing Suicide Ideation: A Systematic Review

(1) Introduction: Around a million people are reported to die by suicide every year, and due to the stigma associated with the nature of the death, this figure is usually assumed to be an underestimate. Machine learning and artificial intelligence such as natural language processing has the potential to become a major technique for the detection, diagnosis, and treatment of people. (2) Methods: PubMed, EMBASE, MEDLINE, PsycInfo, and Global Health databases were searched for studies that reported use of NLP for suicide ideation or self-harm. (3) Result: The preliminary search of 5 databases generated 387 results. Removal of duplicates resulted in 158 potentially suitable studies. Twenty papers were finally included in this review. (4) Discussion: Studies show that combining structured and unstructured data in NLP data modelling yielded more accurate results than utilizing either alone. Additionally, to reduce suicides, people with mental problems must be continuously and passively monitored. (5) Conclusions: The use of AI&ML opens new avenues for considerably guiding risk prediction and advancing suicide prevention frameworks. The review's analysis of the included research revealed that the use of NLP may result in low-cost and effective alternatives to existing resource-intensive methods of suicide prevention.

Synthesis of Affective Expressions and Artificial Intelligence to Discover Mental Distress in Online Community

Looking at the rapidity the social media has gained ascendancy in the society, coupled with considerable shortage of addressing the health of the social media users, there is a pressing need for employing mechanized systems to help identify individuals at risk. In this study, we investigated potential of people's social media language in order to predict their vulnerability towards the future episode of mental distress. This work aims to (a) explore the most frequent affective expressions used by online users which reflect their mental health condition and (b) develop predictive models to detect users with risk of psychological distress. In this paper, dominant sentiment extraction techniques were employed to quantify the affective expressions and classify and predict the incident of psychological distress. We trained a set of seven supervised machine learning classifiers on logs crowd-sourced from 2500 Indian Social Networking Sites (SNS) users and validated with 3149 tweets collected from Indian Twitter. We test the model on these two different SNS datasets with different scales and ground truth labeling method and discuss the relationship between key factors and mental health. Performance of classifiers is evaluated at all classification thresholds; accuracy, precision, recall, F1-score. and experimental results show a better traction of accuracies ranging from ~ 82 to ~ 99% as compared to the models of relevant existing studies. Thus, this paper presents a mechanized decision support system to detect users' susceptibility towards mental distress and provides several evidences that it can be utilized as an efficient tool to preserve the psychological health of the social media users.

Network-based prediction of the disclosure of ideation about self-harm and suicide in online counseling sessions

BACKGROUND

In psychological services, the transition to the disclosure of ideation about self-harm and suicide (ISS) is a critical point warranting attention. This study developed and tested a succinct descriptor to predict such transitions in an online synchronous text-based counseling service.

METHOD

We analyzed two years' worth of counseling sessions (N = 49,770) from Open Up, a 24/7 service in Hong Kong. Sessions from Year 1 (N = 20,618) were used to construct a word affinity network (WAN), which depicts the semantic relationships between words. Sessions from Year 2 (N = 29,152), including 1168 with explicit ISS, were used to train and test the downstream ISS prediction model. We divided and classified these sessions into ISS blocks (ISSBs), blocks prior to ISSBs (PISSBs), and non-ISS blocks (NISSBs). To detect PISSB, we adopted complex network approaches to examine the distance among different types of blocks in WAN.

RESULTS

Our analyses find that words within a block tend to form a module in WAN and that network-based distance between modules is a reliable indicator of PISSB. The proposed model yields a c-statistic of 0.79 in identifying PISSB.

CONCLUSIONS

This simple yet robust network-based model could accurately predict the transition point of suicidal ideation prior to its explicit disclosure. It can potentially improve the preparedness and efficiency of help-providers in text-based counseling services for mitigating self-harm and suicide.

Assessment of the Use of Patient Vital Sign Data for Preventing Misidentification and Medical Errors

Patient misidentification is a preventable issue that contributes to medical errors. When patients are confused with each other, they can be given the wrong medication or unneeded surgeries. Unconscious, juvenile, and mentally impaired patients represent particular areas of concern, due to their potential inability to confirm their identity or the possibility that they may inadvertently respond to an incorrect patient name (in the case of juveniles and the mentally impaired). This paper evaluates the use of patient vital sign data, within an enabling artificial intelligence (AI) framework, for the purposes of patient identification. The AI technique utilized is both explainable (meaning that its decision-making process is human understandable) and defensible (meaning that its decision-making pathways cannot be altered, just optimized). It is used to identify patients based on standard vital sign data. Analysis is presented on the efficacy of doing this, for the purposes of catching misidentification and preventing error.

From Virtual Reality to Regenerative Virtual Therapy: Some Insights from a Systematic Review Exploring Inner Body Perception in Anorexia and Bulimia Nervosa

Despite advances in our understanding of the behavioral and molecular factors that underlie the onset and maintenance of Eating Disorders (EDs), it is still necessary to optimize treatment strategies and establish their efficacy. In this context, over the past 25 years, Virtual Reality (VR) has provided creative treatments for a variety of ED symptoms, including body dissatisfaction, craving, and negative emotions. Recently, different researchers suggested that EDs may reflect a broader impairment in multisensory body integration, and a particular VR technique-VR body swapping-has been used to repair it, but with limited clinical results. In this paper, we use the results of a systematic review employing PRISMA guidelines that explore inner body perception in EDs (21 studies included), with the ultimate goal to analyze the features of multisensory impairment associated with this clinical condition and provide possible solutions. Deficits in interoception, proprioception, and vestibular signals were observed across Anorexia and Bulimia Nervosa, suggesting that: (a) alteration of inner body perception might be a crucial feature of EDs, even if further research is needed and; (b) VR, to be effective with these patients, has to simulate/modify both the external and the internal body. Following this outcome, we introduce a new therapeutic approach-Regenerative Virtual Therapy-that integrates VR with different technologies and clinical strategies to regenerate a faulty bodily experience by stimulating the multisensory brain mechanisms and promoting self-regenerative processes within the brain itself.

Analyzing Suicide Risk From Linguistic Features in Social Media: Evaluation Study

Background

Effective suicide risk assessments and interventions are vital for suicide prevention. Although assessing such risks is best done by health care professionals, people experiencing suicidal ideation may not seek help. Hence, machine learning (ML) and computational linguistics can provide analytical tools for understanding and analyzing risks. This, therefore, facilitates suicide intervention and prevention.

Objective

This study aims to explore, using statistical analyses and ML, whether computerized language analysis could be applied to assess and better understand a person’s suicide risk on social media.

Methods

We used the University of Maryland Suicidality Dataset comprising text posts written by users (N=866) of mental health–related forums on Reddit. Each user was classified with a suicide risk rating (no, low, moderate, or severe) by either medical experts or crowdsourced annotators, denoting their estimated likelihood of dying by suicide. In language analysis, the Linguistic Inquiry and Word Count lexicon assessed sentiment, thinking styles, and part of speech, whereas readability was explored using the TextStat library. The Mann-Whitney U test identified differences between at-risk (low, moderate, and severe risk) and no-risk users. Meanwhile, the Kruskal-Wallis test and Spearman correlation coefficient were used for granular analysis between risk levels and to identify redundancy, respectively. In the ML experiments, gradient boost, random forest, and support vector machine models were trained using 10-fold cross validation. The area under the receiver operator curve and F₁-score were the primary measures. Finally, permutation importance uncovered the features that contributed the most to each model’s decision-making.

Results

Statistically significant differences (P<.05) were identified between the at-risk (671/866, 77.5%) and no-risk groups (195/866, 22.5%). This was true for both the crowd- and expert-annotated samples. Overall, at-risk users had higher median values for most variables (authenticity, first-person pronouns, and negation), with a notable exception of clout, which indicated that at-risk users were less likely to engage in social posturing. A high positive correlation (ρ>0.84) was present between the part of speech variables, which implied redundancy and demonstrated the utility of aggregate features. All ML models performed similarly in their area under the curve (0.66-0.68); however, the random forest and gradient boost models were noticeably better in their F₁-score (0.65 and 0.62) than the support vector machine (0.52). The features that contributed the most to the ML models were authenticity, clout, and negative emotions.

Conclusions

In summary, our statistical analyses found linguistic features associated with suicide risk, such as social posturing (eg, authenticity and clout), first-person singular pronouns, and negation. This increased our understanding of the behavioral and thought patterns of social media users and provided insights into the mechanisms behind ML models. We also demonstrated the applicative potential of ML in assisting health care professionals to assess and manage individuals experiencing suicide risk.

Leveraging Reddit for Suicidal Ideation Detection: A Review of Machine Learning and Natural Language Processing Techniques

Suicide is a major public-health problem that exists in virtually every part of the world. Hundreds of thousands of people commit suicide every year. The early detection of suicidal ideation is critical for suicide prevention. However, there are challenges associated with conventional suicide-risk screening methods. At the same time, individuals contemplating suicide are increasingly turning to social media and online forums, such as Reddit, to express their feelings and share their struggles with suicidal thoughts. This prompted research that applies machine learning and natural language processing techniques to detect suicidality among social media and forum users. The objective of this paper is to investigate methods employed to detect suicidal ideations on the Reddit forum. To achieve this objective, we conducted a literature review of the recent articles detailing machine learning and natural language processing techniques applied to Reddit data to detect the presence of suicidal ideations. Following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, we selected 26 recent studies, published between 2018 and 2022. The findings of the review outline the prevalent methods of data collection, data annotation, data preprocessing, feature engineering, model development, and evaluation. Furthermore, we present several Reddit-based datasets utilized to construct suicidal ideation detection models. Finally, we conclude by discussing the current limitations and future directions in the research of suicidal ideation detection.

Using natural language processing to improve suicide classification requires consideration of race

OBJECTIVES

To improve the accuracy of classification of deaths of undetermined intent and to examine racial differences in misclassification.

METHODS

We used natural language processing and statistical text analysis on restricted-access case narratives of suicides, homicides, and undetermined deaths in 37 states collected from the National Violent Death Reporting System (NVDRS) (2017). We fit separate race-specific classification models to predict suicide among undetermined cases using data from known homicide cases (true negatives) and known suicide cases (true positives).

RESULTS

A classifier trained on an all-race dataset predicts less than half of these cases as suicide. Importantly, our analysis yields an estimated suicide rate for the Black population comparable with the typical detection rate for the White population, indicating that misclassification excess is endemic for Black suicide. This problem may be mitigated by using race-specific data. Our findings, based on the statistical text analysis, also reveal systematic differences in the phrases identified as most predictive of suicide.

CONCLUSIONS

This study highlights the need to understand the reasons underlying suicide rate differences and for further testing of strategies to reduce misclassification, particularly among people of color.

Language-agnostic deep learning framework for automatic monitoring of population-level mental health from social networks

In many countries, mental health issues are among the most serious public health concerns. National mental health statistics are frequently collected from reported patient cases or government-sponsored surveys, which have restricted coverage, frequency, and timeliness. Many domains of study, including public healthcare and biomedical informatics, have recently adopted social media data as a feasible real-time alternative to traditional methods of gathering representative information at the population level in a variety of contexts. However, because of the limits of fundamental natural language processing tools and labeled corpora in countries with limited natural language resources, such as Thailand, implementing social media systems to monitor mental health signals could be challenging. This paper presents LAPoMM, a novel framework for monitoring real-time mental health indicators from social media data without using labeled datasets in low-resource languages. Specifically, we use cross-lingual methods to train language-agnostic models and validate our framework by examining cross-correlations between the aggregate predicted mental signals and real-world administrative data from Thailand's Department of Mental Health, which includes monthly depression patients and reported cases of suicidal attempts. A combination of a language-agnostic representation and a deep learning classification model outperforms all other cross-lingual techniques for recognizing various mental signals in Tweets, such as emotions, sentiments, and suicidal tendencies. The correlation analyses discover a strong positive relationship between actual depression cases and the predicted negative sentiment signals as well as suicide attempts and negative signals (e.g., fear, sadness, and disgust) and suicidal tendency. These findings establish the effectiveness of our proposed framework and its potential applications in monitoring population-level mental health using large-scale social media data. Furthermore, because the language-agnostic model utilized in the methodology is capable of supporting a wide range of languages, the proposed LAPoMM framework can be easily generalized for analogous applications in other countries with limited language resources.

A Multi-Modal Convolutional Neural Network Model for Intelligent Analysis of the Influence of Music Genres on Children’s Emotions

The influence of music genres on children's emotional intelligence is one of the hot topics in the field of multi-modal emotion research. How to fuse multi-modal information has an important impact on children's emotional analysis. Most of the current research is based on transformer, in which the self-attention mechanism module is improved to achieve the fusion effect of multi-modal information. However, it is difficult for these methods to effectively capture the effective information of different modalities. Therefore, for the task of the influence of music genres on children's emotions, this paper proposes a transformer-based multi-modal convolutional neural network. The first is to use the BiLSTM sub-network model to extract the video and audio features and use the BERT sub-network to extract the text features. Secondly, this paper uses the improved transformer cross-modal fusion module to effectively fuse different types of modal information. Finally, the transformer module is used to judge the information of different modalities and analyze the emotion from the multi-modal information. At the same time, a large number of experiments prove that the model based on multi-modal convolutional neural network proposed in this paper surpasses other methods in prediction accuracy and effectively improves the accuracy of sentiment classification tasks.

Problems with Suicidal Behavior Prevention in Adolescents: a Narrative Literature Review

BACKGROUND

Among the existing issues related to the health and quality of life of Russian adolescents, suicidal behavior is being actively discussed; however, the available comprehensive measures for prevention of suicide and attempts at suicide at this age do not provide an adequate solution. This is due to the fact that suicide is an integrative phenomenon, and the act of suicide itself is interpreted, in essence, as the "tip of the iceberg". What is especially clearly manifested in adolescence is the fact that the readiness to commit suicide is associated not so much with the level of severity of mental pathology and personality dysfunction, but with the general social context lack of well-being of total trouble. Therefore, suicide prevention cannot be based purely on the timely identification of persons at risk for mental pathology.

AIM

The purpose of this work is to analyze the available literature on current approaches that have demonstrated their efficacy in reducing suicidal behavior in adolescents.

METHODS

The authors performed a narrative review of the relevant literature published between 2012 and 2021. They analyzed the works presented in the PubMed, MEDLINE, and Web of Science electronic databases. Descriptive analysis was used to generalize the data obtained.

RESULTS

The article discusses preventive approaches to suicidal behavior in adolescents, which are most often studied, and which are also used in practical healthcare. It outlines the problems associated with the implementation and evaluation of the efficacy of these preventive programs.

CONCLUSIONS

The continuing high rate of suicide among adolescents calls for an urgent concerted effort to develop, disseminate, and implement more effective prevention strategies. School-based approaches are the most convenient in practical terms, but they require systematic and long-term use of anti-suicidal programs. Digital interventions can reduce the economic burden of their use, including assessing suicidal risk and identifying psychopathology associated with suicidality.

Detecting Suicidal Ideation in Social Media: An Ensemble Method Based on Feature Fusion

Suicide has become a serious problem, and how to prevent suicide has become a very important research topic. Social media provides an ideal platform for monitoring suicidal ideation. This paper presents an integrated model for multidimensional information fusion. By integrating the best classification models determined by single and multiple features, different feature information is combined to better identify suicidal posts in online social media. This approach was assessed with a dataset formed from 40,222 posts annotated by Weibo. By integrating the best classification model of single features and multidimensional features, the proposed model ((BSC + RFS)-fs, WEC-fs) achieved 80.61% accuracy and a 79.20% F1-score. Other representative text information representation methods and demographic factors related to suicide may also be important predictors of suicide, which were not considered in this study. To the best of our knowledge, this is the good try that feature combination and ensemble algorithms have been fused to detect user-generated content with suicidal ideation. The findings suggest that feature combinations do not always work well, and that an appropriate combination strategy can make classification models work better. There are differences in the information contained in different functional carriers, and a targeted choice classification model may improve the detection rate of suicidal ideation.

Assessing rigid modes of thinking in self-declared abortion ideology: natural language processing insights from an online pilot qualitative study on abortion attitudes

Introduction

Although much work has been done on US abortion ideology, less is known relative to the psychological processes that distinguish personal abortion beliefs or how those beliefs are communicated to others. As part of a forthcoming probability-based sampling designed study on US abortion climate, we piloted a study with a controlled sample to determine whether psychological indicators guiding abortion beliefs can be meaningfully extracted from qualitative interviews using natural language processing (NLP) substring matching. Of particular interest to this study is the presence of cognitive distortions—markers of rigid thinking—spoken during interviews and how cognitive distortion frequency may be tied to rigid, or firm, abortion beliefs.

Methods

We ran qualitative interview transcripts against two lexicons. The first lexicon, the cognitive distortion schemata (CDS), was applied to identify cognitive distortion n-grams (a series of words) embedded within the qualitative interviews. The second lexicon, the Linguistic Inquiry Word Count (LIWC), was applied to extract other psychological indicators, including the degrees of (1) analytic thinking, (2) emotional reasoning, (3) authenticity, and (4) clout.

Results

People with polarized abortion views (i.e., strongly supportive of or opposed to abortion) had the highest observed usage of CDS n-grams, scored highest on authenticity, and lowest on analytic thinking. By contrast, people with moderate or uncertain abortion views (i.e., people holding more complex or nuanced views of abortion) spoke with the least CDS n-grams and scored slightly higher on analytic thinking.

Discussion and conclusion

Our findings suggest people communicate about abortion differently depending on their personal abortion ideology. Those with strong abortion views may be more likely to communicate with authoritative words and patterns of words indicative of cognitive distortions—or limited complexity in belief systems. Those with moderate views are more likely to speak in conflicting terms and patterns of words that are flexible and open to change—or high complexity in belief systems. These findings suggest it is possible to extract psychological indicators with NLP from qualitative interviews about abortion. Findings from this study will help refine our protocol ahead of full-study launch.

Detection of Depression and Suicide Risk Based on Text From Clinical Interviews Using Machine Learning: Possibility of a New Objective Diagnostic Marker

Background

Depression and suicide are critical social problems worldwide, but tools to objectively diagnose them are lacking. Therefore, this study aimed to diagnose depression through machine learning and determine whether it is possible to identify groups at high risk of suicide through words spoken by the participants in a semi-structured interview.

Methods

A total of 83 healthy and 83 depressed patients were recruited. All participants were recorded during the Mini-International Neuropsychiatric Interview. Through the suicide risk assessment from the interview items, participants with depression were classified into high-suicide-risk (31 participants) and low-suicide-risk (52 participants) groups. The recording was transcribed into text after only the words uttered by the participant were extracted. In addition, all participants were evaluated for depression, anxiety, suicidal ideation, and impulsivity. The chi-square test and student's T-test were used to compare clinical variables, and the Naive Bayes classifier was used for the machine learning text model.

Results

A total of 21,376 words were extracted from all participants and the model for diagnosing patients with depression based on this text confirmed an area under the curve (AUC) of 0.905, a sensitivity of 0.699, and a specificity of 0.964. In the model that distinguished the two groups using statistically significant demographic variables, the AUC was only 0.761. The DeLong test result (p-value 0.001) confirmed that the text-based classification was superior to the demographic model. When predicting the high-suicide-risk group, the demographics-based AUC was 0.499, while the text-based one was 0.632. However, the AUC of the ensemble model incorporating demographic variables was 0.800.

Conclusion

The possibility of diagnosing depression using interview text was confirmed; regarding suicide risk, the diagnosis accuracy increased when demographic variables were incorporated. Therefore, participants' words during an interview show significant potential as an objective and diagnostic marker through machine learning.

NeuroBlu, an electronic health record (EHR) trusted research environment (TRE) to support mental healthcare analytics with real-world data

PURPOSE

NeuroBlu is a real-world data (RWD) repository that contains deidentified electronic health record (EHR) data from US mental healthcare providers operating the MindLinc EHR system. NeuroBlu enables users to perform statistical analysis through a secure web-based interface. Structured data are available for sociodemographic characteristics, mental health service contacts, hospital admissions, International Classification of Diseases ICD-9/ICD-10 diagnosis, prescribed medications, family history of mental disorders, Clinical Global Impression-Severity and Improvement (CGI-S/CGI-I) and Global Assessment of Functioning (GAF). To further enhance the data set, natural language processing (NLP) tools have been applied to obtain mental state examination (MSE) and social/environmental data. This paper describes the development and implementation of NeuroBlu, the procedures to safeguard data integrity and security and how the data set supports the generation of real-world evidence (RWE) in mental health.

PARTICIPANTS

As of 31 July 2021, 562 940 individuals (48.9% men) were present in the data set with a mean age of 33.4 years (SD: 18.4 years). The most frequently recorded diagnoses were substance use disorders (1 52 790 patients), major depressive disorder (1 29 120 patients) and anxiety disorders (1 03 923 patients). The median duration of follow-up was 7 months (IQR: 1.3 to 24.4 months).

FINDINGS TO DATE

The data set has supported epidemiological studies demonstrating increased risk of psychiatric hospitalisation and reduced antidepressant treatment effectiveness among people with comorbid substance use disorders. It has also been used to develop data visualisation tools to support clinical decision-making, evaluate comparative effectiveness of medications, derive models to predict treatment response and develop NLP applications to obtain clinical information from unstructured EHR data.

FUTURE PLANS

The NeuroBlu data set will be further analysed to better understand factors related to poor clinical outcome, treatment responsiveness and the development of predictive analytic tools that may be incorporated into the source EHR system to support real-time clinical decision-making in the delivery of mental healthcare services.

Machine learning of language use on Twitter reveals weak and non-specific predictions

Depressed individuals use language differently than healthy controls and it has been proposed that social media posts can be used to identify depression. Much of the evidence behind this claim relies on indirect measures of mental health and few studies have tested if these language features are specific to depression versus other aspects of mental health. We analysed the Tweets of 1006 participants who completed questionnaires assessing symptoms of depression and 8 other mental health conditions. Daily Tweets were subjected to textual analysis and the resulting linguistic features were used to train an Elastic Net model on depression severity, using nested cross-validation. We then tested performance in a held-out test set (30%), comparing predictions of depression versus 8 other aspects of mental health. The depression trained model had modest out-of-sample predictive performance, explaining 2.5% of variance in depression symptoms (R² = 0.025, r = 0.16). The performance of this model was as-good or superior when used to identify other aspects of mental health: schizotypy, social anxiety, eating disorders, generalised anxiety, above chance for obsessive-compulsive disorder, apathy, but not significant for alcohol abuse or impulsivity. Machine learning analysis of social media data, when trained on well-validated clinical instruments, could not make meaningful individualised predictions regarding users’ mental health. Furthermore, language use associated with depression was non-specific, having similar performance in predicting other mental health problems.

Leveraging data science to enhance suicide prevention research: a literature review

OBJECTIVE

The purpose of this research is to identify how data science is applied in suicide prevention literature, describe the current landscape of this literature and highlight areas where data science may be useful for future injury prevention research.

DESIGN

We conducted a literature review of injury prevention and data science in April 2020 and January 2021 in three databases.

METHODS

For the included 99 articles, we extracted the following: (1) author(s) and year; (2) title; (3) study approach (4) reason for applying data science method; (5) data science method type; (6) study description; (7) data source and (8) focus on a disproportionately affected population.

RESULTS

Results showed the literature on data science and suicide more than doubled from 2019 to 2020, with articles with individual-level approaches more prevalent than population-level approaches. Most population-level articles applied data science methods to describe (n=10) outcomes, while most individual-level articles identified risk factors (n=27). Machine learning was the most common data science method applied in the studies (n=48). A wide array of data sources was used for suicide research, with most articles (n=45) using social media and web-based behaviour data. Eleven studies demonstrated the value of applying data science to suicide prevention literature for disproportionately affected groups.

CONCLUSION

Data science techniques proved to be effective tools in describing suicidal thoughts or behaviour, identifying individual risk factors and predicting outcomes. Future research should focus on identifying how data science can be applied in other injury-related topics.

Digital Life Data in the Clinical Whitespace

In our increasingly digital world, aspects of our lives are encoded in the routine interactions we have with technology. Over the past few years, psychologists and technologists have been exploring what possibilities these digital life data might hold for improving mental health and well-being. Here I examine some of the recent advances in this field, particularly in the use of language data; consider the ethical and pragmatic implications of this technology; and examine a few areas where I believe these advances could significantly alter the way in which mental health and well-being are approached. This technology holds special promise for providing information about a patient’s life in between clinical encounters, in the clinical whitespace.

Transfer Learning with Social Media Content in the Ride-Hailing Domain by Using a Hybrid Machine Learning Architecture

The analysis of the content of posts written on social media has established an important line of research in recent years. The study of these texts, as well as their relationship with each other and their dependence on the platform on which they are written, enables the behavior analysis of users and their opinions with respect to different domains. In this work, a hybrid machine learning-based system has been developed to classify texts using topic modeling techniques and different word-vector representations, as well as traditional text representations. The system has been trained with ride-hailing posts extracted from Reddit, showing promising performance. Then, the generated models have been tested with data extracted from other sources such as Twitter and Google Play, classifying these texts without retraining any models and thus performing Transfer Learning. The obtained results show that our proposed architecture is effective when performing Transfer Learning from data-rich domains and applying them to other sources.

Detecting Suicide Ideation in the Era of Social Media: The Population Neuroscience Perspective

Social media platforms are increasingly used across many population groups not only to communicate and consume information, but also to express symptoms of psychological distress and suicidal thoughts. The detection of suicidal ideation (SI) can contribute to suicide prevention. Twitter data suggesting SI have been associated with negative emotions (e.g., shame, sadness) and a number of geographical and ecological variables (e.g., geographic location, environmental stress). Other important research contributions on SI come from studies in neuroscience. To date, very few research studies have been conducted that combine different disciplines (epidemiology, health geography, neurosciences, psychology, and social media big data science), to build innovative research directions on this topic. This article aims to offer a new interdisciplinary perspective, that is, a Population Neuroscience perspective on SI in order to highlight new ways in which multiple scientific fields interact to successfully investigate emotions and stress in social media to detect SI in the population. We argue that a Population Neuroscience perspective may help to better understand the mechanisms underpinning SI and to promote more effective strategies to prevent suicide timely and at scale.

Accelerating the impact of artificial intelligence in mental healthcare through implementation science

Background

The implementation of artificial intelligence (AI) in mental healthcare offers a potential solution to some of the problems associated with the availability, attractiveness, and accessibility of mental healthcare services. However, there are many knowledge gaps regarding how to implement and best use AI to add value to mental healthcare services, providers, and consumers. The aim of this paper is to identify challenges and opportunities for AI use in mental healthcare and to describe key insights from implementation science of potential relevance to understand and facilitate AI implementation in mental healthcare.

Methods

The paper is based on a selective review of articles concerning AI in mental healthcare and implementation science.

Results

Research in implementation science has established the importance of considering and planning for implementation from the start, the progression of implementation through different stages, and the appreciation of determinants at multiple levels. Determinant frameworks and implementation theories have been developed to understand and explain how different determinants impact on implementation. AI research should explore the relevance of these determinants for AI implementation. Implementation strategies to support AI implementation must address determinants specific to AI implementation in mental health. There might also be a need to develop new theoretical approaches or augment and recontextualize existing ones. Implementation outcomes may have to be adapted to be relevant in an AI implementation context.

Conclusion

Knowledge derived from implementation science could provide an important starting point for research on implementation of AI in mental healthcare. This field has generated many insights and provides a broad range of theories, frameworks, and concepts that are likely relevant for this research. However, when taking advantage of the existing knowledge basis, it is important to also be explorative and study AI implementation in health and mental healthcare as a new phenomenon in its own right since implementing AI may differ in various ways from implementing evidence-based practices in terms of what implementation determinants, strategies, and outcomes are most relevant. Plain Language Summary: The implementation of artificial intelligence (AI) in mental healthcare offers a potential solution to some of the problems associated with the availability, attractiveness, and accessibility of mental healthcare services. However, there are many knowledge gaps concerning how to implement and best use AI to add value to mental healthcare services, providers, and consumers. This paper is based on a selective review of articles concerning AI in mental healthcare and implementation science, with the aim to identify challenges and opportunities for the use of AI in mental healthcare and describe key insights from implementation science of potential relevance to understand and facilitate AI implementation in mental healthcare. AI offers opportunities for identifying the patients most in need of care or the interventions that might be most appropriate for a given population or individual. AI also offers opportunities for supporting a more reliable diagnosis of psychiatric disorders and ongoing monitoring and tailoring during the course of treatment. However, AI implementation challenges exist at organizational/policy, individual, and technical levels, making it relevant to draw on implementation science knowledge for understanding and facilitating implementation of AI in mental healthcare. Knowledge derived from implementation science could provide an important starting point for research on AI implementation in mental healthcare. This field has generated many insights and provides a broad range of theories, frameworks, and concepts that are likely relevant for this research.

Detecting risk level in individuals misusing fentanyl utilizing posts from an online community on Reddit

INTRODUCTION

Opioid misuse is a public health crisis in the US, and misuse of synthetic opioids such as fentanyl have driven the most recent waves of opioid-related deaths. Because those who misuse fentanyl are often a hidden and high-risk group, innovative methods for identifying individuals at risk for fentanyl misuse are needed. Machine learning has been used in the past to investigate discussions surrounding substance use on Reddit, and this study leverages similar techniques to identify risky content from discussions of fentanyl on this platform.

METHODS

A codebook was developed by clinical domain experts with 12 categories indicative of fentanyl misuse risk, and this was used to manually label 391 Reddit posts and comments. Using this data, we built machine learning classification models to identify fentanyl risk.

RESULTS

Our machine learning risk model was able to detect posts or comments labeled as risky by our clinical experts with 76% accuracy and 76% sensitivity. Furthermore, we provide a vocabulary of community-specific, colloquial words for fentanyl and its analogues.

DISCUSSION

This study uses an interdisciplinary approach leveraging machine learning techniques and clinical domain expertise to automatically detect risky discourse, which may elicit and benefit from timely intervention. Moreover, our vocabulary of online terms for fentanyl and its analogues expands our understanding of online "street" nomenclature for opiates. Through an improved understanding of substance misuse risk factors, these findings allow for identification of risk concepts among those misusing fentanyl to inform outreach and intervention strategies tailored to this at-risk group.

Suicide Risk and Protective Factors in Online Support Forum Posts: Annotation Scheme Development and Validation Study

BACKGROUND

Online communities provide support for individuals looking for help with suicidal ideation and crisis. As community data are increasingly used to devise machine learning models to infer who might be at risk, there have been limited efforts to identify both risk and protective factors in web-based posts. These annotations can enrich and augment computational assessment approaches to identify appropriate intervention points, which are useful to public health professionals and suicide prevention researchers.

OBJECTIVE

This qualitative study aims to develop a valid and reliable annotation scheme for evaluating risk and protective factors for suicidal ideation in posts in suicide crisis forums.

METHODS

We designed a valid, reliable, and clinically grounded process for identifying risk and protective markers in social media data. This scheme draws on prior work on construct validity and the social sciences of measurement. We then applied the scheme to annotate 200 posts from r/SuicideWatch-a Reddit community focused on suicide crisis.

RESULTS

We documented our results on producing an annotation scheme that is consistent with leading public health information coding schemes for suicide and advances attention to protective factors. Our study showed high internal validity, and we have presented results that indicate that our approach is consistent with findings from prior work.

CONCLUSIONS

Our work formalizes a framework that incorporates construct validity into the development of annotation schemes for suicide risk on social media. This study furthers the understanding of risk and protective factors expressed in social media data. This may help public health programming to prevent suicide and computational social science research and investigations that rely on the quality of labels for downstream machine learning tasks.

Automated Monitoring of Suicidal Adolescents' Digital Media Use: Qualitative Study Exploring Acceptability Within Clinical Care

BACKGROUND

Monitoring linguistic cues from adolescents' digital media use (DMU; ie, digital content transmitted on the web, such as through text messages or social media) that could denote suicidal risk offers a unique opportunity to protect adolescents vulnerable to suicide, the second leading cause of death among youth. Adolescents communicate through digital media in high volumes and frequently express emotionality. In fact, web-based disclosures of suicidality are more common than in-person disclosures. The use of automated methods of digital media monitoring triggered by a natural language processing algorithm offers the potential to detect suicidal risk from subtle linguistic units (eg, negatively valanced words, phrases, or emoticons known to be associated with suicidality) present within adolescents' digital media content and to use this information to respond to alerts of suicidal risk. Critical to the implementation of such an approach is the consideration of its acceptability in the clinical care of adolescents at high risk of suicide.

OBJECTIVE

Through data collection among recently suicidal adolescents, parents, and clinicians, this study examines the current context of digital media monitoring for suicidal adolescents seeking clinical care to inform the need for automated monitoring and the factors that influence the acceptance of automated monitoring of suicidal adolescents' DMU within clinical care.

METHODS

A total of 15 recently suicidal adolescents (aged 13-17 years), 12 parents, and 10 clinicians participated in focus groups, qualitative interviews, and a group discussion, respectively. Data were recorded, transcribed, and analyzed using thematic analysis.

RESULTS

Participants described important challenges to the current strategies for monitoring the DMU of suicidal youth. They felt that automated monitoring would have advantages over current monitoring approaches, namely, by protecting web-based environments and aiding adolescent disclosure and support seeking about web-based suicidal risk communication, which may otherwise go unnoticed. However, they identified barriers that could impede implementation within clinical care, namely, adolescents' and parents' concerns about unintended consequences of automated monitoring, that is, the potential for loss of privacy or false alerts, and clinicians' concerns about liability to respond to alerts of suicidal risk. On the basis of the needs and preferences of adolescents, parents, and clinicians, a model for automated digital media monitoring is presented that aims to optimize acceptability within clinical care for suicidal youth.

CONCLUSIONS

Automated digital media monitoring offers a promising means to augment detection and response to suicidal risk within the clinical care of suicidal youth when strategies that address the preferences of adolescents, parents, and clinicians are in place.