Detection of Suicidality Among Opioid Users on Reddit: Machine Learning-Based Approach

Which social media platforms facilitate monitoring the opioid crisis?

Social media can provide real-time insight into trends in substance use, addiction, and recovery. Prior studies have used platforms such as Reddit and X (formerly Twitter), but evolving policies around data access have threatened these platforms' usability in research. We evaluate the potential of a broad set of platforms to detect emerging trends in the opioid epidemic. From these, we created a shortlist of 11 platforms, for which we documented official policies regulating drug-related discussion, data accessibility, geolocatability, and prior use in opioid-related studies. We quantified their volumes of opioid discussion, capturing informal language by including slang generated using a large language model. Beyond the most commonly used Reddit and X, the platforms with high potential for use in opioid-related surveillance are TikTok, YouTube, and Facebook. Leveraging many different social platforms, instead of a single platform, safeguards against sudden changes to data access and may better capture all populations that use opioids than any single platform.

The Use of Natural Language Processing Methods in Reddit to Investigate Opioid Use: Scoping Review

BACKGROUND

The growing availability of big data spontaneously generated by social media platforms allows us to leverage natural language processing (NLP) methods as valuable tools to understand the opioid crisis.

OBJECTIVE

We aimed to understand how NLP has been applied to Reddit (Reddit Inc) data to study opioid use.

METHODS

We systematically searched for peer-reviewed studies and conference abstracts in PubMed, Scopus, PsycINFO, ACL Anthology, IEEE Xplore, and Association for Computing Machinery data repositories up to July 19, 2022. Inclusion criteria were studies investigating opioid use, using NLP techniques to analyze the textual corpora, and using Reddit as the social media data source. We were specifically interested in mapping studies' overarching goals and findings, methodologies and software used, and main limitations.

RESULTS

In total, 30 studies were included, which were classified into 4 nonmutually exclusive overarching goal categories: methodological (n=6, 20% studies), infodemiology (n=22, 73% studies), infoveillance (n=7, 23% studies), and pharmacovigilance (n=3, 10% studies). NLP methods were used to identify content relevant to opioid use among vast quantities of textual data, to establish potential relationships between opioid use patterns or profiles and contextual factors or comorbidities, and to anticipate individuals' transitions between different opioid-related subreddits, likely revealing progression through opioid use stages. Most studies used an embedding technique (12/30, 40%), prediction or classification approach (12/30, 40%), topic modeling (9/30, 30%), and sentiment analysis (6/30, 20%). The most frequently used programming languages were Python (20/30, 67%) and R (2/30, 7%). Among the studies that reported limitations (20/30, 67%), the most cited was the uncertainty regarding whether redditors participating in these forums were representative of people who use opioids (8/20, 40%). The papers were very recent (28/30, 93%), from 2019 to 2022, with authors from a range of disciplines.

CONCLUSIONS

This scoping review identified a wide variety of NLP techniques and applications used to support surveillance and social media interventions addressing the opioid crisis. Despite the clear potential of these methods to enable the identification of opioid-relevant content in Reddit and its analysis, there are limits to the degree of interpretive meaning that they can provide. Moreover, we identified the need for standardized ethical guidelines to govern the use of Reddit data to safeguard the anonymity and privacy of people using these forums.

Predicting Suicidal Ideation, Planning, and Attempts among the Adolescent Population of the United States

Suicide is the second leading cause of death among individuals aged 5 to 24 in the United States (US). However, the precursors to suicide often do not surface, making suicide prevention challenging. This study aims to develop a machine learning model for predicting suicide ideation (SI), suicide planning (SP), and suicide attempts (SA) among adolescents in the US during the coronavirus pandemic. We used the 2021 Adolescent Behaviors and Experiences Survey Data. Class imbalance was addressed using the proposed data augmentation method tailored for binary variables, Modified Synthetic Minority Over-Sampling Technique. Five different ML models were trained and compared. SHapley Additive exPlanations analysis was conducted for explainability. The Logistic Regression model, identified as the most effective, showed superior performance across all targets, achieving high scores in recall: 0.82, accuracy: 0.80, and area under the Receiver Operating Characteristic curve: 0.88. Variables such as sad feelings, hopelessness, sexual behavior, and being overweight were noted as the most important predictors. Our model holds promise in helping health policymakers design effective public health interventions. By identifying vulnerable sub-groups within regions, our model can guide the implementation of tailored interventions that facilitate early identification and referral to medical treatment.

Use of Social Media Data Mining to Examine Needs, Concerns, and Experiences of People With Traumatic Brain Injury

PURPOSE

Given the limited availability of topic-specific resources, many people turn to anonymous social media platforms such as Reddit to seek information and connect to others with similar experiences and needs. Mining of such data can therefore identify unmet needs within the community and allow speech-language pathologists to incorporate clients' real-life insights into clinical practices.

METHOD

A mixed-method analysis was performed on 3,648 traumatic brain injury (TBI) subreddit posts created between 2013 and 2021. Sentiment analysis was used to determine the sentiment expressed in each post; topic modeling and qualitative content analysis were used to uncover the main topics discussed across posts. Subgroup analyses were conducted based on injury severity, chronicity, and whether the post was authored by a person with TBI or a close other.

RESULTS

There was no significant difference between the number of posts with positive sentiment and the number of posts with negative sentiment. Comparisons between subgroups showed significantly higher positive sentiment in posts by or about people with moderate-to-severe TBI (compared to mild TBI) and who were more than 1 month postinjury (compared to less than 1 month). Posts by close others had significantly higher positive sentiment than posts by people with TBI. Topic modeling identified three meta-themes: Recovery, Symptoms, and Medical Care. Qualitative content analysis further revealed that returning to productivity and life as well as sharing recovery tips were the primary focus under the Recovery theme. Symptom-related posts often discussed symptom management and validation of experiences. The Medical Care theme encompassed concerns regarding diagnosis, medication, and treatment.

CONCLUSIONS

Concerns and needs shift over time following TBI, and they extend beyond health and functioning to participation in meaningful daily activities. The findings can inform the development of tailored educational resources and rehabilitative approaches, facilitating recovery and community building for individuals with TBI.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.24881340.

Investigating Substance Use via Reddit: Systematic Scoping Review

BACKGROUND

Reddit's (Reddit Inc) large user base, diverse communities, and anonymity make it a useful platform for substance use research. Despite a growing body of literature on substance use on Reddit, challenges and limitations must be carefully considered. However, no systematic scoping review has been conducted on the use of Reddit as a data source for substance use research.

OBJECTIVE

This review aims to investigate the use of Reddit for studying substance use by examining previous studies' objectives, reasons, limitations, and methods for using Reddit. In addition, we discuss the implications and contributions of previous studies and identify gaps in the literature that require further attention.

METHODS

A total of 7 databases were searched using keyword combinations including Reddit and substance-related keywords in April 2022. The initial search resulted in 456 articles, and 227 articles remained after removing duplicates. All included studies were peer reviewed, empirical, available in full text, and pertinent to Reddit and substance use, and they were all written in English. After screening, 60 articles met the eligibility criteria for the review, with 57 articles identified from the initial database search and 3 from the ancestry search. A codebook was developed, and qualitative content analysis was performed to extract relevant evidence related to the research questions.

RESULTS

The use of Reddit for studying substance use has grown steadily since 2015, with a sharp increase in 2021. The primary objective was to identify tendencies and patterns in various types of substance use discussions (52/60, 87%). Reddit was also used to explore unique user experiences, propose methodologies, investigate user interactions, and develop interventions. A total of 9 reasons for using Reddit to study substance use were identified, such as the platform's anonymity, its widespread popularity, and the explicit topics of subreddits. However, 7 limitations were noted, including the platform's low representativeness of the general population with substance use and the lack of demographic information. Most studies use application programming interfaces for data collection and quantitative approaches for analysis, with few using qualitative approaches. Machine learning algorithms are commonly used for natural language processing tasks. The theoretical, methodological, and practical implications and contributions of the included articles are summarized and discussed. The most prevalent practical implications are investigating prevailing topics in Reddit discussions, providing recommendations for clinical practices and policies, and comparing Reddit discussions on substance use across various sources.

CONCLUSIONS

This systematic scoping review provides an overview of Reddit's use as a data source for substance use research. Although the limitations of Reddit data must be considered, analyzing them can be useful for understanding patterns and user experiences related to substance use. Our review also highlights gaps in the literature and suggests avenues for future research.

Automatic Detection of Intimate Partner Violence Victims from Social Media for Proactive Delivery of Support

Social media platforms are increasingly being used by intimate partner violence (IPV) victims to share experiences and seek support. If such information is automatically curated, it may be possible to conduct social media based surveillance and even design interventions over such platforms. In this paper, we describe the development of a supervised classification system that automatically characterizes IPV-related posts on the social network Reddit. We collected data from four IPV-related subreddits and manually annotated the data to indicate whether a post is a self-report of IPV or not. Using the annotated data (N=289), we trained, evaluated, and compared supervised machine learning systems. A transformer-based classifier, RoBERTa, obtained the best classification performance with overall accuracy of 78% and IPV-self-report class 𝐹1 -score of 0.67. Post-classification error analyses revealed that misclassifications often occur for posts that are very long or are non-first-person reports of IPV. Despite the relatively small annotated data, our classification methods obtained promising results, indicating that it may be possible to detect and, hence, provide support to IPV victims over Reddit.

Using Reddit as a recruitment strategy for addiction science research

Reddit is a forum-based social media and message board platform that has been used in the social sciences as a recruitment source of human subject data. In addiction science, Reddit remains a viable but underutilized tool, compared to other websites (e.g., Amazon's Mechanical Turk, Prolific). The purpose of this commentary is to provide a rationale and recommendations for the successful use of Reddit for addiction science researchers interested in adding it as a recruitment tool. We provide an example of how Reddit can be used to target specific populations of interest, such as individuals struggling with depression or alcohol use disorder. Last, we discuss the limitations of Reddit as a research tool and some considerations for future research to help promote effective use of the platform.

Foreign pop-culture and backlash: the case of non-fan K-pop Subreddits during the pandemic

Communication research establishes that when confronted with information contradicting their beliefs, people tend to 'backlash' by doubling down on their prior. Can international popular culture be the context of backlash? This paper analyzes two K-pop Subreddits (r/WeHateKpop and r/Cringetopia) populated by non-fans. A particular focus is given to their attitudinal changes upon being exposed to news stories about South Korea. I argue that a heavy dose of positive news stories about South Korea triggers non-fans as they associate K-pop with the country. This exposure leads to backlash, resulting in increased engagement with the posts critical of K-pop in the two Subreddits. I present a series of econometric evidence strongly supportive of this argument. The paper is a rare large-N study on the non-fans of K-pop. It offers implications for cultural economics, demonstrating how seemingly irrelevant news stories can have profound effects on individuals' engagement with foreign cultures.

Predicting Patient Satisfaction With Medications for Treating Opioid Use Disorder: Case Study Applying Natural Language Processing to Reviews of Methadone and Buprenorphine/Naloxone on Health-Related Social Media

Background

Medication-assisted treatment (MAT) is an effective method for treating opioid use disorder (OUD), which combines behavioral therapies with one of three Food and Drug Administration-approved medications: methadone, buprenorphine, and naloxone. While MAT has been shown to be effective initially, there is a need for more information from the patient perspective about the satisfaction with medications. Existing research focuses on patient satisfaction with the entirety of the treatment, making it difficult to determine the unique role of medication and overlooking the views of those who may lack access to treatment due to being uninsured or concerns over stigma. Studies focusing on patients' perspectives are also limited by the lack of scales that can efficiently collect self-reports across domains of concerns.

Objective

A broad survey of patients' viewpoints can be obtained through social media and drug review forums, which are then assessed using automated methods to discover factors associated with medication satisfaction. Because the text is unstructured, it may contain a mix of formal and informal language. The primary aim of this study was to use natural language processing methods on text posted on health-related social media to detect patients' satisfaction with two well-studied OUD medications: methadone and buprenorphine/naloxone.

Methods

We collected 4353 patient reviews of methadone and buprenorphine/naloxone from 2008 to 2021 posted on WebMD and Drugs.com. To build our predictive models for detecting patient satisfaction, we first employed different analyses to build four input feature sets using the vectorized text, topic models, duration of treatment, and biomedical concepts by applying MetaMap. We then developed six prediction models: logistic regression, Elastic Net, least absolute shrinkage and selection operator, random forest classifier, Ridge classifier, and extreme gradient boosting to predict patients' satisfaction. Lastly, we compared the prediction models' performance over different feature sets.

Results

Topics discovered included oral sensation, side effects, insurance, and doctor visits. Biomedical concepts included symptoms, drugs, and illnesses. The F-score of the predictive models across all methods ranged from 89.9% to 90.8%. The Ridge classifier model, a regression-based method, outperformed the other models.

Conclusions

Assessment of patients' satisfaction with opioid dependency treatment medication can be predicted using automated text analysis. Adding biomedical concepts such as symptoms, drug name, and illness, along with the duration of treatment and topic models, had the most benefits for improving the prediction performance of the Elastic Net model compared to other models. Some of the factors associated with patient satisfaction overlap with domains covered in medication satisfaction scales (eg, side effects) and qualitative patient reports (eg, doctors' visits), while others (insurance) are overlooked, thereby underscoring the value added from processing text on online health forums to better understand patient adherence.

Leveraging Reddit for Suicidal Ideation Detection: A Review of Machine Learning and Natural Language Processing Techniques

Suicide is a major public-health problem that exists in virtually every part of the world. Hundreds of thousands of people commit suicide every year. The early detection of suicidal ideation is critical for suicide prevention. However, there are challenges associated with conventional suicide-risk screening methods. At the same time, individuals contemplating suicide are increasingly turning to social media and online forums, such as Reddit, to express their feelings and share their struggles with suicidal thoughts. This prompted research that applies machine learning and natural language processing techniques to detect suicidality among social media and forum users. The objective of this paper is to investigate methods employed to detect suicidal ideations on the Reddit forum. To achieve this objective, we conducted a literature review of the recent articles detailing machine learning and natural language processing techniques applied to Reddit data to detect the presence of suicidal ideations. Following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, we selected 26 recent studies, published between 2018 and 2022. The findings of the review outline the prevalent methods of data collection, data annotation, data preprocessing, feature engineering, model development, and evaluation. Furthermore, we present several Reddit-based datasets utilized to construct suicidal ideation detection models. Finally, we conclude by discussing the current limitations and future directions in the research of suicidal ideation detection.

Natural language processing applied to mental illness detection: a narrative review

Mental illness is highly prevalent nowadays, constituting a major cause of distress in people’s life with impact on society’s health and well-being. Mental illness is a complex multi-factorial disease associated with individual risk factors and a variety of socioeconomic, clinical associations. In order to capture these complex associations expressed in a wide variety of textual data, including social media posts, interviews, and clinical notes, natural language processing (NLP) methods demonstrate promising improvements to empower proactive mental healthcare and assist early diagnosis. We provide a narrative review of mental illness detection using NLP in the past decade, to understand methods, trends, challenges and future directions. A total of 399 studies from 10,467 records were included. The review reveals that there is an upward trend in mental illness detection NLP research. Deep learning methods receive more attention and perform better than traditional machine learning methods. We also provide some recommendations for future studies, including the development of novel detection methods, deep learning paradigms and interpretable models.

Types and Sources of Stigma on Opioid Use Treatment and Recovery Communities on Reddit

Background: Digitally-mediated peer support may improve opioid use disorder (OUD) recovery. Our objective was to examine the types and sources of stigma that people seek support for in online OUD recovery communities (subreddits) on Reddit. Methods: We extracted all posts containing stigma keywords from three subreddits as well as a random sample that do not contain stigma keywords. We conducted deductive content analysis to confirm that the post self-described an experience of stigma and identify the type (condition, intervention) and source (provider-based, public, self, structural) of stigma. Results: Two-hundred and fifty-nine posts self-reported a stigmatizing experience. The majority of posts described an intervention stigma associated with medications for OUD. Posts discussing intervention stigma acknowledged the role of stigma in their treatment decision-making and quality of their treatment program. The most frequent sources of stigma were the public (including family members), provider-based (healthcare and pharmacy workers), structural (workplace, law enforcement, child protective services, and abstinence-based self-help groups), and self. No posts mentioned courtesy stigma. Posts sought assistance in navigating their experiences and participating in advocacy to counter stigmatized narratives. Conclusions: Our study indicates that people in online communities seek support to disclose and manage experiences of stigma on Reddit in similar ways to people in offline communities with the noted exception of an absence of discussions of courtesy stigma. Since each subreddit is a microcosm of varying needs, we suggest areas of future work for collaborative resources developed between stakeholders of these subreddits and public health that work within the preexisting Reddit social norms.

Thematic Analysis of Reddit Content About Buprenorphine-naloxone Using Manual Annotation and Natural Language Processing Techniques

BACKGROUND

Opioid use disorder (OUD) is a major public health crisis for which buprenorphine-naloxone is an effective evidence-based treatment. Analysis of Reddit data yields detailed information about firsthand experiences with buprenorphine-naloxone that has the potential to inform treatment of OUD.

METHODS

We conducted a thematic analysis of posts about buprenorphine-naloxone from a Reddit forum in which Reddit users anonymously discuss topics related to opioid use. We used an application programming interface to retrieve posts about buprenorphine-naloxone, then applied natural language processing to generate meta-information and curate samples of salient posts. We manually categorized posts according to their content and conducted natural language processing-aided analysis of posts about buprenorphine tapering strategies, withdrawal symptoms, and adjunctive substances/behaviors useful in the tapering process.

RESULTS

A total of 16,146 posts from 1933 redditors were retrieved from the /r/suboxone subreddit. Thematic analysis of sample posts (N = 200) revealed descriptions of personal experiences (74%), nonpersonal accounts (24%), and other content (2%). Among redditors who reported tapering to termination (N = 40), 0.063 mg and 0.125 mg were the most common termination doses. Fatigue, gastrointestinal disturbance, and mood disturbance were the most frequent adverse effects, and loperamide and vitamins/dietary supplements the most frequently discussed adverse effects adjunctive substances/behaviors respectively.

CONCLUSIONS

Discussions on Reddit are rich in information about buprenorphine-naloxone. Information derived from analysis of Reddit posts about buprenorphine-naloxone may not be available elsewhere and may help providers improve treatment of people with OUD through better understanding of the experiences of people who have used buprenorphine-naloxone.

Methodological approaches for the prediction of opioid use-related epidemics in the United States: a narrative review and cross-disciplinary call to action

The opioid crisis in the United States has been defined by waves of drug- and locality-specific Opioid use-Related Epidemics (OREs) of overdose and bloodborne infections, among a range of health harms. The ability to identify localities at risk of such OREs, and better yet, to predict which ones will experience them, holds the potential to mitigate further morbidity and mortality. This narrative review was conducted to identify and describe quantitative approaches aimed at the "risk assessment," "detection" or "prediction" of OREs in the United States. We implemented a PubMed search composed of the: (1) objective (eg, prediction), (2) epidemiologic outcome (eg, outbreak), (3) underlying cause (ie, opioid use), (4) health outcome (eg, overdose, HIV), (5) location (ie, US). In total, 46 studies were included, and the following information extracted: discipline, objective, health outcome, drug/substance type, geographic region/unit of analysis, and data sources. Studies identified relied on clinical, epidemiological, behavioral and drug markets surveillance and applied a range of methods including statistical regression, geospatial analyses, dynamic modeling, phylogenetic analyses and machine learning. Studies for the prediction of overdose mortality at national/state/county and zip code level are rapidly emerging. Geospatial methods are increasingly used to identify hotspots of opioid use and overdose. In the context of infectious disease OREs, routine genetic sequencing of patient samples to identify growing transmission clusters via phylogenetic methods could increase early detection capacity. A coordinated implementation of multiple, complementary approaches would increase our ability to successfully anticipate outbreak risk and respond preemptively. We present a multi-disciplinary framework for the prediction of OREs in the US and reflect on challenges research teams will face in implementing such strategies along with good practices.