Toward an Ethical Framework for the Text Mining of Social Media for Health Research: A Systematic Review

Exploring online health information quality criteria on social media: a mixed method approach

PURPOSE

This article outlines a research study that ranked health information quality criteria on social media from experts' perspectives.

METHODOLOGY

A mixed-method approach (qualitative-quantitative) used in current research. In the qualitative phase a literature review explored existing dimensions for evaluating social media content quality, focusing on identifying common dimensions and attributes. Furthermore, a quantitative method involving experts was utilized to rank the health information quality criteria for social media.

RESULTS

The findings indicated various dimensions of health information quality in the literature. Out of 17 criteria, accuracy, credibility, and reliability had the highest ranks, while originality, value-added, and amount of data had the lowest ranks, respectively, according to experts.

CONCLUSION

The endeavor to bolster the dissemination of reliable health information on social media demands a sustained commitment to enhancing accountability, transparency, and accuracy, ensuring that users have access to information that is not only informative but also trustworthy.

Rapid review methods series: Guidance on the use of supportive software

This paper is part of a series of methodological guidance from the Cochrane Rapid Reviews Methods Group. Rapid reviews (RRs) use modified systematic review methods to accelerate the review process while maintaining systematic, transparent and reproducible methods. This paper guides how to use supportive software for RRs.We strongly encourage the use of supportive software throughout RR production. Specifically, we recommend (1) using collaborative online platforms that enable working in parallel, allow for real-time project management and centralise review details; (2) using automation software to support, but not entirely replace a human reviewer and human judgement and (3) being transparent in reporting the methodology and potential risk for bias due to the use of supportive software.

Nutrients and Foods Recommended for Blood Pressure Control on Twitter in Japan: Content Analysis

BACKGROUND

Management and prevention of hypertension are important public health issues. Healthy dietary habits are one of the modifiable factors. As Twitter (subsequently rebranded X) is a digital platform that can influence public eating behavior, there is a knowledge gap regarding the information about foods and nutrients recommended for blood pressure control and who disseminates them on Twitter.

OBJECTIVE

This study aimed to investigate the nature of the information people are exposed to on Twitter regarding nutrients and foods for blood pressure control.

METHODS

A total of 147,898 Japanese tweets were extracted from January 1, 2022, to December 31, 2022. The final sample of 2347 tweets with at least 1 retweet was manually coded into categories of food groups, nutrients, user characteristics, and themes. The number and percentage of tweets, retweets, and themes in each category were calculated.

RESULTS

Of the 2347 tweets, 80% (n=1877) of tweets mentioned foods, which were categorized into 17 different food groups. Seasonings and spices, including salt, were most frequently mentioned (1356/1877, 72.2%). This was followed by vegetable and fruit groups. The 15 kinds of nutrients were mentioned in 1566 tweets, with sodium being the largest proportion at 83.1% (n=1301), followed by potassium at 8.4% (n=132). There was misinformation regarding salt intake for hypertension, accounting for 40.8% (n=531) of tweets referring to salt, including recommendations for salt intake to lower blood pressure. In total, 75% (n=21) of tweets from "doctors" mentioned salt reduction is effective for hypertension control, while 31.1% (n=74) of tweets from "health, losing weight, and beauty-related users," 25.9% (n=429) of tweets from "general public," and 23.5% (n=4) tweets from "dietitian or registered dietitian" denied salt reduction for hypertension. The antisalt reduction tweets accounted for 31.5% (n=106) of the most disseminated tweets related to nutrients and foods for blood pressure control.

CONCLUSIONS

The large number of tweets in this study indicates a high interest in nutrients and foods for blood pressure control. Misinformation asserting antisalt reduction was posted primarily by the general public and self-proclaimed health experts. The number of tweets from nutritionists, registered dietitians, and doctors who were expected to correct misinformation and promote salt reduction was relatively low, and their messages were not always positive toward salt reduction. There is a need for communication strategies to combat misinformation, promote correct information on salt reduction, and train health care professionals to effectively communicate evidence-based information on this topic.

User Experiences of Well-Being Chatbots

OBJECTIVE

The current paper conducted two parallel studies to explore user experiences of well-being conversational agents (CAs) and identify important features for engagement.

BACKGROUND

Students transitioning into university life take on greater responsibility, yet tend to sacrifice healthy behaviors to strive for academic and financial gain. Additionally, students faced an unprecedented pandemic, leading to remote courses and reduced access to healthcare services. One tool designed to improve healthcare accessibility is well-being CAs. CAs have addressed mental health support in the general population but have yet to address physical well-being support and accessibility to those in disadvantaged socio-economic backgrounds where healthcare access is further limited.

METHOD

Study One comprised a thematic analysis of mental health applications featuring CAs from the public forum, Reddit. Study Two explored emerging usability themes of an SMS-based CA designed to improve accessibility to well-being services alongside a commercially available CA, Woebot.

RESULTS

Study One identified several themes, including accessibility and availability, communication style, and anthropomorphism as important features. Study Two identified themes such as user response modality, perceived CA role, question specificity, and conversation flow control as critical for user engagement.

CONCLUSION

Various themes emerged from individuals' experiences regarding CA features, functionality, and responses. The mixed experiences relevant to the communication and conversational styles between the CA and the user suggest varied motivations for using CAs for mental and physical well-being.

APPLICATION

Practical recommendations to encourage continued use include providing dynamic response modalities, anthropomorphizing the chatbot, and calibrating expectations early.

Question-based computational language approach outperforms rating scales in quantifying emotional states

Psychological constructs are commonly quantified with closed-ended rating scales. However, recent advancements in natural language processing (NLP) enable the quantification of open-ended language responses. Here we demonstrate that descriptive word responses analyzed using NLP show higher accuracy in categorizing emotional states compared to traditional rating scales. One group of participants (N = 297) generated narratives related to depression, anxiety, satisfaction, or harmony, summarized them with five descriptive words, and rated them using rating scales. Another group (N = 434) evaluated these narratives (with descriptive words and rating scales) from the author's perspective. The descriptive words were quantified using NLP, and machine learning was used to categorize the responses into the corresponding emotional states. The results showed a significantly higher number of accurate categorizations of the narratives based on descriptive words (64%) than on rating scales (44%), questioning the notion that rating scales are more precise in measuring emotional states than language-based measures.

Ethical guidance for conducting health research with online communities: A scoping review of existing guidance

Online research methods have grown in popularity due in part to the globalised and far-reaching nature of the internet but also linked to the Covid-19 pandemic whereby restrictions to travel and face to face contact necessitated a shift in methods of research recruitment and data collection. Ethical guidance exists to support researchers in conducting online research, however this is lacking within health fields. This scoping review aims to synthesise formal ethical guidance for applying online methods within health research as well as provide examples of where guidance has been used. A systematic search of literature was conducted, restricted to English language records between 2013 and 2022. Eligibility focused on whether the records were providing ethical guidance or recommendations, were situated or relevant to health disciplines, and involved the use or discussion of online research methods. Following exclusion of ineligible records and duplicate removal, three organisational ethical guidance and 24 research papers were charted and thematically analysed. Four key themes were identified within the guidance documents, 1) consent, 2) confidentiality and privacy, 3) protecting participants from harm and 4) protecting researchers from harm with the research papers describing additional context and understanding around these issues. The review identified that there are currently no specific guidelines aimed at health researchers, with the most cited guidance coming from broader methodological perspectives and disciplines or auxiliary fields. All guidance discussed each of the four key themes within the wider context of sensitive topics and vulnerable populations, areas and issues which are often prominent within health research thus highlighting the need for unifying guidance specific for health researchers. Further research should aim to understand better how online health studies apply ethical principles, to support in informing gaps across both research and guidance.

Patient listening on social media for patient-focused drug development: a synthesis of considerations from patients, industry and regulators

Patients, life science industry and regulatory authorities are united in their goal to reduce the disease burden of patients by closing remaining unmet needs. Patients have, however, not always been systematically and consistently involved in the drug development process. Recognizing this gap, regulatory bodies worldwide have initiated patient-focused drug development (PFDD) initiatives to foster a more systematic involvement of patients in the drug development process and to ensure that outcomes measured in clinical trials are truly relevant to patients and represent significant improvements to their quality of life. As a source of real-world evidence (RWE), social media has been consistently shown to capture the first-hand, spontaneous and unfiltered disease and treatment experience of patients and is acknowledged as a valid method for generating patient experience data by the Food and Drug Administration (FDA). While social media listening (SML) methods are increasingly applied to many diseases and use cases, a significant piece of uncertainty remains on how evidence derived from social media can be used in the drug development process and how it can impact regulatory decision making, including legal and ethical aspects. In this policy paper, we review the perspectives of three key stakeholder groups on the role of SML in drug development, namely patients, life science companies and regulators. We also carry out a systematic review of current practices and use cases for SML and, in particular, highlight benefits and drawbacks for the use of SML as a way to identify unmet needs of patients. While we find that the stakeholders are strongly aligned regarding the potential of social media for PFDD, we identify key areas in which regulatory guidance is needed to reduce uncertainty regarding the impact of SML as a source of patient experience data that has impact on regulatory decision making.

Automated data analysis of unstructured grey literature in health research: A mapping review

The amount of grey literature and 'softer' intelligence from social media or websites is vast. Given the long lead-times of producing high-quality peer-reviewed health information, this is causing a demand for new ways to provide prompt input for secondary research. To our knowledge, this is the first review of automated data extraction methods or tools for health-related grey literature and soft data, with a focus on (semi)automating horizon scans, health technology assessments (HTA), evidence maps, or other literature reviews. We searched six databases to cover both health- and computer-science literature. After deduplication, 10% of the search results were screened by two reviewers, the remainder was single-screened up to an estimated 95% sensitivity; screening was stopped early after screening an additional 1000 results with no new includes. All full texts were retrieved, screened, and extracted by a single reviewer and 10% were checked in duplicate. We included 84 papers covering automation for health-related social media, internet fora, news, patents, government agencies and charities, or trial registers. From each paper, we extracted data about important functionalities for users of the tool or method; information about the level of support and reliability; and about practical challenges and research gaps. Poor availability of code, data, and usable tools leads to low transparency regarding performance and duplication of work. Financial implications, scalability, integration into downstream workflows, and meaningful evaluations should be carefully planned before starting to develop a tool, given the vast amounts of data and opportunities those tools offer to expedite research.

Characterizing Precision Nutrition Discourse on Twitter: Quantitative Content Analysis

BACKGROUND

It is possible that tailoring dietary approaches to an individual's genomic profile could provide optimal dietary inputs for biological functioning and support adherence to dietary management protocols. The science required for such nutrigenetic and nutrigenomic profiling is not yet considered ready for broad application by the scientific and medical communities; however, many personalized nutrition products are available in the marketplace, creating the potential for hype and misleading information on social media. Twitter provides a unique big data source that provides real-time information. Therefore, it has the potential to disseminate evidence-based health information, as well as misinformation.

OBJECTIVE

We sought to characterize the landscape of precision nutrition content on Twitter, with a specific focus on nutrigenetics and nutrigenomics. We focused on tweet authors, types of content, and presence of misinformation.

METHODS

Twitter Archiver was used to capture tweets from September 1, 2020, to December 1, 2020, using keywords related to nutrition and genetics. A random sample of tweets was coded using quantitative content analysis by 4 trained coders. Codebook-driven, quantified information about tweet authors, content details, information quality, and engagement metrics were compiled and analyzed.

RESULTS

The most common categories of tweets were precision nutrition products and nutrigenomic concepts. About a quarter (132/504, 26.2%) of tweet authors presented themselves as science experts, medicine experts, or both. Nutrigenetics concepts most frequently came from authors with science and medicine expertise, and tweets about the influence of genes on weight were more likely to come from authors with neither type of expertise. A total of 14.9% (75/504) of the tweets were noted to contain untrue information; these were most likely to occur in the nutrigenomics concepts topic category.

CONCLUSIONS

By evaluating social media discourse on precision nutrition on Twitter, we made several observations about the content available in the information environment through which individuals can learn about related concepts and products. Tweet content was consistent with the indicators of medical hype, and the inclusion of potentially misleading and untrue information was common. We identified a contingent of users with scientific and medical expertise who were active in discussing nutrigenomics concepts and products and who may be encouraged to share credible expert advice on precision nutrition and tackle false information as this technology develops.

Specific challenges posed by artificial intelligence in research ethics

Background

The twenty first century is often defined as the era of Artificial Intelligence (AI), which raises many questions regarding its impact on society. It is already significantly changing many practices in different fields. Research ethics (RE) is no exception. Many challenges, including responsibility, privacy, and transparency, are encountered. Research ethics boards (REB) have been established to ensure that ethical practices are adequately followed during research projects. This scoping review aims to bring out the challenges of AI in research ethics and to investigate if REBs are equipped to evaluate them.

Methods

Three electronic databases were selected to collect peer-reviewed articles that fit the inclusion criteria (English or French, published between 2016 and 2021, containing AI, RE, and REB). Two instigators independently reviewed each piece by screening with Covidence and then coding with NVivo.

Results

From having a total of 657 articles to review, we were left with a final sample of 28 relevant papers for our scoping review. The selected literature described AI in research ethics (i.e., views on current guidelines, key ethical concept and approaches, key issues of the current state of AI-specific RE guidelines) and REBs regarding AI (i.e., their roles, scope and approaches, key practices and processes, limitations and challenges, stakeholder perceptions). However, the literature often described REBs ethical assessment practices of projects in AI research as lacking knowledge and tools.

Conclusion

Ethical reflections are taking a step forward while normative guidelines adaptation to AI's reality is still dawdling. This impacts REBs and most stakeholders involved with AI. Indeed, REBs are not equipped enough to adequately evaluate AI research ethics and require standard guidelines to help them do so.

Signals of increasing co-use of stimulants and opioids from online drug forum data

Background

Despite recent rises in fatal overdoses involving multiple substances, there is a paucity of knowledge about stimulant co-use patterns among people who use opioids (PWUO) or people being treated with medications for opioid use disorder (PTMOUD). A better understanding of the timing and patterns in stimulant co-use among PWUO based on mentions of these substances on social media can help inform prevention programs, policy, and future research directions. This study examines stimulant co-mention trends among PWUO/PTMOUD on social media over multiple years.

Methods

We collected publicly available data from 14 forums on Reddit (subreddits) that focused on prescription and illicit opioids, and medications for opioid use disorder (MOUD). Collected data ranged from 2011 to 2020, and we also collected timelines comprising past posts from a sample of Reddit users (Redditors) on these forums. We applied natural language processing to generate lexical variants of all included prescription and illicit opioids and stimulants and detect mentions of them on the chosen subreddits. Finally, we analyzed and described trends and patterns in co-mentions.

Results

Posts collected for 13,812 Redditors showed that 12,306 (89.1%) mentioned at least 1 opioid, opioid-related medication, or stimulant. Analyses revealed that the number and proportion of Redditors mentioning both opioids and/or opioid-related medications and stimulants steadily increased over time. Relative rates of co-mentions by the same Redditor of heroin and methamphetamine, the substances most commonly co-mentioned, decreased in recent years, while co-mentions of both fentanyl and MOUD with methamphetamine increased.

Conclusion

Our analyses reflect increasing mentions of stimulants, particularly methamphetamine, among PWUO/PTMOUD, which closely resembles the growth in overdose deaths involving both opioids and stimulants. These findings are consistent with recent reports suggesting increasing stimulant use among people receiving treatment for opioid use disorder. These data offer insights on emerging trends in the overdose epidemic and underscore the importance of scaling efforts to address co-occurring opioid and stimulant use including harm reduction and comprehensive healthcare access spanning mental-health services and substance use disorder treatment.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12954-022-00628-2.

Artificial Intelligence Tools for Suicide Prevention in Adolescents and Young Adults

Background:

Artificial Intelligence is making a significant transformation in human lives. Its application in the medical and healthcare field has been also observed making an impact and improving overall outcomes. There has been a quest for similar processes in mental health due to the lack of observable changes in the areas of suicide prevention. In the last five years, there has been an emerging body of empirical research applying the technology of artificial intelligence (AI) and machine learning (ML) in mental health.

Objective:

To review the clinical applicability of the AI/ML-based tools in suicide prevention.

Methods:

The compelling question of predicting suicidality has been the focus of this research. We performed a broad literature search and then identified 36 articles relevant to meet the objectives of this review. We review the available evidence and provide a brief overview of the advances in this field.

Conclusion:

In the last five years, there has been more evidence supporting the implementation of these algorithms in clinical practice. Its current clinical utility is limited to using electronic health records and could be highly effective in conjunction with existing tools for suicide prevention. Other potential sources of relevant data include smart devices and social network sites. There are some serious questions about data privacy and ethics which need more attention while developing these new modalities in suicide research.

Assessing the reliability of automatic sentiment analysis tools on rating the sentiment of reviews of NHS dental practices in England

Background

Online reviews may act as a rich source of data to assess the quality of dental practices. Assessing the content and sentiment of reviews on a large scale is time consuming and expensive. Automation of the process of assigning sentiment to big data samples of reviews may allow for reviews to be used as Patient Reported Experience Measures for primary care dentistry.

Aim

To assess the reliability of three different online sentiment analysis tools (Amazon Comprehend DetectSentiment API (ACDAPI), Google and Monkeylearn) at assessing the sentiment of reviews of dental practices working on National Health Service contracts in the United Kingdom.

Methods

A Python 3 script was used to mine 15800 reviews from 4803 unique dental practices on the NHS.uk websites between April 2018 –March 2019. A random sample of 270 reviews were rated by the three sentiment analysis tools. These reviews were rated by 3 blinded independent human reviewers and a pooled sentiment score was assigned. Kappa statistics and polychoric evalutaiton were used to assess the level of agreement. Disagreements between the automated and human reviewers were qualitatively assessed.

Results

There was good agreement between the sentiment assigned to reviews by the human reviews and ACDAPI (k = 0.660). The Google (k = 0.706) and Monkeylearn (k = 0.728) showed slightly better agreement at the expense of usability on a massive dataset. There were 33 disagreements in rating between ACDAPI and human reviewers, of which n = 16 were due to syntax errors, n = 10 were due to misappropriation of the strength of conflicting emotions and n = 7 were due to a lack of overtly emotive language in the text.

Conclusions

There is good agreement between the sentiment of an online review assigned by a group of humans and by cloud-based sentiment analysis. This may allow the use of automated sentiment analysis for quality assessment of dental service provision in the NHS.