1
|
Golder S, O'Connor K, Wang Y, Klein A, Gonzalez Hernandez G. The Value of Social Media Analysis for Adverse Events Detection and Pharmacovigilance: Scoping Review. JMIR Public Health Surveill 2024; 10:e59167. [PMID: 39240684 DOI: 10.2196/59167] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2024] [Revised: 05/03/2024] [Accepted: 05/30/2024] [Indexed: 09/07/2024] Open
Abstract
BACKGROUND Adverse drug events pose an enormous public health burden, leading to hospitalization, disability, and death. Even the adverse events (AEs) categorized as nonserious can severely impact on patient's quality of life, adherence, and persistence. Monitoring medication safety is challenging. Web-based patient reports on social media may be a useful supplementary source of real-world data. Despite the growth of sophisticated techniques for identifying AEs using social media data, a consensus has not been reached as to the value of social media in relation to more traditional data sources. OBJECTIVE This study aims to evaluate and characterize the utility of social media analysis in adverse drug event detection and pharmacovigilance as compared with other data sources (such as spontaneous reporting systems and the clinical literature). METHODS In this scoping review, we searched 11 bibliographical databases and Google Scholar, followed by handsearching and forward and backward citation searching. Each record was screened by 2 independent reviewers at both the title and abstract stage and the full-text screening stage. Studies were included if they used any type of social media (such as Twitter or patient forums) to detect AEs associated with any drug medication and compared the results ascertained from social media to any other data source. Study information was collated using a piloted data extraction sheet. Data were extracted on the AEs and drugs searched for and included; the methods used (such as machine learning); social media data source; volume of data analyzed; limitations of the methodology; availability of data and code; comparison data source and comparison methods; results, including the volume of AEs, and how the AEs found compared with other data sources in their seriousness, frequencies, and expectedness or novelty (new vs known knowledge); and conclusions. RESULTS Of the 6538 unique records screened, 73 publications representing 60 studies with a wide variety of extraction methods met our inclusion criteria. The most common social media platforms used were Twitter and online health forums. The most common comparator data source was spontaneous reporting systems, although other comparisons were also made, such as with scientific literature and product labels. Although similar patterns of AE reporting tended to be identified, the frequencies were lower in social media. Social media data were found to be useful in identifying new or unexpected AEs and in identifying AEs in a timelier manner. CONCLUSIONS There is a large body of research comparing AEs from social media to other sources. Most studies advocate the use of social media as an adjunct to traditional data sources. Some studies also indicate the value of social media in understanding patient perspectives such as the impact of AEs, which could be better explored. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) RR2-10.2196/47068.
Collapse
Affiliation(s)
- Su Golder
- University of York, York, United Kingdom
| | - Karen O'Connor
- University of Pennsylvannia, Philadelphia, PA, United States
| | - Yunwen Wang
- Cedars-Sinai Medical Center, Los Angeles, CA, United States
| | - Ari Klein
- University of Pennsylvannia, Philadelphia, PA, United States
| | | |
Collapse
|
2
|
Holtorf AP, Danyliv A, Krause A, Hanna A, Venable Y, Mattingly TJ, Huang LY, Pierre M, Silveira Silva A, Walsh D. Ethical and legal considerations in social media research for health technology assessment: conclusions from a scoping review. Int J Technol Assess Health Care 2023; 39:e62. [PMID: 37842838 PMCID: PMC11570170 DOI: 10.1017/s0266462323000399] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Revised: 04/24/2023] [Accepted: 06/17/2023] [Indexed: 10/17/2023]
Abstract
OBJECTIVES The objective was to identify and describe the published guidance and current academic discourse of ethical issues and standards related to the use of Social Media Research for generating patient insights for the use by health technology assessment (HTA) or health policy decisions. METHODS A scoping review of the literature was conducted in PubMed and Embase and identified 935 potential references published between January 2017 and June 2021. After title and abstract screening by three reviewers, 40 publications were included, the relevant information was extracted and data were collected in a mind map, which was then used to structure the output of the review. RESULTS Social Media Research may reveal new insights of relevance to HTA or health policies into patient needs, patient experiences, or patient behaviors. However, the research approaches, methods, data use, interpretation, and communication may expose those who post the data in social media channels to risks and potential harms relating to privacy, anonymity/confidentiality, authenticity, context, and rapidly changing technologies. CONCLUSIONS An actively engaged approach to ensuring ethical innocuousness is recommended that carefully follows best practices throughout planning, conduct, and communication of the research. Throughout the process and as a follow-up, there should be a discourse with the ethical experts to maximally protect the current and future users of social media, to support their trust in the research, and to advance the knowledge in parallel to the advancement of the media themselves, the technologies, and the research tools.
Collapse
Affiliation(s)
- Anke-Peggy Holtorf
- PCIG Project Coordinator, Health Outcomes Strategies GmbH, Basel, Switzerland
| | | | | | - Alissa Hanna
- Patient Engagement, Edwards Lifesciences, Irvine, CA, USA
| | | | | | - Li-Ying Huang
- Division of Health Technology Assessment, Center for Drug Evaluation, Taipeh, Taiwan
| | - Miranda Pierre
- Scottish Medicines Consortium, Healthcare Improvement Scotland, Glasgow, Scotland
| | | | - Donna Walsh
- European Federation of Neurological Associations, Brussels, Belgium
| |
Collapse
|
3
|
Dirkson A, den Hollander D, Verberne S, Desar I, Husson O, van der Graaf WTA, Oosten A, Reyners AKL, Steeghs N, van Loon W, van Oortmerssen G, Gelderblom H, Kraaij W. Sample Bias in Web-Based Patient-Generated Health Data of Dutch Patients With Gastrointestinal Stromal Tumor: Survey Study. JMIR Form Res 2022; 6:e36755. [PMID: 36520526 PMCID: PMC9801270 DOI: 10.2196/36755] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2022] [Revised: 09/21/2022] [Accepted: 09/22/2022] [Indexed: 12/23/2022] Open
Abstract
BACKGROUND Increasingly, social media is being recognized as a potential resource for patient-generated health data, for example, for pharmacovigilance. Although the representativeness of the web-based patient population is often noted as a concern, studies in this field are limited. OBJECTIVE This study aimed to investigate the sample bias of patient-centered social media in Dutch patients with gastrointestinal stromal tumor (GIST). METHODS A population-based survey was conducted in the Netherlands among 328 patients with GIST diagnosed 2-13 years ago to investigate their digital communication use with fellow patients. A logistic regression analysis was used to analyze clinical and demographic differences between forum users and nonusers. RESULTS Overall, 17.9% (59/328) of survey respondents reported having contact with fellow patients via social media. Moreover, 78% (46/59) of forum users made use of GIST patient forums. We found no statistically significant differences for age, sex, socioeconomic status, and time since diagnosis between forum users (n=46) and nonusers (n=273). Patient forum users did differ significantly in (self-reported) treatment phase from nonusers (P=.001). Of the 46 forum users, only 2 (4%) were cured and not being monitored; 3 (7%) were on adjuvant, curative treatment; 19 (41%) were being monitored after adjuvant treatment; and 22 (48%) were on palliative treatment. In contrast, of the 273 patients who did not use disease-specific forums to communicate with fellow patients, 56 (20.5%) were cured and not being monitored, 31 (11.3%) were on curative treatment, 139 (50.9%) were being monitored after treatment, and 42 (15.3%) were on palliative treatment. The odds of being on a patient forum were 2.8 times as high for a patient who is being monitored compared with a patient that is considered cured. The odds of being on a patient forum were 1.9 times as high for patients who were on curative (adjuvant) treatment and 10 times as high for patients who were in the palliative phase compared with patients who were considered cured. Forum users also reported a lower level of social functioning (84.8 out of 100) than nonusers (93.8 out of 100; P=.008). CONCLUSIONS Forum users showed no particular bias on the most important demographic variables of age, sex, socioeconomic status, and time since diagnosis. This may reflect the narrowing digital divide. Overrepresentation and underrepresentation of patients with GIST in different treatment phases on social media should be taken into account when sourcing patient forums for patient-generated health data. A further investigation of the sample bias in other web-based patient populations is warranted.
Collapse
Affiliation(s)
- Anne Dirkson
- Leiden Institute of Advanced Computer Science, Leiden University, Leiden, Netherlands
| | - Dide den Hollander
- Department of Medical Oncology, The Netherlands Cancer Institute, Amsterdam, Netherlands
- Department of Psychosocial Research and Epidemiology, The Netherlands Cancer Institute, Amsterdam, Netherlands
- Department of Medical Oncology, Radboud University Medical Center, Nijmegen, Netherlands
| | - Suzan Verberne
- Leiden Institute of Advanced Computer Science, Leiden University, Leiden, Netherlands
| | - Ingrid Desar
- Department of Medical Oncology, Radboud University Medical Center, Nijmegen, Netherlands
| | - Olga Husson
- Department of Medical Oncology, The Netherlands Cancer Institute, Amsterdam, Netherlands
- Department of Psychosocial Research and Epidemiology, The Netherlands Cancer Institute, Amsterdam, Netherlands
- Department of Surgical Oncology, Erasmus Medical Center, Rotterdam, Netherlands
| | - Winette T A van der Graaf
- Department of Medical Oncology, The Netherlands Cancer Institute, Amsterdam, Netherlands
- Department of Medical Oncology, Erasmus Medical Center, Rotterdam, Netherlands
| | - Astrid Oosten
- Department of Medical Oncology, Erasmus Medical Center, Rotterdam, Netherlands
| | - Anna K L Reyners
- Department of Medical Oncology, University Medical Center Groningen, University of Groningen, Groningen, Netherlands
| | - Neeltje Steeghs
- Department of Medical Oncology, The Netherlands Cancer Institute, Amsterdam, Netherlands
| | - Wouter van Loon
- Department of Methodology and Statistics, Leiden University, Leiden, Netherlands
| | - Gerard van Oortmerssen
- Leiden Institute of Advanced Computer Science, Leiden University, Leiden, Netherlands
- Sarcoma Patient Advocacy Global Network, Wölfersheim, Germany
| | - Hans Gelderblom
- Department of Medical Oncology, Leiden University Medical Center, Leiden, Netherlands
| | - Wessel Kraaij
- Leiden Institute of Advanced Computer Science, Leiden University, Leiden, Netherlands
- The Netherlands Organisation for Applied Scientific Research, Den Haag, Netherlands
| |
Collapse
|
4
|
Automated gathering of real-world data from online patient forums can complement pharmacovigilance for rare cancers. Sci Rep 2022; 12:10317. [PMID: 35725736 PMCID: PMC9209513 DOI: 10.1038/s41598-022-13894-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2021] [Accepted: 05/30/2022] [Indexed: 12/01/2022] Open
Abstract
Current methods of pharmacovigilance result in severe under-reporting of adverse drug events (ADEs). Patient forums have the potential to complement current pharmacovigilance practices by providing real-time uncensored and unsolicited information. We are the first to explore the value of patient forums for rare cancers. To this end, we conduct a case study on a patient forum for Gastrointestinal Stromal Tumor patients. We have developed machine learning algorithms to automatically extract and aggregate side effects from messages on open online discussion forums. We show that patient forum data can provide suggestions for which ADEs impact quality of life the most: For many side effects the relative reporting rate differs decidedly from that of the registration trials, including for example cognitive impairment and alopecia as side effects of avapritinib. We also show that our methods can provide real-world data for long-term ADEs, such as osteoporosis and tremors for imatinib, and novel ADEs not found in registration trials, such as dry eyes and muscle cramping for imatinib. We thus posit that automated pharmacovigilance from patient forums can provide real-world data for ADEs and should be employed as input for medical hypotheses for rare cancers.
Collapse
|
5
|
杨 羽, 王 胜, 詹 思. [Utilizing social media data in post-market safety surveillance]. BEIJING DA XUE XUE BAO. YI XUE BAN = JOURNAL OF PEKING UNIVERSITY. HEALTH SCIENCES 2021; 53:623-627. [PMID: 34145872 PMCID: PMC8220064 DOI: 10.19723/j.issn.1671-167x.2021.03.031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 12/10/2020] [Indexed: 06/12/2023]
Abstract
Post-marketing surveillance is the principal means to ensure drug use safety. The spontaneous report is the essential method of post-marketing surveillance for drug safety. Often, most spontaneous reports come from medical staff and sometimes come from patients who use the drug. The posts published by individuals on social media platforms that contain drugs and related adverse reaction content have gradually been seen as a new data source similar to spontaneous reports from drug users in recent years. Those user-generated posts potentially provide researchers and regulators with new opportunities to conduct post-marketing surveillance for drug safety from patients' perspectives mostly rather than medical professionals and can afford the possibility theoretically to discover drug-related safety issues earlier than traditional methods. Social media data as a new data source for safety signal detection and signal reinforcement have the unique advantages, such as population coverage, type of drugs, type of adverse reactions, data timeliness and quantity. Most of the social media data used in post-marketing surveillance research for drug safety are still text data in English, and even multiple languages are used by different people worldwide on several social media platforms. Unfortunately, there is still a controversy in the academic circles whether social media data can be used as reliable data sources for routine post-marketing surveillance for drug safety. A couple of obstacles of data, methods and ethics must be overcome before leveraging social media data for post-marketing surveillance. The number of Chinese social media users is large, and the social media data in the Chinese language is rapidly snowballing, which can be employed as the potential data source for post-marketing surveillance for drug safety. However, due to the Chinese language's specific characteristics, the text's diversity is different from the English text, and there is not enough accepted corpus in medical scenarios. Besides, the lack of domestic laws and regulations on privacy and security protection of social media data poses more challenges for applying Chinese social media data for post-market surveillance. The significance of social media data to post-marketing surveillance for drug safety is undoubtedly significant. It will be an essential development direction for future research to overcome the challenges of using social media data by developing new technologies and establishing new mechanisms.
Collapse
Affiliation(s)
- 羽 杨
- 北京大学健康医疗大数据国家研究院, 北京 100191National Institute of Health Data Science, Peking University, Beijing 100191, China
| | - 胜锋 王
- 北京大学公共卫生学院流行病学与卫生统计学系, 北京 100191Department of Epidemiology and Biostatistics, Peking University School of Public Health, Beijing 100191, Chian
| | - 思延 詹
- 北京大学公共卫生学院流行病学与卫生统计学系, 北京 100191Department of Epidemiology and Biostatistics, Peking University School of Public Health, Beijing 100191, Chian
| |
Collapse
|