1
|
Dong G, Bate A, Haguinet F, Westman G, Dürlich L, Hviid A, Sessa M. Optimizing Signal Management in a Vaccine Adverse Event Reporting System: A Proof-of-Concept with COVID-19 Vaccines Using Signs, Symptoms, and Natural Language Processing. Drug Saf 2024; 47:173-182. [PMID: 38062261 PMCID: PMC10821983 DOI: 10.1007/s40264-023-01381-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/14/2023] [Indexed: 01/28/2024]
Abstract
INTRODUCTION The Vaccine Adverse Event Reporting System (VAERS) has already been challenged by an extreme increase in the number of individual case safety reports (ICSRs) after the market introduction of coronavirus disease 2019 (COVID-19) vaccines. Evidence from scientific literature suggests that when there is an extreme increase in the number of ICSRs recorded in spontaneous reporting databases (such as the VAERS), an accompanying increase in the number of disproportionality signals (sometimes referred to as 'statistical alerts') generated is expected. OBJECTIVES The objective of this study was to develop a natural language processing (NLP)-based approach to optimize signal management by excluding disproportionality signals related to listed adverse events following immunization (AEFIs). COVID-19 vaccines were used as a proof-of-concept. METHODS The VAERS was used as a data source, and the Finding Associated Concepts with Text Analysis (FACTA+) was used to extract signs and symptoms of listed AEFIs from MEDLINE for COVID-19 vaccines. Disproportionality analyses were conducted according to guidelines and recommendations provided by the US Centers for Disease Control and Prevention. By using signs and symptoms of listed AEFIs, we computed the proportion of disproportionality signals dismissed for COVID-19 vaccines using this approach. Nine NLP techniques, including Generative Pre-Trained Transformer 3.5 (GPT-3.5), were used to automatically retrieve Medical Dictionary for Regulatory Activities Preferred Terms (MedDRA PTs) from signs and symptoms extracted from FACTA+. RESULTS Overall, 17% of disproportionality signals for COVID-19 vaccines were dismissed as they reported signs and symptoms of listed AEFIs. Eight of nine NLP techniques used to automatically retrieve MedDRA PTs from signs and symptoms extracted from FACTA+ showed suboptimal performance. GPT-3.5 achieved an accuracy of 78% in correctly assigning MedDRA PTs. CONCLUSION Our approach reduced the need for manual exclusion of disproportionality signals related to listed AEFIs and may lead to better optimization of time and resources in signal management.
Collapse
Affiliation(s)
- Guojun Dong
- Department of Drug Design and Pharmacology, University of Copenhagen, Jagtvej 160, 2100, Copenhagen, Denmark
| | - Andrew Bate
- Global Safety, GSK, Brentford, UK
- Department of Non‑Communicable Disease Epidemiology, London School of Hygiene and Tropical Medicine, London, UK
| | | | - Gabriel Westman
- Department of Medical Sciences, Uppsala University, Uppsala, Sweden
| | - Luise Dürlich
- Department of Linguistics and Philology, Uppsala University, Uppsala, Sweden
- Department of Computer Science, RISE Research Institutes of Sweden, Kista, Sweden
| | - Anders Hviid
- Department of Drug Design and Pharmacology, University of Copenhagen, Jagtvej 160, 2100, Copenhagen, Denmark
- Department of Epidemiology Research, Statens Serum Institut, Copenhagen, Denmark
| | - Maurizio Sessa
- Department of Drug Design and Pharmacology, University of Copenhagen, Jagtvej 160, 2100, Copenhagen, Denmark.
| |
Collapse
|
2
|
Maksimovic N, Gazibara T, Dotlic J, Milic M, Jeremic Stojkovic V, Cvjetkovic S, Markovic G. "It Bothered Me": The Mental Burden of COVID-19 Media Reports on Community-Dwelling Elderly People. MEDICINA (KAUNAS, LITHUANIA) 2023; 59:2011. [PMID: 38004060 PMCID: PMC10673444 DOI: 10.3390/medicina59112011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Revised: 11/01/2023] [Accepted: 11/02/2023] [Indexed: 11/26/2023]
Abstract
Background and Objectives: Elderly people may have difficulties understanding the quality and quantity of information about the COVID-19 epidemic, which can put an additional mental strain on their health and well-being. The purpose of this study was to explore the processing of COVID-19 information among older people. Materials and Methods: A qualitative study was carried out in summer 2021. The sampling was based on the snowball method. This approach allowed us to communicate with the next potential participants relatively freely and without reservations. Two female researchers (both MD, PhD) conducted the interviews. All interviews were held in Serbian. The data were analyzed using qualitative content analysis. Results: The interviews were conducted with 13 participants (average age 71 years). The analysis of qualitative content suggested that four topics could be identified: (1) sources of information, (2) information interest and need, (3) reporting of information and (4) suggestions for better reporting. The participants were troubled by the excess of information, repetitive information about death tolls, unqualified people in media discussing the pandemic and inconsistent reporting. These features caused the participants to feel the psychological burden in processing all the pieces of information. Conclusions: The elderly people in Serbia followed mainstream media to get information about COVID-19; however, they perceived a variety of problems with reporting, which made the understanding of the information difficult and psychologically burdensome. These findings should be taken into consideration when delivering health-related information to elderly people.
Collapse
Affiliation(s)
- Natasa Maksimovic
- Institute of Epidemiology, Faculty of Medicine, University of Belgrade, 11000 Belgrade, Serbia
| | - Tatjana Gazibara
- Institute of Epidemiology, Faculty of Medicine, University of Belgrade, 11000 Belgrade, Serbia
| | - Jelena Dotlic
- Faculty of Medicine, University of Belgrade, 11000 Belgrade, Serbia
- Clinic for Obstetrics and Gynecology, University Clinical Center of Serbia, 11000 Belgrade, Serbia
| | - Marija Milic
- Institute of Public Health of Serbia "Dr. Milan Jovanovic Batut", 11000 Belgrade, Serbia
- Department of Epidemiology, Faculty of Medicine, University of Pristina Temporarily Seated in Kosovska Mitrovica, 38220 Kosovska Mitrovica, Serbia
| | - Vida Jeremic Stojkovic
- Department of Humanities, Faculty of Medicine, University of Belgrade, 11000 Belgrade, Serbia
| | - Smiljana Cvjetkovic
- Department of Humanities, Faculty of Medicine, University of Belgrade, 11000 Belgrade, Serbia
| | | |
Collapse
|
3
|
Cooks EJ, Vilaro MJ, Dyal BW, Wang S, Mertens G, Raisa A, Kim B, Campbell-Salome G, Wilkie DJ, Odedina F, Johnson-Mallard V, Yao Y, Krieger JL. What did the pandemic teach us about effective health communication? Unpacking the COVID-19 infodemic. BMC Public Health 2022; 22:2339. [PMID: 36514047 PMCID: PMC9747260 DOI: 10.1186/s12889-022-14707-3] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Accepted: 11/22/2022] [Indexed: 12/15/2022] Open
Abstract
BACKGROUND The spread of unvetted scientific information about COVID-19 presents a significant challenge to public health, adding to the urgency for increased understanding of COVID-19 information-seeking preferences that will allow for the delivery of evidence-based health communication. This study examined factors associated with COVID-19 information-seeking behavior. METHODS An online survey was conducted with US adults (N = 1800) to identify key interpersonal (e.g., friends, health care providers) and mediated (e.g., TV, social media) sources of COVID-19 information. Logistic regression models were fitted to explore correlates of information-seeking. RESULTS Study findings show that the first sought and most trusted sources of COVID-19 information had different relationships with sociodemographic characteristics, perceived discrimination, and self-efficacy. Older adults had greater odds of seeking information from print materials (e.g., newspapers and magazines) and TV first. Participants with less educational attainment and greater self-efficacy preferred interpersonal sources first, with notably less preference for mass media compared to health care providers. Those with more experiences with discrimination were more likely to seek information from friends, relatives, and co-workers. Additionally, greater self-efficacy was related to increased trust in interpersonal sources. CONCLUSION Study results have implications for tailoring health communication strategies to reach specific subgroups, including those more vulnerable to severe illness from COVID-19. A set of recommendations are provided to assist in campaign development.
Collapse
Affiliation(s)
- Eric J Cooks
- STEM Translational Communication Center, College of Journalism and Communications, University of Florida, Weimer Hall 2043, PO Box 118400, Gainesville, FL, 32611-8400, USA.
| | - Melissa J Vilaro
- Department of Family, Youth, and Community Sciences, University of Florida, Gainesville, USA
| | - Brenda W Dyal
- Department of Biobehavioral Nursing Science, University of Florida, Gainesville, USA
| | - Shu Wang
- Department of Biostatistics, University of Florida, Gainesville, USA
| | - Gillian Mertens
- STEM Translational Communication Center, College of Journalism and Communications, University of Florida, Weimer Hall 2043, PO Box 118400, Gainesville, FL, 32611-8400, USA
| | - Aantaki Raisa
- STEM Translational Communication Center, College of Journalism and Communications, University of Florida, Weimer Hall 2043, PO Box 118400, Gainesville, FL, 32611-8400, USA
| | - Bumsoo Kim
- Department of Media and Communication, Joongbu University, Geumsan, South Korea
| | | | - Diana J Wilkie
- Department of Biobehavioral Nursing Science, University of Florida, Gainesville, USA
| | - Folake Odedina
- Department of Quantitative Health Sciences, Mayo Clinic, Jacksonville, USA
| | | | - Yingwei Yao
- Department of Biobehavioral Nursing Science, University of Florida, Gainesville, USA
| | - Janice L Krieger
- STEM Translational Communication Center, College of Journalism and Communications, University of Florida, Weimer Hall 2043, PO Box 118400, Gainesville, FL, 32611-8400, USA
| |
Collapse
|