1
|
Geethanjali R, Valarmathi A. A novel hybrid deep learning IChOA-CNN-LSTM model for modality-enriched and multilingual emotion recognition in social media. Sci Rep 2024; 14:22270. [PMID: 39333289 PMCID: PMC11436932 DOI: 10.1038/s41598-024-73452-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2024] [Accepted: 09/17/2024] [Indexed: 09/29/2024] Open
Abstract
In the rapidly evolving field of artificial intelligence, the importance of multimodal sentiment analysis has never been more evident, especially amid the ongoing COVID-19 pandemic. Our research addresses the critical need to understand public sentiment across various dimensions of this crisis by integrating data from multiple modalities, such as text, images, audio, and videos sourced from platforms like Twitter. Conventional methods, which primarily focus on text analysis, often fall short in capturing the nuanced intricacies of emotional states, necessitating a more comprehensive approach. To tackle this challenge, our proposed framework introduces a novel hybrid model, IChOA-CNN-LSTM, which leverages Convolutional Neural Networks (CNNs) for precise image feature extraction, Long Short-Term Memory (LSTM) networks for sequential data analysis, and an Improved Chimp Optimization Algorithm for effective feature fusion. Remarkably, our model achieves an impressive accuracy rate of 97.8%, outperforming existing approaches in the field. Additionally, by integrating the GeoCoV19 dataset, we facilitate a comprehensive analysis that spans linguistic and geographical boundaries, enriching our understanding of global pandemic discourse and providing critical insights for informed decision-making in public health crises. Through this holistic approach and innovative techniques, our research significantly advances multimodal sentiment analysis, offering a robust framework for deciphering the complex interplay of emotions during unprecedented global challenges like the COVID-19 pandemic.
Collapse
Affiliation(s)
- R Geethanjali
- Research Scholar, Faculty of Information and Communication Engineering, UCE-BIT Campus, Tiruchirappalli, Anna University, Chennai, Tamilnadu, India.
| | - A Valarmathi
- Assistant Professor, Department of Computer Applications, UCE-BIT Campus, Tiruchirappalli, Anna University, Chennai, Tamilnadu, India
| |
Collapse
|
2
|
Gyftopoulos S, Drosatos G, Fico G, Pecchia L, Kaldoudi E. Analysis of Pharmaceutical Companies' Social Media Activity during the COVID-19 Pandemic and Its Impact on the Public. Behav Sci (Basel) 2024; 14:128. [PMID: 38392481 PMCID: PMC10886074 DOI: 10.3390/bs14020128] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Revised: 01/30/2024] [Accepted: 02/06/2024] [Indexed: 02/24/2024] Open
Abstract
The COVID-19 pandemic, a period of great turmoil, was coupled with the emergence of an "infodemic", a state when the public was bombarded with vast amounts of unverified information from dubious sources that led to a chaotic information landscape. The excessive flow of messages to citizens, combined with the justified fear and uncertainty imposed by the unknown virus, cast a shadow on the credibility of even well-intentioned sources and affected the emotional state of the public. Several studies highlighted the mental toll this environment took on citizens by analyzing their discourse on online social networks (OSNs). In this study, we focus on the activity of prominent pharmaceutical companies on Twitter, currently known as X, as well as the public's response during the COVID-19 pandemic. Communication between companies and users is examined and compared in two discrete channels, the COVID-19 and the non-COVID-19 channel, based on the content of the posts circulated in them in the period between March 2020 and September 2022, while the emotional profile of the content is outlined through a state-of-the-art emotion analysis model. Our findings indicate significantly increased activity in the COVID-19 channel compared to the non-COVID-19 channel while the predominant emotion in both channels is joy. However, the COVID-19 channel exhibited an upward trend in the circulation of fear by the public. The quotes and replies produced by the users, with a stark presence of negative charge and diffusion indicators, reveal the public's preference for promoting tweets conveying an emotional charge, such as fear, surprise, and joy. The findings of this research study can inform the development of communication strategies based on emotion-aware messages in future crises.
Collapse
Affiliation(s)
- Sotirios Gyftopoulos
- European Alliance for Medical and Biological Engineering and Science, 3001 Leuven, Belgium
- Institute for Language and Speech Processing, Athena Research Center, 67100 Xanthi, Greece
| | - George Drosatos
- European Alliance for Medical and Biological Engineering and Science, 3001 Leuven, Belgium
- Institute for Language and Speech Processing, Athena Research Center, 67100 Xanthi, Greece
| | - Giuseppe Fico
- European Alliance for Medical and Biological Engineering and Science, 3001 Leuven, Belgium
- Life Supporting Technologies, Universidad Politécnica de Madrid, 28040 Madrid, Spain
| | - Leandro Pecchia
- European Alliance for Medical and Biological Engineering and Science, 3001 Leuven, Belgium
- School of Engineering, University of Warwick, Coventry CV4 7AL, UK
- Department of Engineering, Università Campus Bio-Medico di Roma, 00128 Rome, Italy
| | - Eleni Kaldoudi
- European Alliance for Medical and Biological Engineering and Science, 3001 Leuven, Belgium
- Institute for Language and Speech Processing, Athena Research Center, 67100 Xanthi, Greece
- School of Medicine, Democritus University of Thrace, 68100 Alexandroupoli, Greece
| |
Collapse
|
3
|
Gao J, Gallegos GA, West JF. Public Health Policy, Political Ideology, and Public Emotion Related to COVID-19 in the U.S. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2023; 20:6993. [PMID: 37947551 PMCID: PMC10649259 DOI: 10.3390/ijerph20216993] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Revised: 10/25/2023] [Accepted: 10/26/2023] [Indexed: 11/12/2023]
Abstract
Social networks, particularly Twitter 9.0 (known as X as of 23 July 2023), have provided an avenue for prompt interactions and sharing public health-related concerns and emotions, especially during the COVID-19 pandemic when in-person communication became less feasible due to stay-at-home policies in the United States (U.S.). The study of public emotions extracted from social network data has garnered increasing attention among scholars due to its significant predictive value for public behaviors and opinions. However, few studies have explored the associations between public health policies, local political ideology, and the spatial-temporal trends of emotions extracted from social networks. This study aims to investigate (1) the spatial-temporal clustering trends (or spillover effects) of negative emotions related to COVID-19; and (2) the association relationships between public health policies such as stay-at-home policies, political ideology, and the negative emotions related to COVID-19. This study employs multiple statistical methods (zero-inflated Poisson (ZIP) regression, random-effects model, and spatial autoregression (SAR) model) to examine relationships at the county level by using the data merged from multiple sources, mainly including Twitter 9.0, Johns Hopkins, and the U.S. Census Bureau. We find that negative emotions related to COVID-19 extracted from Twitter 9.0 exhibit spillover effects, with counties implementing stay-at-home policies or leaning predominantly Democratic showing higher levels of observed negative emotions related to COVID-19. These findings highlight the impact of public health policies and political polarization on spatial-temporal public emotions exhibited in social media. Scholars and policymakers can benefit from understanding how public policies and political ideology impact public emotions to inform and enhance their communication strategies and intervention design during public health crises such as the COVID-19 pandemic.
Collapse
Affiliation(s)
- Jingjing Gao
- Department of Management, Policy and Community Health, School of Public Health, The University of Texas Health Science Center at Houston (UTHealth Houston), El Paso, TX 79905, USA;
| | - Gabriela A. Gallegos
- Department of Management, Policy and Community Health, School of Public Health, The University of Texas Health Science Center at Houston (UTHealth Houston), El Paso, TX 79905, USA;
| | - Joe F. West
- College of Health Sciences, The University of North Carolina at Pembroke, Pembroke, NC 28372, USA;
| |
Collapse
|
4
|
Sainz-Santamaria J, Moctezuma D, Martinez-Cruz AL, Téllez ES, Graff M, Miranda-Jiménez S. Contesting views on mobility restrictions in urban green spaces amid COVID-19-Insights from Twitter in Latin America and Spain. CITIES (LONDON, ENGLAND) 2023; 132:104094. [PMID: 36407936 PMCID: PMC9648905 DOI: 10.1016/j.cities.2022.104094] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/09/2021] [Revised: 10/26/2022] [Accepted: 11/02/2022] [Indexed: 05/05/2023]
Abstract
Positive sentiments towards urban green spaces (UGS) unequivocally increased worldwide amid COVID-19. In contrast, this paper documents that views on mobility restrictions applicable to UGS are of a contested nature. That is, while residents unambiguously report positive sentiments towards UGS, they do not share views on how to administer access to UGS-which is a matter of public policy. These contesting views reflect opposite demands that managers of UGS had to balance during the pandemic as they faced the challenge of reducing risk of spread while providing services that support physical and mental health of residents. The empirical analysis in this paper relies on views inferred through a text classification algorithm implemented on Twitter messages posted from January to October 2020, by urban residents in three Latin American countries-Argentina, Colombia, and Mexico-and Spain. The focus on Latin America is motivated by the documented lack of compliance with mobility restrictions; Spain works as a comparison point to learn differences with respect to other regions. Understanding and following in real-time the evolution of contesting views amid a pandemic is useful for managers and city planners to inform adaptation measures-e.g. communication strategies can be tailored to residents with specific views.
Collapse
Affiliation(s)
- Jaime Sainz-Santamaria
- Department of Public Administration, Centro de Investigacion y Docencia Economicas (CIDE) Sede Región Centro, Aguascalientes, Mexico
| | - Daniela Moctezuma
- Laboratorio Nacional de GeoInteligencia Territorial, Centro de Investigación en Ciencias de Información Geoespacial (CentroGEO), Aguascalientes, Mexico
| | - Adan L Martinez-Cruz
- Department of Forest Economics and Centre for Environmental and Resource Economics (CERE), Swedish University of Agricultural Sciences (SLU), Umeå, Sweden
| | - Eric S Téllez
- Centro de Investigación e Innovación en Tecnologías de la Información y Comunicación (INFOTEC), Aguascalientes, Mexico
| | - Mario Graff
- Centro de Investigación e Innovación en Tecnologías de la Información y Comunicación (INFOTEC), Aguascalientes, Mexico
| | - Sabino Miranda-Jiménez
- Centro de Investigación e Innovación en Tecnologías de la Información y Comunicación (INFOTEC), Aguascalientes, Mexico
| |
Collapse
|
5
|
Sunitha D, Patra RK, Babu NV, Suresh A, Gupta SC. Twitter sentiment analysis using ensemble based deep learning model towards COVID-19 in India and European countries. Pattern Recognit Lett 2022; 158:164-170. [PMID: 35464347 PMCID: PMC9014659 DOI: 10.1016/j.patrec.2022.04.027] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Revised: 04/06/2022] [Accepted: 04/16/2022] [Indexed: 11/22/2022]
Abstract
As of November 2021, more than 24.80 crore people are diagnosed with the coronavirus in that around 50.20 lakhs people lost their lives, because of this infectious disease. By understanding the people's sentiment's expressed in their social media (Facebook, Twitter, Instagram etc.) helps their governments in controlling, monitoring, and eradicating the coronavirus. Compared to other social media's, the twitter data are indispensable in the extraction of useful awareness information related to any crisis. In this article, a sentiment analysis model is proposed to analyze the real time tweets, which are related to coronavirus. Initially, around 3100 Indian and European people's tweets are collected between the time period of 23.03.2020 to 01.11.2021. Next, the data pre-processing and exploratory investigation are accomplished for better understanding of the collected data. Further, the feature extraction is performed using Term Frequency-Inverse Document Frequency (TF-IDF), GloVe, pre-trained Word2Vec, and fast text embedding's. The obtained feature vectors are fed to the ensemble classifier (Gated Recurrent Unit (GRU) and Capsule Neural Network (CapsNet)) for classifying the user's sentiment's as anger, sad, joy, and fear. The obtained experimental outcomes showed that the proposed model achieved 97.28% and 95.20% of prediction accuracy in classifying the both Indian and European people's sentiments.
Collapse
Affiliation(s)
- D Sunitha
- Department of Computer Science & Engineering, Kamala Institute of Technology & Science, Singapur, Telangana 505468, India
| | | | - N V Babu
- Department of Electrical and Electronics Engineering, SJB Institute of Technology, Bangalore, India
| | - A Suresh
- Department of Computer Science and Engineering, Veltech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Chennai, India
| | - Suresh Chand Gupta
- Department of Computer Science & Engineering, Panipat Institute of Engineering and Technology, Panipat, Haryana, India
| |
Collapse
|
6
|
Fernández-Isabel A, Cabezas J, Moctezuma D, de Diego IM. Improving Sentiment Classification Performance through Coaching Architectures. Cognit Comput 2022; 15:1065-1081. [PMID: 35497382 PMCID: PMC9043891 DOI: 10.1007/s12559-022-10018-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2021] [Accepted: 03/31/2022] [Indexed: 11/05/2022]
Abstract
Intelligent systems have been developed for years to solve specific tasks automatically. An important issue emerges when the information used by these systems exhibits a dynamic nature and evolves. This fact adds a level of complexity that makes these systems prone to a noticeable worsening of their performance. Thus, their capabilities have to be upgraded to address these new requirements. Furthermore, this problem is even more challenging when the information comes from human individuals and their interactions through language. This issue happens more easily and forcefully in the specific domain of Sentiment Analysis, where feelings and opinions of humans are in constant evolution. In this context, systems are trained with an enormous corpus of textual content, or they include an extensive set of words and their related sentiment values. These solutions are usually static and generic, making their manual upgrading almost unworkable. In this paper, an automatic and interactive coaching architecture is proposed. It includes a ML framework and a dictionary-based system both trained for a specific domain. These systems converse about the outcomes obtained during their respective learning stages by simulating human interactive coaching sessions. This leads to an Active Learning process where the dictionary-based system acquires new information and improves its performance. More than 800, 000 tweets have been gathered and processed for experiments. Outstanding results were obtained when the proposed architecture was used. Also, the lexicon was updated with the prior and new words related to the corpus used which is important to reach a better sentiment analysis classification.
Collapse
|
7
|
Santoveña-Casal S, Pérez MDF. Relevance of E-Participation in the state health campaign in Spain: #EstoNoEsUnJuego / #ThisIsNotAGame. TECHNOLOGY IN SOCIETY 2022; 68:101877. [PMID: 36540135 PMCID: PMC9755482 DOI: 10.1016/j.techsoc.2022.101877] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Revised: 12/29/2021] [Accepted: 01/03/2022] [Indexed: 06/17/2023]
Abstract
Confronting the COVID-19 health emergency has forced public administrations in Spain to work with various networks as a means of promoting their campaigns to citizens. This paper aims to analyse digital citizens' e-participation by focusing on the state health campaign #EstoNoEsUnJuego - #ThisIsNotAGame. This campaign was launched by the Spanish Ministry of Health in September 2020 via Twitter with the objective of reinforcing protection measures against the virus. A sample consisting of 19,576 tweets, sent from September 2020 to February 2021, was investigated and the results have indicated that, of 9133 users, 64.8% of citizens collaborated in the dissemination of tweets. It was observed that most messages supported the campaign by disseminating information on measures, data and news. Only 0.1% of the messages were aggressive. The conclusion is that, despite not having created a true form of communication between public institutions and citizens, e-participation has generated a functional connection between them. Citizens have acquired a responsible and participatory digital role which, although failing to show personal involvement in their comments, has been the main driving force behind the success of this campaign.
Collapse
Affiliation(s)
- Sonia Santoveña-Casal
- Department of Education, National University of Distance Education, C/ Juan del Rosal, 14, Madrid, 28040, Spain
| | - Ma Dolores Fernández Pérez
- Department of Education, National University of Distance Education, C/ Juan del Rosal, 14, Madrid, 28040, Spain
| |
Collapse
|
8
|
How Does the World View China’s Carbon Policy? A Sentiment Analysis on Twitter Data. ENERGIES 2021. [DOI: 10.3390/en14227782] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/21/2023]
Abstract
China has recently put forth an ambitious plan to achieve carbon peak around 2030 and carbon neutrality around 2060. However, there are quite a few differences regarding the public views about China’s carbon policy between the Chinese people and the people from other countries, especially concerning the doubt of foreign people about the fidelity of China’s carbon policy goals. Based on Twitter data related to China’s carbon policy topics from 2008 to 2020, this study shows the inter- and intra-annual trends in the count of tweets about China’s carbon policy, conducts sentiment analysis, extracts top frequency words from different attitudes, and analyzes the impact of China’s official Twitter accounts on the global view of China’s carbon policy. Our results show: (1) the global attention to China’s carbon policy gradually rises and occasionally rises suddenly due to important carbon events; (2) the proportion of Twitter users with negative sentiment about China’s carbon policy has increased rapidly and has exceeded the proportion of Twitter users with positive sentiment since 2019; (3) people in developing countries hold more positive or neutral attitudes towards China’s carbon policy, while developed countries hold more negative attitudes; (4) China’s official Twitter accounts serve to improve the global views on China’s carbon policy.
Collapse
|