1
|
Pena CB, MacCarron P, O’Sullivan DJP. Finding polarized communities and tracking information diffusion on Twitter: a network approach on the Irish Abortion Referendum. ROYAL SOCIETY OPEN SCIENCE 2025; 12:240454. [PMID: 39816737 PMCID: PMC11732405 DOI: 10.1098/rsos.240454] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/20/2024] [Revised: 08/09/2024] [Accepted: 10/07/2024] [Indexed: 01/18/2025]
Abstract
The analysis of social networks enables the understanding of social interactions, polarization of ideas and the spread of information, and therefore plays an important role in society. We use Twitter data-as it is a popular venue for the expression of opinion and dissemination of information-to identify opposing sides of a debate and, importantly, to observe how information spreads between these groups in our current polarized climate. To achieve this, we collected over 688 000 tweets from the Irish Abortion Referendum of 2018 to build a conversation network from users' mentions with sentiment-based homophily. From this network, community detection methods allow us to isolate yes- or no-aligned supporters with high accuracy (90.9%). We supplement this by tracking how information cascades spread via over 31 000 retweet cascades. We found that very little information spread between polarized communities. This provides a valuable methodology for extracting and studying information diffusion on large networks by isolating ideologically polarized groups and exploring the propagation of information within and between these groups.
Collapse
Affiliation(s)
- Caroline B. Pena
- Mathematics Application Consortium for Science and Industry (MACSI), University of Limerick, Limerick, Ireland
| | - Pádraig MacCarron
- Mathematics Application Consortium for Science and Industry (MACSI), University of Limerick, Limerick, Ireland
| | - David J. P. O’Sullivan
- Mathematics Application Consortium for Science and Industry (MACSI), University of Limerick, Limerick, Ireland
| |
Collapse
|
2
|
Guo K, Xie H. Deep learning in finance assessing twitter sentiment impact and prediction on stocks. PeerJ Comput Sci 2024; 10:e2018. [PMID: 38855200 PMCID: PMC11157597 DOI: 10.7717/peerj-cs.2018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Accepted: 04/03/2024] [Indexed: 06/11/2024]
Abstract
The widespread adoption of social media platforms has led to an influx of data that reflects public sentiment, presenting a novel opportunity for market analysis. This research aims to quantify the correlation between the fleeting sentiments expressed on social media and the measurable fluctuations in the stock market. By adapting a pre-existing sentiment analysis algorithm, we refined a model specifically for evaluating the sentiment of tweets associated with financial markets. The model was trained and validated against a comprehensive dataset of stock-related discussions on Twitter, allowing for the identification of subtle emotional cues that may predict changes in stock prices. Our quantitative approach and methodical testing have revealed a statistically significant relationship between sentiment expressed on Twitter and subsequent stock market activity. These findings suggest that machine learning algorithms can be instrumental in enhancing the analytical capabilities of financial experts. This article details the technical methodologies used, the obstacles overcome, and the potential benefits of integrating machine learning-based sentiment analysis into the realm of economic forecasting.
Collapse
Affiliation(s)
- Kaifeng Guo
- Maynooth International Engineering College, Fuzhou University, Fuzhou, Fujian, China
| | - Haoling Xie
- Maynooth International Engineering College, Fuzhou University, Fuzhou, Fujian, China
| |
Collapse
|
3
|
Díaz Berenguer A, Da Y, Bossa MN, Oveneke MC, Sahli H. Causality-driven multivariate stock movement forecasting. PLoS One 2024; 19:e0302197. [PMID: 38662755 PMCID: PMC11045085 DOI: 10.1371/journal.pone.0302197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2024] [Accepted: 03/30/2024] [Indexed: 04/28/2024] Open
Abstract
Our study aims to investigate the interdependence between international stock markets and sentiments from financial news in stock forecasting. We adopt the Temporal Fusion Transformers (TFT) to incorporate intra and inter-market correlations and the interaction between the information flow, i.e. causality, of financial news sentiment and the dynamics of the stock market. The current study distinguishes itself from existing research by adopting Dynamic Transfer Entropy (DTE) to establish an accurate information flow propagation between stock and sentiments. DTE has the advantage of providing time series that mine information flow propagation paths between certain parts of the time series, highlighting marginal events such as spikes or sudden jumps, which are crucial in financial time series. The proposed methodological approach involves the following elements: a FinBERT-based textual analysis of financial news articles to extract sentiment time series, the use of the Transfer Entropy and corresponding heat maps to analyze the net information flows, the calculation of the DTE time series, which are considered as co-occurring covariates of stock Price, and TFT-based stock forecasting. The Dow Jones Industrial Average index of 13 countries, along with daily financial news data obtained through the New York Times API, are used to demonstrate the validity and superiority of the proposed DTE-based causality method along with TFT for accurate stock Price and Return forecasting compared to state-of-the-art time series forecasting methods.
Collapse
Affiliation(s)
- Abel Díaz Berenguer
- Department of Electronics and Informatics (ETRO), Vrije Universiteit Brussel (VUB), Brussels, Belgium
| | - Yifei Da
- Department of Electronics and Informatics (ETRO), Vrije Universiteit Brussel (VUB), Brussels, Belgium
| | - Matías Nicolás Bossa
- Department of Electronics and Informatics (ETRO), Vrije Universiteit Brussel (VUB), Brussels, Belgium
| | | | - Hichem Sahli
- Department of Electronics and Informatics (ETRO), Vrije Universiteit Brussel (VUB), Brussels, Belgium
- Interuniversity Microelectronics Centre (IMEC), Heverlee, Belgium
| |
Collapse
|
4
|
Andrei F, Veltri GA. Social influence in the darknet market: The impact of product descriptions on cocaine sales. THE INTERNATIONAL JOURNAL OF DRUG POLICY 2024; 124:104328. [PMID: 38245917 DOI: 10.1016/j.drugpo.2024.104328] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Revised: 01/04/2024] [Accepted: 01/07/2024] [Indexed: 01/23/2024]
Abstract
BACKGROUND The rise of the darknet market, supported by technologies such as the Tor Browser and cryptocurrencies, has created a secure environment in which illicit transactions can occur. However, due to the lack of government oversight in this hidden online domain, darknet markets face significant challenges in upholding social order. Hence, this study explores the social dynamics that promote social order in a darknet market, focusing on the impact of item descriptions on sales. In particular, the study examines how text contained in product listings can influence sales and contribute to social order. METHOD To conduct this analysis, we examined 4160 cocaine listings on AlphaBay, which was active from December 2014 to July 2017 and is one of the largest darknet markets in history. Using generalised additive models (GAMs), we assessed the impact of various listing description features, including content and semantic structure, on cocaine sales. RESULTS The results showed that sales increased by 61.6 % when listings included delivery information in their description, compared to offers that did not. In addition, the standardised sentiment score (ranging 0,1) of the product description increased positively, and estimated sales increased by 260.5 %. We also found that international shipping reduced sales by 28.3 %. Finally, we found that listings stating the product origin increased sales for all continents except Asia. CONCLUSION The study sheds light on the characteristics of product advertising that facilitate social order within a darknet market. Listings that include delivery details in the description reduce uncertainty about a critical stage of the transaction process while using positive language increases trust. This study makes both an empirical and a theoretical contribution by demonstrating the influence of ad descriptions on sales and the intricate role of social influences in shaping market order.
Collapse
Affiliation(s)
- Filippo Andrei
- Department of Sociology and Social Research, University of Trento, Via Giuseppe Verdi, 26, Trento, TN 38122, Italy.
| | - Giuseppe Alessandro Veltri
- Department of Sociology and Social Research, University of Trento, Via Giuseppe Verdi, 26, Trento, TN 38122, Italy
| |
Collapse
|
5
|
Lam WS, Lam WH, Jaaman SH, Lee PF. Bibliometric Analysis of Granger Causality Studies. ENTROPY (BASEL, SWITZERLAND) 2023; 25:632. [PMID: 37190420 PMCID: PMC10137504 DOI: 10.3390/e25040632] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/25/2023] [Revised: 03/26/2023] [Accepted: 04/03/2023] [Indexed: 05/17/2023]
Abstract
Granger causality provides a framework that uses predictability to identify causation between time series variables. This is important to policymakers for effective policy management and recommendations. Granger causality is recognized as the primary advance on the causation problem. The objective of this paper is to conduct a bibliometric analysis of Granger causality publications indexed in the Web of Science database. Harzing's Publish or Perish and VOSviewer were used for performance analysis and science mapping. The first paper indexed was published in 1981 and there has been an upward trend in the annual publication of Granger causality studies which are shifting towards the areas of environmental science, energy, and economics. Most of the publications are articles and proceeding papers under the areas of business economics, environmental science ecology, and neurosciences/neurology. China has the highest number of publications while the United States has the highest number of citations. England has the highest citation impact. This paper also constructed country co-authorship, co-analysis of cited references, cited sources, and cited authors, keyword co-occurrence, and keyword overlay visualization maps.
Collapse
Affiliation(s)
- Weng Siew Lam
- Department of Physical and Mathematical Science, Faculty of Science, Kampar Campus, Universiti Tunku Abdul Rahman, Jalan Universiti, Bandar Barat, Kampar 31900, Perak, Malaysia; (W.S.L.); (P.F.L.)
| | - Weng Hoe Lam
- Department of Physical and Mathematical Science, Faculty of Science, Kampar Campus, Universiti Tunku Abdul Rahman, Jalan Universiti, Bandar Barat, Kampar 31900, Perak, Malaysia; (W.S.L.); (P.F.L.)
| | - Saiful Hafizah Jaaman
- Department of Mathematical Sciences, Faculty of Science and Technology, Universiti Kebangsaan Malaysia (UKM), Bangi 43600, Selangor, Malaysia
| | - Pei Fun Lee
- Department of Physical and Mathematical Science, Faculty of Science, Kampar Campus, Universiti Tunku Abdul Rahman, Jalan Universiti, Bandar Barat, Kampar 31900, Perak, Malaysia; (W.S.L.); (P.F.L.)
| |
Collapse
|
6
|
Suzuki M, Sakaji H, Hirano M, Izumi K. Constructing and analyzing domain-specific language model for financial text mining. Inf Process Manag 2023. [DOI: 10.1016/j.ipm.2022.103194] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
7
|
Ichev R. Reported corporate misconducts: The impact on the financial markets. PLoS One 2023; 18:e0276637. [PMID: 36758041 PMCID: PMC9910724 DOI: 10.1371/journal.pone.0276637] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2022] [Accepted: 10/11/2022] [Indexed: 02/10/2023] Open
Abstract
This study empirically examines how reported corporate misconducts affect the stock returns of US firms. As the reported misconducts are broadcasted in the newspaper outlets, the cumulative abnormal return (CAR) is -4.1%. Involvement in a reported corporate misconduct gets punished by market participants especially when the act of reported misconduct is blamed on the level of the corporation rather than in involvement of a specific individual, when reported misconducts take place in the home market, and when the linguistic tone used in the newspaper article is negative. Financial penalties imposed, firm size, leverage, revenue growth, and the level of firm foreign exposure are found to have significant impact on the returns during the period of observation. The results suggest that investors recognize the importance to penalize firms in the financial markets when firms act unethically.
Collapse
Affiliation(s)
- Riste Ichev
- Faculty of Economics, University of Ljubljana, Ljubljana, Slovenia
| |
Collapse
|
8
|
Ossai CI, Wickramasinghe N. Sentiments prediction and thematic analysis for diabetes mobile apps using Embedded Deep Neural Networks and Latent Dirichlet Allocation. Artif Intell Med 2023; 138:102509. [PMID: 36990592 DOI: 10.1016/j.artmed.2023.102509] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Revised: 07/21/2022] [Accepted: 02/06/2023] [Indexed: 02/11/2023]
Abstract
The increasing reliance on mobile health for managing disease conditions has opened a new frontier in digital health, thus, the need for understanding what constitutes positive and negative sentiments of the various apps. This paper relies on Embedded Deep Neural Networks (E-DNN), Kmeans, and Latent Dirichlet Allocation (LDA) for predicting the sentiments of diabetes mobile apps users and identifying the themes and sub-themes of positive and negative sentimental users. A total of 38,640 comments from 39 diabetes mobile apps obtained from the google play store are analyzed and accuracy of 87.67 % ± 2.57 % was obtained from a 10-fold leave-one-out cross-validation. This accuracy is 2.95 % - 18.71 % better than other predominant algorithms used for sentiment analysis and 3.47 % - 20.17 % better than the results obtained by previous researchers. The study also identified the challenges of diabetes mobile apps usage to include safety and security issues, outdated information for diabetes management, clumsy user interface, and difficulty controlling operations. The positives of the apps are ease of operation, lifestyle management, effectiveness in communication and control, and data management capabilities.
Collapse
|
9
|
Nyakurukwa K, Seetharam Y. The evolution of studies on social media sentiment in the stock market: Insights from bibliometric analysis. SCIENTIFIC AFRICAN 2023. [DOI: 10.1016/j.sciaf.2023.e01596] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/22/2023] Open
|
10
|
Global environmental equities and investor sentiment: the role of social media and Covid-19 pandemic crisis. REVIEW OF MANAGERIAL SCIENCE 2023. [DOI: 10.1007/s11846-022-00614-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Abstract
AbstractAccording to researchers, information generated from social media provides useful data for understanding the behaviour of various types of financial assets, using the sentiment expressed by these network users as an explanatory variable of asset prices. In a context in which investment based on sustainability and environmental preservation values is vital, there is no known scientific work that analyses the relationship between social networks and environmental investment, which is closely related to the 2030 Agenda for Sustainable Development. In this study, we aim to identify how investor sentiment, generated from social networks, influences environmental investment and whether this influence depends on the time variable, as well the role of the pandemic crisis and the Russia-Ukraine war. Our results show different forms of behaviour for the different periods considered, with the proximity between the two types of variables being time-varying. For shorter periods, proximity occurred mainly during the pandemic crisis, repeatedly revealing that sentiment is a risk factor in environmental investment and in particular how important the information generated from social networks can be in pricing environmental assets. For longer periods, no common stochastic trends were identified. The mechanisms generating the series are thus characterised by a certain autonomy.
Collapse
|
11
|
Wang Y, Chen Z, Fu C. Synergy Masks of Domain Attribute Model DaBERT: Emotional Tracking on Time-Varying Virtual Space Communication. SENSORS (BASEL, SWITZERLAND) 2022; 22:8450. [PMID: 36366148 PMCID: PMC9658096 DOI: 10.3390/s22218450] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Revised: 10/30/2022] [Accepted: 11/02/2022] [Indexed: 06/16/2023]
Abstract
Emotional tracking on time-varying virtual space communication aims to identify sentiments and opinions expressed in a piece of user-generated content. However, the existing research mainly focuses on the user's single post, despite the fact that social network data are sequential. In this article, we propose a sentiment analysis model based on time series prediction in order to understand and master the chronological evolution of the user's point of view. Specifically, with the help of a domain-knowledge-enhanced pre-trained encoder, the model embeds tokens for each moment in the text sequence. We then propose an attention-based temporal prediction model to extract rich timing information from historical posting records, which improves the prediction of the user's current state and personalizes the analysis of user's sentiment changes in social networks. The experiments show that the proposed model improves on four kinds of sentiment tasks and significantly outperforms the strong baseline.
Collapse
Affiliation(s)
- Ye Wang
- College of Computer, National University of Defense Technology, Changsha 410073, China
| | - Zhenghan Chen
- School of Software & Microelectronics, Peking University, Beijing 100191, China
| | - Changzeng Fu
- SSTC, Northeastern University, Qinhuangdao 066004, China
- Graduate School of Engineering Science, Osaka University, Toyonaka 560-0043, Osaka, Japan
| |
Collapse
|
12
|
Qian C, Mathur N, Zakaria NH, Arora R, Gupta V, Ali M. Understanding public opinions on social media for financial sentiment analysis using AI-based techniques. Inf Process Manag 2022. [DOI: 10.1016/j.ipm.2022.103098] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
13
|
Yilmaz ES, Ozpolat A, Destek MA. Do Twitter sentiments really effective on energy stocks? Evidence from the intercompany dependency. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2022; 29:78757-78767. [PMID: 35701695 PMCID: PMC9197096 DOI: 10.1007/s11356-022-21269-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/01/2022] [Accepted: 05/31/2022] [Indexed: 06/15/2023]
Abstract
The study aims to examine the effects of social media activities on stock prices of the energy sector. In this respect, the sample covers the monthly period from 2015m6 to 2020m5 has been observed. Energy stocks as S&P 500 index (SP), stock market volatility index (VIX), trade-weighted USD index (USD), and Brent oil prices (OIL) have been used as independent variables. Accordingly, three different models have been created to analyze the link between returns, volatility and trading volume and Twitter sentiments by using Augmented Mean Group. As a result, we found that Twitter sentiment values have no significant impact on the returns and volatility of the companies. Tweets, on the other hand, appear to have a favorable impact on company trading volume values.
Collapse
Affiliation(s)
- Emrah Sitki Yilmaz
- Department of Accounting and Tax Applications, Gaziantep University, Gaziantep, Turkey
| | - Asli Ozpolat
- Department of Management and Organization, Gaziantep University, Gaziantep, Turkey
| | | |
Collapse
|
14
|
Ji R, Han Q. Understanding heterogeneity of investor sentiment on social media: A structural topic modeling approach. Front Artif Intell 2022; 5:884699. [PMID: 36277168 PMCID: PMC9582335 DOI: 10.3389/frai.2022.884699] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2022] [Accepted: 08/16/2022] [Indexed: 11/05/2022] Open
Abstract
Investors nowadays post heterogeneous sentiments on social media about financial assets based on their trading preferences. However, existing works typically analyze the sentiment by its content only and do not account for investor profiles and trading preferences in different types of assets. This paper explicitly considers how investor sentiment about financial market events is shaped by the relative discussions of different types of investors. We leverage a large-scale financial social media dataset and employ a structural topic modeling approach to extract topical contents of investor sentiment across multiple finance-specific factors. The identified topics reveal important events related to the financial market and show strong heterogeneity in the social media content in terms of compositions of investor profiles, asset categories, and bullish/bearish sentiment. Results show that investors with different profiles and trading preferences tend to discuss financial markets with heterogeneous beliefs, leading to divergent opinions about those events regarding the topic prevalence and proportion. Moreover, our findings may shed light on the mechanism that underlies the efficient investor sentiment extraction and aggregation while considering the heterogeneity of investor sentiment across different dimensions.
Collapse
Affiliation(s)
- Rongjiao Ji
- Department of Mathematics, University of Milan, Milan, Italy
| | - Qiwei Han
- Nova School of Business and Economics, Universidade NOVA de Lisboa, Lisbon, Portugal,*Correspondence: Qiwei Han
| |
Collapse
|
15
|
Ding J, Xu M, Tse YK, Lin KY, Zhang M. Customer opinions mining through social media: insights from sustainability fraud crisis - Volkswagen emissions scandal. ENTERP INF SYST-UK 2022. [DOI: 10.1080/17517575.2022.2130012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/10/2022]
Affiliation(s)
- Juling Ding
- School of Information Technology, Jiangxi University of Finance and Economics, Nanchang, Jiangxi, China
| | - Mao Xu
- Cardiff Business School, Cardiff University, Cardiff, UK
| | - Ying Kei Tse
- Cardiff Business School, Cardiff University, Cardiff, UK
| | - Kuo-Yi Lin
- School of Business, Guilin University of Electronic Technology, Guilin, China
| | - Minhao Zhang
- School of Management, University of Bristol, Bristol, UK
| |
Collapse
|
16
|
Suzuki M, Sakaji H, Izumi K, Ishikawa Y. Forecasting Stock Price Trends by Analyzing Economic Reports With Analyst Profiles. Front Artif Intell 2022; 5:866723. [PMID: 35747249 PMCID: PMC9210503 DOI: 10.3389/frai.2022.866723] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2022] [Accepted: 04/25/2022] [Indexed: 11/13/2022] Open
Abstract
This article proposes a methodology to forecast the movements of analysts' estimated net income and stock prices using analyst profiles. Our methodology is based on applying natural language processing and neural networks in the context of analyst reports. First, we apply the proposed method to extract opinion sentences from the analyst report while classifying the remaining parts as non-opinion sentences. Then, we employ the proposed method to forecast the movements of analysts' estimated net income and stock price by inputting the opinion and non-opinion sentences into separate neural networks. In addition to analyst reports, we input analyst profiles to the networks. As analyst profiles, we used the name of an analyst, the securities company to which the analyst belongs, the sector which the analyst covers, and the analyst ranking. Consequently, we obtain an indication that the analyst profile effectively improves the model forecasts. However, classifying analyst reports into opinion and non-opinion sentences is insignificant for the forecasts.
Collapse
Affiliation(s)
- Masahiro Suzuki
- Department of Systems Innovation, School of Engineering, The University of Tokyo, Tokyo, Japan
- *Correspondence: Masahiro Suzuki
| | - Hiroki Sakaji
- Department of Systems Innovation, School of Engineering, The University of Tokyo, Tokyo, Japan
| | - Kiyoshi Izumi
- Department of Systems Innovation, School of Engineering, The University of Tokyo, Tokyo, Japan
| | | |
Collapse
|
17
|
Ahelegbey DF, Cerchiello P, Scaramozzino R. Network based evidence of the financial impact of Covid-19 pandemic. INTERNATIONAL REVIEW OF FINANCIAL ANALYSIS 2022; 81:102101. [PMID: 36536770 PMCID: PMC8935984 DOI: 10.1016/j.irfa.2022.102101] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/16/2021] [Revised: 10/16/2021] [Accepted: 03/04/2022] [Indexed: 06/16/2023]
Abstract
How much the largest worldwide companies, belonging to different sectors of the economy, are suffering from the pandemic? Are economic relations among them changing? In this paper, we address such issues by analyzing the top 50 S&P companies by means of market and textual data. Our work proposes a network analysis model that combines such two types of information to highlight the connections among companies with the purpose of investigating the relationships before and during the pandemic crisis. In doing so, we leverage a large amount of textual data through the employment of a sentiment score which is coupled with standard market data. Our results show that the COVID-19 pandemic has largely affected the US productive system, however differently sector by sector and with more impact during the second wave compared to the first.
Collapse
Affiliation(s)
- Daniel Felix Ahelegbey
- Department of Economics and Management, University of Pavia, Via San Felice 7, 27100 Pavia, Italy
| | - Paola Cerchiello
- Department of Economics and Management, University of Pavia, Via San Felice 7, 27100 Pavia, Italy
| | - Roberta Scaramozzino
- Department of Economics and Management, University of Pavia, Via San Felice 7, 27100 Pavia, Italy
| |
Collapse
|
18
|
Smith S, O’Hare A. Comparing traditional news and social media with stock price movements; which comes first, the news or the price change? JOURNAL OF BIG DATA 2022; 9:47. [PMID: 35502408 PMCID: PMC9047470 DOI: 10.1186/s40537-022-00591-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/19/2021] [Accepted: 03/28/2022] [Indexed: 06/14/2023]
Abstract
Twitter has been responsible for some major stock market news in the recent past, from rogue CEOs damaging their company to very active world leaders asking for brand boycotts, but despite its impact Twitter has still not been as impactful on markets as traditional news sources. In this paper we examine whether daily news sentiment of several companies and Twitter sentiment from their CEOs have an impact on their market performance and whether traditional news sources and Twitter activity of heads of government impact the benchmark indexes of major world economies over a period spanning the outbreak of the SAR-COV-2 pandemic. Our results indicate that there is very limited correlation between Twitter sentiment and price movements and that this does not change much when returns are taken relative to the market or when the market is calm or turbulent. There is almost no correlation under any circumstances between non-financial news sources and price movements, however there is some correlation between financial news sentiment and stock price movements. We also find this correlation gets stronger when returns are taken relative to the market. There are fewer companies correlated in both turbulent and calm economic times. There is no clear pattern to the direction and strength of the correlation, with some being strongly negatively correlated and others being strongly positively correlated, but in general the size of the correlation tends to indicate that price movement is driving sentiment, except in the turbulent economic times of the SARS-COV-2 pandemic in 2020.
Collapse
Affiliation(s)
- Stephen Smith
- Department of Mathematics and Statistics, University of Strathclyde, Glasgow, UK
| | - Anthony O’Hare
- Division of Computing Science and Mathematics, University of Stirling, Stirling, UK
| |
Collapse
|
19
|
Sinha A, Kedas S, Kumar R, Malo P. SEntFiN
1.0:
Entity‐aware
sentiment analysis for financial news. J Assoc Inf Sci Technol 2022. [DOI: 10.1002/asi.24634] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Affiliation(s)
- Ankur Sinha
- Production and Quantitative Methods IIM Ahmedabad India
| | | | - Rishu Kumar
- Production and Quantitative Methods IIM Ahmedabad India
| | - Pekka Malo
- Department of Information and Service Economy Alto University Espoo Finland
| |
Collapse
|
20
|
Zhang Y, Shirakawa M, Wang Y, Li Z, Hara T. Twitter-aided decision making: a review of recent developments. APPL INTELL 2022; 52:13839-13854. [PMID: 35250174 PMCID: PMC8881980 DOI: 10.1007/s10489-022-03241-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/13/2022] [Indexed: 11/27/2022]
Abstract
AbstractTwitter is one of the largest online platforms where people exchange information. In the first few years since its emergence, researchers have been exploring ways to use Twitter data in various decision making scenarios, and have shown promising results. In this review, we examine 28 newer papers published in last five years (since 2016) that continued to advance Twitter-aided decision making. The application scenarios we cover include product sales prediction, stock selection, crime prevention, epidemic tracking, and traffic monitoring. We first discuss the findings presented in these papers, that is how much decision making performance has been improved with the help of Twitter data. Then we offer a methodological analysis that considers four aspects of methods used in these papers, including problem formulation, solution, Twitter feature, and information transformation. This methodological analysis aims to enable researchers and decision makers to see the applicability of Twitter-aided methods in different application domains or platforms.
Collapse
Affiliation(s)
- Yihong Zhang
- Graduate School of Information Science and Technology, Osaka University, Osaka, Japan
| | - Masumi Shirakawa
- Graduate School of Information Science and Technology, Osaka University, Osaka, Japan
| | - Yuanyuan Wang
- Graduate School of Sciences and Technology for Innovation, Yamaguchi University, Ube, Japan
| | - Zhi Li
- Graduate School of Information Science and Technology, Osaka University, Osaka, Japan
| | - Takahiro Hara
- Graduate School of Information Science and Technology, Osaka University, Osaka, Japan
| |
Collapse
|
21
|
Statistical Analysis Dow Jones Stock Index—Cumulative Return Gap and Finite Difference Method. JOURNAL OF RISK AND FINANCIAL MANAGEMENT 2022. [DOI: 10.3390/jrfm15020089] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
This study was motivated by the poor performance of the current models used in stock return forecasting and aimed to improve the accuracy of the existing models in forecasting future stock returns. The current literature largely assumes that the residual term used in the existing model is white noise and, as such, has no valuable information. We exploit the valuable information contained in the residuals of the models in the context of cumulative return and construct a new cumulative return gap (CRG) model to overcome the weaknesses of the traditional cumulative abnormal returns (CAR) and buy-and-hold abnormal returns (BHAR) models. To deal with the residual items of the prediction model and improving the prediction accuracy, we also lead the finite difference (FD) method into the autoregressive (AR) model and autoregressive distributed lag (ARDL) model. The empirical results of the study show that the cumulative return (CR) model is better than the simple return model for stock return prediction. We found that the CRG model can improve prediction accuracy, the term of the residuals from the autoregressive analysis is very important in stock return prediction, and the FD model can improve prediction accuracy.
Collapse
|
22
|
|
23
|
Li J, Wang Y, Liu C. SPATIAL EFFECT OF MARKET SENTIMENT ON HOUSING PRICE: EVIDENCE FROM SOCIAL MEDIA DATA IN CHINA. INTERNATIONAL JOURNAL OF STRATEGIC PROPERTY MANAGEMENT 2022. [DOI: 10.3846/ijspm.2022.16255] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
Market sentiment has become more easily spread between cities through social media. This study investigates the spatial effect of market sentiment on housing price in a social media environment. In order to extract home-buyer sentiment from social media, we use text sentiment analysis techniques and build a novel housing market sentiment index. A spatial econometric model of housing price volatility is subsequently constructed and the housing market sentiment index is included as an independent variable in the model. Using panel data from 30 large and medium-sized cities in China for 20 quarters from 2016 to 2020, the spatial effect of market sentiment on housing price is empirically analyzed by calculating direct and indirect effects. The results show that market sentiment had a significant positive effect on housing prices in the local and neighboring cities over the research period. However, the impact of market sentiment on housing price was heterogeneous in terms of geographical region; the direct effect was stronger in the eastern region than in the central and western regions, and the indirect effect was significant only in the eastern region. These findings can provide references for government to formulate housing market regulation policies and measures based on market sentiment.
Collapse
Affiliation(s)
- Junjie Li
- School of Management Engineering, Zhengzhou University, Zhengzhou, China
| | - Yu Wang
- School of Management Engineering, Zhengzhou University, Zhengzhou, China
| | - Chunlu Liu
- School of Architecture and Built Environment, Deakin University, Geelong, Australia
| |
Collapse
|
24
|
Stock Market Prediction Using Machine Learning Techniques: A Decade Survey on Methodologies, Recent Developments, and Future Directions. ELECTRONICS 2021. [DOI: 10.3390/electronics10212717] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
With the advent of technological marvels like global digitization, the prediction of the stock market has entered a technologically advanced era, revamping the old model of trading. With the ceaseless increase in market capitalization, stock trading has become a center of investment for many financial investors. Many analysts and researchers have developed tools and techniques that predict stock price movements and help investors in proper decision-making. Advanced trading models enable researchers to predict the market using non-traditional textual data from social platforms. The application of advanced machine learning approaches such as text data analytics and ensemble methods have greatly increased the prediction accuracies. Meanwhile, the analysis and prediction of stock markets continue to be one of the most challenging research areas due to dynamic, erratic, and chaotic data. This study explains the systematics of machine learning-based approaches for stock market prediction based on the deployment of a generic framework. Findings from the last decade (2011–2021) were critically analyzed, having been retrieved from online digital libraries and databases like ACM digital library and Scopus. Furthermore, an extensive comparative analysis was carried out to identify the direction of significance. The study would be helpful for emerging researchers to understand the basics and advancements of this emerging area, and thus carry-on further research in promising directions.
Collapse
|
25
|
Fine-Grained Implicit Sentiment in Financial News: Uncovering Hidden Bulls and Bears. ELECTRONICS 2021. [DOI: 10.3390/electronics10202554] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The field of sentiment analysis is currently dominated by the detection of attitudes in lexically explicit texts such as user reviews and social media posts. In objective text genres such as economic news, indirect expressions of sentiment are common. Here, a positive or negative attitude toward an entity must be inferred from connotational or real-world knowledge. To capture all expressions of subjectivity, a need exists for fine-grained resources and approaches for implicit sentiment analysis. We present the SENTiVENT corpus of English business news that contains token-level annotations for target spans, polar spans, and implicit polarity (positive, negative, or neutral investor sentiment, respectively). We both directly annotate polar expressions and induce them from existing schema-based event annotations to obtain event-implied implicit sentiment tuples. This results in a large dataset of 12,400 sentiment–target tuples in 288 fully annotated articles. We validate the created resource with an inter-annotator agreement study and a series of coarse- to fine-grained supervised deep-representation-learning experiments. Agreement scores show that our annotations are of substantial quality. The coarse-grained experiments involve classifying the positive, negative, and neutral polarity of known polar expressions and, in clause-based experiments, the detection of positive, negative, neutral, and no-polarity clauses. The gold coarse-grained experiments obtain decent performance (76% accuracy and 63% macro-F1) and clause-based detection shows decreased performance (65% accuracy and 57% macro-F1) with the confusion of neutral and no-polarity. The coarse-grained results demonstrate the feasibility of implicit polarity classification as operationalized in our dataset. In the fine-grained experiments, we apply the grid tagging scheme unified model for <polar span, target span, polarity> triplet extraction, which obtains state-of-the-art performance on explicit sentiment in user reviews. We observe a drop in performance on our implicit sentiment corpus compared to the explicit benchmark (22% vs. 76% F1). We find that the current models for explicit sentiment are not directly portable to our implicit task: the larger lexical variety within implicit opinion expressions causes lexical data scarcity. We identify common errors and discuss several recommendations for implicit fine-grained sentiment analysis. Data and source code are available.
Collapse
|
26
|
Semeraro A, Vilella S, Ruffo G. PyPlutchik: Visualising and comparing emotion-annotated corpora. PLoS One 2021; 16:e0256503. [PMID: 34469455 PMCID: PMC8409663 DOI: 10.1371/journal.pone.0256503] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2021] [Accepted: 08/06/2021] [Indexed: 11/18/2022] Open
Abstract
The increasing availability of textual corpora and data fetched from social networks is fuelling a huge production of works based on the model proposed by psychologist Robert Plutchik, often referred simply as the "Plutchik Wheel". Related researches range from annotation tasks description to emotions detection tools. Visualisation of such emotions is traditionally carried out using the most popular layouts, as bar plots or tables, which are however sub-optimal. The classic representation of the Plutchik's wheel follows the principles of proximity and opposition between pairs of emotions: spatial proximity in this model is also a semantic proximity, as adjacent emotions elicit a complex emotion (a primary dyad) when triggered together; spatial opposition is a semantic opposition as well, as positive emotions are opposite to negative emotions. The most common layouts fail to preserve both features, not to mention the need of visually allowing comparisons between different corpora in a blink of an eye, that is hard with basic design solutions. We introduce PyPlutchik the Pyplutchik package is available as a Github repository (http://github.com/alfonsosemeraro/pyplutchik) or through the installation commands pip or conda. For any enquiry about usage or installation feel free to contact the corresponding author, a Python module specifically designed for the visualisation of Plutchik's emotions in texts or in corpora. PyPlutchik draws the Plutchik's flower with each emotion petal sized after how much that emotion is detected or annotated in the corpus, also representing three degrees of intensity for each of them. Notably, PyPlutchik allows users to display also primary, secondary, tertiary and opposite dyads in a compact, intuitive way. We substantiate our claim that PyPlutchik outperforms other classic visualisations when displaying Plutchik emotions and we showcase a few examples that display our module's most compelling features.
Collapse
Affiliation(s)
- Alfonso Semeraro
- Department of Computer Science, University of Turin, Turin, Italy
| | | | - Giancarlo Ruffo
- Department of Computer Science, University of Turin, Turin, Italy
| |
Collapse
|
27
|
Hambridge K, Endacott R, Nichols A. The experience and psychological impact of a sharps injury on a nursing student population in the UK. ACTA ACUST UNITED AC 2021; 30:910-918. [PMID: 34379471 DOI: 10.12968/bjon.2021.30.15.910] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
AIMS The aims of this study were to explore the experience and psychological impact of sustaining a sharps injury within a nursing student population in the UK. Design: A qualitative approach was taken, using two methods to gather data, namely a Twitter chat and interviews. METHODS A Twitter chat was orchestrated to investigate the experiences of sharps injury with nursing students and registered nurses nationwide (n=71). Interviews were conducted with nursing students from a university in the UK who had sustained a sharps injury (n=12) to discover their experiences and the impact of the injury. Findings were then synthesised and examined. RESULTS Some nursing students reported psychological impacts after sustaining the sharps injury, which affected both their professional and personal life. The qualitative findings were synthesised into eight themes. CONCLUSION Sharps injuries can have many psychological impacts on the individual nursing student and necessary support should be available.
Collapse
Affiliation(s)
- Kevin Hambridge
- Lecturer in Adult Nursing, Associate Head of School (Marketing), University of Plymouth
| | - Ruth Endacott
- Professor in Clinical Nursing (Critical Care), University of Plymouth
| | | |
Collapse
|
28
|
Jazbec M, Pàsztor B, Faltings F, Antulov-Fantulin N, Kolm PN. On the impact of publicly available news and information transfer to financial markets. ROYAL SOCIETY OPEN SCIENCE 2021; 8:202321. [PMID: 34350010 PMCID: PMC8316821 DOI: 10.1098/rsos.202321] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/21/2020] [Accepted: 07/06/2021] [Indexed: 06/13/2023]
Abstract
We quantify the propagation and absorption of large-scale publicly available news articles from the World Wide Web to financial markets. To extract publicly available information, we use the news archives from the Common Crawl, a non-profit organization that crawls a large part of the web. We develop a processing pipeline to identify news articles associated with the constituent companies in the S&P 500 index, an equity market index that measures the stock performance of US companies. Using machine learning techniques, we extract sentiment scores from the Common Crawl News data and employ tools from information theory to quantify the information transfer from public news articles to the US stock market. Furthermore, we analyse and quantify the economic significance of the news-based information with a simple sentiment-based portfolio trading strategy. Our findings provide support for that information in publicly available news on the World Wide Web has a statistically and economically significant impact on events in financial markets.
Collapse
Affiliation(s)
- Metod Jazbec
- Department of Computer Science, ETH Zurich, 8092 Zurich, Switzerland
| | - Barna Pàsztor
- Department of Computer Science, ETH Zurich, 8092 Zurich, Switzerland
| | - Felix Faltings
- Department of Computer Science, ETH Zurich, 8092 Zurich, Switzerland
| | - Nino Antulov-Fantulin
- Computational Social Science, ETH Zurich, 8092 Zurich, Switzerland
- Courant Institute of Mathematical Sciences, New York University, New York, NY 10012, USA
| | - Petter N. Kolm
- Courant Institute of Mathematical Sciences, New York University, New York, NY 10012, USA
| |
Collapse
|
29
|
Selman LE, Chamberlain C, Sowden R, Chao D, Selman D, Taubert M, Braude P. Sadness, despair and anger when a patient dies alone from COVID-19: A thematic content analysis of Twitter data from bereaved family members and friends. Palliat Med 2021; 35:1267-1276. [PMID: 34016005 PMCID: PMC8267082 DOI: 10.1177/02692163211017026] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
BACKGROUND To inform clinical practice and policy, it is essential to understand the lived experience of health and social care policies, including restricted visitation policies towards the end of life. AIM To explore the views and experiences of Twitter social media users who reported that a relative, friend or acquaintance died of COVID-19 without a family member/friend present. DESIGN Qualitative content analysis of English-language tweets. DATA SOURCES Twitter data collected 7-20th April 2020. A bespoke software system harvested selected publicly-available tweets from the Twitter application programming interface. After filtering we hand-screened tweets to include only those referring to a relative, friend or acquaintance who died alone of COVID-19. Data were analysed using thematic content analysis. RESULTS 9328 tweets were hand-screened; 196 were included. Twitter users expressed sadness, despair, hopelessness and anger about their experience and loss. Saying goodbye via video-conferencing technology was viewed ambivalently. Clinicians' presence during a death was little consolation. Anger, frustration and blame were directed at governments' inaction/policies or the public. The sadness of not being able to say goodbye as wished was compounded by lack of social support and disrupted after-death rituals. Users expressed a sense of political neglect/mistreatment alongside calls for action. They also used the platform to reinforce public health messages, express condolences and pay tribute. CONCLUSION Twitter was used for collective mourning and support and to promote public health messaging. End-of-life care providers should facilitate and optimise contact with loved ones, even when strict visitation policies are necessary, and provide proactive bereavement support.
Collapse
Affiliation(s)
- Lucy E Selman
- Palliative and End of Life Care Research Group, Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Charlotte Chamberlain
- Palliative and End of Life Care Research Group, Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Ryann Sowden
- Palliative and End of Life Care Research Group, Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Davina Chao
- Bristol Medical School, University of Bristol, Bristol, UK
| | - Daniel Selman
- Chief Technology Officer, Clause, Inc., Winchester, UK
| | - Mark Taubert
- Palliative Care Department, Cardiff University School of Medicine and Velindre University NHS Trust, Cardiff, UK
| | - Philip Braude
- Department for Medicine for Older People, North Bristol NHS Trust, Bristol, UK
| |
Collapse
|
30
|
Nguyen AXL, Trinh XV, Wang SY, Wu AY. Determination of Patient Sentiment and Emotion in Ophthalmology: Infoveillance Tutorial on Web-Based Health Forum Discussions. J Med Internet Res 2021; 23:e20803. [PMID: 33999001 PMCID: PMC8167608 DOI: 10.2196/20803] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2020] [Revised: 08/27/2020] [Accepted: 03/16/2021] [Indexed: 01/26/2023] Open
Abstract
Background Clinical data in social media are an underused source of information with great potential to allow for a deeper understanding of patient values, attitudes, and preferences. Objective This tutorial aims to describe a novel, robust, and modular method for the sentiment analysis and emotion detection of free text from web-based forums and the factors to consider during its application. Methods We mined the discussion and user information of all posts containing search terms related to a medical subspecialty (oculoplastics) from MedHelp, the largest web-based platform for patient health forums. We used data cleaning and processing tools to define the relevant subset of results and prepare them for sentiment analysis. We executed sentiment and emotion analyses by using IBM Watson Natural Language Understanding to generate sentiment and emotion scores for the posts and their associated keywords. The keywords were aggregated using natural language processing tools. Results Overall, 39 oculoplastic-related search terms resulted in 46,381 eligible posts within 14,329 threads. Posts were written by 18,319 users (117 doctors; 18,202 patients) and included 201,611 associated keywords. Keywords that occurred ≥500 times in the corpus were used to identify the most prominent topics, including specific symptoms, medication, and complications. The sentiment and emotion scores of these keywords and eligible posts were analyzed to provide concrete examples of the potential of this methodology to allow for a better understanding of patients’ attitudes. The overall sentiment score reflects a positive, neutral, or negative sentiment, whereas the emotion scores (anger, disgust, fear, joy, and sadness) represent the likelihood of the presence of the emotion. In keyword grouping analyses, medical signs, symptoms, and diseases had the lowest overall sentiment scores (−0.598). Complications were highly associated with sadness (0.485). Forum posts mentioning body parts were related to sadness (0.416) and fear (0.321). Administration was the category with the highest anger score (0.146). The top 6 forum subgroups had an overall negative sentiment score; the most negative one was the Neurology forum, with a score of −0.438. The Undiagnosed Symptoms forum had the highest sadness score (0.448). The least likely fearful posts were those from the Eye Care forum, with a score of 0.260. The overall sentiment score was much more negative before the doctor replied. The anger, disgust, fear, and sadness emotion scores decreased in likelihood, whereas joy was slightly more likely to be expressed after doctors replied. Conclusions This report allows physicians and researchers to efficiently mine and perform sentiment analysis on social media to better understand patients’ perspectives and promote patient-centric care. Important factors to be considered during its application include evaluating the scope of the search; selecting search terms and understanding their linguistic usages; and establishing selection, filtering, and processing criteria for posts and keywords tailored to the desired results.
Collapse
Affiliation(s)
| | - Xuan-Vi Trinh
- Department of Computer Science, McGill University, Montreal, QC, Canada
| | - Sophia Y Wang
- Department of Ophthalmology, Byers Eye Institute, Stanford University, Palo Alto, CA, United States
| | - Albert Y Wu
- Department of Ophthalmology, Byers Eye Institute, Stanford University, Palo Alto, CA, United States
| |
Collapse
|
31
|
Scaramozzino R, Cerchiello P, Aste T. Information Theoretic Causality Detection between Financial and Sentiment Data. ENTROPY (BASEL, SWITZERLAND) 2021; 23:621. [PMID: 34065756 PMCID: PMC8156204 DOI: 10.3390/e23050621] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/30/2021] [Revised: 05/11/2021] [Accepted: 05/12/2021] [Indexed: 12/03/2022]
Abstract
The interaction between the flow of sentiment expressed on blogs and media and the dynamics of the stock market prices are analyzed through an information-theoretic measure, the transfer entropy, to quantify causality relations. We analyzed daily stock price and daily social media sentiment for the top 50 companies in the Standard & Poor (S&P) index during the period from November 2018 to November 2020. We also analyzed news mentioning these companies during the same period. We found that there is a causal flux of information that links those companies. The largest fraction of significant causal links is between prices and between sentiments, but there is also significant causal information which goes both ways from sentiment to prices and from prices to sentiment. We observe that the strongest causal signal between sentiment and prices is associated with the Tech sector.
Collapse
Affiliation(s)
- Roberta Scaramozzino
- Department of Economics and Management, University of Pavia, Via San Felice 7, 27100 Pavia, Italy;
| | - Paola Cerchiello
- Department of Economics and Management, University of Pavia, Via San Felice 7, 27100 Pavia, Italy;
| | - Tomaso Aste
- Department of Computer Science, University College London, Gower Street, London WC1E 6EA, UK;
- UCL Centre for Blockchain Technologies, University College London, London WC1E 6BT, UK
- Systemic Risk Centre, London School of Economics and Political Sciences, London WC2A 2AE, UK
| |
Collapse
|
32
|
Could social interaction reduce the disposition effect? Evidence from retail investors in a directed social trading network. PLoS One 2021; 16:e0246759. [PMID: 33571279 PMCID: PMC7877604 DOI: 10.1371/journal.pone.0246759] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2020] [Accepted: 01/25/2021] [Indexed: 11/19/2022] Open
Abstract
With data collected from a directed social trading network, this paper investigates how social interaction affects the disposition effect. We constantly observe a negative association between them: After being exposed to social interaction, a trader’s odds ratio to sell a paper gain stock decreases by 9% to 10%, depending on different model settings. We then test the mechanisms of social interaction by decomposing it into three channels: learning intensity (willingness to learn), learning quality (information advantage through learning), and public scrutinization (exposure of trading outcome to others). We find that all three channels contribute to a smaller disposition effect. Specifically, our findings support the claim that public scrutinization promotes self-consciousness and reduces disposition effect. Also, our results extend previous studies on investors’ information advantage by suggesting that it could also help to mitigate the disposition effect through the reduction of uncertainty. Overall, this paper suggests a positive role of social trading platforms in helping investors make better decisions.
Collapse
|
33
|
Sentiment correlation in financial news networks and associated market movements. Sci Rep 2021; 11:3062. [PMID: 33542292 PMCID: PMC7862280 DOI: 10.1038/s41598-021-82338-6] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2020] [Accepted: 01/15/2021] [Indexed: 11/09/2022] Open
Abstract
In an increasingly connected global market, news sentiment towards one company may not only indicate its own market performance, but can also be associated with a broader movement on the sentiment and performance of other companies from the same or even different sectors. In this paper, we apply NLP techniques to understand news sentiment of 87 companies among the most reported on Reuters for a period of 7 years. We investigate the propagation of such sentiment in company networks and evaluate the associated market movements in terms of stock price and volatility. Our results suggest that, in certain sectors, strong media sentiment towards one company may indicate a significant change in media sentiment towards related companies measured as neighbours in a financial network constructed from news co-occurrence. Furthermore, there exists a weak but statistically significant association between strong media sentiment and abnormal market return as well as volatility. Such an association is more significant at the level of individual companies, but nevertheless remains visible at the level of sectors or groups of companies.
Collapse
|
34
|
Deb S. Analyzing airlines stock price volatility during COVID‐19 pandemic through internet search data. INTERNATIONAL JOURNAL OF FINANCE & ECONOMICS 2021:10.1002/ijfe.2490. [PMCID: PMC8013544 DOI: 10.1002/ijfe.2490] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/09/2023]
Abstract
Recent Coronavirus pandemic has prompted many regulations which are affecting the stock market. Especially because of lockdown policies across the world, the airlines industry is suffering. We analyse the stock price movements of three major airlines companies using a new approach which leverages a measure of internet concern on different topics. In this approach, Twitter data and Google Trends are used to create a set of predictors which then leads to an appropriately modified GARCH model. In the analysis, first we show that the ongoing pandemic has an unprecedented severe effect. Then, the proposed model is used to analyse and forecast stock price volatility of the airlines companies. The findings establish that our approach can successfully use the effects of internet concern for different topics on the movement of stock price index and provide good forecasting accuracy. Model confidence set (MCS) procedure further shows that the short‐term volatility forecasts are more accurate for this method than other candidate models. Thus, it can be used to understand the stock market during a pandemic in a better way. Further, the proposed approach is attractive and flexible, and can be extended to other related problems as well.
Collapse
Affiliation(s)
- Soudeep Deb
- Decision SciencesIndian Institute of Management BangaloreBangaloreIndia
| |
Collapse
|
35
|
Kolbinger O, Knopp M. Video kills the sentiment-Exploring fans' reception of the video assistant referee in the English premier league using Twitter data. PLoS One 2020; 15:e0242728. [PMID: 33296406 PMCID: PMC7725346 DOI: 10.1371/journal.pone.0242728] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2020] [Accepted: 10/15/2020] [Indexed: 11/20/2022] Open
Abstract
Evaluative research of technological officiating aids in sports predominantly focuses on the respective technology and the impact on decision accuracy, whereas the impact on stakeholders is neglected. Therefore, the aim of this study was to investigate the immediate impact of the recently introduced Video Assistant Referee, often referred to as VAR, on the sentiment of fans of the English Premier League. We analyzed the content of 643,251 tweets from 129 games, including 94 VAR incidents, using a new variation of a gradient boosting approach to train two tree-based classifiers for text corpora: one classifier to identify tweets related to the VAR and another one to rate a tweet’s sentiment. The results of 10-fold cross-validations showed that our approach, for which we only took a small share of all features to grow each tree, performed better than common approaches (naïve Bayes, support vector machines, random forest and traditional gradient tree boosting) used by other studies for both classification problems. Regarding the impact of the VAR on fans, we found that the average sentiment of tweets related to this technological officiating aid was significantly lower compared to other tweets (-0.64 vs. 0.08; t = 45.5, p < .001). Further, by tracking the mean sentiment of all tweets chronologically for each game, we could display that there is a significant drop of sentiment for tweets posted in the periods after an incident compared to the periods before. A plunge that persisted for 20 minutes on average. Summed up, our results provide evidence that the VAR effects predominantly expressions of negative sentiment on Twitter. This is in line with the results found in previous, questionnaire-based, studies for other technological officiating aids and also consistent with the psychological principle of loss aversion.
Collapse
Affiliation(s)
- Otto Kolbinger
- Chair of Performance Analysis and Sport Informatics, TUM Department of Sport and Health Sciences, Technical University of Munich, Munich, Germany
- * E-mail:
| | - Melanie Knopp
- Chair of Performance Analysis and Sport Informatics, TUM Department of Sport and Health Sciences, Technical University of Munich, Munich, Germany
| |
Collapse
|
36
|
Nicola G, Cerchiello P, Aste T. Information Network Modeling for U.S. Banking Systemic Risk. ENTROPY 2020; 22:e22111331. [PMID: 33266514 PMCID: PMC7711443 DOI: 10.3390/e22111331] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/17/2020] [Revised: 11/15/2020] [Accepted: 11/16/2020] [Indexed: 11/24/2022]
Abstract
In this work we investigate whether information theory measures like mutual information and transfer entropy, extracted from a bank network, Granger cause financial stress indexes like LIBOR-OIS (London Interbank Offered Rate-Overnight Index Swap) spread, STLFSI (St. Louis Fed Financial Stress Index) and USD/CHF (USA Dollar/Swiss Franc) exchange rate. The information theory measures are extracted from a Gaussian Graphical Model constructed from daily stock time series of the top 74 listed US banks. The graphical model is calculated with a recently developed algorithm (LoGo) which provides very fast inference model that allows us to update the graphical model each market day. We therefore can generate daily time series of mutual information and transfer entropy for each bank of the network. The Granger causality between the bank related measures and the financial stress indexes is investigated with both standard Granger-causality and Partial Granger-causality conditioned on control measures representative of the general economy conditions.
Collapse
Affiliation(s)
- Giancarlo Nicola
- Department of Economics and Management, University of Pavia, 27100 Pavia, Italy; (G.N.); (P.C.)
| | - Paola Cerchiello
- Department of Economics and Management, University of Pavia, 27100 Pavia, Italy; (G.N.); (P.C.)
| | - Tomaso Aste
- Department of Computer Science, University College London, London WC1E 6EA, UK
- Systemic Risk Centre, London School of Economics, London WC2A 2AE, UK
- Correspondence:
| |
Collapse
|
37
|
Liu A, Chen J, Yang SY, Hawkes AG. The Flow of Information in Trading: An Entropy Approach to Market Regimes. ENTROPY 2020; 22:e22091064. [PMID: 33286833 PMCID: PMC7597144 DOI: 10.3390/e22091064] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/29/2020] [Revised: 09/19/2020] [Accepted: 09/21/2020] [Indexed: 11/16/2022]
Abstract
In this study, we use entropy-based measures to identify different types of trading behaviors. We detect the return-driven trading using the conditional block entropy that dynamically reflects the “self-causality” of market return flows. Then we use the transfer entropy to identify the news-driven trading activity that is revealed by the information flows from news sentiment to market returns. We argue that when certain trading behavior becomes dominant or jointly dominant, the market will form a specific regime, namely return-, news- or mixed regime. Based on 11 years of news and market data, we find that the evolution of financial market regimes in terms of adaptive trading activities over the 2008 liquidity and euro-zone debt crises can be explicitly explained by the information flows. The proposed method can be expanded to make “causal” inferences on other types of economic phenomena.
Collapse
Affiliation(s)
- Anqi Liu
- School of Mathematics, Cardiff University, Cardiff CF24 4AG, UK;
- Correspondence: ; Tel.: +44-29-2087-0908
| | - Jing Chen
- School of Mathematics, Cardiff University, Cardiff CF24 4AG, UK;
| | - Steve Y. Yang
- School of Business, Stevens Institute of Technology, Hoboken, NJ 03070, USA;
| | - Alan G. Hawkes
- School of Management, Swansea University, Swansea SA1 8EN, UK;
| |
Collapse
|
38
|
Ji P, Yan X, Yu G. The Impact of Enterprise IT Investment on Corporate Performance: Evidence from China. JOURNAL OF GLOBAL INFORMATION TECHNOLOGY MANAGEMENT 2020. [DOI: 10.1080/1097198x.2020.1792230] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Affiliation(s)
- Peinan Ji
- School of Management, Harbin Institute of Technology, Harbin, China
| | - Xiangbin Yan
- Donlinks School of Economics and Management, University of Science and Technology Beijing, Beijing, China
| | - Guang Yu
- School of Management, Harbin Institute of Technology, Harbin, China
| |
Collapse
|
39
|
Forecasting Net Income Estimate and Stock Price Using Text Mining from Economic Reports. INFORMATION 2020. [DOI: 10.3390/info11060292] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
This paper proposes and analyzes a methodology of forecasting movements of the analysts’ net income estimates and those of stock prices. We achieve this by applying natural language processing and neural networks in the context of analyst reports. In the pre-experiment, we applied our method to extract opinion sentences from the analyst report while classifying the remaining parts as non-opinion sentences. Then, we performed two additional experiments. First, we employed our proposed method for forecasting the movements of analysts’ net income estimates by inputting the opinion and non-opinion sentences into separate neural networks. Besides the reports, we inputted the trend of the net income estimate to the networks. Second, we employed our proposed method for forecasting the movements of stock prices. Consequently, we found differences between security firms, which depend on whether analysts’ net income estimates tend to be forecasted by opinions or facts in the context of analyst reports. Furthermore, the trend of the net income estimate was found to be effective for the forecast as well as an analyst report. However, in experiments of forecasting movements of stock prices, the difference between opinion sentences and non-opinion sentences was not effective.
Collapse
|
40
|
Brans H, Scholtens B. Under his thumb the effect of president Donald Trump's Twitter messages on the US stock market. PLoS One 2020; 15:e0229931. [PMID: 32160241 PMCID: PMC7065837 DOI: 10.1371/journal.pone.0229931] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2019] [Accepted: 02/17/2020] [Indexed: 11/30/2022] Open
Abstract
Does president Trump’s use of Twitter affect financial markets? The president frequently mentions companies in his tweets and, as such, tries to gain leverage over their behavior. We analyze the effect of president Trump’s Twitter messages that specifically mention a company name on its stock market returns. We find that tweets from the president which reveal strong negative sentiment are followed by reduced market value of the company mentioned, whereas supportive tweets do not render a significant effect. Our methodology does not allow us to conclude about the exact mechanism behind these findings and can only be used to investigate short-term effects.
Collapse
Affiliation(s)
- Heleen Brans
- Department of Finance, Faculty of Economics and Business, University of Groningen, Groningen, The Netherlands
| | - Bert Scholtens
- Department of Finance, Faculty of Economics and Business, University of Groningen, Groningen, The Netherlands
- School of Management, University of Saint Andrews, St Andrews, Scotland, United Kingdom
- * E-mail:
| |
Collapse
|
41
|
Liquidity Risk and Investors’ Mood: Linking the Financial Market Liquidity to Sentiment Analysis through Twitter in the S&P500 Index. SUSTAINABILITY 2019. [DOI: 10.3390/su11247048] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Microblogging services can enrich the information investors use to make financial decisions on the stock markets. As liquidity has immediate consequences for a trader’s movements, this risk is an attractive area of interest for both academics and those who participate in the financial markets. This paper focuses on market liquidity and studies the impact on liquidity and trading costs of the popular Twitter microblogging service. Sentiment analysis extracted from Twitter and different popular liquidity measures were gathered to analyze the relationship between liquidity and investors’ opinions. The results, based on the analysis of the S&P 500 Index, found that the investors’ mood had little influence on the spread of the index.
Collapse
|
42
|
Ghassemi MM, Al-Hanai T, Raffa JD, Mark RG, Nemati S, Chokshi FH. How is the Doctor Feeling? ICU Provider Sentiment is Associated with Diagnostic Imaging Utilization. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2019; 2018:4058-4064. [PMID: 30441248 DOI: 10.1109/embc.2018.8513325] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
The judgment of intensive care unit (ICU) providers is difficult to measure using conventional structured electronic medical record (EMR) data. However, provider sentiment may be a proxy for such judgment. Utilizing 10 years of EMR data, this study evaluates the association between provider sentiment and diagnostic imaging utilization. We extracted daily positive / negative sentiment scores of written provider notes, and used a Poisson regression to estimate sentiment association with the total number of daily imaging reports. After adjusting for confounding factors, we found that (1) negative sentiment was associated with increased imaging utilization $(p < 0.01)$, (2) sentiment's association was most pronounced at the beginning of the ICU stay $(p < 0.01)$, and (3) the presence of any form of sentiment increased diagnostic imaging utilization up to a critical threshold $(p < 0.01)$. Our results indicate that provider sentiment may clarify currently unexplained variance in resource utilization and clinical practice.
Collapse
|
43
|
Ibrahim NF, Wang X. Decoding the sentiment dynamics of online retailing customers: Time series analysis of social media. COMPUTERS IN HUMAN BEHAVIOR 2019. [DOI: 10.1016/j.chb.2019.02.004] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
|
44
|
Khan MK, Teng JZ, Khan MI. Asymmetric impact of oil prices on stock returns in Shanghai stock exchange: Evidence from asymmetric ARDL model. PLoS One 2019; 14:e0218289. [PMID: 31211817 PMCID: PMC6581273 DOI: 10.1371/journal.pone.0218289] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2019] [Accepted: 05/29/2019] [Indexed: 11/18/2022] Open
Abstract
This study scrutinized the asymmetric impact of oil prices on stock returns in Shanghai stock exchange with data (January 2000 to December 2018) by using asymmetric ARDL model. The examined results of asymmetric autoregressive distributed lag model indicate that cointegration exists between the oil prices and the stock returns. Results of asymmetric autoregressive distributed lag model confirm that both in the long run and the short run increase in oil prices have a negative impact on the stock returns of Shanghai stock exchange while decrease in the oil prices has a positive impact on the stock returns. The examined results of this study recommend that oil prices dynamically contribute incompetence in stock prices in such a way that impact the profits of investors in stock market.
Collapse
Affiliation(s)
- Muhammad Kamran Khan
- School of Economics, Northeast Normal University, Changchun, Jilin, China
- * E-mail:
| | - Jian-Zhou Teng
- School of Economics, Northeast Normal University, Changchun, Jilin, China
| | | |
Collapse
|
45
|
Public Mood–Driven Asset Allocation: the Importance of Financial Sentiment in Portfolio Management. Cognit Comput 2018. [DOI: 10.1007/s12559-018-9609-2] [Citation(s) in RCA: 43] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
46
|
Novak PK, Amicis LD, Mozetič I. Impact investing market on Twitter: influential users and communities. APPLIED NETWORK SCIENCE 2018; 3:40. [PMID: 30839812 PMCID: PMC6214330 DOI: 10.1007/s41109-018-0097-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/11/2018] [Accepted: 09/06/2018] [Indexed: 06/09/2023]
Abstract
The 2008 financial crisis unveiled the intrinsic failures of the financial system as we know it. As a consequence, impact investing started to receive increasing attention, as evidenced by the high market growth rates. The goal of impact investment is to generate social and environmental impact alongside a financial return. In this paper we identify the main players in the sector and how they interact and communicate with each other. We use Twitter as a proxy of the impact investing market, and analyze relevant tweets posted over a period of ten months. We apply network, contents and sentiment analysis on the acquired dataset. Our study shows that Twitter users exhibit favourable leaning (predominantly neutral or positive) towards impact investing. Retweet communities are decentralised and include users from a variety of sectors. Despite some basic common vocabulary used by all retweet communities identified, the vocabulary and the topics discussed by each community vary largely. We note that an additional effort should be made in raising awareness about the sector, especially by policymakers and media outlets. The role of investors and the academia is also discussed, as well as the emergence of hybrid business models within the sector and its connections to the tech industry. This paper extends our previous study, one of the first analyses of Twitter activities in the impact investing market.
Collapse
Affiliation(s)
- Petra Kralj Novak
- Department of Knowledge Technologies, Jožef Stefan Institute, Jamova 39, Ljubljana, Slovenia
| | - Luisa De Amicis
- PlusValue, 131–151 Great Titchfield Street, London W1W 5BB, United Kingdom
| | - Igor Mozetič
- Department of Knowledge Technologies, Jožef Stefan Institute, Jamova 39, Ljubljana, Slovenia
| |
Collapse
|
47
|
Wakamiya S, Kawai Y, Aramaki E. Twitter-Based Influenza Detection After Flu Peak via Tweets With Indirect Information: Text Mining Study. JMIR Public Health Surveill 2018; 4:e65. [PMID: 30274968 PMCID: PMC6231889 DOI: 10.2196/publichealth.8627] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2017] [Revised: 02/24/2018] [Accepted: 07/18/2018] [Indexed: 11/13/2022] Open
Abstract
Background The recent rise in popularity and scale of social networking services (SNSs) has resulted in an increasing need for SNS-based information extraction systems. A popular application of SNS data is health surveillance for predicting an outbreak of epidemics by detecting diseases from text messages posted on SNS platforms. Such applications share the following logic: they incorporate SNS users as social sensors. These social sensor–based approaches also share a common problem: SNS-based surveillance are much more reliable if sufficient numbers of users are active, and small or inactive populations produce inconsistent results. Objective This study proposes a novel approach to estimate the trend of patient numbers using indirect information covering both urban areas and rural areas within the posts. Methods We presented a TRAP model by embedding both direct information and indirect information. A collection of tweets spanning 3 years (7 million influenza-related tweets in Japanese) was used to evaluate the model. Both direct information and indirect information that mention other places were used. As indirect information is less reliable (too noisy or too old) than direct information, the indirect information data were not used directly and were considered as inhibiting direct information. For example, when indirect information appeared often, it was considered as signifying that everyone already had a known disease, leading to a small amount of direct information. Results The estimation performance of our approach was evaluated using the correlation coefficient between the number of influenza cases as the gold standard values and the estimated values by the proposed models. The results revealed that the baseline model (BASELINE+NLP) shows .36 and that the proposed model (TRAP+NLP) improved the accuracy (.70, +.34 points). Conclusions The proposed approach by which the indirect information inhibits direct information exhibited improved estimation performance not only in rural cities but also in urban cities, which demonstrated the effectiveness of the proposed method consisting of a TRAP model and natural language processing (NLP) classification.
Collapse
Affiliation(s)
| | - Yukiko Kawai
- Kyoto Sangyo University, Kyoto, Japan.,Osaka University, Osaka, Japan
| | - Eiji Aramaki
- Nara Institute of Science and Technology, Ikoma, Japan
| |
Collapse
|
48
|
Huang B, Huan Y, Xu LD, Zheng L, Zou Z. Automated trading systems statistical and machine learning methods and hardware implementation: a survey. ENTERP INF SYST-UK 2018. [DOI: 10.1080/17517575.2018.1493145] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Affiliation(s)
- Boming Huang
- School of Information Science and Technology, Shanghai Institute of Intelligent Electronics and Systems, Fudan University, Shanghai, China
| | - Yuxiang Huan
- School of Information Science and Technology, Shanghai Institute of Intelligent Electronics and Systems, Fudan University, Shanghai, China
- School of ICT, KTH Royal Institute of Technology, Kista, Sweden
| | - Li Da Xu
- Old Dominion University, Norfolk, VA, USA
| | - Lirong Zheng
- School of Information Science and Technology, Shanghai Institute of Intelligent Electronics and Systems, Fudan University, Shanghai, China
| | - Zhuo Zou
- School of Information Science and Technology, Shanghai Institute of Intelligent Electronics and Systems, Fudan University, Shanghai, China
| |
Collapse
|
49
|
Padilla JJ, Kavak H, Lynch CJ, Gore RJ, Diallo SY. Temporal and spatiotemporal investigation of tourist attraction visit sentiment on Twitter. PLoS One 2018; 13:e0198857. [PMID: 29902270 PMCID: PMC6002102 DOI: 10.1371/journal.pone.0198857] [Citation(s) in RCA: 65] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2018] [Accepted: 05/25/2018] [Indexed: 11/18/2022] Open
Abstract
In this paper, we propose a sentiment-based approach to investigate the temporal and spatiotemporal effects on tourists' emotions when visiting a city's tourist destinations. Our approach consists of four steps: data collection and preprocessing from social media; visitor origin identification; visit sentiment identification; and temporal and spatiotemporal analysis. The temporal and spatiotemporal dimensions include day of the year, season of the year, day of the week, location sentiment progression, enjoyment measure, and multi-location sentiment progression. We apply this approach to the city of Chicago using over eight million tweets. Results show that seasonal weather, as well as special days and activities like concerts, impact tourists' emotions. In addition, our analysis suggests that tourists experience greater levels of enjoyment in places such as observatories rather than zoos. Finally, we find that local and international visitors tend to convey negative sentiment when visiting more than one attraction in a day whereas the opposite holds for out of state visitors.
Collapse
Affiliation(s)
- Jose J. Padilla
- Virginia Modeling Analysis and Simulation Center, Old Dominion University, Suffolk, Virginia, United States of America
| | - Hamdi Kavak
- Modeling Simulation and Visualization Engineering Department, Old Dominion University, Suffolk, Virginia, United States of America
| | - Christopher J. Lynch
- Virginia Modeling Analysis and Simulation Center, Old Dominion University, Suffolk, Virginia, United States of America
| | - Ross J. Gore
- Virginia Modeling Analysis and Simulation Center, Old Dominion University, Suffolk, Virginia, United States of America
| | - Saikou Y. Diallo
- Virginia Modeling Analysis and Simulation Center, Old Dominion University, Suffolk, Virginia, United States of America
| |
Collapse
|
50
|
Bovet A, Morone F, Makse HA. Validation of Twitter opinion trends with national polling aggregates: Hillary Clinton vs Donald Trump. Sci Rep 2018; 8:8673. [PMID: 29875364 PMCID: PMC5989214 DOI: 10.1038/s41598-018-26951-y] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2017] [Accepted: 05/09/2018] [Indexed: 11/09/2022] Open
Abstract
Measuring and forecasting opinion trends from real-time social media is a long-standing goal of big-data analytics. Despite the large amount of work addressing this question, there has been no clear validation of online social media opinion trend with traditional surveys. Here we develop a method to infer the opinion of Twitter users by using a combination of statistical physics of complex networks and machine learning based on hashtags co-occurrence to build an in-domain training set of the order of a million tweets. We validate our method in the context of 2016 US Presidential Election by comparing the Twitter opinion trend with the New York Times National Polling Average, representing an aggregate of hundreds of independent traditional polls. The Twitter opinion trend follows the aggregated NYT polls with remarkable accuracy. We investigate the dynamics of the social network formed by the interactions among millions of Twitter supporters and infer the support of each user to the presidential candidates. Our analytics unleash the power of Twitter to uncover social trends from elections, brands to political movements, and at a fraction of the cost of traditional surveys.
Collapse
Affiliation(s)
- Alexandre Bovet
- Levich Institute and Physics Department, City College of New York, New York, New York, 10031, USA
| | - Flaviano Morone
- Levich Institute and Physics Department, City College of New York, New York, New York, 10031, USA
| | - Hernán A Makse
- Levich Institute and Physics Department, City College of New York, New York, New York, 10031, USA.
| |
Collapse
|