1
|
Lanjewar MG, Panchbhai KG, Patle LB. Fusion of transfer learning models with LSTM for detection of breast cancer using ultrasound images. Comput Biol Med 2024; 169:107914. [PMID: 38190766 DOI: 10.1016/j.compbiomed.2023.107914] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2023] [Revised: 12/14/2023] [Accepted: 12/27/2023] [Indexed: 01/10/2024]
Abstract
Breast Cancer (BC) is one of the top reasons for fatality in women worldwide. As a result, timely identification is critical for successful therapy and excellent survival rates. Transfer Learning (TL) approaches have recently shown promise in aiding in the early recognition of BC. In this work, three TL models, MobileNetV2, ResNet50, and VGG16, were combined with LSTM to extract the features from Ultrasound Images (USIs). Furthermore, the Synthetic Minority Over-sampling Technique (SMOTE) with Tomek (SMOTETomek) was employed to balance the extracted features. The proposed method with VGG16 achieved an F1 score of 99.0 %, Matthews Correlation Coefficient (MCC) and Kappa Coefficient of 98.9 % with an Area Under Curve (AUC) of 1.0. The K-fold method was applied for cross-validation and achieved an average F1 score of 96 %. Moreover, the Gradient-weighted Class Activation Mapping (Grad-CAM) method was applied for visualization, and the Local Interpretable Model-agnostic Explanations (LIME) method was applied for interpretability. The Normal Approximation Interval (NAI) and bootstrapping methods were used to calculate Confidence Intervals (CIs). The proposed method achieved a Lower CI (LCI), Upper CI (UCI), and Mean CI (MCI) of 96.50 %, 99.75 %, and 98.13 %, respectively, with the NAI, while 95 % LCI of 93.81 %, an UCI of 96.00 %, and a bootstrap mean of 94.90 % with the bootstrap method. Furthermore, the performance of the six state-of-the-art (SOTA) TL models, such as Xception, NASNetMobile, InceptionResNetV2, MobileNetV2, ResNet50, and VGG16, were compared with the proposed method.
Collapse
Affiliation(s)
- Madhusudan G Lanjewar
- School of Physical and Applied Sciences, Goa University, Taleigao Plateau, Goa, 403206, India.
| | | | - Lalchand B Patle
- PG Department of Electronics, MGSM's DDSGP College Chopda, KBCNMU, Jalgaon, Maharashtra, 425107, India.
| |
Collapse
|
2
|
Pereira F, Costa JM, Ramos R, Raimundo A. The impact of the COVID-19 pandemic on airlines' passenger satisfaction. JOURNAL OF AIR TRANSPORT MANAGEMENT 2023; 112:102441. [PMID: 37304757 PMCID: PMC10247150 DOI: 10.1016/j.jairtraman.2023.102441] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/09/2021] [Revised: 06/04/2023] [Accepted: 06/04/2023] [Indexed: 06/13/2023]
Abstract
This study aims to understand airline passengers' satisfaction trends by analyzing the most influential factors on satisfaction before and during the COVID-19 pandemic. The sample consists of a dataset with 9745 passenger reviews published on airlinequality.com. The reviews were analyzed with a sentiment analysis tool calibrated for the aviation industry for accuracy. Machine learning algorithms were then implemented to predict review sentiment based on airline company, travelers' type and class, and country of origin. Findings show passengers were unhappy before the pandemic, aggravated after the COVID-19 outbreak. The staff's behavior is the main factor influencing passengers' satisfaction. Predictive modeling showed that it is possible to predict negative review sentiments with satisfactory performance rather than positive reviews. The main takeaway is that passengers, after the pandemic, are most worried about refunds and aircraft cabin cleanliness. From a managerial standpoint, airline companies can benefit from the created knowledge to adjust their strategies in agreement and meet their customers' expectations.
Collapse
Affiliation(s)
| | | | - Ricardo Ramos
- Instituto Universitário de Lisboa (ISCTE-IUL), ISTAR, Lisboa, Portugal
- Instituto Politécnico de Coimbra, ESTGOH, Rua General Santos Costa, 3400-124, Oliveira do Hospital, Portugal
| | - António Raimundo
- Instituto de Telecomunicações (IT-IUL), Instituto Universitário de Lisboa (ISCTE-IUL), 1649-026, Lisboa, Portugal
| |
Collapse
|
3
|
Ganapathy R, Rajendran V. CB-GRU-an encrypted net traffic flow classification in SDN using optimizing hyper parameters of neural network. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2023. [DOI: 10.3233/jifs-220051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
In current years, increased number of cyberspace users cause rapid ascends of network traffics. For instance: probability of receiving network traffic ever since software technologies that linked with devices produced massive amounts of data which are unable to accommodate through conventional schemes port based, payload based and machine learning approaches. Simultaneously SDN technology can alleviate problems of conventional method in classifying network traffic as malicious and benign, resources allocation, network monitoring along with enhancement in overall network performance via activist methods. This research work analyzed the net traffic metadata of 1,04,345 samples gathered from RYU-SDN controller, an OpenFlow controller using mininet emulator with 23 features then performed encrypted metadata categorization into three classes namely TCP, UDP and ICMP attacks through deep CNN with two layers LSTM, CNN-two layers GRU and ConvNet Bidirectional with two layers GRU approaches with hyper parameters tuning appropriate for better network convergence, performance, optimization too. The proposed experimental outcomes reveals that deep based CB-GRU method fulfill traffic classification in SDN environment and accomplished significance enhancement in terms of accuracy 99.97%, and loss rate 0.01. Other evaluation criterias precision, recall, area under curve, were calculated for performance identification in net data traffic classification than conventional methods.
Collapse
Affiliation(s)
- Revathy Ganapathy
- Vels Institute of Science, Technology & Advanced Studies, Pallavaram, Chennai, Tamil Nadu, India
| | - Velayutham Rajendran
- Vels Institute of Science, Technology & Advanced Studies, Pallavaram, Chennai, Tamil Nadu, India
| |
Collapse
|
4
|
Sandhu G, Singh A, Lamba PS, Virmani D, Chaudhary G. Modified Euclidean-Canberra blend distance metric for kNN classifier. INTELLIGENT DECISION TECHNOLOGIES 2023. [DOI: 10.3233/idt-220223] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/10/2023]
Abstract
In today’s world different data sets are available on which regression or classification algorithms of machine learning are applied. One of the classification algorithms is k-nearest neighbor (kNN) which computes distance amongst various rows in a dataset. The performance of kNN is evaluated based on K-value and distance metric used where K is the total count of neighboring elements. Many different distance metrics have been used by researchers in literature, one of them is Canberra distance metric. In this paper the performance of kNN based on Canberra distance metric is measured on different datasets, further the proposed Canberra distance metric, namely, Modified Euclidean-Canberra Blend Distance (MECBD) metric has been applied to the kNN algorithm which led to improvement of class prediction efficiency on the same datasets measured in terms of accuracy, precision, recall, F1-score for different values of k. Further, this study depicts that MECBD metric use led to improvement in accuracy value 80.4% to 90.3%, 80.6% to 85.4% and 70.0% to 77.0% for various data sets used. Also, implementation of ROC curves and auc for k= 5 is done to show the improvement is kNN model prediction which showed increase in auc values for different data sets, for instance increase in auc values form 0.873 to 0.958 for Spine (2 Classes) dataset, 0.857 to 0.940, 0.983 to 0.983 (no change), 0.910 to 0.957 for DH, SL and NO class for Spine (3 Classes) data set and 0.651 to 0.742 for Haberman’s data set.
Collapse
Affiliation(s)
- Gaurav Sandhu
- Guru Tegh Bahadur Institute of Technology, GGSIPU, New Delhi, India
| | - Amandeep Singh
- Guru Tegh Bahadur Institute of Technology, GGSIPU, New Delhi, India
| | - Puneet Singh Lamba
- VIPS-TC, School of Engineering and Technology, Pitampura, New Delhi, India
| | - Deepali Virmani
- VIPS-TC, School of Engineering and Technology, Pitampura, New Delhi, India
| | - Gopal Chaudhary
- VIPS-TC, School of Engineering and Technology, Pitampura, New Delhi, India
| |
Collapse
|
5
|
García-Valls M, Palomar-Cosín E. An Evaluation Process for IoT Platforms in Time-Sensitive Domains. SENSORS (BASEL, SWITZERLAND) 2022; 22:9501. [PMID: 36502202 PMCID: PMC9737625 DOI: 10.3390/s22239501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/30/2022] [Revised: 11/27/2022] [Accepted: 11/28/2022] [Indexed: 06/17/2023]
Abstract
Determining the temporal behavior of an IoT platform is of utmost importance as IoT systems are time-sensitive. IoT platforms play a central role in the operation of an IoT system, impacting the overall performance. As a result, initiating an IoT project without the exhaustive knowledge of such a core software piece may lead to a failed project if the finished systems do not meet the needed temporal response and scalability levels. Despite this fact, existing works on IoT software systems focus on the design and implementation of a particular system, providing a final evaluation as the validation. This is a risky approach as an incorrect decision on the core IoT platform may involve great monetary loss if the final evaluation proves that the system does not meet the expected validation criteria. To overcome this, we provide an evaluation process to determine the temporal behavior of IoT platforms to support early design decisions with respect to the appropriateness of the particular platform in its application as an IoT project. The process defines the steps towards the early evaluation of IoT platforms, ranging from the identification of the potential software items and the determination of the validation criteria to running the experiments and obtaining results. The process is exemplified on an exhaustive evaluation of a particular mainstream IoT platform for the case of a medical system for patient monitoring. In this time-sensitive scenario, results report the temporal behavior of the platform regarding the validation parameters expressed at the initial steps.
Collapse
|
6
|
Candelaria MDE, Chua NMM, Kee SH. Evaluation of Heat-Induced Damage in Concrete Using Machine Learning of Ultrasonic Pulse Waves. MATERIALS (BASEL, SWITZERLAND) 2022; 15:7914. [PMID: 36431399 PMCID: PMC9692534 DOI: 10.3390/ma15227914] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Revised: 11/01/2022] [Accepted: 11/05/2022] [Indexed: 06/16/2023]
Abstract
This study investigated the applicability of using ultrasonic wave signals in detecting early fire damage in concrete. This study analyzed the reliability of using the linear (wave velocity) and nonlinear (coherence) parameters from ultrasonic pulse measurements and the applicability of machine learning in assessing the thermal damage of concrete cylinders. While machine learning has been used in some damage detections for concrete, its feasibility has not been fully investigated in classifying thermal damage. Data was collected from laboratory experiments using concrete specimens with three different water-to-binder ratios (0.54, 0.46, and 0.35). The specimens were subjected to different target temperatures (100 °C, 200 °C, 300 °C, 400 °C, and 600 °C) and another set of cylinders was subjected to room temperature (20 °C) to represent the normal temperature condition. It was observed that P-wave velocities increased by 0.1% to 10.44% when the concretes were heated to 100 °C, and then decreased continuously until 600 °C by 48.46% to 65.80%. Conversely, coherence showed a significant decrease after exposure to 100 °C but had fluctuating values in the range of 0.110 to 0.223 thereafter. In terms of classifying the thermal damage of concrete, machine learning yielded an accuracy of 76.0% while the use of P-wave velocity and coherence yielded accuracies of 30.26% and 32.31%, respectively.
Collapse
Affiliation(s)
- Ma. Doreen Esplana Candelaria
- Department of ICT Integrated Ocean Smart Cities Engineering, Dong-A University, Busan 49315, Korea
- Institute of Civil Engineering, University of the Philippines Diliman, Quezon City 1101, Philippines
| | - Nhoja Marie Miranda Chua
- Department of ICT Integrated Ocean Smart Cities Engineering, Dong-A University, Busan 49315, Korea
| | - Seong-Hoon Kee
- Department of ICT Integrated Ocean Smart Cities Engineering, Dong-A University, Busan 49315, Korea
| |
Collapse
|
7
|
Saleh H, Mostafa S, Alharbi A, El-Sappagh S, Alkhalifah T. Heterogeneous Ensemble Deep Learning Model for Enhanced Arabic Sentiment Analysis. SENSORS 2022; 22:s22103707. [PMID: 35632116 PMCID: PMC9147256 DOI: 10.3390/s22103707] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/03/2022] [Revised: 05/06/2022] [Accepted: 05/10/2022] [Indexed: 11/18/2022]
Abstract
Sentiment analysis was nominated as a hot research topic a decade ago for its increasing importance in analyzing the people’s opinions extracted from social media platforms. Although the Arabic language has a significant share of the content shared across social media platforms, its content’s sentiment analysis is still limited due to its complex morphological structures and the varieties of dialects. Traditional machine learning and deep neural algorithms have been used in a variety of studies to predict sentiment analysis. Therefore, a need of changing current mechanisms is required to increase the accuracy of sentiment analysis prediction. This paper proposed an optimized heterogeneous stacking ensemble model for enhancing the performance of Arabic sentiment analysis. The proposed model combines three different of pre-trained Deep Learning (DL) models: Recurrent Neural Network (RNN), Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU) in conjunction with three meta-learners Logistic Regression (LR), Random Forest (RF), and Support Vector Machine (SVM) in order to enhance model’s performance for predicting Arabic sentiment analysis. The performance of the proposed model with RNN, LSTM, GRU, and the five regular ML techniques: Decision Tree (DT), LR, K-Nearest Neighbor (KNN), RF, and Naive Bayes (NB) are compared using three benchmarks Arabic dataset. Parameters of Machine Learning (ML) and DL are optimized using Grid search and KerasTuner, respectively. Accuracy, precision, recall, and f1-score were applied to evaluate the performance of the models and validate the results. The results show that the proposed ensemble model has achieved the best performance for each dataset compared with other models.
Collapse
Affiliation(s)
- Hager Saleh
- Faculty of Computers and Artificial Intelligence, South Valley University, Hurghada 84511, Egypt;
- Correspondence: (H.S.); (T.A.)
| | - Sherif Mostafa
- Faculty of Computers and Artificial Intelligence, South Valley University, Hurghada 84511, Egypt;
| | - Abdullah Alharbi
- Department of Information Technology, College of Computers and Information Technology, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia;
| | - Shaker El-Sappagh
- Faculty of Computer Science and Engineering, Galala University, Suez 435611, Egypt;
- Information Systems Department, Faculty of Computers and Artificial Intelligence, Benha University, Banha 13518, Egypt
| | - Tamim Alkhalifah
- Department of Computer, College of Science and Arts in Ar Rass, Qassim University, Buraydah 52571, Saudi Arabia
- Correspondence: (H.S.); (T.A.)
| |
Collapse
|
8
|
A Deep Learning Approach to Analyze Airline Customer Propensities: The Case of South Korea. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12041916] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
In the airline industry, customer satisfaction occurs when passengers’ expectations are met through the airline experience. Considering that airline service quality is the main factor in obtaining new and retaining existing customers, airline companies are applying various approaches to improve the quality of the physical and social servicescapes. It is common to use data analysis techniques for analyzing customer propensity in marketing. However, their application to the airline industry has traditionally focused solely on surveys; hence, there is a lack of attention paid to deep learning techniques based on survey results. This study has two purposes. The first purpose is to find the relationship between various factors influencing customer churn risk and satisfaction by analyzing the airline customer data. For this, we applied deep learning techniques to the survey data collected from the users who have used mostly Korean airplanes. To the best of our knowledge, this is the one of the few attempts at applying deep learning to analyze airline customer propensities. The second purpose is to analyze the influence of the social servicescape, including the viewpoints of the cabin crew and passengers using aircraft, on airline customer propensities. The experimental results demonstrated that the proposed method of considering human services increased the accuracy of predictive models by up to 10% and 9% in predicting customer churn risk and satisfaction, respectively.
Collapse
|