Hybridized neural network and decision tree based classifier for prognostic decision making in breast cancers

Modelling Electricity Consumption During the COVID19 Pandemic: Datasets, Models, Results and a Research Agenda

The COVID19 pandemic has impacted the global economy, social activities, and Electricity Consumption (EC), affecting the performance of historical data-based Electricity Load Forecasting (ELF) algorithms. This study thoroughly analyses the pandemic's impact on these models and develop a hybrid model with better prediction accuracy using COVID19 data. Existing datasets are reviewed, and their limited generalization potential for the COVID19 period is highlighted. A dataset of 96 residential customers, comprising 36 and six months before and after the pandemic, is collected, posing significant challenges for current models. The proposed model employs convolutional layers for feature extraction, gated recurrent nets for temporal feature learning, and a self-attention module for feature selection, leading to better generalization for predicting EC patterns. Our proposed model outperforms existing models, as demonstrated by a detailed ablation study using our dataset. For instance, it achieves an average reduction of 0.56% & 3.46% in MSE, 1.5% & 5.07% in RMSE, and 11.81% & 13.19% in MAPE over the pre- and post-pandemic data, respectively. However, further research is required to address the varied nature of the data. These findings have significant implications for improving ELF algorithms during pandemics and other significant events that disrupt historical data patterns.

Artificial Intelligence in Pharmaceutical Technology and Drug Delivery Design

Artificial intelligence (AI) has emerged as a powerful tool that harnesses anthropomorphic knowledge and provides expedited solutions to complex challenges. Remarkable advancements in AI technology and machine learning present a transformative opportunity in the drug discovery, formulation, and testing of pharmaceutical dosage forms. By utilizing AI algorithms that analyze extensive biological data, including genomics and proteomics, researchers can identify disease-associated targets and predict their interactions with potential drug candidates. This enables a more efficient and targeted approach to drug discovery, thereby increasing the likelihood of successful drug approvals. Furthermore, AI can contribute to reducing development costs by optimizing research and development processes. Machine learning algorithms assist in experimental design and can predict the pharmacokinetics and toxicity of drug candidates. This capability enables the prioritization and optimization of lead compounds, reducing the need for extensive and costly animal testing. Personalized medicine approaches can be facilitated through AI algorithms that analyze real-world patient data, leading to more effective treatment outcomes and improved patient adherence. This comprehensive review explores the wide-ranging applications of AI in drug discovery, drug delivery dosage form designs, process optimization, testing, and pharmacokinetics/pharmacodynamics (PK/PD) studies. This review provides an overview of various AI-based approaches utilized in pharmaceutical technology, highlighting their benefits and drawbacks. Nevertheless, the continued investment in and exploration of AI in the pharmaceutical industry offer exciting prospects for enhancing drug development processes and patient care.

Decision Support System and Web-Application Using Supervised Machine Learning Algorithms for Easy Cancer Classifications

Using a decision support system (DSS) that classifies various cancers provides support to the clinicians/researchers to make better decisions that can aid in early cancer diagnosis, thereby reducing chances of incorrect disease diagnosis. Thus, this work aimed at designing a classification model that can predict accurately for 5 different cancer types comprising of 20 cancer exomes, using the mutations identified from whole exome cancer analysis. Initially, a basic model was designed using supervised machine learning classification algorithms such as K-nearest neighbor (KNN), support vector machine (SVM), decision tree, naïve bayes and random forest (RF), among which decision tree and random forest performed better in terms of preliminary model accuracy. However, output predictions were incorrect due to less training scores. Thus, 16 essential features were then selected for model improvement using 2 approaches. All imbalanced datasets were balanced using SMOTE. In the first approach, all features from 20 cancer exome datasets were trained and models were designed using decision tree and random forest. Balanced datasets for decision tree model showed an accuracy of 77%, while with the RF model, the accuracy improved to 82% where all 5 cancer types were predicted correctly. Area under the curve for RF model was closer to 1, than decision tree model. In the second approach, all 15 datasets were trained, while 5 were tested. However, only 2 cancer types were predicted correctly. To cross validate RF model, Matthew's correlation co-efficient (MCC) test was performed. For method 1, the MCC test and MCC cross validation was found to be 0.7796 and 0.9356 respectively. Likewise, for second approach, MCC was observed to be 0.9365, corroborating the accuracy of the designed model. The model was successfully deployed using Streamlit as a web application for easy use. This study presents insights for allowing easy cancer classifications.

Explainable, trustworthy, and ethical machine learning for healthcare: A survey

With the advent of machine learning (ML) and deep learning (DL) empowered applications for critical applications like healthcare, the questions about liability, trust, and interpretability of their outputs are raising. The black-box nature of various DL models is a roadblock to clinical utilization. Therefore, to gain the trust of clinicians and patients, we need to provide explanations about the decisions of models. With the promise of enhancing the trust and transparency of black-box models, researchers are in the phase of maturing the field of eXplainable ML (XML). In this paper, we provided a comprehensive review of explainable and interpretable ML techniques for various healthcare applications. Along with highlighting security, safety, and robustness challenges that hinder the trustworthiness of ML, we also discussed the ethical issues arising because of the use of ML/DL for healthcare. We also describe how explainable and trustworthy ML can resolve all these ethical problems. Finally, we elaborate on the limitations of existing approaches and highlight various open research problems that require further development.

Predicting Churn of Credit Card Customers Using Machine Learning and AutoML

Nowadays, a major concern for most retail banks is the risk that originates from customer fluctuation and that increases the cost of almost every financial product. In this work, the authors compared different approaches and algorithms to predict the relevant features that affect the customer churn, which means we can find ways to reduce the customer churn and create financial inclusion. This research was conducted by applying different machine learning techniques like decision tree classifier, random forest classifier, AdaBoost classifier, extreme gradient boosting, and balancing data with random under-sampling and random oversampling. The authors have also implemented AutoML to further compare different models and improve the accuracy of the model to predict customer churn. It was observed that applying AutoML highest accuracy model gave the accuracy of 97.53% in comparison to that of the decision tree classifier, which was 93.48% with the use of low processing power. Important features were ‘total transaction amount' and ‘total transaction count' to predict customer churn for a given dataset.

Comparison of machine learning models for predicting the risk of breast cancer-related lymphedema in Chinese women

Objective

Predictive models for the occurrence of cancer symptoms by using machine learning (ML) algorithms could be used to aid clinical decision-making in order to enhance the quality of cancer care. This study aimed to develop and validate a selection of classification models that used ML algorithms to predict the occurrence of breast cancer-related lymphedema (BCRL) among Chinese women.

Methods

This was a retrospective cohort study of consecutive cases that had been diagnosed with breast cancer, stages I-IV. Forty-eight variables were grouped into five feature sets. Five classification models with ML algorithms were developed, and the models' performance and the variables’ relative importance were assessed accordingly.

Results

Of 370 eligible female participants, 91 had BCRL (24.6%). The mean age of this study sample was 49.89 (SD ​= ​7.45). All participants had had breast cancer surgery, and more than half of them had had a modified radical mastectomy (n ​= ​206, 55.5%). The mean follow-up time after breast cancer surgery was 28.73 months (SD ​= ​11.71). Most of the tumors were either stage I (n ​= ​49, 31.2%) or stage II (n ​= ​252, 68.1%). More than half of the sample had had postoperative chemotherapy (n ​= ​227, 61.4%). Overall, the logistic regression model achieved the best performance in terms of accuracy (91.6%), precision (82.1%), and recall (91.4%) for BCRL. Although this study included 48 predicting variables, we found that the five models required only 22 variables to achieve predictive performance. The most important variable was the number of positive lymph nodes, followed in descending order by the BCRL occurring on the same side as the surgery, a history of sentinel lymph node biopsy, a dietary preference for meat and fried food, and an exercise frequency of less than three times per week. These factors were the most influential predictors for enhancing the ML models’ performance.

Conclusions

This study found that in the ML training dataset, the multilayer perceptron model and the logistic regression model were the best discrimination models for predicting the outcome of BCRL, and the k-nearest neighbors and support vector machine models demonstrated good calibration performance in the ML validation dataset. Future research will need to use large-sample datasets to establish a more robust ML model for predicting BCRL deeply and reliably.

Automatic Rule Generation for Decision-Making in Context-Aware Systems Using Machine Learning

With the increasing interest devoted to dynamic environments, a crucial aspect is revealed in context-aware systems to deal with the rapid changes occurring in users' surrounding environments at runtime. However, most context-aware systems with predefined context-aware rules may not support effective decision-making in dynamic environments. These context-aware rules, which take into account different context information to reach an appropriate decision, could lose their efficiency at runtime. Therefore, a growing need is emerging to address the decision-making issue leveraged by dynamic environments. To tackle this issue, we present an approach that relies on improving decision-making in the wake of dynamic environments through automatically enriching a rule knowledge base with new context-aware rules discovered at runtime. The major features of the presented approach are as follows: (i) a hybridization of two machine learning algorithms for rule generation, (ii) an extended genetic algorithm (GA) for rule optimization, and (iii) a rule transformation for the knowledge base enrichment in an automated manner. Furthermore, extensive experiments on different datasets are performed to assess the effectiveness of the presented approach. The obtained experimental results depict that this approach exhibits better effectiveness compared to some algorithms and state-of-the-art works.

An effective fine grading method of BI-RADS classification in mammography

PURPOSE

Mammography is an important imaging technique for the detection of early breast cancer. Doctors classify mammograms as Breast Imaging Reporting and Data Systems (BI-RADS). This study aims to provide an intelligent BI-RADS grading prediction method, which can help radiologists and clinicians to distinguish the most challenging 4A, 4B, and 4C cases in mammography.

METHODS

Firstly, the breast region, the lesion region, and the corresponding region in the contralateral breast were extracted. Four categories of features were extracted from the original images and the images after the wavelet transform. Secondly, an optimized sequential forward floating selection (SFFS) was used for feature selection. Finally, a two-layer classifier integration was employed for fine grading prediction. 45 cases from the hospital and 500 cases from Digital Database for Screening Mammography (DDSM) database were used for evaluation.

RESULTS

The classification performance of the support vector machine (SVM), Bayes, and random forest is very close on the 45 testing set, with the area under the receiver operating characteristic curve (AUC) of 0.978, 0.967, and 0.968. On the DDSM set, the AUC achieves 0.931, 0.938, and 0.874. Using the mean probability prediction, the AUC on the two datasets reaches 0.998 and 0.916. However, they are all significantly higher than the doctors' diagnosis, with the AUC of 0.807 and 0.725.

CONCLUSIONS

A BI-RADS fine grading (2, 3, 4A, 4B, 4C, 5) prediction model was proposed. Through the evaluation from different datasets, the performance is proved higher than that of the doctors, which may provide great help for clinical BI-RADS classification diagnosis. Therefore, our method can produce more effective and reliable results.

A Novel Feature Selection Technique to Better Predict Climate Change Stage of Change

Indications of people’s environmental concern are linked to transport decisions and can provide great support for policymaking on climate change. This study aims to better predict individual climate change stage of change (CC-SoC) based on different features of transport-related behavior, General Ecological Behavior, New Environmental Paradigm, and socio-demographic characteristics. Together these sources result in over 100 possible features that indicate someone’s level of environmental concern. Such a large number of features may create several analytical problems, such as overfitting, accuracy reduction, and high computational costs. To this end, a new feature selection technique, named the Coyote Optimization Algorithm-Quadratic Discriminant Analysis (COA-QDA), is first proposed to find the optimal features to predict CC-SoC with the highest accuracy. Different conventional feature selection methods (Lasso, Elastic Net, Random Forest Feature Selection, Extra Trees, and Principal Component Analysis Feature Selection) are employed to compare with the COA-QDA. Afterward, eight classification techniques are applied to solve the prediction problem. Finally, a sensitivity analysis is performed to determine the most important features affecting the prediction of CC-SoC. The results indicate that COA-QDA outperforms conventional feature selection methods by increasing average testing data accuracy from 0.7% to 5.6%. Logistic Regression surpasses other classifiers with the highest prediction accuracy.

Examining the predictability and prognostication of multimorbidity among older Delayed-Discharge Patients: A Machine learning analytics

BACKGROUND

Patient complexity among older delayed-discharge patients complicates discharge planning, resulting in a higher rate of adverse outcomes, such as readmission and mortality. Early prediction of multimorbidity, as a common indicator of patient complexity, can support proactive discharge planning by prioritizing complex patients and reducing healthcare inefficiencies.

OBJECTIVE

We set out to accomplish the following two objectives: 1) to examine the predictability of three common multimorbidity indices, including Charlson-Deyo Comorbidity Index (CDCI), the Elixhauser Comorbidity Index (ECI), and the Functional Comorbidity Index (FCI) using machine learning (ML), and 2) to assess the prognostic power of these indices in predicting 30-day readmission and mortality.

MATERIALS AND METHODS

We used data including 163,983 observations of patients aged 65 and older who experienced discharge delay in Ontario, Canada, during 2004 - 2017. First, we utilized various classification ML algorithms, including classification and regression trees, random forests, bagging trees, extreme gradient boosting, and logistic regression, to predict the multimorbidity status based on CDCI, ECI, and FCI. Second, we used adjusted multinomial logistic regression to assess the association between multimorbidity indices and the patient-important outcomes, including 30-day mortality and readmission.

RESULTS

For all ML algorithms and regardless of the predictive performance criteria, better predictions were established for the CDCI compared with the ECI and FCI. Remarkably, the most predictable multimorbidity index (i.e., CDCI with Area Under the Receiver Operating Characteristic Curve = 0.80, 95% CI = 0.79 - 0.81) also offered the highest prognostications regarding adverse events (RRR_mortality = 3.44, 95% CI = 3.21 - 3.68 and RRR_readmission = 1.36, 95% CI = 1.31 - 1.40).

CONCLUSIONS

Our findings highlight the feasibility and utility of predicting multimorbidity status using ML algorithms, resulting in the early detection of patients at risk of mortality and readmission. This can support proactive triage and decision-making about staffing and resource allocation, with the goal of optimizing patient outcomes and facilitating an upstream and informed discharge process through prioritizing complex patients for discharge and providing patient-centered care.

IoT Solution for AI-Enabled PRIVACY-PREServing with Big Data Transferring: An Application for Healthcare Using Blockchain

Internet of Things (IoT) performs a vital role in providing connectivity between computing devices, processes, and things. It significantly increases the communication facilities and giving up-to-date information to distributed networks. On the other hand, the techniques of artificial intelligence offer numerous and valuable services in emerging fields. An IoT-based healthcare solution facilitates patients, hospitals, and professionals to observe real-time and critical data. In the literature, most of the solution suffers from data intermission, high ethical standards, and trustworthiness communication. Moreover, network interruption with recurrent expose of sensitive and personal health data decreases the reliance on network systems. Therefore, this paper intends to propose an IoT solution for AI-enabled privacy-preserving with big data transferring using blockchain. Firstly, the proposed algorithm uses a graph-modeling to develop a scalable and reliable system for gathering and transmitting data. In addition, it extracts the subset of nodes using the artificial intelligence approach and achieves efficient services for the healthcare system. Secondly, symmetric-based digital certificates are utilized to offer authentic and confidential transmission with communication resources using blockchain. The proposed algorithm is explored with existing solutions through multiple simulations and proved improvement in terms of realistic parameters.

Molecular insights on ABL kinase activation using tree-based machine learning models and molecular docking

Abelson kinase (c-Abl) is a non-receptor tyrosine kinase involved in several biological processes essential for cell differentiation, migration, proliferation, and survival. This enzyme's activation might be an alternative strategy for treating diseases such as neutropenia induced by chemotherapy, prostate, and breast cancer. Recently, a series of compounds that promote the activation of c-Abl has been identified, opening a promising ground for c-Abl drug development. Structure-based drug design (SBDD) and ligand-based drug design (LBDD) methodologies have significantly impacted recent drug development initiatives. Here, we combined SBDD and LBDD approaches to characterize critical chemical properties and interactions of identified c-Abl's activators. We used molecular docking simulations combined with tree-based machine learning models—decision tree, AdaBoost, and random forest to understand the c-Abl activators' structural features required for binding to myristoyl pocket, and consequently, to promote enzyme and cellular activation. We obtained predictive and robust models with Matthews correlation coefficient values higher than 0.4 for all endpoints and identified characteristics that led to constructing a structure–activity relationship model (SAR).

Epidemic zone of COVID-19 from social media using hypergraph with weighting factor (HWF)

Online social network is one of the most prominent media that holds information about society's epidemic problem. Due to privacy reasons, most of the users will not disclose their location. Detecting the location of the tweet users is required to track the geographic location of the spreading diseases. This work aims to detect the spreading location of the COVID-19 disease from the Twitter users and content discussed in the tweet. COVID-19 is a disease caused by the "novel coronavirus." About 80% of confirmed cases recover from the disease. However, one out of every six people who get COVID-19 can become seriously ill, stated by the World health organization. Inferring the user location for identifying the spreading location for the disease is a very challenging task. This paper proposes a new technique based on a hypergraph model to detect the Twitter user's locations based on the spreading disease. This model uses hypergraph with weighting factor technique to infer the spreading disease's spatial location. The accuracy of prediction can be improved when a massive volume of streaming data is analyzed. The Helly property of the hypergraph was applied to discard less potential words from the text analysis, which claims this work of unique nature. A weighting factor was introduced to calculate the score of each location for a particular user. The location of each user is predicted based on the one that possesses the highest weighting factor. The proposed framework has been evaluated and tested for various measures like precision, recall and F-measure. The promising results obtained have substantiated the claim for this work compared to the state-of-the-art methodologies.

Towards secure deep learning architecture for smart farming-based applications

The immense growth of the cloud infrastructure leads to the deployment of several machine learning as a service (MLaaS) in which the training and the development of machine learning models are ultimately performed in the cloud providers’ environment. However, this could also cause potential security threats and privacy risk as the deep learning algorithms need to access generated data collection, which lacks security in nature. This paper predominately focuses on developing a secure deep learning system design with the threat analysis involved within the smart farming technologies as they are acquiring more attention towards the global food supply needs with their intensifying demands. Smart farming is known to be a combination of data-driven technology and agricultural applications that helps in yielding quality food products with the enhancing crop yield. Nowadays, many use cases had been developed by executing smart farming paradigm and promote high impacts on the agricultural lands.

Cervical Cancer Identification with Synthetic Minority Oversampling Technique and PCA Analysis using Random Forest Classifier

Cervical cancer is the fourth most communal malignant disease amongst women worldwide. In maximum circumstances, cervical cancer indications are not perceptible at its initial stages. There are a proportion of features that intensify the threat of emerging cervical cancer like human papilloma virus, sexual transmitted diseases, and smoking. Ascertaining those features and constructing a classification model to categorize, if the cases are cervical cancer or not is an existing challenging research. This learning intentions at using cervical cancer risk features to build classification model using Random Forest (RF) classification technique with the synthetic minority oversampling technique (SMOTE) and two feature reduction techniques recursive feature elimination and principle component analysis (PCA). Utmost medical data sets are frequently imbalanced since the number of patients is considerably fewer than the number of non-patients. For the imbalance of the used data set, SMOTE is cast-off to solve this problem. The data set comprises of 32 risk factors and four objective variables: Hinselmann, Schiller, Cytology and Biopsy. Accuracy, Sensitivity, Specificity, PPA and NPA of the four variables remains accurate after SMOTE when compared with values obtained before SMOTE. An RSOnto ontology has been created to visualize the progress in classification performance.