Camden Coalition Medical-Legal Partnership: Year One Analysis of Civil + Criminal MLP Model in Addiction Medicine Setting

In 2022, the Camden Coalition Medical-Legal Partnership began providing civil and criminal legal services to substance use disorder patients at Cooper University Health Care's Center for Healing. This paper discusses early findings from the program's first year on the efficacy of the provision of criminal-legal representation, which is uncommon among MLPs and critical for this patient population. The paper concludes with takeaways for other programs providing legal services in an addiction medicine setting.

Comparative study of respiratory sounds classification methods based on cepstral analysis and artificial neural networks

In this paper, we investigated and evaluated various machine learning-based approaches for automatically detecting wheezing sounds. We conducted a comprehensive comparison of these proposed systems, assessing their classification performance through metrics such as Sensitivity, Specificity, and Accuracy. The main approach to developing a machine learning-based system for classifying respiratory sounds involved the combination of a technique for extracting features from an unknown input sound with a classification method to determine its belonging class. The characterization techniques used in this study are based on the cepstral analysis, which was extensively employed in the automatic speech recognition field. While MFCC (Mel-Frequency Cepstral Coefficients) feature extraction methods are commonly used in respiratory sounds classification, our study introduces a novelty by employing GFCC (Gammatone-Frequency Cepstral Coefficients) and BFCC (Bark-Frequency Cepstral Coefficients) for this purpose. For the classification task, we employed two types of neural networks: the MLP (Multilayer Perceptron), a feedforward neural network, and a variant of the LSTM (Long Short-Term Memory) recurrent neural network called BiLSTM (Bidirectional LSTM). The proposed classification systems are evaluated using a database consisting of 497 wheezing segments and 915 normal respiratory segments, which are recorded from individuals diagnosticated with asthma and individuals without any respiratory issues, respectively. The highest classification performance was achieved by the BFCC-BiLSTM model, which demonstrated an exceptional accuracy rate of 99.8%.

Deciphering the impact of microenvironmental factors on cuticular hydrocarbon degradation in Lucilia sericata empty Puparia: Bridging ecological and forensic entomological perspectives using machine learning models

Blow flies (Calliphoridae) play essential ecological roles in nutrient recycling by consuming decaying organic matter. They serve as valuable bioindicators in ecosystem management and forensic entomology, with their unique feeding behavior leading to the accumulation of environmental pollutants in their cuticular hydrocarbons (CHCs), making them potential indicators of exposure history. This study focuses on CHC degradation dynamics in empty puparia of Lucilia sericata under different environmental conditions for up to 90 days. The three distinct conditions were considered: outdoor-buried, outdoor-above-ground, and indoor environments. Five predominant CHCs, n-Pentacosane (n-C25), n-Hexacosane (n-C26), n-Heptacosane (n-C27), n-Octacosane (n-C28), and n-Nonacosane (n-C29), were analyzed using Gas Chromatography-Mass Spectrometry (GC-MS). The findings revealed variations in CHC concentrations over time, influenced by environmental factors, with significant differences at different time points. Correlation heatmap analysis indicated negative correlations between weathering time and certain CHCs, suggesting decreasing concentrations over time. Machine learning techniques Support Vector Machine (SVM), Multilayer Perceptron (MLP), and eXtreme Gradient Boosting (XGBoost) models explored the potential of CHCs as age indicators. SVM achieved an R-squared value of 0.991, demonstrating high accuracy in age estimation based on CHC concentrations. MLP also exhibited satisfactory performance in outdoor conditions, while SVM and MLP yielded unsatisfactory results indoors due to the lack of significant CHC variations. After comprehensive model selection and performance evaluations, it was found that the XGBoost model excelled in capturing the patterns in all three datasets. This study bridges the gap between baseline and ecological/forensic use of empty puparia, offering valuable insights into the potential of CHCs in environmental monitoring and investigations. Understanding CHCs' stability and degradation enhances blow flies' utility as bioindicators for pollutants and exposure history, benefiting environmental monitoring and forensic entomology.

Integrating conceptual and machine learning models to enhance daily-Scale streamflow simulation and assessing climate change impact in the watersheds of the Godavari basin, India

This study examined and addressed climate change's effects on hydrological patterns, particularly in critical places like the Godavari River basin. This study used daily gridded rainfall and temperature datasets from the Indian Meteorological Department (IMD) for model training and testing, 70% and 30%, respectively. To anticipate future hydrological shifts, the study harnessed the EC-Earth3 data, presenting an innovative methodology tailored to the unique hydrological dynamics of the Godavari River basin. The Sacramento model provided initial streamflow estimates for Kanhargaon, Nowrangpur, and Wairagarh. This approach melded traditional hydrological modeling with advanced multi-layer perceptron (MLP) capabilities. When combined with parameters like lagged rainfall, lagged streamflow, potential evapotranspiration (PET), and temperature variations, these initial outputs were further refined using the Sac-MLP model. A comparison with Sacramento revealed the superior performance of the Sac-MLP model. For instance, during training, the Nash Sutcliffe efficiency (NSE) values for the Sac-MLP witnessed an improvement from 0.610 to 0.810 in Kanhargaon, 0.580 to 0.692 in Nowrangpur, and 0.675 to 0.849 in Wairagarh. The results of the testing further corroborated these findings, as evidenced by the increase in the NSE for Kanhargaon from 0.890 to 0.910. Additionally, Nowrangpur and Wairagarh experienced notable improvements, with their NSE values rising from 0.629 to 0.785 and 0.725 to 0.902, respectively. Projections based on EC-Earth3 data across various scenarios highlighted significant shifts in rainfall and temperature patterns, especially in the far future (2071-2100). Regarding the relative change in annual streamflow, Kanhargaon projections under SSP370 and SSP585 for the far future indicate increases of 584.38% and 662.74%. Similarly, Nowrangpur and Wairagarh are projected to see increases of 98.27% and 114.98%, and 81.68% and 108.08%, respectively. This study uses EC-Earth3 estimates to demonstrate the Sac-MLP model's accuracy and importance in climate change water resource planning. The unique method for region-specific hydrological analysis provides vital insights for sustainable water resource management. This research provides a deeper understanding of climate-induced hydrological changes and a robust modeling approach for accurate predictions in changing environmental conditions.

Diagnosing and tracking depression based on eye movement in response to virtual reality

Introduction

Depression is a prevalent mental illness that is primarily diagnosed using psychological and behavioral assessments. However, these assessments lack objective and quantitative indices, making rapid and objective detection challenging. In this study, we propose a novel method for depression detection based on eye movement data captured in response to virtual reality (VR).

Methods

Eye movement data was collected and used to establish high-performance classification and prediction models. Four machine learning algorithms, namely eXtreme Gradient Boosting (XGBoost), multilayer perceptron (MLP), Support Vector Machine (SVM), and Random Forest, were employed. The models were evaluated using five-fold cross-validation, and performance metrics including accuracy, precision, recall, area under the curve (AUC), and F1-score were assessed. The predicted error for the Patient Health Questionnaire-9 (PHQ-9) score was also determined.

Results

The XGBoost model achieved a mean accuracy of 76%, precision of 94%, recall of 73%, and AUC of 82%, with an F1-score of 78%. The MLP model achieved a classification accuracy of 86%, precision of 96%, recall of 91%, and AUC of 86%, with an F1-score of 92%. The predicted error for the PHQ-9 score ranged from -0.6 to 0.6.To investigate the role of computerized cognitive behavioral therapy (CCBT) in treating depression, participants were divided into intervention and control groups. The intervention group received CCBT, while the control group received no treatment. After five CCBT sessions, significant changes were observed in the eye movement indices of fixation and saccade, as well as in the PHQ-9 scores. These two indices played significant roles in the predictive model, indicating their potential as biomarkers for detecting depression symptoms.

Discussion

The results suggest that eye movement indices obtained using a VR eye tracker can serve as useful biomarkers for detecting depression symptoms. Specifically, the fixation and saccade indices showed promise in predicting depression. Furthermore, CCBT demonstrated effectiveness in treating depression, as evidenced by the observed changes in eye movement indices and PHQ-9 scores. In conclusion, this study presents a novel approach for depression detection using eye movement data captured in VR. The findings highlight the potential of eye movement indices as biomarkers and underscore the effectiveness of CCBT in treating depression.

MCNMF-Unet: a mixture Conv-MLP network with multi-scale features fusion Unet for medical image segmentation

Recently, the medical image segmentation scheme combining Vision Transformer (ViT) and multilayer perceptron (MLP) has been widely used. However, one of its disadvantages is that the feature fusion ability of different levels is weak and lacks flexible localization information. To reduce the semantic gap between the encoding and decoding stages, we propose a mixture conv-MLP network with multi-scale features fusion Unet (MCNMF-Unet) for medical image segmentation. MCNMF-Unet is a U-shaped network based on convolution and MLP, which not only inherits the advantages of convolutional in extracting underlying features and visual structures, but also utilizes MLP to fuse local and global information of each layer of the network. MCNMF-Unet performs multi-layer fusion and multi-scale feature map skip connections in each network stage so that all the feature information can be fully utilized and the gradient disappearance problem can be alleviated. Additionally, MCNMF-Unet incorporates a multi-axis and multi-windows MLP module. This module is fully end-to-end and eliminates the need to consider the negative impact of image cropping. It not only fuses information from multiple dimensions and receptive fields but also reduces the number of parameters and computational complexity. We evaluated the proposed model on BUSI, ISIC2018 and CVC-ClinicDB datasets. The experimental results show that the performance of our proposed model is superior to most existing networks, with an IoU of 84.04% and a F1-score of 91.18%.

MSS-UNet: A Multi-Spatial-Shift MLP-based UNet for skin lesion segmentation

Multilayer perceptron (MLP) networks have become a popular alternative to convolutional neural networks and transformers because of fewer parameters. However, existing MLP-based models improve performance by increasing model depth, which adds computational complexity when processing local features of images. To meet this challenge, we propose MSS-UNet, a lightweight convolutional neural network (CNN) and MLP model for the automated segmentation of skin lesions from dermoscopic images. Specifically, MSS-UNet first uses the convolutional module to extract local information, which is essential for precisely segmenting the skin lesion. We propose an efficient double-spatial-shift MLP module, named DSS-MLP, which enhances the vanilla MLP by enabling communication between different spatial locations through double spatial shifts. We also propose a module named MSSEA with multiple spatial shifts of different strides and lighter external attention to enlarge the local receptive field and capture the boundary continuity of skin lesions. We extensively evaluated the MSS-UNet on ISIC 2017, 2018, and PH2 skin lesion datasets. On three datasets, the method achieves IoU metrics of 85.01%±0.65, 83.65%±1.05, and 92.71%±1.03, with a parameter size and computational complexity of 0.33M and 15.98G, respectively, outperforming most state-of-the-art methods.The code is publicly available at https://github.com/AirZWH/MSS-UNet.

Diagnosis of Covid-19 from CT slices using Whale Optimization Algorithm, Support Vector Machine and Multi-Layer Perceptron

BACKGROUND

The coronavirus disease 2019 is a serious and highly contagious disease caused by infection with a newly discovered virus, named severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2).

OBJECTIVE

A Computer Aided Diagnosis (CAD) system to assist physicians to diagnose Covid-19 from chest Computed Tomography (CT) slices is modelled and experimented.

METHODS

The lung tissues are segmented using Otsu's thresholding method. The Covid-19 lesions have been annotated as the Regions of Interest (ROIs), which is followed by texture and shape extraction. The obtained features are stored as feature vectors and split into 80:20 train and test sets. To choose the optimal features, Whale Optimization Algorithm (WOA) with Support Vector Machine (SVM) classifier's accuracy is employed. A Multi-Layer Perceptron (MLP) classifier is trained to perform classification with the selected features.

RESULTS

Comparative experimentations of the proposed system with existing eight benchmark Machine Learning classifiers using real-time dataset demonstrates that the proposed system with 88.94% accuracy outperforms the benchmark classifier's results. Statistical analysis namely, Friedman test, Mann Whitney U test and Kendall's Rank Correlation Coefficient Test has been performed which indicates that the proposed method has a significant impact on the novel dataset considered.

CONCLUSION

The MLP classifier's accuracy without feature selection yielded 80.40%, whereas with feature selection using WOA, it yielded 88.94%.

Noninvasive Staging of Lymph Node Status in Breast Cancer Using Machine Learning: External Validation and Further Model Development

BACKGROUND

Most patients diagnosed with breast cancer present with a node-negative disease. Sentinel lymph node biopsy (SLNB) is routinely used for axillary staging, leaving patients with healthy axillary lymph nodes without therapeutic effects but at risk of morbidities from the intervention. Numerous studies have developed nodal status prediction models for noninvasive axillary staging using postoperative data or imaging features that are not part of the diagnostic workup. Lymphovascular invasion (LVI) is a top-ranked predictor of nodal metastasis; however, its preoperative assessment is challenging.

OBJECTIVE

This paper aimed to externally validate a multilayer perceptron (MLP) model for noninvasive lymph node staging (NILS) in a large population-based cohort (n=18,633) and develop a new MLP in the same cohort. Data were extracted from the Swedish National Quality Register for Breast Cancer (NKBC, 2014-2017), comprising only routinely and preoperatively available documented clinicopathological variables. A secondary aim was to develop and validate an LVI MLP for imputation of missing LVI status to increase the preoperative feasibility of the original NILS model.

METHODS

Three nonoverlapping cohorts were used for model development and validation. A total of 4 MLPs for nodal status and 1 LVI MLP were developed using 11 to 12 routinely available predictors. Three nodal status models were used to account for the different availabilities of LVI status in the cohorts and external validation in NKBC. The fourth nodal status model was developed for 80% (14,906/18,663) of NKBC cases and validated in the remaining 20% (3727/18,663). Three alternatives for imputation of LVI status were compared. The discriminatory capacity was evaluated using the validation area under the receiver operating characteristics curve (AUC) in 3 of the nodal status models. The clinical feasibility of the models was evaluated using calibration and decision curve analyses.

RESULTS

External validation of the original NILS model was performed in NKBC (AUC 0.699, 95% CI 0.690-0.708) with good calibration and the potential of sparing 16% of patients with node-negative disease from SLNB. The LVI model was externally validated (AUC 0.747, 95% CI 0.694-0.799) with good calibration but did not improve the discriminatory performance of the nodal status models. A new nodal status model was developed in NKBC without information on LVI (AUC 0.709, 95% CI: 0.688-0.729), with excellent calibration in the holdout internal validation cohort, resulting in the potential omission of 24% of patients from unnecessary SLNBs.

CONCLUSIONS

The NILS model was externally validated in NKBC, where the imputation of LVI status did not improve the model's discriminatory performance. A new nodal status model demonstrated the feasibility of using register data comprising only the variables available in the preoperative setting for NILS using machine learning. Future steps include ongoing preoperative validation of the NILS model and extending the model with, for example, mammography images.

MLP-based classification of COVID-19 and skin diseases

Recent years have witnessed a growing interest in neural network-based medical image classification methods, which have demonstrated remarkable performance in this field. Typically, convolutional neural network (CNN) architectures have been commonly employed to extract local features. However, the transformer, a newly emerged architecture, has gained popularity due to its ability to explore the relevance of remote elements in an image through a self-attention mechanism. Despite this, it is crucial to establish not only local connectivity but also remote relationships between lesion features and capture the overall image structure to improve image classification accuracy. Therefore, to tackle the aforementioned issues, this paper proposes a network based on multilayer perceptrons (MLPs) that can learn the local features of medical images on the one hand and capture the overall feature information in both spatial and channel dimensions on the other hand, thus utilizing image features effectively. This paper has been extensively validated on COVID19-CT dataset and ISIC 2018 dataset, and the results show that the method in this paper is more competitive and has higher performance in medical image classification compared with existing methods. This shows that the use of MLP to capture image features and establish connections between lesions is expected to provide novel ideas for medical image classification tasks in the future.

Genome-Wide Evolutionary Characterization and Expression Analysis of Major Latex Protein (MLP) Family Genes in Tomato

Major latex proteins (MLPs) play a key role in plant response to abiotic and biotic stresses. However, little is known about this gene family in tomatoes (Solanum lycopersicum). In this paper, we perform a genome-wide evolutionary characterization and gene expression analysis of the MLP family in tomatoes. We found a total of 34 SlMLP members in the tomato genome, which are heterogeneously distributed on eight chromosomes. The phylogenetic analysis of the SlMLP family unveiled their evolutionary relationships and possible functions. Furthermore, the tissue-specific expression analysis revealed that the tomato MLP members possess distinct biological functions. Crucially, multiple cis-regulatory elements associated with stress, hormone, light, and growth responses were identified in the promoter regions of these SlMLP genes, suggesting that SlMLPs are potentially involved in plant growth, development, and various stress responses. Subcellular localization demonstrated that SlMLP1, SlMLP3, and SlMLP17 are localized in the cytoplasm. In conclusion, these findings lay a foundation for further dissecting the functions of tomato SlMLP genes and exploring the evolutionary relationships of MLP homologs in different plants.

MixSeg: a lightweight and accurate mix structure network for semantic segmentation of apple leaf disease in complex environments

Introduction

Semantic segmentation is effective in dealing with complex environments. However, the most popular semantic segmentation methods are usually based on a single structure, they are inefficient and inaccurate. In this work, we propose a mix structure network called MixSeg, which fully combines the advantages of convolutional neural network, Transformer, and multi-layer perception architectures.

Methods

Specifically, MixSeg is an end-to-end semantic segmentation network, consisting of an encoder and a decoder. In the encoder, the Mix Transformer is designed to model globally and inject local bias into the model with less computational cost. The position indexer is developed to dynamically index absolute position information on the feature map. The local optimization module is designed to optimize the segmentation effect of the model on local edges and details. In the decoder, shallow and deep features are fused to output accurate segmentation results.

Results

Taking the apple leaf disease segmentation task in the real scene as an example, the segmentation effect of the MixSeg is verified. The experimental results show that MixSeg has the best segmentation effect and the lowest parameters and floating point operations compared with the mainstream semantic segmentation methods on small datasets. On apple alternaria blotch and apple grey spot leaf image datasets, the most lightweight MixSeg-T achieves 98.22%, 98.09% intersection over union for leaf segmentation and 87.40%, 86.20% intersection over union for disease segmentation.

Discussion

Thus, the performance of MixSeg demonstrates that it can provide a more efficient and stable method for accurate segmentation of leaves and diseases in complex environments.

Sound Identification Method for Gas and Coal Dust Explosions Based on MLP

To solve the problems of backward gas and coal dust explosion alarm technology and single monitoring means in coal mines, and to improve the accuracy of gas and coal dust explosion identification in coal mines, a sound identification method for gas and coal dust explosions based on MLP in coal mines is proposed, and the distributions of the mean value of the short-time energy, zero crossing rate, spectral centroid, spectral spread, roll-off, 16-dimensional time-frequency features, MFCC, GFCC, short-time Fourier coefficients of gas explosion sound, coal dust sound, and other underground sounds were analyzed. In order to select the most suitable feature vector to characterize the sound signal, the best feature extraction model of the Relief algorithm was established, and the cross-entropy distribution of the MLP model trained with the different numbers of feature values was analyzed. In order to further optimize the feature value selection, the recognition results of the recognition models trained with the different numbers of sound feature values were compared, and the first 35-dimensional feature values were finally determined as the feature vector to characterize the sound signal. The feature vectors are input into the MLP to establish the sound recognition model of coal mine gas and coal dust explosion. An analysis of the feature extraction, optimal feature extraction, model training, and time consumption for model recognition during the model establishment process shows that the proposed algorithm has high computational efficiency and meets the requirement of the real-time coal mine safety monitoring and alarm system. From the results of recognition experiments, the sound recognition algorithm can distinguish each kind of sound involved in the experiments more accurately. The average recognition rate, recall rate, and accuracy rate of the model can reach 95%, 95%, and 95.8%, respectively, which is obviously better than the comparison algorithm and can meet the requirements of coal mine gas and coal dust explosion sensing and alarming.

An automatic system for extracting figure-caption pair from medical documents: a six-fold approach

Background

Figures and captions in medical documentation contain important information. As a result, researchers are becoming more interested in obtaining published medical figures from medical papers and utilizing the captions as a knowledge source.

Methods

This work introduces a unique and successful six-fold methodology for extracting figure-caption pairs. The A-torus wavelet transform is used to retrieve the first edge from the scanned page. Then, using the maximally stable extremal regions connected component feature, text and graphical contents are isolated from the edge document, and multi-layer perceptron is used to successfully detect and retrieve figures and captions from medical records. The figure-caption pair is then extracted using the bounding box approach. The files that contain the figures and captions are saved separately and supplied to the end useras theoutput of any investigation. The proposed approach is evaluated using a self-created database based on the pages collected from five open access books: Sergey Makarov, Gregory Noetscher and Aapo Nummenmaa's book "Brain and Human Body Modelling 2021", "Healthcare and Disease Burden in Africa" by Ilha Niohuru, "All-Optical Methods to Study Neuronal Function" by Eirini Papagiakoumou, "RNA, the Epicenter of Genetic Information" by John Mattick and Paulo Amaral and "Illustrated Manual of Pediatric Dermatology" by Susan Bayliss Mallory, Alanna Bree and Peggy Chern.

Results

Experiments and findings comparing the new method to earlier systems reveal a significant increase in efficiency, demonstrating the suggested technique's robustness and efficiency.

Wheel Defect Detection Using a Hybrid Deep Learning Approach

Defective wheels pose a significant challenge in railway transportation, impacting operational performance and safety. Excessive traction and braking forces give rise to deviations from the intended conical tread shape, resulting in amplified vibrations and noise. Moreover, these deviations contribute to the accelerated damage of track components. Detecting wheel defects at an early stage is crucial to ensure safe and comfortable operation, as well as to minimize maintenance costs. However, the presence of various vibrations, such as those induced by the track, traction motors, and other rolling stock subsystems, poses a significant challenge for onboard detection techniques. These vibrations create difficulties in accurately identifying wheel defects in real-time during operational activities, often resulting in false alarms. This research paper aims to address this issue by using a hybrid deep learning-based approach for the accurate detection of various types of wheel defects using accelerometer data. The proposed approach aims to enhance wheel defect detection accuracy while considering onboard techniques' cost-effectiveness and efficiency. A realistic simulation model of the railway wheelset is developed to generate a comprehensive dataset. To generate vibration data in various scenarios, the model is simulated for 20 s under different conditions, including one non-faulty scenario and six faulty scenarios. The simulations are conducted at different speeds and track conditions to capture a wide range of operating conditions. Within each simulation iteration, a total of 200,000 data points are generated, providing a comprehensive dataset for analysis and evaluation. The generated data are then utilized to train and evaluate a hybrid deep learning model, employing a multi-layer perceptron (MLP) as a feature extractor and multiple machine learning models (support vector machine, random forest, decision tree, and k-nearest neighbors) for performance comparison. The results demonstrate that the MLP-RF (multi-layer perceptron with random forest) model achieved an accuracy of 99%, while the MLP-DT (multi-layer perceptron with decision tree) model achieved an accuracy of 98%. These high accuracy values indicate the effectiveness of the models in accurately classifying and predicting the outcomes. The contributions of this research work include the development of a realistic simulation model, the evaluation of sensor layout effectiveness, and the application of deep learning techniques for improved wheel flat detections.

Exploring machine learning algorithms for accurate water level forecasting in Muda river, Malaysia

Accurate water level prediction for both lake and river is essential for flood warning and freshwater resource management. In this study, three machine learning algorithms: multi-layer perceptron neural network (MLP-NN), long short-term memory neural network (LSTM) and extreme gradient boosting XGBoost were applied to develop water level forecasting models in Muda River, Malaysia. The models were developed using limited amount of daily water level and meteorological data from 2016 to 2018. Different input scenarios were tested to investigate the performance of the models. The results of the evaluation showed that the MLP model outperformed both the LSTM and the XGBoost models in predicting water levels, with an overall accuracy score of 0.871 compared to 0.865 for LSTM and 0.831 for XGBoost. No noticeable improvement has been achieved after incorporating meteorological data into the models. Even though the lowest reported performance was reported by the XGBoost, it is the faster of the three algorithms due to its advanced parallel processing capabilities and distributed computing architecture. In terms of different time horizons, the LSTM model was found to be more accurate than the MLP and XGBoost model when predicting 7 days ahead, demonstrating its superiority in capturing long-term dependencies. Therefore, it can be concluded that each ML model has its own merits and weaknesses, and the performance of different ML models differs on each case because these models depends largely on the quantity and quality of data available for the model training.

A Novel Hybrid Approach for Classifying Osteosarcoma Using Deep Feature Extraction and Multilayer Perceptron

Osteosarcoma is the most common type of bone cancer that tends to occur in teenagers and young adults. Due to crowded context, inter-class similarity, inter-class variation, and noise in H&E-stained (hematoxylin and eosin stain) histology tissue, pathologists frequently face difficulty in osteosarcoma tumor classification. In this paper, we introduced a hybrid framework for improving the efficiency of three types of osteosarcoma tumor (nontumor, necrosis, and viable tumor) classification by merging different types of CNN-based architectures with a multilayer perceptron (MLP) algorithm on the WSI (whole slide images) dataset. We performed various kinds of preprocessing on the WSI images. Then, five pre-trained CNN models were trained with multiple parameter settings to extract insightful features via transfer learning, where convolution combined with pooling was utilized as a feature extractor. For feature selection, a decision tree-based RFE was designed to recursively eliminate less significant features to improve the model generalization performance for accurate prediction. Here, a decision tree was used as an estimator to select the different features. Finally, a modified MLP classifier was employed to classify binary and multiclass types of osteosarcoma under the five-fold CV to assess the robustness of our proposed hybrid model. Moreover, the feature selection criteria were analyzed to select the optimal one based on their execution time and accuracy. The proposed model achieved an accuracy of 95.2% for multiclass classification and 99.4% for binary classification. Experimental findings indicate that our proposed model significantly outperforms existing methods; therefore, this model could be applicable to support doctors in osteosarcoma diagnosis in clinics. In addition, our proposed model is integrated into a web application using the FastAPI web framework to provide a real-time prediction.

LcmUNet: A Lightweight Network Combining CNN and MLP for Real-Time Medical Image Segmentation

In recent years, UNet and its improved variants have become the main methods for medical image segmentation. Although these models have achieved excellent results in segmentation accuracy, their large number of network parameters and high computational complexity make it difficult to achieve medical image segmentation in real-time therapy and diagnosis rapidly. To address this problem, we introduce a lightweight medical image segmentation network (LcmUNet) based on CNN and MLP. We designed LcmUNet's structure in terms of model performance, parameters, and computational complexity. The first three layers are convolutional layers, and the last two layers are MLP layers. In the convolution part, we propose an LDA module that combines asymmetric convolution, depth-wise separable convolution, and an attention mechanism to reduce the number of network parameters while maintaining a strong feature-extraction capability. In the MLP part, we propose an LMLP module that helps enhance contextual information while focusing on local information and improves segmentation accuracy while maintaining high inference speed. This network also covers skip connections between the encoder and decoder at various levels. Our network achieves real-time segmentation results accurately in extensive experiments. With only 1.49 million model parameters and without pre-training, LcmUNet demonstrated impressive performance on different datasets. On the ISIC2018 dataset, it achieved an IoU of 85.19%, 92.07% recall, and 92.99% precision. On the BUSI dataset, it achieved an IoU of 63.99%, 79.96% recall, and 76.69% precision. Lastly, on the Kvasir-SEG dataset, LcmUNet achieved an IoU of 81.89%, 88.93% recall, and 91.79% precision.

Harnessing Shannon entropy-based descriptors in machine learning models to enhance the prediction accuracy of molecular properties

Accurate prediction of molecular properties is essential in the screening and development of drug molecules and other functional materials. Traditionally, property-specific molecular descriptors are used in machine learning models. This in turn requires the identification and development of target or problem-specific descriptors. Additionally, an increase in the prediction accuracy of the model is not always feasible from the standpoint of targeted descriptor usage. We explored the accuracy and generalizability issues using a framework of Shannon entropies, based on SMILES, SMARTS and/or InChiKey strings of respective molecules. Using various public databases of molecules, we showed that the accuracy of the prediction of machine learning models could be significantly enhanced simply by using Shannon entropy-based descriptors evaluated directly from SMILES. Analogous to partial pressures and total pressure of gases in a mixture, we used atom-wise fractional Shannon entropy in combination with total Shannon entropy from respective tokens of the string representation to model the molecule efficiently. The proposed descriptor was competitive in performance with standard descriptors such as Morgan fingerprints and SHED in regression models. Additionally, we found that either a hybrid descriptor set containing the Shannon entropy-based descriptors or an optimized, ensemble architecture of multilayer perceptrons and graph neural networks using the Shannon entropies was synergistic to improve the prediction accuracy. This simple approach of coupling the Shannon entropy framework to other standard descriptors and/or using it in ensemble models could find applications in boosting the performance of molecular property predictions in chemistry and material science.

Archive-based coronavirus herd immunity algorithm for optimizing weights in neural networks

The success of the supervised learning process for feedforward neural networks, especially multilayer perceptron neural network (MLP), depends on the suitable configuration of its controlling parameters (i.e., weights and biases). Normally, the gradient descent method is used to find the optimal values of weights and biases. The gradient descent method suffers from the local optimal trap and slow convergence. Therefore, stochastic approximation methods such as metaheuristics are invited. Coronavirus herd immunity optimizer (CHIO) is a recent metaheuristic human-based algorithm stemmed from the herd immunity mechanism as a way to treat the spread of the coronavirus pandemic. In this paper, an external archive strategy is proposed and applied to direct the population closer to more promising search regions. The external archive is implemented during the algorithm evolution, and it saves the best solutions to be used later. This enhanced version of CHIO is called ACHIO. The algorithm is utilized in the training process of MLP to find its optimal controlling parameters thus empowering their classification accuracy. The proposed approach is evaluated using 15 classification datasets with classes ranging between 2 to 10. The performance of ACHIO is compared against six well-known swarm intelligence algorithms and the original CHIO in terms of classification accuracy. Interestingly, ACHIO is able to produce accurate results that excel other comparative methods in ten out of the fifteen classification datasets and very competitive results for others.

Transfer Learning for Image-Based Malware Detection for IoT

The tremendous growth in online activity and the Internet of Things (IoT) led to an increase in cyberattacks. Malware infiltrated at least one device in almost every household. Various malware detection methods that use shallow or deep IoT techniques were discovered in recent years. Deep learning models with a visualization method are the most commonly and popularly used strategy in most works. This method has the benefit of automatically extracting features, requiring less technical expertise, and using fewer resources during data processing. Training deep learning models that generalize effectively without overfitting is not feasible or appropriate with large datasets and complex architectures. In this paper, a novel ensemble model, Stacked Ensemble-autoencoder, GRU, and MLP or SE-AGM, composed of three light-weight neural network models-autoencoder, GRU, and MLP-that is trained on the 25 essential and encoded extracted features of the benchmark MalImg dataset for classification was proposed. The GRU model was tested for its suitability in malware detection due to its lesser usage in this domain. The proposed model used a concise set of malware features for training and classifying the malware classes, which reduced the time and resource consumption in comparison to other existing models. The novelty lies in the stacked ensemble method where the output of one intermediate model works as input for the next model, thereby refining the features as compared to the general notion of an ensemble approach. Inspiration was drawn from earlier image-based malware detection works and transfer learning ideas. To extract features from the MalImg dataset, a CNN-based transfer learning model that was trained from scratch on domain data was used. Data augmentation was an important step in the image processing stage to investigate its effect on classifying grayscale malware images in the MalImg dataset. SE-AGM outperformed existing approaches on the benchmark MalImg dataset with an average accuracy of 99.43%, demonstrating that our method was on par with or even surpassed them.

Multilayer perceptron-based self-care early prediction of children with disabilities

Early identification of children with self-care impairments is one of the key challenges professional therapists face due to the complex and time-consuming detection process using relevant self-care activities. Due to the complex nature of the problem, machine-learning methods have been widely applied in this area. In this study, a feed-forward artificial neural network (ANN)-based self-care prediction methodology, called multilayer perceptron (MLP)-progressive, has been proposed. The proposed methodology integrates unsupervised instance-based resampling and randomizing preprocessing techniques to MLP for improved early detection of self-care disabilities in children. Preprocessing of the dataset affects the MLP performance; hence, randomization and resampling of the dataset improves the performance of the MLP model. To confirm the usefulness of MLP-progressive, three experiments were conducted, including validating MLP-progressive methodology over multi-class and binary-class datasets, impact analysis of the proposed preprocessing filters on the model performance, and comparing the MLP-progressive results with state-of-the-art studies. The evaluation metrics accuracy, precision, recall, F-measure, TP rate, FP rate, and ROC were used to measure performance of the proposed disability detection model. The proposed MLP-progressive model outperforms existing methods and attains a classification accuracy of 97.14% and 98.57% on multi-class and binary-class datasets, respectively. Additionally, when evaluated on the multi-class dataset, significant improvements in accuracies ranging from 90.00% to 97.14% were observed when compared to state-of-the-art methods.

Cough Audio Analysis for COVID-19 Diagnosis

Humanity has suffered catastrophically due to the COVID-19 pandemic. One of the most reliable diagnoses of COVID-19 is RT-PCR (reverse-transcription polymer chain reaction) testing. This method, however, has its limitations. It is time consuming and requires scalability. This research work carries out a preliminary prognosis of COVID-19, which is scalable and less time consuming. The research carried out a competitive analysis of four machine-learning models namely, Multilayer Perceptron, Convolutional Neural Networks, Recurrent Neural Networks with Long Short-Term Memory, and VGG-19 with Support Vector Machines. Out of these models, Multilayer Perceptron outperformed with higher specificity of 94.5% and accuracy of 96.8%. The results show that Multilayer Perceptron was able to distinguish between positive and negative COVID-19 coughs by a robust feature embedding technique.

Newborn Cry-Based Diagnostic System to Distinguish between Sepsis and Respiratory Distress Syndrome Using Combined Acoustic Features

Crying is the only means of communication for a newborn baby with its surrounding environment, but it also provides significant information about the newborn's health, emotions, and needs. The cries of newborn babies have long been known as a biomarker for the diagnosis of pathologies. However, to the best of our knowledge, exploring the discrimination of two pathology groups by means of cry signals is unprecedented. Therefore, this study aimed to identify septic newborns with Neonatal Respiratory Distress Syndrome (RDS) by employing the Machine Learning (ML) methods of Multilayer Perceptron (MLP) and Support Vector Machine (SVM). Furthermore, the cry signal was analyzed from the following two different perspectives: 1) the musical perspective by studying the spectral feature set of Harmonic Ratio (HR), and 2) the speech processing perspective using the short-term feature set of Gammatone Frequency Cepstral Coefficients (GFCCs). In order to assess the role of employing features from both short-term and spectral modalities in distinguishing the two pathology groups, they were fused in one feature set named the combined features. The hyperparameters (HPs) of the implemented ML approaches were fine-tuned to fit each experiment. Finally, by normalizing and fusing the features originating from the two modalities, the overall performance of the proposed design was improved across all evaluation measures, achieving accuracies of 92.49% and 95.3% by the MLP and SVM classifiers, respectively. The MLP classifier was outperformed in terms of all evaluation measures presented in this study, except for the Area Under Curve of Receiver Operator Characteristics (AUC-ROC), which signifies the ability of the proposed design in class separation. The achieved results highlighted the role of combining features from different levels and modalities for a more powerful analysis of the cry signals, as well as including a neural network (NN)-based classifier. Consequently, attaining a 95.3% accuracy for the separation of two entangled pathology groups of RDS and sepsis elucidated the promising potential for further studies with larger datasets and more pathology groups.

Modeling and Forecasting Monkeypox Cases Using Stochastic Models

BACKGROUND

Monkeypox virus is gaining attention due to its severity and spread among people. This study sheds light on the modeling and forecasting of new monkeypox cases. Knowledge about the future situation of the virus using a more accurate time series and stochastic models is required for future actions and plans to cope with the challenge.

METHODS

We conduct a side-by-side comparison of the machine learning approach with the traditional time series model. The multilayer perceptron model (MLP), a machine learning technique, and the Box-Jenkins methodology, also known as the ARIMA model, are used for classical modeling. Both methods are applied to the Monkeypox cumulative data set and compared using different model selection criteria such as root mean square error, mean square error, mean absolute error, and mean absolute percentage error.

RESULTS

With a root mean square error of 150.78, the monkeypox series follows the ARIMA (7,1,7) model among the other potential models. Comparatively, we use the multilayer perceptron (MLP) model, which employs the sigmoid activation function and has a different number of hidden neurons in a single hidden layer. The root mean square error of the MLP model, which uses a single input and ten hidden neurons, is 54.40, significantly lower than that of the ARIMA model. The actual confirmed cases versus estimated or fitted plots also demonstrate that the multilayer perceptron model has a better fit for the monkeypox data than the ARIMA model.

CONCLUSIONS AND RECOMMENDATION

When it comes to predicting monkeypox, the machine learning method outperforms the traditional time series. A better match can be achieved in future studies by applying the extreme learning machine model (ELM), support vector machine (SVM), and some other methods with various activation functions. It is thus concluded that the selected data provide a real picture of the virus. If the situations remain the same, governments and other stockholders should ensure the follow-up of Standard Operating Procedures (SOPs) among the masses, as the trends will continue rising in the upcoming 10 days. However, governments should take some serious interventions to cope with the virus.

LIMITATION

In the ARIMA models selected for forecasting, we did not incorporate the effect of covariates such as the effect of net migration of monkeypox virus patients, government interventions, etc.

Gait Trajectory Prediction on an Embedded Microcontroller Using Deep Learning

Achieving a normal gait trajectory for an amputee's active prosthesis is challenging due to its kinematic complexity. Accordingly, lower limb gait trajectory kinematics and gait phase segmentation are essential parameters in controlling an active prosthesis. Recently, the most practiced algorithm in gait trajectory generation is the neural network. Deploying such a complex Artificial Neural Network (ANN) algorithm on an embedded system requires performing the calculations on an external computational device; however, this approach lacks mobility and reliability. In this paper, more simple and reliable ANNs are investigated to be deployed on a single low-cost Microcontroller (MC) and hence provide system mobility. Two neural network configurations were studied: Multi-Layered Perceptron (MLP) and Convolutional Neural Network (CNN); the models were trained on shank and foot IMU data. The data were collected from four subjects and tested on a fifth to predict the trajectory of 200 ms ahead. The prediction was made for two cases: with and without providing the current phase of the gait. Then, the models were deployed on a low-cost microcontroller (ESP32). It was found that with fewer data (excluding the current gait phase), CNN achieved a better correlation coefficient of 0.973 when compared to 0.945 for MLP; when including the current phase, both network configurations achieved better correlation coefficients of nearly 0.98. However, when comparing the execution time required for the prediction on the intended MC, MLP was much faster than CNN, with an execution time of 2.4 ms and 142 ms, respectively. In summary, it was found that when training data are scarce, CNN is more efficient within the acceptable execution time, while MLP achieves relative accuracy with low execution time with enough data.

Deep learning for Covid-19 forecasting: State-of-the-art review

The Covid-19 pandemic has galvanized scientists to apply machine learning methods to help combat the crisis. Despite the significant amount of research there exists no comprehensive survey devoted specifically to examining deep learning methods for Covid-19 forecasting. In this paper, we fill the gap in the literature by reviewing and analyzing the current studies that use deep learning for Covid-19 forecasting. In our review, all published papers and preprints, discoverable through Google Scholar, for the period from Apr 1, 2020 to Feb 20, 2022 which describe deep learning approaches to forecasting Covid-19 were considered. Our search identified 152 studies, of which 53 passed the initial quality screening and were included in our survey. We propose a model-based taxonomy to categorize the literature. We describe each model and highlight its performance. Finally, the deficiencies of the existing approaches are identified and the necessary improvements for future research are elucidated. The study provides a gateway for researchers who are interested in forecasting Covid-19 using deep learning.

Machine-Learning-Based Near-Surface Ozone Forecasting Model with Planetary Boundary Layer Information

Surface ozone is one of six air pollutants designated as harmful by National Ambient Air Quality Standards because it can adversely impact human health and the environment. Thus, ozone forecasting is a critical task that can help people avoid dangerously high ozone concentrations. Conventional numerical approaches, as well as data-driven forecasting approaches, have been studied for ozone forecasting. Data-driven forecasting models, in particular, have gained momentum with the introduction of machine learning advancements. We consider planetary boundary layer (PBL) height as a new input feature for data-driven ozone forecasting models. PBL has been shown to impact ozone concentrations, making it an important factor in ozone forecasts. In this paper, we investigate the effectiveness of utilization of PBL height on the performance of surface ozone forecasts. We present both surface ozone forecasting models, based on multilayer perceptron (MLP) and bidirectional long short-term memory (LSTM) models. These two models forecast hourly ozone concentrations for an upcoming 24-h period using two types of input data, such as measurement data and PBL height. We consider the predicted values of PBL height obtained from the weather research and forecasting (WRF) model, since it is difficult to gather actual PBL measurements. We evaluate two ozone forecasting models in terms of index of agreement (IOA), mean absolute error (MAE), and root mean square error (RMSE). Results showed that the MLP-based and bidirectional LSTM-based models yielded lower MAE and RMSE when considering forecasted PBL height, but there was no significant changes in IOA when compared with models in which no forecasted PBL data were used. This result suggests that utilizing forecasted PBL height can improve the forecasting performance of data-driven prediction models for surface ozone concentrations.

HEA-Net: Attention and MLP Hybrid Encoder Architecture for Medical Image Segmentation

The model, Transformer, is known to rely on a self-attention mechanism to model distant dependencies, which focuses on modeling the dependencies of the global elements. However, its sensitivity to the local details of the foreground information is not significant. Local detail features help to identify the blurred boundaries in medical images more accurately. In order to make up for the defects of Transformer and capture more abundant local information, this paper proposes an attention and MLP hybrid-encoder architecture combining the Efficient Attention Module (EAM) with a Dual-channel Shift MLP module (DS-MLP), called HEA-Net. Specifically, we effectively connect the convolution block with Transformer through EAM to enhance the foreground and suppress the invalid background information in medical images. Meanwhile, DS-MLP further enhances the foreground information via channel and spatial shift operations. Extensive experiments on public datasets confirm the excellent performance of our proposed HEA-Net. In particular, on the GlaS and MoNuSeg datasets, the Dice reached 90.56% and 80.80%, respectively, and the IoU reached 83.62% and 68.26%, respectively.

Forecasting daily Covid-19 cases in the world with a hybrid ARIMA and neural network model

The use of models to predict disease cases is common in epidemiology and related areas, in the context of Covid-19, both ARIMA and Neural Network models can be applied for purposes of optimized resource management, so the aim of this study is to capture the linear and non-linear structures of daily Covid-19 cases in the world by using a hybrid forecasting model. In summary, the proposed hybrid system methodology consists of two steps. In the first step, an ARIMA model is used to analyze the linear part of the problem. In the second step, a neural network model is developed to model the residuals of the ARIMA model, which would be the non-linear part of it. The neural network model was superior to the ARIMA when considering the capture of weekly seasonality and in two weeks, the combination of models with the capture of seasonality in two weeks provided a mixed model with good error metrics, that allows actions to be premeditated with greater certainty, such as increasing the number of nurses in a location, or the acceleration of vaccination campaigns to diminish a possible increase in the number of cases.

Moisture content monitoring in industrial-scale composting systems using low-cost sensor-based machine learning techniques

Moisture is a key aspect for proper composting, allowing greater efficiency and lower environmental impact. Low-cost real-time moisture determination methods are still a challenge in industrial composting processes. The aim of this study was to design a model of hardware and software that would allow self-adjustment of a low-cost capacitive moisture sensor. Samples of organic composts with distinct waste composition and from different composting stages were used. Machine learning techniques were applied for self-adjustment of the sensor. To validate the model, results obtained in a laboratory by the gravimetric method were used. The proposed model proved to be efficient and reliable in measuring moisture in compost, reaching a correlation coefficient of 0.9939 between the moisture content verified by gravimetric analysis and the prediction obtained by the Sensor Node.

Role of Muscle LIM Protein in Mechanotransduction Process

The induction of protein synthesis is crucial to counteract the deconditioning of neuromuscular system and its atrophy. In the past, hormones and cytokines acting as growth factors involved in the intracellular events of these processes have been identified, while the implications of signaling pathways associated with the anabolism/catabolism ratio in reference to the molecular mechanism of skeletal muscle hypertrophy have been recently identified. Among them, the mechanotransduction resulting from a mechanical stress applied to the cell appears increasingly interesting as a potential pathway for therapeutic intervention. At present, there is an open question regarding the type of stress to apply in order to induce anabolic events or the type of mechanical strain with respect to the possible mechanosensing and mechanotransduction processes involved in muscle cells protein synthesis. This review is focused on the muscle LIM protein (MLP), a structural and mechanosensing protein with a LIM domain, which is expressed in the sarcomere and costamere of striated muscle cells. It acts as a transcriptional cofactor during cell proliferation after its nuclear translocation during the anabolic process of differentiation and rebuilding. Moreover, we discuss the possible opportunity of stimulating this mechanotransduction process to counteract the muscle atrophy induced by anabolic versus catabolic disorders coming from the environment, aging or myopathies.

Analysis of algal bloom intensification in mid-Ganga river, India, using satellite data and neural network techniques

River Ganga is one of the most significant rivers in the country. This river is the adobe for numerous aquatic species and microorganisms. The color of the river suddenly changed to green due to the rise of algal bloom in the Varanasi and nearby regions of the river Ganga during May-June 2021. These algal blooms can be detrimental to the aquatic animals of the river. This study analyzes the occurrence and the possible reasons for the algal bloom generation in the river for the considered stretch. Several factors like nutrient accumulation in the river through agricultural run-off, warm river temperature, low flow condition of the river, thermal stratification, and less turbid river water can be considered as possible reasons for algal bloom development. In this work, the optical remote sensing-based Sentinel 2 datasets have been used for the duration of mid-May 2021 to mid-June 2021. These datasets have been processed in the Google Earth Engine (GEE) platform, and chlorophyll concentration has been calculated using different satellite-based indices or band ratios. The chlorophyll concentration measurements have quantified the algal bloom growth. These indices or band ratios have been analyzed using several artificial neural network (ANN) architectures like multilayer perceptron (MLP) and radial basis function (RBF) along with the in situ values. It has been found that chlorophyll concentration has been highest for the mid-June 2021 time period in the considered river stretch.

Comparison of Data Classification Results for Leap Motion Recovery Gestures

Static and dynamic gestures are frequently used in activities supporting learning, recovery healthcare, engineering, and 3D games to increase the interactivity between man and machine. The gestures are detected via hardware devices and data is processed using different software methods. This paper presents the manner of detection and interpretation of two gestures, a hand rotation gesture and a palm closing and opening gesture, using the Leap Motion device. These two dynamic gestures are very often used in hand recovery exercises. For comparing the two gestures we use data classification methods, Support Vector Machine (SVM) and Multilayer Perceptron (MLP). The data for the gesture classification were 80% training data and 20% testing data. The metrics for comparison are precision, recall, F1-score, and the total number of testing cases (support). The SVM classifier gives an accuracy of 99.4% and the MLP classifier a 96.2%. We built two confusion matrices for better visualizing the results.

Emotion Recognition With Knowledge Graph Based on Electrodermal Activity

Electrodermal activity (EDA) sensor is emerging non-invasive equipment in affect detection research, which is used to measure electrical activities of the skin. Knowledge graphs are an effective way to learn representation from data. However, few studies analyzed the effect of knowledge-related graph features with physiological signals when subjects are in non-similar mental states. In this paper, we propose a model using deep learning techniques to classify the emotional responses of individuals acquired from physiological datasets. We aim to improve the execution of emotion recognition based on EDA signals. The proposed framework is based on observed gender and age information as embedding feature vectors. We also extract time and frequency EDA features in line with cognitive studies. We then introduce a sophisticated weighted feature fusion method that combines knowledge embedding feature vectors and statistical feature (SF) vectors for emotional state classification. We finally utilize deep neural networks to optimize our approach. Results obtained indicated that the correct combination of Gender-Age Relation Graph (GARG) and SF vectors improve the performance of the valence-arousal emotion recognition system by 4 and 5% on PAFEW and 3 and 2% on DEAP datasets.

Deep Learning for Prediction of Progression and Recurrence in Nonfunctioning Pituitary Macroadenomas: Combination of Clinical and MRI Features

Objectives

A subset of non-functioning pituitary macroadenomas (NFMAs) may exhibit early progression/recurrence (P/R) after tumor resection. The purpose of this study was to apply deep learning (DL) algorithms for prediction of P/R in NFMAs.

Methods

From June 2009 to December 2019, 78 patients diagnosed with pathologically confirmed NFMAs, and who had undergone complete preoperative MRI and postoperative MRI follow-up for more than one year, were included. DL classifiers including multi-layer perceptron (MLP) and convolutional neural network (CNN) were used to build predictive models. Categorical and continuous clinical data were fed into the MLP model, and images of preoperative MRI (T2WI and contrast enhanced T1WI) were analyzed by the CNN model. MLP, CNN and multimodal CNN-MLP architectures were performed to predict P/R in NFMAs.

Results

Forty-two (42/78, 53.8%) patients exhibited P/R after surgery. The median follow-up time was 42 months, and the median time to P/R was 25 months. As compared with CNN using MRI (accuracy 83%, precision 87%, and AUC 0.84) or MLP using clinical data (accuracy 73%, precision 73%, and AUC 0.73) alone, the multimodal CNN-MLP model using both clinical and MRI features showed the best performance for prediction of P/R in NFMAs, with accuracy 83%, precision 90%, and AUC 0.85.

Conclusions

DL architecture incorporating clinical and MRI features performs well to predict P/R in NFMAs. Pending more studies to support the findings, the results of this study may provide valuable information for NFMAs treatment planning.

PTML Modeling for Pancreatic Cancer Research: In Silico Design of Simultaneous Multi-Protein and Multi-Cell Inhibitors

Pancreatic cancer (PANC) is a dangerous type of cancer that is a major cause of mortality worldwide and exhibits a remarkably poor prognosis. To date, discovering anti-PANC agents remains a very complex and expensive process. Computational approaches can accelerate the search for anti-PANC agents. We report for the first time two models that combined perturbation theory with machine learning via a multilayer perceptron network (PTML-MLP) to perform the virtual design and prediction of molecules that can simultaneously inhibit multiple PANC cell lines and PANC-related proteins, such as caspase-1, tumor necrosis factor-alpha (TNF-alpha), and the insulin-like growth factor 1 receptor (IGF1R). Both PTML-MLP models exhibited accuracies higher than 78%. Using the interpretation from one of the PTML-MLP models as a guideline, we extracted different molecular fragments desirable for the inhibition of the PANC cell lines and the aforementioned PANC-related proteins and then assembled some of those fragments to form three new molecules. The two PTML-MLP models predicted the designed molecules as potentially versatile anti-PANC agents through inhibition of the three PANC-related proteins and multiple PANC cell lines. Conclusions: This work opens new horizons for the application of the PTML modeling methodology to anticancer research.

Joint Communication and Sensing: A Proof of Concept and Datasets for Greenhouse Monitoring Using LoRaWAN

In recent years, greenhouse-based precision agriculture (PA) has been strengthened by utilization of Internet of Things applications and low-power wide area network communication. The advancements in multidisciplinary technologies such as artificial intelligence (AI) have created opportunities to assist farmers further in detecting disease and poor nutrition of plants. Neural networks and other AI techniques need an initial set of measurement campaigns along with extensive datasets as a training set to baseline and evolve different applications. This paper presents LoRaWAN-based greenhouse monitoring datasets over a period of nine months. The dataset has both the network and sensing information from multiple sensor nodes for tomato crops in two different greenhouse environments. The goal is to provide the research community with a dataset to evaluate performance of LoRaWAN inside a greenhouse and develop more efficient PA monitoring techniques. In this paper, we carried out an exploratory data analysis to infer crop growth by analyzing just the LoRaWAN signals and without inclusion of any extra hardware. This work uses a multilayer perceptron artificial neural network to predict the weekly plant growth, trained using RSSI value from sensor data and manual measurement of plant height from the greenhouse. We developed this proof of concept of joint communication and sensing by using generated dataset from the “Proefcentrum Hoogstraten” greenhouse in Belgium. Results for the proposed method yield a root mean square error of 10% in detecting the average plant height inside a greenhouse. In future, we can use this concept of landscape sensing for different supplementary use-cases and to develop optimized methods.

Predicting evaporation with optimized artificial neural network using multi-objective salp swarm algorithm

Evaporation is a crucial component to be established in agriculture management and water engineering. Evaporation prediction is thus an essential issue for modeling researchers. In this study, the multilayer perceptron (MLP) was used for predicting daily evaporation. MLP model is as one of the famous ANN models with multilayers for predicting different target variables. A new strategy was used to enhance the accuracy of the MLP model. Three multi-objective algorithms, namely, the multi-objective salp swarm algorithm (MOSSA), the multi-objective crow algorithm (MOCA), and the multi-objective particle swarm optimization (MOPSO), were respectively and separately coupled to the MLP model for determining the model parameters, the best input combination, and the best activation function. In this study, three stations in Malaysia, namely, the Muadzam Shah (MS), the Kuala Terengganu (KT), and the Kuantan (KU), were selected for the prediction of the respective daily evaporation. The spacing (SP) and maximum spread (MS) indices were used to evaluate the quality of generated Pareto front (PF) by the algorithms. The lower SP and higher MS showed better PF for the models. It was observed that the MOSSA had higher MS and lower SP than the other algorithms, at all stations. The root means square error (RMSE), mean absolute error (MAE), percent bias (PBIAS), and Nash Sutcliffe efficiency (NSE) quantifiers were used to compare the ability of the models with each other. The MLP-MOSSA had reduced RMSE compared to the MLP-MOCA, MLP-MOPSO, and MLP models by 18%, 25%, and 35%, respectively, at the MS station. The MAE of the MLP-MOSSA was 2.7%, 4.1%, and 26%, respectively lower than those of the MLP-MOCA, MLP-MOPSO, and MLP models at the KU station. The MLP-MOSSA showed lower MAE than the MLP-MOCA, MLP-MOPSO, and MLP models by 16%, 18%, and 19%, respectively, at the KT station. An uncertainty analysis was performed based on the input and parameter uncertainty. The results indicated that the MLP-MOSSA had the lowest uncertainty among the models. Also, the input uncertainty was lower than the parameter uncertainty. The general results indicated that the MLP-MOSSA had the high efficiency for predicting evaporation.

DNN-based multi-output model for predicting soccer team tactics

In modern sports, strategy and tactics are important in determining the game outcome. However, many coaches still base their game tactics on experience and intuition. The aim of this study is to predict tactics such as formations, game styles, and game outcome based on soccer dataset. In this paper, we propose to use Deep Neural Networks (DNN) based on Multi-Layer Perceptron (MLP) and feature engineering to predict the soccer tactics of teams. Previous works adopt simple machine learning techniques, such as Support Vector Machine (SVM) and decision tree, to analyze soccer dataset. However, these often have limitations in predicting tactics using soccer dataset. In this study, we use feature selection, clustering techniques for the segmented positions and Multi-Output model for Soccer (MOS) based on DNN, wide inputs and residual connections. Feature selection selects important features among features of soccer player dataset. Each position is segmented by applying clustering to the selected features. The segmented positions and game appearance dataset are used as training dataset for the proposed model. Our model predicts the core of soccer tactics: formation, game style and game outcome. And, we use wide inputs and embedding layers to learn sparse, specific rules of soccer dataset, and use residual connections to learn additional information. MLP layers help the model to generalize features of soccer dataset. Experimental results demonstrate the superiority of the proposed model, which obtain significant improvements comparing to baseline models.

[Digital futures of the university: Scenarios of sociotechnical change]

For the university, digital technologies proved to be a central element of crisis management during the COVID-19 pandemic. This is especially true for teaching. From a "multi-level perspective" (Geels 2004), the disruptive effects of the pandemic open a "window of opportunity" for profound and lasting sociotechnical change. Against this backdrop, this article discusses how members of the university assess the future significance of digital technologies. On the basis of qualitative, empirical research, five scenarios can be distinguished, each of which outlines digital futures in a different way. However, with our analysis of these future scenarios we do not scrutinise the probability of their occurrence, but their desirability. In this way, we identify justifications diploid to argue why further steps towards a digital university should be taken or why not. At this point in time, it is impossible to assess which scenarios of digital universities will ultimately prevail. Not least for this reason, this article is intended as a basis for a broad debate that is yet to be conducted.

Optimized adaptive Savitzky-Golay filtering algorithm based on deep learning network for absorption spectroscopy

An improved Savitzky-Golay (S-G) filtering algorithm was developed to denoise the absorption spectroscopy of nitrogen oxide (NO₂). A deep learning (DL) network was introduced to the traditional S-G filtering algorithm to adjust the window size and polynomial order in real time. The self-adjusting and follow-up actions of DL network can effectively solve the blindness of selecting the input filter parameters in digital signal processing. The developed adaptive S-G filter algorithm is compared with the multi-signal averaging filtering (MAF) algorithm to demonstrate its performance. The optimized S-G filtering algorithm is used to detect NO₂ in a mid-quantum-cascade-laser (QCL) based gas sensor system. A sensitivity enhancement factor of 5 is obtained, indicating that the newly developed algorithm can generate a high-quality gas absorption spectrum for applications such as atmospheric environmental monitoring and exhaled breath detection.

In Silico Drug Repurposing for Anti-Inflammatory Therapy: Virtual Search for Dual Inhibitors of Caspase-1 and TNF-Alpha

Inflammation involves a complex biological response of the body tissues to damaging stimuli. When dysregulated, inflammation led by biomolecular mediators such as caspase-1 and tumor necrosis factor-alpha (TNF-alpha) can play a detrimental role in the progression of different medical conditions such as cancer, neurological disorders, autoimmune diseases, and cytokine storms caused by viral infections such as COVID-19. Computational approaches can accelerate the search for dual-target drugs able to simultaneously inhibit the aforementioned proteins, enabling the discovery of wide-spectrum anti-inflammatory agents. This work reports the first multicondition model based on quantitative structure–activity relationships and a multilayer perceptron neural network (mtc-QSAR-MLP) for the virtual screening of agency-regulated chemicals as versatile anti-inflammatory therapeutics. The mtc-QSAR-MLP model displayed accuracy higher than 88%, and was interpreted from a physicochemical and structural point of view. When using the mtc-QSAR-MLP model as a virtual screening tool, we could identify several agency-regulated chemicals as dual inhibitors of caspase-1 and TNF-alpha, and the experimental information later retrieved from the scientific literature converged with our computational results. This study supports the capabilities of our mtc-QSAR-MLP model in anti-inflammatory therapy with direct applications to current health issues such as the COVID-19 pandemic.

Comparative Study of Popular Deep Learning Models for Machining Roughness Classification Using Sound and Force Signals

This study compared popular Deep Learning (DL) architectures to classify machining surface roughness using sound and force data. The DL architectures considered in this study include Multi-Layer Perceptron (MLP), Convolution Neural Network (CNN), Long Short-Term Memory (LSTM), and transformer. The classification was performed on the sound and force data generated during machining aluminum sheets for different levels of spindle speed, feed rate, depth of cut, and end-mill diameter, and it was trained on 30 s machining data (10–40 s) of the machining experiments. Since a raw audio waveform is seldom used in DL models, Mel-Spectrogram and Mel Frequency Cepstral Coefficients (MFCCs) audio feature extraction techniques were used in the DL models. The results of DL models were compared for the training–validation accuracy, training epochs, and training parameters of each model. Although the roughness classification by all the DL models was satisfactory (except for CNN with Mel-Spectrogram), the transformer-based modes had the highest training (>96%) and validation accuracies (≈90%). The CNN model with Mel-Spectrogram exhibited the worst training and inference accuracy, which is influenced by limited training data. Confusion matrices were plotted to observe the classification accuracy visually. The confusion matrices showed that the transformer model trained on Mel-Spectrogram and the transformer model trained on MFCCs correctly predicted 366 (or 91.5%) and 371 (or 92.7%) out of 400 test samples. This study also highlights the suitability and superiority of the transformer model for time series sound and force data and over other DL models.

Efficient Ventricular Parameter Estimation Using AI-Surrogate Models

The onset and progression of pathological heart conditions, such as cardiomyopathy or heart failure, affect its mechanical behaviour due to the remodelling of the myocardial tissues to preserve its functional response. Identification of the constitutive properties of heart tissues could provide useful biomarkers to diagnose and assess the progression of disease. We have previously demonstrated the utility of efficient AI-surrogate models to simulate passive cardiac mechanics. Here, we propose the use of this surrogate model for the identification of myocardial mechanical properties and intra-ventricular pressure by solving an inverse problem with two novel AI-based approaches. Our analysis concluded that: (i) both approaches were robust toward Gaussian noise when the ventricle data for multiple loading conditions were combined; and (ii) estimates of one and two parameters could be obtained in less than 9 and 18 s, respectively. The proposed technique yields a viable option for the translation of cardiac mechanics simulations and biophysical parameter identification methods into the clinic to improve the diagnosis and treatment of heart pathologies. In addition, the proposed estimation techniques are general and can be straightforwardly translated to other applications involving different anatomical structures.

Neonatal Jaundice Diagnosis Using a Smartphone Camera Based on Eye, Skin, and Fused Features with Transfer Learning

Neonatal jaundice is a common condition worldwide. Failure of timely diagnosis and treatment can lead to death or brain injury. Current diagnostic approaches include a painful and time-consuming invasive blood test and non-invasive tests using costly transcutaneous bilirubinometers. Since periodic monitoring is crucial, multiple efforts have been made to develop non-invasive diagnostic tools using a smartphone camera. However, existing works rely either on skin or eye images using statistical or traditional machine learning methods. In this paper, we adopt a deep transfer learning approach based on eye, skin, and fused images. We also trained well-known traditional machine learning models, including multi-layer perceptron (MLP), support vector machine (SVM), decision tree (DT), and random forest (RF), and compared their performance with that of the transfer learning model. We collected our dataset using a smartphone camera. Moreover, unlike most of the existing contributions, we report accuracy, precision, recall, f-score, and area under the curve (AUC) for all the experiments and analyzed their significance statistically. Our results indicate that the transfer learning model performed the best with skin images, while traditional models achieved the best performance with eyes and fused features. Further, we found that the transfer learning model with skin features performed comparably to the MLP model with eye features.

Computational Drug Repurposing for Antituberculosis Therapy: Discovery of Multi-Strain Inhibitors

Tuberculosis remains the most afflicting infectious disease known by humankind, with one quarter of the population estimated to have it in the latent state. Discovering antituberculosis drugs is a challenging, complex, expensive, and time-consuming task. To overcome the substantial costs and accelerate drug discovery and development, drug repurposing has emerged as an attractive alternative to find new applications for “old” drugs and where computational approaches play an essential role by filtering the chemical space. This work reports the first multi-condition model based on quantitative structure–activity relationships and an ensemble of neural networks (mtc-QSAR-EL) for the virtual screening of potential antituberculosis agents able to act as multi-strain inhibitors. The mtc-QSAR-EL model exhibited an accuracy higher than 85%. A physicochemical and fragment-based structural interpretation of this model was provided, and a large dataset of agency-regulated chemicals was virtually screened, with the mtc-QSAR-EL model identifying already proven antituberculosis drugs while proposing chemicals with great potential to be experimentally repurposed as antituberculosis (multi-strain inhibitors) agents. Some of the most promising molecules identified by the mtc-QSAR-EL model as antituberculosis agents were also confirmed by another computational approach, supporting the capabilities of the mtc-QSAR-EL model as an efficient tool for computational drug repurposing.

Application of periodic parameters and their effects on the ANN landfill gas modeling

To reach a practical landfill gas management system and to diminish the negative environmental impacts from landfills, accurate methane (CH₄) prediction is essential. In this study, the preprocessing steps including minimizing multicollinearity, removal of outliers, and errors with missing data imputation are applied to enhance the data quality. This study is the first at employing periodic parameters in the two-stage non-linear auto-regressive model with exogenous inputs (NARX) with the aim of providing a convenient and precise approach to predict the daily CH₄ collection rate from a municipal landfill in Regina, SK, Canada. Using a stepwise procedure, various volumes of training data were assessed, and concluded that employing the 3-year training data reduced the mean absolute percentage error (MAPE) of the CH₄ prediction model by 26.97% at the testing stage. The favorable artificial neural network model performance was obtained using the day of the year (DOY) as a sole input of the time series model with MAPE of 2.12% showing its acceptable ability in CH₄ prediction. Using an only DOY-based model is especially remarkable because of its simplicity and high accuracy showing a convenient and effective approach in time landfill gas modeling, particularly for the landfills with no reliable climatic data.

A deep-learning based multimodal system for Covid-19 diagnosis using breathing sounds and chest X-ray images

Covid-19 has become a deadly pandemic claiming more than three million lives worldwide. SARS-CoV-2 causes distinct pathomorphological alterations in the respiratory system, thereby acting as a biomarker to aid its diagnosis. A multimodal framework (Ai-CovScan) for Covid-19 detection using breathing sounds, chest X-ray (CXR) images, and rapid antigen test (RAnT) is proposed. Transfer Learning approach using existing deep-learning Convolutional Neural Network (CNN) based on Inception-v3 is combined with Multi-Layered Perceptron (MLP) to develop the CovScanNet model for reducing false-negatives. This model reports a preliminary accuracy of 80% for the breathing sound analysis, and 99.66% Covid-19 detection accuracy for the curated CXR image dataset. Based on Ai-CovScan, a smartphone app is conceptualised as a mass-deployable screening tool, which could alter the course of this pandemic. This app’s deployment could minimise the number of people accessing the limited and expensive confirmatory tests, thereby reducing the burden on the severely stressed healthcare infrastructure.

Dimensionality reduction for EEG-based sleep stage detection: comparison of autoencoders, principal component analysis and factor analysis

Methods developed for automatic sleep stage detection make use of large amounts of data in the form of polysomnographic (PSG) recordings to build predictive models. In this study, we investigate the effect of several dimensionality reduction techniques, i.e., principal component analysis (PCA), factor analysis (FA), and autoencoders (AE) on common classifiers, e.g., random forests (RF), multilayer perceptron (MLP), long-short term memory (LSTM) networks, for automated sleep stage detection. Experimental testing is carried out on the MGH Dataset provided in the "You Snooze, You Win: The PhysioNet/Computing in Cardiology Challenge 2018". The signals used as input are the six available (EEG) electoencephalographic channels and combinations with the other PSG signals provided: ECG - electrocardiogram, EMG - electromyogram, respiration based signals - respiratory efforts and airflow. We observe that a similar or improved accuracy is obtained in most cases when using all dimensionality reduction techniques, which is a promising result as it allows to reduce the computational load while maintaining performance and in some cases also improves the accuracy of automated sleep stage detection. In our study, using autoencoders for dimensionality reduction maintains the performance of the model, while using PCA and FA the accuracy of the models is in most cases improved.