A review of feature selection techniques in bioinformatics

Systematic data analysis pipeline for quantitative morphological cell phenotyping

Quantitative morphological phenotyping (QMP) is an image-based method used to capture morphological features at both the cellular and population level. Its interdisciplinary nature, spanning from data collection to result analysis and interpretation, can lead to uncertainties, particularly among those new to this actively growing field. High analytical specificity for a typical QMP is achieved through sophisticated approaches that can leverage subtle cellular morphological changes. Here, we outline a systematic workflow to refine the QMP methodology. For a practical review, we describe the main steps of a typical QMP; in each step, we discuss the available methods, their applications, advantages, and disadvantages, along with the R functions and packages for easy implementation. This review does not cover theoretical backgrounds, but provides several references for interested researchers. It aims to broaden the horizons for future phenome studies and demonstrate how to exploit years of endeavors to achieve more with less.

Antibody glycan quality predicted from CHO cell culture media markers and machine learning

N-glycosylation can have a profound effect on the quality of mAb therapeutics. In biomanufacturing, one of the ways to influence N-glycosylation patterns is by altering the media used to grow mAb cell expression systems. Here, we explore the potential of machine learning (ML) to forecast the abundances of N-glycan types based on variables related to the growth media. The ML models exploit a dataset consisting of detailed glycomic characterisation of Anti-HER fed-batch bioreactor cell cultures measured daily under 12 different culture conditions, such as changes in levels of dissolved oxygen, pH, temperature, and the use of two different commercially available media. By performing spent media quantitation and subsequent calculation of pseudo cell consumption rates (termed media markers) as inputs to the ML model, we were able to demonstrate a small subset of media markers (18 selected out of 167 mass spectrometry peaks) in a Chinese Hamster Ovary (CHO) cell cultures are important to model N-glycan relative abundances (Regression - correlations between 0.80-0.92; Classification - AUC between 75.0-97.2). The performances suggest the ML models can infer N-glycan critical quality attributes from extracellular media as a proxy. Given its accuracy, we envisage its potential applications in biomaufactucuring, especially in areas of process development, downstream and upstream bioprocessing.

Pattern-centric transformation of omics data grounded on discriminative gene associations aids predictive tasks in TCGA while ensuring interpretability

The increasing prevalence of omics data sources is pushing the study of regulatory mechanisms underlying complex diseases such as cancer. However, the vast quantities of molecular features produced and the inherent interplay between them lead to a level of complexity that hampers both descriptive and predictive tasks, requiring custom-built algorithms that can extract relevant information from these sources of data. We propose a transformation that moves data centered on molecules (e.g., transcripts and proteins) to a new data space focused on putative regulatory modules given by statistically relevant co-expression patterns. To this end, the proposed transformation extracts patterns from the data through biclustering and uses them to create new variables with guarantees of interpretability and discriminative power. The transformation is shown to achieve dimensionality reductions of up to 99% and increase predictive performance of various classifiers across multiple omics layers. Results suggest that omics data transformations from gene-centric to pattern-centric data supports both prediction tasks and human interpretation, notably contributing to precision medicine applications.

A review on advancements in feature selection and feature extraction for high-dimensional NGS data analysis

Recent advancements in biomedical technologies and the proliferation of high-dimensional Next Generation Sequencing (NGS) datasets have led to significant growth in the bulk and density of data. The NGS high-dimensional data, characterized by a large number of genomics, transcriptomics, proteomics, and metagenomics features relative to the number of biological samples, presents significant challenges for reducing feature dimensionality. The high dimensionality of NGS data poses significant challenges for data analysis, including increased computational burden, potential overfitting, and difficulty in interpreting results. Feature selection and feature extraction are two pivotal techniques employed to address these challenges by reducing the dimensionality of the data, thereby enhancing model performance, interpretability, and computational efficiency. Feature selection and feature extraction can be categorized into statistical and machine learning methods. The present study conducts a comprehensive and comparative review of various statistical, machine learning, and deep learning-based feature selection and extraction techniques specifically tailored for NGS and microarray data interpretation of humankind. A thorough literature search was performed to gather information on these techniques, focusing on array-based and NGS data analysis. Various techniques, including deep learning architectures, machine learning algorithms, and statistical methods, have been explored for microarray, bulk RNA-Seq, and single-cell, single-cell RNA-Seq (scRNA-Seq) technology-based datasets surveyed here. The study provides an overview of these techniques, highlighting their applications, advantages, and limitations in the context of high-dimensional NGS data. This review provides better insights for readers to apply feature selection and feature extraction techniques to enhance the performance of predictive models, uncover underlying biological patterns, and gain deeper insights into massive and complex NGS and microarray data.

Machine-learning models for shoulder rehabilitation exercises classification using a wearable system

PURPOSE

The objective of this study is to train and test machine-learning (ML) models to automatically classify shoulder rehabilitation exercises.

METHODS

The cohort included both healthy and patients with rotator-cuff (RC) tears. All participants performed six shoulder rehabilitation exercises, following guidelines developed by the American Society of Shoulder and Elbow Therapists. Each exercise was repeated six times, while wearing a wearable system equipped with three magneto-inertial sensors. Six supervised machine-learning models (k-Nearest Neighbours, Support Vector Machine, Decision Tree, Random Forest (RF), Logistic Regression and Adaptive Boosting) were trained for the classification. The algorithms' ability to accurately classify exercise activities was evaluated using the nested cross-validation method, with different combinations of outer and inner folds.

RESULTS

A total of 19 healthy subjects and 17 patients with complete RC tears were enroled in the study. The highest classification performances were achieved by the RF classifier, with an accuracy of 89.91% and an F1-score of 89.89%.

CONCLUSION

The results of this study highlight the feasibility and effectiveness of using wearable sensors and ML algorithms to accurately classify shoulder rehabilitation exercises. These findings suggest promising prospects for implementing the proposed wearable system in remote home-based monitoring scenarios. The ease of setup and modularity of the system reduce user burden enabling patient-driven sensor positioning.

LEVEL OF EVIDENCE

Level III.

Uncovering waterlogging-responsive genes in cucumber through machine learning and differential gene correlation analysis

As climate change intensifies, the frequency and severity of waterlogging are expected to increase, necessitating a deeper understanding of the cucumber response to this stress. In this study, three public RNA-seq datasets (PRJNA799460, PRJNA844418, and PRJNA678740) comprising 36 samples were analyzed. Various feature selection algorithms including Uncertainty, Relief, SVM (Support Vector Machine), Correlation, and logistic least absolute shrinkage, and selection operator (LASSO) were performed to identify the most significant genes related to the waterlogging stress response. These feature selection techniques, which have different characteristics, were used to reduce the complexity of the data and thereby identify the most significant genes related to the waterlogging stress response. Uncertainty, Relief, SVM, Correlation, and LASSO identified 4, 4, 10, 21, and 13 genes, respectively. Differential gene correlation analysis (DGCA) focusing on the 36 selected genes identified changes in correlation patterns between the selected genes under waterlogged versus control conditions, providing deeper insights into the regulatory networks and interactions among the selected genes. DGCA revealed significant changes in the correlation of 13 genes between control and waterlogging conditions. Finally, we validated 13 genes using the Random Forest (RF) classifier, which achieved 100% accuracy and a 1.0 Area Under the Curve (AUC) score. The SHapley Additive exPlanations (SHAP) values clearly showed the significant impact of LOC101209599, LOC101217277, and LOC101216320 on the model's predictive power. In addition, we employed the Boruta as a wrapper feature selection method to further validate our gene selection strategy. Eight of the 13 genes were common across the four feature weighting algorithms, LASSO, DGCA, and Boruta, underscoring the robustness and reliability of our gene selection strategy. Notably, the genes LOC101209599, LOC101217277, and LOC101216320 were among genes identified by multiple feature selection methods from different categories (filtering, wrapper, and embedded). Pathways associated with these specific genes play a pivotal role in regulating stress tolerance, root development, nutrient absorption, sugar metabolism, gene expression, protein degradation, and calcium signaling. These intricate regulatory mechanisms are crucial for cucumbers to adapt effectively to waterlogging conditions. These findings provide valuable insights for uncovering targets in breeding new cucumber varieties with enhanced stress tolerance.

Using machine learning algorithms to detect fear of falling in people with multiple sclerosis in standardized gait analysis

INTRODUCTION

Multiple sclerosis (MS) is the most common chronic inflammatory disease of the central nervous system. The progressive impairment of gait is one of the most important pathognomic symptoms which are associated with falls and fear of falling (FOF) in people with MS (pwMS). 60 % of pwMS show a FOF, which leads to restrictions in mobility as well as physical activity and reduces the quality of life in general. Therefore, early detection of FOF is crucial because it enables early implementation of rehabilitation strategies as well as clinical decision-making to reduce progression. Qualitative and quantitative evaluation of gait pattern is an essential aspect of disease assessment and can provide valuable insights for personalized treatment decisions in pwMS. Our objective was to identify the most appropriate clinical gait analysis methods to identify FOF in pwMS and to detect the optimal machine learning (ML) algorithms to predict FOF using the complex multidimensional data from gait analysis.

METHODS

Data of 1240 pwMS was recorded at the MS Centre of the University Hospital Dresden between November 2020 and September 2021. Patients performed a multidimensional gait analysis with pressure and motion sensors, as well as patient-reported outcomes (PROs), according to a standardized protocol. A feature selection ensemble (FS-Ensemble) was developed to improve the classification performance. The FS-Ensemble consisted of four filtering methods: Chi-square test, information gain, minimum redundancy maximum relevance and ReliefF. Gaussian Naive Bayes, Decision Tree, k-Nearest Neighbor, and Support Vector Machines (SVM) were used to identify FOF.

RESULTS

The descriptive analysis showed that 37 % of the 1240 pwMS had a FOF (n = 458; age: 51 ± 16 years, 76 % women, median EDSS: 4.0). The FS-Ensemble improved classification performance in most cases. The SVM showed the best performance of the four classification models in detecting FOF. The PROs showed the best F1 scores (Early Mobility Impairment Questionnaire F1 = 0.81 ± 0.00 and 12-item Multiple Sclerosis Scale F1 = 0.80 ± 0.00).

CONCLUSION

FOF is an important psychological risk factor associated with an increased risk of falls. To integrate a functional early warning system for fall detection into MS management and progression monitoring, it is necessary to detect the relevant gait parameters as well as assessment methods. In this context, ML strategies allow the integration of gait parameters from clinical routine to support the initiation of early rehabilitation measures and adaptation of course-modifying therapeutics. The results of this study confirm that patients' self-assessments play an important role in disease management.

Follicular Fluid Proteomic Analysis to Identify Predictive Markers of Normal Embryonic Development

Ageing populations, mass "baby-free" policies and children born to mothers at the age at which they are biologically expected to become grandmothers are growing problems in most developed societies. Therefore, any opportunity to improve the quality of infertility treatments seems important for the survival of societies. The possibility of indirectly studying the quality of developing oocytes by examining their follicular fluids (hFFs) offers new opportunities for progress in our understanding the processes of final oocyte maturation and, consequently, for predicting the quality of the resulting embryos and personalising their culture. Using mass spectrometry, we studied follicular fluids collected individually during in vitro fertilisation and compared their composition with the quality of the resulting embryos. We analysed 110 follicular fluids from 50 oocyte donors, from which we obtained 44 high-quality, 39 medium-quality, and 27 low-quality embryos. We identified 2182 proteins by Sequential Window Acquisition of all Theoretical Mass Spectra (SWATH-MS) using a TripleTOF 5600+ hybrid mass spectrometer, of which 484 were suitable for quantification. We were able to identify several proteins whose concentrations varied between the follicular fluids of different oocytes from the same patient and between patients. Among them, the most important appear to be immunoglobulin heavy constant alpha 1 (IgA1hc) and dickkopf-related protein 3. The first one is found at higher concentrations in hFFs from which oocytes develop into poor-quality embryos, the other one exhibits the opposite pattern. None of these have, so far, had any specific links to fertility disorders. In light of these findings, these proteins should be considered a primary target for research aimed at developing a diagnostic tool for oocyte quality control and pre-fertilisation screening. This is particularly important in cases where the fertilisation of each egg is not an option for ethical or other reasons, or in countries where it is prohibited by law.

A New Filter Approach Based on Effective Ranges for Classification of Gene Expression Data

Over the years, many studies have been carried out to reduce and eliminate the effects of diseases on human health. Gene expression data sets play a critical role in diagnosing and treating diseases. These data sets consist of thousands of genes and a small number of sample sizes. This situation creates the curse of dimensionality and it becomes problematic to analyze such data sets. One of the most effective strategies to solve this problem is feature selection methods. Feature selection is a preprocessing step to improve classification performance by selecting the most relevant and informative features while increasing the accuracy of classification. In this article, we propose a new statistically based filter method for the feature selection approach named Effective Range-based Feature Selection Algorithm (FSAER). As an extension of the previous Effective Range based Gene Selection (ERGS) and Improved Feature Selection based on Effective Range (IFSER) algorithms, our novel method includes the advantages of both methods while taking into account the disjoint area. To illustrate the efficacy of the proposed algorithm, the experiments have been conducted on six benchmark gene expression data sets. The results of the FSAER and the other filter methods have been compared in terms of classification accuracies to demonstrate the effectiveness of the proposed method. For classification methods, support vector machines, naive Bayes classifier, and k-nearest neighbor algorithms have been used.

Non-invasive screening and subtyping for breast cancer by serum SERS combined with LGB-DNN algorithms

Early detection of breast cancer and its molecular subtyping is crucial for guiding clinical treatment and improving survival rate. Current diagnostic methods for breast cancer are invasive, time consuming and complicated. In this work, an optical detection method integrating surface-enhanced Raman spectroscopy (SERS) technology with feature selection and deep learning algorithm was developed for identifying serum components and building diagnostic model, with the aim of efficient and accurate noninvasive screening of breast cancer. First, the high quality of serum SERS spectra from breast cancer (BC), breast benign disease (BBD) patients and healthy controls (HC) were obtained. Chi-square tests were conducted to exclude confounding factors, enhancing the reliability of the study. Then, LightGBM (LGB) algorithm was used as the base model to retain useful features to significantly improve classification performance. The DNN algorithm was trained through backpropagation, adjusting the weights and biases between neurons to improve the network's predictive ability. In comparison to traditional machine learning algorithms, this method provided more accurate information for breast cancer classification, with classification accuracies of 91.38 % for BC and BBD, and 96.40 % for BC, BBD, and HC. Furthermore, the accuracies of 90.11 % for HR+/HR- and 88.89 % for HER2+/HER2- can be reached when evaluating BC patients' molecular subtypes. These results demonstrate that serum SERS combined with powerful LGB-DNN algorithm would provide a supplementary method for clinical breast cancer screening.

Learning Accurate Label-Specific Features From Partially Multilabeled Data

Feature selection is an effective dimensionality reduction technique, which can speed up an algorithm and improve model performance such as predictive accuracy and result comprehensibility. The study of selecting label-specific features for each class label has attracted considerable attention since each class label might be determined by some inherent characteristics, where precise label information is required to guide label-specific feature selection. However, obtaining noise-free labels is quite difficult and impractical. In reality, each instance is often annotated by a candidate label set that comprises multiple ground-truth labels and other false-positive labels, termed partial multilabel (PML) learning scenario. Here, false-positive labels concealed in a candidate label set might induce the selection of false label-specific features while masking the intrinsic label correlations, which misleads the selection of relevant features and compromises the selection performance. To address this issue, a novel two-stage partial multilabel feature selection (PMLFS) approach is proposed, which elicits credible labels to guide accurate label-specific feature selection. First, the label confidence matrix is learned to help elicit ground-truth labels from the candidate label set via the label structure reconstruction strategy, each element of which indicates how likely a class label is ground truth. After that, based on distilled credible labels, a joint selection model, including label-specific feature learner and common feature learner, is designed to learn accurate label-specific features to each class label and common features for all class labels. Besides, label correlations are fused into the features selection process to facilitate the generation of an optimal feature subset. Extensive experimental results clearly validate the superiority of the proposed approach.

Neuroimage Analysis Methods and Artificial Intelligence Techniques for Reliable Biomarkers and Accurate Diagnosis of Schizophrenia: Achievements Made by Chinese Scholars Around the Past Decade

BACKGROUND AND HYPOTHESIS

Schizophrenia (SZ) is characterized by significant cognitive and behavioral disruptions. Neuroimaging techniques, particularly magnetic resonance imaging (MRI), have been widely utilized to investigate biomarkers of SZ, distinguish SZ from healthy conditions or other mental disorders, and explore biotypes within SZ or across SZ and other mental disorders, which aim to promote the accurate diagnosis of SZ. In China, research on SZ using MRI has grown considerably in recent years.

STUDY DESIGN

The article reviews advanced neuroimaging and artificial intelligence (AI) methods using single-modal or multimodal MRI to reveal the mechanism of SZ and promote accurate diagnosis of SZ, with a particular emphasis on the achievements made by Chinese scholars around the past decade.

STUDY RESULTS

Our article focuses on the methods for capturing subtle brain functional and structural properties from the high-dimensional MRI data, the multimodal fusion and feature selection methods for obtaining important and sparse neuroimaging features, the supervised statistical analysis and classification for distinguishing disorders, and the unsupervised clustering and semi-supervised learning methods for identifying neuroimage-based biotypes. Crucially, our article highlights the characteristics of each method and underscores the interconnections among various approaches regarding biomarker extraction and neuroimage-based diagnosis, which is beneficial not only for comprehending SZ but also for exploring other mental disorders.

CONCLUSIONS

We offer a valuable review of advanced neuroimage analysis and AI methods primarily focused on SZ research by Chinese scholars, aiming to promote the diagnosis, treatment, and prevention of SZ, as well as other mental disorders, both within China and internationally.

Explainable artificial intelligence in the design of selective carbonic anhydrase I-II inhibitors via molecular fingerprinting

Inhibiting the enzymes carbonic anhydrase I (CA I) and carbonic anhydrase II (CA II) presents a potential avenue for addressing nervous system ailments such as glaucoma and Alzheimer's disease. Our study explored harnessing explainable artificial intelligence (XAI) to unveil the molecular traits inherent in CA I and CA II inhibitors. The PubChem molecular fingerprints of these inhibitors, sourced from the ChEMBL database, were subjected to detailed XAI analysis. The study encompassed training 10 regression models using IC50 values, and their efficacy was gauged using metrics including R2, RMSE, and time taken. The Decision Tree Regressor algorithm emerged as the optimal performer (R2: 0.93, RMSE: 0.43, time-taken: 0.07). Furthermore, the PFI method unveiled key molecular features for CA I inhibitors, notably PubChemFP432 (C(O)N) and PubChemFP6978 (C(O)O). The SHAP analysis highlighted the significance of attributes like PubChemFP539 (C(O)NCC), PubChemFP601 (C(O)OCC), and PubChemFP432 (C(O)N) in CA I inhibitiotable n. Likewise, features for CA II inhibitors encompassed PubChemFP528(C(O)OCCN), PubChemFP791 (C(O)OCCC), PubChemFP696 (C(O)OCCCC), PubChemFP335 (C(O)NCCN), PubChemFP580 (C(O)NCCCN), and PubChemFP180 (C(O)NCCC), identified through SHAP analysis. The sulfonamide group (S), aromatic ring (A), and hydrogen bonding group (H) exert a substantial impact on CA I and CA II enzyme activities and IC50 values through the XAI approach. These insights into the CA I and CA II inhibitors are poised to guide future drug discovery efforts, serving as a beacon for innovative therapeutic interventions.

Comprehensive application of AI algorithms with TCR NGS data for glioma diagnosis

T-cell receptor (TCR) detection can examine the extent of T-cell immune responses. Therefore, the article analyzed characteristic data of glioma obtained by DNA-based TCR high-throughput sequencing, to predict the disease with fewer biomarkers and higher accuracy. We downloaded data online and obtained six TCR-related diversity indices to establish a multidimensional classification system. By comparing actual presence of the 602 correlated sequences, we obtained two-dimensional and multidimensional datasets. Multiple classification methods were utilized for both datasets with the classification accuracy of multidimensional data slightly less to two-dimensional datasets. This study reduced the TCR β sequences through feature selection methods like RFECV (Recursive Feature Elimination with Cross-Validation). Consequently, using only the presence of these three sequences, the classification AUC value of 96.67% can be achieved. The combination of the three correlated TCR clones obtained at a source data threshold of 0.1 is: CASSLGGNTEAFF_TRBV12_TRBJ1-1, CASSYSDTGELFF_TRBV6_TRBJ2-2, and CASSLTGNTEAFF_TRBV12_TRBJ1-1. At 0.001, the combination is: CASSLGETQYF_TRBV12_TRBJ2-5, CASSLGGNQPQHF_TRBV12_TRBJ1-5, and CASSLSGNTIYF_TRBV12_TRBJ1-3. This method can serve as a potential diagnostic and therapeutic tool, facilitating diagnosis and treatment of glioma and other cancers.

Integration of machine learning models with microsatellite markers: New avenue in world grapevine germplasm characterization

Development of efficient analytical techniques is required for effective interpretation of biological data to take novel hypotheses and finding the critical predictive patterns. Machine Learning algorithms provide a novel opportunity for development of low-cost and practical solutions in biology. In this study, we proposed a new integrated analytical approach using supervised machine learning algorithms and microsatellites data of worldwide vitis populations. A total of 1378 wild (V. vinifera spp. sylvestris) and cultivated (V. vinifera spp. sativa) accessions of grapevine were investigated using 20 microsatellite markers. Data cleaning, feature selection, and supervised machine learning classification models vis, Naive Bayes, Support Vector Machine (SVM) and Tree Induction methods were implied to find most indicative and diagnostic alleles to represent wild/cultivated and originated geography of each population. Our combined approaches showed microsatellite markers with the highest differentiating capacity and proved efficiency for our pipeline of classification and prediction of vitis accessions. Moreover, our study proposed the best combination of markers for better distinguishing of populations, which can be exploited in future germplasm conservation and breeding programs.

Made to measure: An introduction to quantifying microscopy data in the life sciences

Images are at the core of most modern biological experiments and are used as a major source of quantitative information. Numerous algorithms are available to process images and make them more amenable to be measured. Yet the nature of the quantitative output that is useful for a given biological experiment is uniquely dependent upon the question being investigated. Here, we discuss the 3 main types of information that can be extracted from microscopy data: intensity, morphology, and object counts or categorical labels. For each, we describe where they come from, how they can be measured, and what may affect the relevance of these measurements in downstream data analysis. Acknowledging that what makes a measurement 'good' is ultimately down to the biological question being investigated, this review aims at providing readers with a toolkit to challenge how they quantify their own data and be critical of conclusions drawn from quantitative bioimage analysis experiments.

Which surrogate insulin resistance indices best predict coronary artery disease? A machine learning approach

BACKGROUND

Various surrogate markers of insulin resistance have been developed, capable of predicting coronary artery disease (CAD) without the need to detect serum insulin. For accurate prediction, they depend only on glucose and lipid profiles, as well as anthropometric features. However, there is still no agreement on the most suitable one for predicting CAD.

METHODS

We followed a cohort of 2,000 individuals, ranging in age from 20 to 74, for a duration of 9.9 years. We utilized multivariate Cox proportional hazard models to investigate the association between TyG-index, TyG-BMI, TyG-WC, TG/HDL, plus METS-IR and the occurrence of CAD. The receiver operating curve (ROC) was employed to compare the predictive efficacy of these indices and their corresponding cutoff values for predicting CAD. We also used three distinct embedded feature selection methods: LASSO, Random Forest feature selection, and the Boruta algorithm, to evaluate and compare surrogate markers of insulin resistance in predicting CAD. In addition, we utilized the ceteris paribus profile on the Random Forest model to illustrate how the model's predictive performance is affected by variations in individual surrogate markers, while keeping all other factors consistent in a diagram.

RESULTS

The TyG-index was the only surrogate marker of insulin resistance that demonstrated an association with CAD in fully adjusted model (HR: 2.54, CI: 1.34-4.81). The association was more prominent in females. Moreover, it demonstrated the highest area under the ROC curve (0.67 [0.63-0.7]) in comparison to other surrogate indices for insulin resistance. All feature selection approaches concur that the TyG-index is the most reliable surrogate insulin resistance marker for predicting CAD. Based on the Ceteris paribus profile of Random Forest the predictive ability of the TyG-index increased steadily after 9 with a positive slope, without any decline or leveling off.

CONCLUSION

Due to the simplicity of assessing the TyG-index with routine biochemical assays and given that the TyG-index was the most effective surrogate insulin resistance index for predicting CAD based on our results, it seems suitable for inclusion in future CAD prevention strategies.

A machine learning approach for differentiating bipolar disorder type II and borderline personality disorder using electroencephalography and cognitive abnormalities

This study addresses the challenge of differentiating between bipolar disorder II (BD II) and borderline personality disorder (BPD), which is complicated by overlapping symptoms. To overcome this, a multimodal machine learning approach was employed, incorporating both electroencephalography (EEG) patterns and cognitive abnormalities for enhanced classification. Data were collected from 45 participants, including 20 with BD II and 25 with BPD. Analysis involved utilizing EEG signals and cognitive tests, specifically the Wisconsin Card Sorting Test and Integrated Cognitive Assessment. The k-nearest neighbors (KNN) algorithm achieved a balanced accuracy of 93%, with EEG features proving to be crucial, while cognitive features had a lesser impact. Despite the strengths, such as diverse model usage, it's important to note limitations, including a small sample size and reliance on DSM diagnoses. The study suggests that future research should explore multimodal data integration and employ advanced techniques to improve classification accuracy and gain a better understanding of the neurobiological distinctions between BD II and BPD.

Machine Learning-Based Etiologic Subtyping of Ischemic Stroke Using Circulating Exosomal microRNAs

Ischemic stroke is a major cause of mortality worldwide. Proper etiological subtyping of ischemic stroke is crucial for tailoring treatment strategies. This study explored the utility of circulating microRNAs encapsulated in extracellular vesicles (EV-miRNAs) to distinguish the following ischemic stroke subtypes: large artery atherosclerosis (LAA), cardioembolic stroke (CES), and small artery occlusion (SAO). Using next-generation sequencing (NGS) and machine-learning techniques, we identified differentially expressed miRNAs (DEMs) associated with each subtype. Through patient selection and diagnostic evaluation, a cohort of 70 patients with acute ischemic stroke was classified: 24 in the LAA group, 24 in the SAO group, and 22 in the CES group. Our findings revealed distinct EV-miRNA profiles among the groups, suggesting their potential as diagnostic markers. Machine-learning models, particularly logistic regression models, exhibited a high diagnostic accuracy of 92% for subtype discrimination. The collective influence of multiple miRNAs was more crucial than that of individual miRNAs. Additionally, bioinformatics analyses have elucidated the functional implications of DEMs in stroke pathophysiology, offering insights into the underlying mechanisms. Despite limitations like sample size constraints and retrospective design, our study underscores the promise of EV-miRNAs coupled with machine learning for ischemic stroke subtype classification. Further investigations are warranted to validate the clinical utility of the identified EV-miRNA biomarkers in stroke patients.

Personalized prediction of survival rate with combination of penalized Cox models in patients with colorectal cancer

The investigation into individual survival rates within the patient population was typically conducted using the Cox proportional hazards model. This study was aimed to evaluate the performance of machine learning algorithm in predicting survival rates more than 5 years for individual patients with colorectal cancer. A total of 475 patients with colorectal cancer (CRC) and complete data who had underwent surgery for CRC were analyze to measure individual's survival rate more than 5 years using a machine learning based on penalized Cox regression. We conducted thorough calculations to measure the individual's survival rate more than 5 years for performance evaluation. The receiver operating characteristic curves for the LASSO penalized model, the SCAD penalized model, the unpenalized model, and the RSF model were analyzed. The least absolute shrinkage and selection operator penalized model displayed a mean AUC of 0.67 ± 0.06, the smoothly clipped absolute deviation penalized model exhibited a mean AUC of 0.65 ± 0.07, the unpenalized model showed a mean AUC of 0.64 ± 0.09. Notably, the random survival forests model outperformed the others, demonstrating the most favorable performance evaluation with a mean AUC of 0.71 ± 0.05. Compared to the conventional unpenalized Cox model, recent machine learning techniques (LASSO, SCAD, RSF) showed advantages for data interpretation.

Developing and comparing deep learning and machine learning algorithms for osteoporosis risk prediction

Introduction

Osteoporosis, characterized by low bone mineral density (BMD), is an increasingly serious public health issue. So far, several traditional regression models and machine learning (ML) algorithms have been proposed for predicting osteoporosis risk. However, these models have shown relatively low accuracy in clinical implementation. Recently proposed deep learning (DL) approaches, such as deep neural network (DNN), which can discover knowledge from complex hidden interactions, offer a new opportunity to improve predictive performance. In this study, we aimed to assess whether DNN can achieve a better performance in osteoporosis risk prediction.

Methods

By utilizing hip BMD and extensive demographic and routine clinical data of 8,134 subjects with age more than 40 from the Louisiana Osteoporosis Study (LOS), we developed and constructed a novel DNN framework for predicting osteoporosis risk and compared its performance in osteoporosis risk prediction with four conventional ML models, namely random forest (RF), artificial neural network (ANN), k-nearest neighbor (KNN), and support vector machine (SVM), as well as a traditional regression model termed osteoporosis self-assessment tool (OST). Model performance was assessed by area under 'receiver operating curve' (AUC) and accuracy.

Results

By using 16 discriminative variables, we observed that the DNN approach achieved the best predictive performance (AUC = 0.848) in classifying osteoporosis (hip BMD T-score ≤ -1.0) and non-osteoporosis risk (hip BMD T-score > -1.0) subjects, compared to the other approaches. Feature importance analysis showed that the top 10 most important variables identified by the DNN model were weight, age, gender, grip strength, height, beer drinking, diastolic pressure, alcohol drinking, smoke years, and economic level. Furthermore, we performed subsampling analysis to assess the effects of varying number of sample size and variables on the predictive performance of these tested models. Notably, we observed that the DNN model performed equally well (AUC = 0.846) even by utilizing only the top 10 most important variables for osteoporosis risk prediction. Meanwhile, the DNN model can still achieve a high predictive performance (AUC = 0.826) when sample size was reduced to 50% of the original dataset.

Conclusion

In conclusion, we developed a novel DNN model which was considered to be an effective algorithm for early diagnosis and intervention of osteoporosis in the aging population.

Impacts of habitat alteration on macroinvertebrates in large shallow lakes: An application of a macroinvertebrate-based multimetric index

Habitat plays a crucial role in shaping the macroinvertebrate community structure in large shallow lakes. In the pursuit of improving the health of freshwater ecosystems, it is imperative to consider their habitat characteristics. To evaluate the impact of habitat variations on lake ecological health, we developed a macroinvertebrate-based multimetric index (MMI) for both the pelagic and littoral zones of Lake Hongze. Additionally, we employed structural equation models to explore the influence of utilization or phytoplankton biomass on ecological health. Historical data served as reference conditions for the pelagic. Seven key attributes were selected for the pelagic MMI, that is, Biological Monitoring Working Party (BMWP), the percentage of Mollusca taxa, the percentage of filter-collector taxa, the percentage of predator taxa, the percentage of gather-collector taxa, and the percentage of sensitive taxa and functional dispersion. The least minimally disturbed conditions and the best attainable conditions were used to develop the littoral. Four key metrics, that is, the percentage of scraper abundance, Mollusca taxa, Biological Pollution Index, and BMWP, were integrated into the littoral MMI. The assessment based on MMI revealed a "poor" health status for the pelagic zone and a "fair" health status for the littoral zone. These findings underscore the high applicability and efficacy of MMIs in assessing and monitoring ecological health in Lake Hongze. Notably, functional feeding groups exhibited heightened sensitivity to disturbance in both zones. Moreover, sediment organic matter strongly influenced the pelagic ecological health, while chlorophyll a and transparency emerged as primary factors influencing the littoral zone, attributable to varying littoral zone utilization. Integr Environ Assess Manag 2024;00:1-11. © 2024 SETAC.

ProkDBP: Toward more precise identification of prokaryotic DNA binding proteins

Prokaryotic DNA binding proteins (DBPs) play pivotal roles in governing gene regulation, DNA replication, and various cellular functions. Accurate computational models for predicting prokaryotic DBPs hold immense promise in accelerating the discovery of novel proteins, fostering a deeper understanding of prokaryotic biology, and facilitating the development of therapeutics targeting for potential disease interventions. However, existing generic prediction models often exhibit lower accuracy in predicting prokaryotic DBPs. To address this gap, we introduce ProkDBP, a novel machine learning-driven computational model for prediction of prokaryotic DBPs. For prediction, a total of nine shallow learning algorithms and five deep learning models were utilized, with the shallow learning models demonstrating higher performance metrics compared to their deep learning counterparts. The light gradient boosting machine (LGBM), coupled with evolutionarily significant features selected via random forest variable importance measure (RF-VIM) yielded the highest five-fold cross-validation accuracy. The model achieved the highest auROC (0.9534) and auPRC (0.9575) among the 14 machine learning models evaluated. Additionally, ProkDBP demonstrated substantial performance with an independent dataset, exhibiting higher values of auROC (0.9332) and auPRC (0.9371). Notably, when benchmarked against several cutting-edge existing models, ProkDBP showcased superior predictive accuracy. Furthermore, to promote accessibility and usability, ProkDBP (https://iasri-sg.icar.gov.in/prokdbp/) is available as an online prediction tool, enabling free access to interested users. This tool stands as a significant contribution, enhancing the repertoire of resources for accurate and efficient prediction of prokaryotic DBPs.

Improving the Automated Diagnosis of Breast Cancer with Mesh Reconstruction of Ultrasound Images Incorporating 3D Mesh Features and a Graph Attention Network

This study proposes a novel approach for breast tumor classification from ultrasound images into benign and malignant by converting the region of interest (ROI) of a 2D ultrasound image into a 3D representation using the point-e system, allowing for in-depth analysis of underlying characteristics. Instead of relying solely on 2D imaging features, this method extracts 3D mesh features that describe tumor patterns more precisely. Ten informative and medically relevant mesh features are extracted and assessed with two feature selection techniques. Additionally, a feature pattern analysis has been conducted to determine the feature's significance. A feature table with dimensions of 445 × 12 is generated and a graph is constructed, considering the rows as nodes and the relationships among the nodes as edges. The Spearman correlation coefficient method is employed to identify edges between the strongly connected nodes (with a correlation score greater than or equal to 0.7), resulting in a graph containing 56,054 edges and 445 nodes. A graph attention network (GAT) is proposed for the classification task and the model is optimized with an ablation study, resulting in the highest accuracy of 99.34%. The performance of the proposed model is compared with ten machine learning (ML) models and one-dimensional convolutional neural network where the test accuracy of these models ranges from 73 to 91%. Our novel 3D mesh-based approach, coupled with the GAT, yields promising performance for breast tumor classification, outperforming traditional models, and has the potential to reduce time and effort of radiologists providing a reliable diagnostic system.

Precision healthcare: A deep dive into machine learning algorithms and feature selection strategies for accurate heart disease prediction

This paper presents a comprehensive exploration of machine learning algorithms (MLAs) and feature selection techniques for accurate heart disease prediction (HDP) in modern healthcare. By focusing on diverse datasets encompassing various challenges, the research sheds light on optimal strategies for early detection. MLAs such as Decision Trees (DT), Random Forests (RF), Support Vector Machines (SVM), Gaussian Naive Bayes (NB), and others were studied, with precision and recall metrics emphasized for robust predictions. Our study addresses challenges in real-world data through data cleaning and one-hot encoding, enhancing the integrity of our predictive models. Feature extraction techniques-Recursive Feature Extraction (RFE), Principal Component Analysis (PCA), and univariate feature selection-play a crucial role in identifying relevant features and reducing data dimensionality. Our findings showcase the impact of these techniques on improving prediction accuracy. Optimized models for each dataset have been achieved through grid search hyperparameter tuning, with configurations meticulously outlined. Notably, a remarkable 99.12 % accuracy was achieved on the first Kaggle dataset, showcasing the potential for accurate HDP. Model robustness across diverse datasets was highlighted, with caution against overfitting. The study emphasizes the need for validation of unseen data and encourages ongoing research for generalizability. Serving as a practical guide, this research aids researchers and practitioners in HDP model development, influencing clinical decisions and healthcare resource allocation. By providing insights into effective algorithms and techniques, the paper contributes to reducing heart disease-related morbidity and mortality, supporting the healthcare community's ongoing efforts.

MFPINC: prediction of plant ncRNAs based on multi-source feature fusion

Non-coding RNAs (ncRNAs) are recognized as pivotal players in the regulation of essential physiological processes such as nutrient homeostasis, development, and stress responses in plants. Common methods for predicting ncRNAs are susceptible to significant effects of experimental conditions and computational methods, resulting in the need for significant investment of time and resources. Therefore, we constructed an ncRNA predictor(MFPINC), to predict potential ncRNA in plants which is based on the PINC tool proposed by our previous studies. Specifically, sequence features were carefully refined using variance thresholding and F-test methods, while deep features were extracted and feature fusion were performed by applying the GRU model. The comprehensive evaluation of multiple standard datasets shows that MFPINC not only achieves more comprehensive and accurate identification of gene sequences, but also significantly improves the expressive and generalization performance of the model, and MFPINC significantly outperforms the existing competing methods in ncRNA identification. In addition, it is worth mentioning that our tool can also be found on Github ( https://github.com/Zhenj-Nie/MFPINC ) the data and source code can also be downloaded for free.

Enhancing mass spectrometry imaging accessibility using convolutional autoencoders for deriving hypoxia-associated peptides from tumors

Mass spectrometry imaging (MSI) allows to study cancer's intratumoral heterogeneity through spatially-resolved peptides, metabolites and lipids. Yet, in biomedical research MSI is rarely used for biomarker discovery. Besides its high dimensionality and multicollinearity, mass spectrometry (MS) technologies typically output mass-to-charge ratio values but not the biochemical compounds of interest. Our framework makes particularly low-abundant signals in MSI more accessible. We utilized convolutional autoencoders to aggregate features associated with tumor hypoxia, a parameter with significant spatial heterogeneity, in cancer xenograft models. We highlight that MSI captures these low-abundant signals and that autoencoders can preserve them in their latent space. The relevance of individual hyperparameters is demonstrated through ablation experiments, and the contribution from original features to latent features is unraveled. Complementing MSI with tandem MS from the same tumor model, multiple hypoxia-associated peptide candidates were derived. Compared to random forests alone, our autoencoder approach yielded more biologically relevant insights for biomarker discovery.

Hybrid feature selection in a machine learning predictive model for perioperative myocardial injury in noncoronary cardiac surgery with cardiopulmonary bypass

BACKGROUND

Perioperative myocardial injury (PMI) is associated with increased mobility and mortality after noncoronary cardiac surgery. However, limited studies have developed a predictive model for PMI. Therefore, we used hybrid feature selection (FS) methods to establish a predictive model for PMI in noncoronary cardiac surgery with cardiopulmonary bypass (CPB).

METHODS

This was a single-center retrospective study conducted at the Fuwai Hospital in China. Patients aged 18-70 years who underwent elective noncoronary surgery with CPB at our institution from December 2018 to April 2021 were enrolled. The primary outcome was PMI, defined as the postoperative cardiac troponin I (cTnI) levels exceeding 220 times of upper reference limit (URL). Statistical analyses were conducted by Python (Python Software Foundation, version 3.9.7 and integrated development environment Jupyter Notebook 1.1.0) and SPSS software version 26.0 (IBM Corp., Armonk, New York, USA).

RESULTS

A total of 1130 patients were eventually eligible for this study. The incidence of PMI was 20.3% (229/1130) in the overall patients, 20.6% (163/791) in the training dataset, and 19.5% (66/339) in the testing dataset. The logistic regression model performed the best AUC of 0.6893 (95 CI%: 0.6371-0.7382) by the traditional selection method, and the random forest model performed the best AUC of 0.6937 (95 CI%: 0.6416-0.7423) by the union of Wrapper and Embedded method, and the CatBoost model performed the best AUC of 0.6828 (95 CI%: 0.6304-0.7320) by the union of Embedded and forward logistic regression technique, and the Naïve Bayes model achieved the best AUC with 0.7254 (95 CI%: 0.6746-0.7723) by forwarding logistic regression method. Moreover, the decision tree, KNeighborsClassifier, and support vector machine models performed the worse AUC in all selection forms. Furthermore, the SHapley Additive exPlanations plot showed that prolonged CPB, aortic clamp time, and preoperative low platelets count were strongly related to the PMI risk.

CONCLUSIONS

In total, four category feature selection methods were utilized, comprising five individual selection techniques and 15 combined methods. Notably, the combination of logistic regression and embedded methods demonstrated outstanding performance in predicting PMI risk. We also concluded that the machine learning model, including random forest, catboost, and Naive Bayes, were suitable candidates for establishing PMI predictive model. Nevertheless, additional investigation and validation are imperative for substantiating these finding.

Penalized logistic regression with prior information for microarray gene expression classification

Cancer classification and gene selection are important applications in DNA microarray gene expression data analysis. Since DNA microarray data suffers from the high-dimensionality problem, automatic gene selection methods are used to enhance the classification performance of expert classifier systems. In this paper, a new penalized logistic regression method that performs simultaneous gene coefficient estimation and variable selection in DNA microarray data is discussed. The method employs prior information about the gene coefficients to improve the classification accuracy of the underlying model. The coordinate descent algorithm with screening rules is given to obtain the gene coefficient estimates of the proposed method efficiently. The performance of the method is examined on five high-dimensional cancer classification datasets using the area under the curve, the number of selected genes, misclassification rate and F-score measures. The real data analysis results indicate that the proposed method achieves a good cancer classification performance with a small misclassification rate, large area under the curve and F-score by trading off some sparsity level of the underlying model. Hence, the proposed method can be seen as a reliable penalized logistic regression method in the scope of high-dimensional cancer classification.

Synovial fibroblast gene expression is associated with sensory nerve growth and pain in rheumatoid arthritis

It has been presumed that rheumatoid arthritis (RA) joint pain is related to inflammation in the synovium; however, recent studies reveal that pain scores in patients do not correlate with synovial inflammation. We developed a machine-learning approach (graph-based gene expression module identification or GbGMI) to identify an 815-gene expression module associated with pain in synovial biopsy samples from patients with established RA who had limited synovial inflammation at arthroplasty. We then validated this finding in an independent cohort of synovial biopsy samples from patients who had early untreated RA with little inflammation. Single-cell RNA sequencing analyses indicated that most of these 815 genes were most robustly expressed by lining layer synovial fibroblasts. Receptor-ligand interaction analysis predicted cross-talk between human lining layer fibroblasts and human dorsal root ganglion neurons expressing calcitonin gene-related peptide (CGRP+). Both RA synovial fibroblast culture supernatant and netrin-4, which is abundantly expressed by lining fibroblasts and was within the GbGMI-identified pain-associated gene module, increased the branching of pain-sensitive murine CGRP+ dorsal root ganglion neurons in vitro. Imaging of solvent-cleared synovial tissue with little inflammation from humans with RA revealed CGRP+ pain-sensing neurons encasing blood vessels growing into synovial hypertrophic papilla. Together, these findings support a model whereby synovial lining fibroblasts express genes associated with pain that enhance the growth of pain-sensing neurons into regions of synovial hypertrophy in RA.

Brain Alteration Patterns in Children with Duchenne Muscular Dystrophy: A Machine Learning Approach to Magnetic Resonance Imaging

Background

Duchenne Muscular Dystrophy (DMD) is a genetic disease in which lack of the dystrophin protein causes progressive muscular weakness, cardiomyopathy and respiratory insufficiency. DMD is often associated with other cognitive and behavioral impairments, however the correlation of abnormal dystrophin expression in the central nervous system with brain structure and functioning remains still unclear.

Objective

To investigate brain involvement in patients with DMD through a multimodal and multivariate approach accounting for potential comorbidities.

Methods

We acquired T1-weighted and Diffusion Tensor Imaging data from 18 patients with DMD and 18 age- and sex-matched controls with similar cognitive and behavioral profiles. Cortical thickness, structure volume, fractional anisotropy and mean diffusivity measures were used in a multivariate analysis performed using a Support Vector Machine classifier accounting for potential comorbidities in patients and controls.

Results

the classification experiment significantly discriminates between the two populations (97.2% accuracy) and the forward model weights showed that DMD mostly affects the microstructural integrity of long fiber bundles, in particular in the cerebellar peduncles (bilaterally), in the posterior thalamic radiation (bilaterally), in the fornix and in the medial lemniscus (bilaterally). We also reported a reduced cortical thickness, mainly in the motor cortex, cingulate cortex, hippocampal area and insula.

Conclusions

Our study identified a small pattern of alterations in the CNS likely associated with the DMD diagnosis.

Data-Driven Identification of Factors That Influence the Quality of Adverse Event Reports: 15-Year Interpretable Machine Learning and Time-Series Analyses of VigiBase and QUEST

BACKGROUND

The completeness of adverse event (AE) reports, crucial for assessing putative causal relationships, is measured using the vigiGrade completeness score in VigiBase, the World Health Organization global database of reported potential AEs. Malaysian reports have surpassed the global average score (approximately 0.44), achieving a 5-year average of 0.79 (SD 0.23) as of 2019 and approaching the benchmark for well-documented reports (0.80). However, the contributing factors to this relatively high report completeness score remain unexplored.

OBJECTIVE

This study aims to explore the main drivers influencing the completeness of Malaysian AE reports in VigiBase over a 15-year period using vigiGrade. A secondary objective was to understand the strategic measures taken by the Malaysian authorities leading to enhanced report completeness across different time frames.

METHODS

We analyzed 132,738 Malaysian reports (2005-2019) recorded in VigiBase up to February 2021 split into historical International Drug Information System (INTDIS; n=63,943, 48.17% in 2005-2016) and newer E2B (n=68,795, 51.83% in 2015-2019) format subsets. For machine learning analyses, we performed a 2-stage feature selection followed by a random forest classifier to identify the top features predicting well-documented reports. We subsequently applied tree Shapley additive explanations to examine the magnitude, prevalence, and direction of feature effects. In addition, we conducted time-series analyses to evaluate chronological trends and potential influences of key interventions on reporting quality.

RESULTS

Among the analyzed reports, 42.84% (56,877/132,738) were well documented, with an increase of 65.37% (53,929/82,497) since 2015. Over two-thirds (46,186/68,795, 67.14%) of the Malaysian E2B reports were well documented compared to INTDIS reports at 16.72% (10,691/63,943). For INTDIS reports, higher pharmacovigilance center staffing was the primary feature positively associated with being well documented. In recent E2B reports, the top positive features included reaction abated upon drug dechallenge, reaction onset or drug use duration of <1 week, dosing interval of <1 day, reports from public specialist hospitals, reports by pharmacists, and reaction duration between 1 and 6 days. In contrast, reports from product registration holders and other health care professionals and reactions involving product substitution issues negatively affected the quality of E2B reports. Multifaceted strategies and interventions comprising policy changes, continuity of education, and human resource development laid the groundwork for AE reporting in Malaysia, whereas advancements in technological infrastructure, pharmacovigilance databases, and reporting tools concurred with increases in both the quantity and quality of AE reports.

CONCLUSIONS

Through interpretable machine learning and time-series analyses, this study identified key features that positively or negatively influence the completeness of Malaysian AE reports and unveiled how Malaysia has developed its pharmacovigilance capacity via multifaceted strategies and interventions. These findings will guide future work in enhancing pharmacovigilance and public health.

Multi-Attribute Subset Selection enables prediction of representative phenotypes across microbial populations

The interpretation of complex biological datasets requires the identification of representative variables that describe the data without critical information loss. This is particularly important in the analysis of large phenotypic datasets (phenomics). Here we introduce Multi-Attribute Subset Selection (MASS), an algorithm which separates a matrix of phenotypes (e.g., yield across microbial species and environmental conditions) into predictor and response sets of conditions. Using mixed integer linear programming, MASS expresses the response conditions as a linear combination of the predictor conditions, while simultaneously searching for the optimally descriptive set of predictors. We apply the algorithm to three microbial datasets and identify environmental conditions that predict phenotypes under other conditions, providing biologically interpretable axes for strain discrimination. MASS could be used to reduce the number of experiments needed to identify species or to map their metabolic capabilities. The generality of the algorithm allows addressing subset selection problems in areas beyond biology.

Machine learning-based prediction of effluent total suspended solids in a wastewater treatment plant using different feature selection approaches: A comparative study

Accurately predicting the characteristics of effluent, discharged from wastewater treatment plants (WWTPs) is crucial for reducing sampling requirements, labor, costs, and environmental pollution. Machine learning (ML) techniques can be effective in achieving this goal. To optimize ML-based models, various feature selection (FS) methods are employed. This study aims to investigate the impact of six FS methods (categorized as Wrapper, Filter, and Embedded methods) on the accuracy of three supervised ML algorithms in predicting total suspended solids (TSS) concentration in the effluent of a municipal wastewater treatment plant. Based on the features proposed by each FS method, five distinct scenarios were defined. Within each scenario, three ML algorithms, namely artificial neural network-multi layer perceptron (ANN-MLP), K-nearest neighbors (KNN), and adaptive boosting (AdaBoost) were applied. The features utilized for predicting TSS concentration in the WWTP effluent included BOD5, COD, TSS, TN, NH3 in the influent, and BOD5, COD, residual Cl2, NO3, TN, NH4 in the effluent. To construct the models, the dataset was randomly divided into training and testing subsets, and K-fold cross-validation was employed to control overfitting and underfitting. The evaluation metrics that are used are root mean squared error (RMSE), mean absolute error (MAE), and correlation coefficient (R2). The most efficient scenario was identified as Scenario IV, with the Sequential Backward Selection FS method. The features selected by this method were CODe, BOD5e, BOD5i, TNi. Furthermore, the ANN-MLP algorithm demonstrated the best performance, achieving the highest R2 value. This algorithm exhibited acceptable performance in both the training and testing subsets (R2 = 0.78 and R2 = 0.8, respectively).

Monitoring the efficacy of antibiotic therapy in febrile pediatric oncology patients with bacteremia using infrared spectroscopy of white blood cells-based machine learning

Bacteremia refers to the presence of bacteria in the bloodstream, which can lead to a serious and potentially life-threatening condition. In oncology patients, individuals undergoing cancer treatment have a higher risk of developing bacteremia due to a weakened immune system resulting from the disease itself or the treatments they receive. Prompt and accurate detection of bacterial infections and monitoring the effectiveness of antibiotic therapy are essential for enhancing patient outcomes and preventing the development and dissemination of multidrug-resistant bacteria. Traditional methods of infection monitoring, such as blood cultures and clinical observations, are time-consuming, labor-intensive, and often subject to limitations. This manuscript presents an innovative application of infrared spectroscopy of leucocytes of pediatric oncology patients with bacteremia combined with machine learning to diagnose the etiology of infection as bacterial and simultaneously monitor the efficacy of the antibiotic therapy in febrile pediatric oncology patients with bacteremia infections. Through the implementation of effective monitoring, it becomes possible to promptly identify any indications of treatment failure. This, in turn, indirectly serves to limit the progression of antibiotic resistance. The logistic regression (LR) classifier was able to differentiate the samples as bacterial or control within an hour, after receiving the blood samples with a success rate of over 95 %. Additionally, initial findings indicate that employing infrared spectroscopy of white blood cells (WBCs) along with machine learning is viable for monitoring the success of antibiotic therapy. Our follow up results demonstrate an accuracy of 87.5 % in assessing the effectiveness of the antibiotic treatment.

Intelligent assessment of atrial fibrillation gradation based on sinus rhythm electrocardiogram and baseline information

BACKGROUND

Atrial fibrillation (AF) is a progressive arrhythmia that significantly affects a patient's quality of life. The 4S-AF scheme is clinically recommended for AF management; however, the evaluation process is complex and time-consuming. This renders its promotion in primary medical institutions challenging. This retrospective study aimed to simplify the evaluation process and present an objective assessment model for AF gradation.

METHODS

In total, 189 12-lead electrocardiogram (ECG) recordings from 64 patients were included in this study. The data were annotated into two groups (mild and severe) according to the 4S-AF scheme. Using a preprocessed ECG during the sinus rhythm (SR), we obtained a synthesized vectorcardiogram (VCG). Subsequently, various features were calculated from both signals, and age, sex, and medical history were included as baseline characteristics. Different machine learning models, including support vector machines, random forests (RF), and logistic regression, were finally tested with a combination of feature selection techniques.

RESULTS

The proposed method demonstrated excellent performance in the classification of AF gradation. With an optimized feature set of VCG and baseline features, the RF model achieved accuracy, sensitivity, and specificity of 83.02 %, 80.56 %, and 88.24 %, respectively, under the inter-patient paradigm.

CONCLUSION

Our results demonstrate the value of physiological signals in AF gradation evaluation, and VCG signals were effective in identifying mild and severe AF. Considering its low computational complexity and high assessment performance, the proposed model is expected to serve as a useful prognostic tool for clinical AF management.

CoVar: A generalizable machine learning approach to identify the coordinated regulators driving variational gene expression

Network inference is used to model transcriptional, signaling, and metabolic interactions among genes, proteins, and metabolites that identify biological pathways influencing disease pathogenesis. Advances in machine learning (ML)-based inference models exhibit the predictive capabilities of capturing latent patterns in genomic data. Such models are emerging as an alternative to the statistical models identifying causative factors driving complex diseases. We present CoVar, an ML-based framework that builds upon the properties of existing inference models, to find the central genes driving perturbed gene expression across biological states. Unlike differentially expressed genes (DEGs) that capture changes in individual gene expression across conditions, CoVar focuses on identifying variational genes that undergo changes in their expression network interaction profiles, providing insights into changes in the regulatory dynamics, such as in disease pathogenesis. Subsequently, it finds core genes from among the nearest neighbors of these variational genes, which are central to the variational activity and influence the coordinated regulatory processes underlying the observed changes in gene expression. Through the analysis of simulated as well as yeast expression data perturbed by the deletion of the mitochondrial genome, we show that CoVar captures the intrinsic variationality and modularity in the expression data, identifying key driver genes not found through existing differential analysis methodologies.

Decoding bilingualism from resting-state oscillatory network organization

Can lifelong bilingualism be robustly decoded from intrinsic brain connectivity? Can we determine, using a spectrally resolved approach, the oscillatory networks that better predict dual-language experience? We recorded resting-state magnetoencephalographic activity in highly proficient Spanish-Basque bilinguals and Spanish monolinguals, calculated functional connectivity at canonical frequency bands, and derived topological network properties using graph analysis. These features were fed into a machine learning classifier to establish how robustly they discriminated between the groups. The model showed excellent classification (AUC: 0.91 ± 0.12) between individuals in each group. The key drivers of classification were network strength in beta (15-30 Hz) and delta (2-4 Hz) rhythms. Further characterization of these networks revealed the involvement of temporal, cingulate, and fronto-parietal hubs likely underpinning the language and default-mode networks (DMNs). Complementary evidence from a correlation analysis showed that the top-ranked features that better discriminated individuals during rest also explained interindividual variability in second language (L2) proficiency within bilinguals, further supporting the robustness of the machine learning model in capturing trait-like markers of bilingualism. Overall, our results show that long-term experience with an L2 can be "brain-read" at a fine-grained level from resting-state oscillatory network organization, highlighting its pervasive impact, particularly within language and DMN networks.

Multimorbidity healthcare expenditure in Belgium: a 4-year analysis (COMORB study)

BACKGROUND

The complex management of health needs in multimorbid patients, alongside limited cost data, presents challenges in developing cost-effective patient-care pathways. We estimated the costs of managing 171 dyads and 969 triads in Belgium, taking into account the influence of morbidity interactions on costs.

METHODS

We followed a retrospective longitudinal study design, using the linked Belgian Health Interview Survey 2018 and the administrative claim database 2017-2020 hosted by the Intermutualistic Agency. We included people aged 15 and older, who had complete profiles (N = 9753). Applying a system costing perspective, the average annual direct cost per person per dyad/triad was presented in 2022 Euro and comprised mainly direct medical costs. We developed mixed models to analyse the impact of single chronic conditions, dyads and triads on healthcare costs, considering two-/three-way interactions within dyads/triads, key cost determinants and clustering at the household level.

RESULTS

People with multimorbidity constituted nearly half of the study population and their total healthcare cost constituted around three quarters of the healthcare cost of the study population. The most common dyad, arthropathies + dorsopathies, with a 14% prevalence rate, accounted for 11% of the total national health expenditure. The most frequent triad, arthropathies + dorsopathies + hypertension, with a 5% prevalence rate, contributed 5%. The average annual direct costs per person with dyad and triad were €3515 (95% CI 3093-3937) and €4592 (95% CI 3920-5264), respectively. Dyads and triads associated with cancer, diabetes, chronic fatigue, and genitourinary problems incurred the highest costs. In most cases, the cost associated with multimorbidity was lower or not substantially different from the combined cost of the same conditions observed in separate patients.

CONCLUSION

Prevalent morbidity combinations, rather than high-cost ones, made a greater contribution to total national health expenditure. Our study contributes to the sparse evidence on this topic globally and in Europe, with the aim of improving cost-effective care for patients with diverse needs.

Comparison of cerebrospinal fluid, plasma and neuroimaging biomarker utility in Alzheimer's disease

Alzheimer's disease biomarkers are crucial to understanding disease pathophysiology, aiding accurate diagnosis and identifying target treatments. Although the number of biomarkers continues to grow, the relative utility and uniqueness of each is poorly understood as prior work has typically calculated serial pairwise relationships on only a handful of markers at a time. The present study assessed the cross-sectional relationships among 27 Alzheimer's disease biomarkers simultaneously and determined their ability to predict meaningful clinical outcomes using machine learning. Data were obtained from 527 community-dwelling volunteers enrolled in studies at the Charles F. and Joanne Knight Alzheimer Disease Research Center at Washington University in St Louis. We used hierarchical clustering to group 27 imaging, CSF and plasma measures of amyloid beta, tau [phosphorylated tau (p-tau), total tau t-tau)], neuronal injury and inflammation drawn from MRI, PET, mass-spectrometry assays and immunoassays. Neuropsychological and genetic measures were also included. Random forest-based feature selection identified the strongest predictors of amyloid PET positivity across the entire cohort. Models also predicted cognitive impairment across the entire cohort and in amyloid PET-positive individuals. Four clusters emerged reflecting: core Alzheimer's disease pathology (amyloid and tau), neurodegeneration, AT8 antibody-associated phosphorylated tau sites and neuronal dysfunction. In the entire cohort, CSF p-tau181/Aβ40lumi and Aβ42/Aβ40lumi and mass spectrometry measurements for CSF pT217/T217, pT111/T111, pT231/T231 were the strongest predictors of amyloid PET status. Given their ability to denote individuals on an Alzheimer's disease pathological trajectory, these same markers (CSF pT217/T217, pT111/T111, p-tau/Aβ40lumi and t-tau/Aβ40lumi) were largely the best predictors of worse cognition in the entire cohort. When restricting analyses to amyloid-positive individuals, the strongest predictors of impaired cognition were tau PET, CSF t-tau/Aβ40lumi, p-tau181/Aβ40lumi, CSF pT217/217 and pT205/T205. Non-specific CSF measures of neuronal dysfunction and inflammation were poor predictors of amyloid PET and cognitive status. The current work utilized machine learning to understand the interrelationship structure and utility of a large number of biomarkers. The results demonstrate that, although the number of biomarkers has rapidly expanded, many are interrelated and few strongly predict clinical outcomes. Examining the entire corpus of available biomarkers simultaneously provides a meaningful framework to understand Alzheimer's disease pathobiological change as well as insight into which biomarkers may be most useful in Alzheimer's disease clinical practice and trials.

Hybrid similarity relation based mutual information for feature selection in intuitionistic fuzzy rough framework and its applications

Fuzzy rough entropy established in the notion of fuzzy rough set theory, which has been effectively and efficiently applied for feature selection to handle the uncertainty in real-valued datasets. Further, Fuzzy rough mutual information has been presented by integrating information entropy with fuzzy rough set to measure the importance of features. However, none of the methods till date can handle noise, uncertainty and vagueness simultaneously due to both judgement and identification, which lead to degrade the overall performances of the learning algorithms with the increment in the number of mixed valued conditional features. In the current study, these issues are tackled by presenting a novel intuitionistic fuzzy (IF) assisted mutual information concept along with IF granular structure. Initially, a hybrid IF similarity relation is introduced. Based on this relation, an IF granular structure is introduced. Then, IF rough conditional and joint entropies are established. Further, mutual information based on these concepts are discussed. Next, mathematical theorems are proved to demonstrate the validity of the given notions. Thereafter, significance of the features subset is computed by using this mutual information, and corresponding feature selection is suggested to delete the irrelevant and redundant features. The current approach effectively handles noise and subsequent uncertainty in both nominal and mixed data (including both nominal and category variables). Moreover, comprehensive experimental performances are evaluated on real-valued benchmark datasets to demonstrate the practical validation and effectiveness of the addressed technique. Finally, an application of the proposed method is exhibited to improve the prediction of phospholipidosis positive molecules. RF(h2o) produces the most effective results till date based on our proposed methodology with sensitivity, accuracy, specificity, MCC, and AUC of 86.7%, 90.1%, 93.0% , 0.808, and 0.922 respectively.

scFSNN: a feature selection method based on neural network for single-cell RNA-seq data

While single-cell RNA sequencing (scRNA-seq) allows researchers to analyze gene expression in individual cells, its unique characteristics like over-dispersion, zero-inflation, high gene-gene correlation, and large data volume with many features pose challenges for most existing feature selection methods. In this paper, we present a feature selection method based on neural network (scFSNN) to solve classification problem for the scRNA-seq data. scFSNN is an embedded method that can automatically select features (genes) during model training, control the false discovery rate of selected features and adaptively determine the number of features to be eliminated. Extensive simulation and real data studies demonstrate its excellent feature selection ability and predictive performance.

Machine Learning Models for Predicting Sudden Sensorineural Hearing Loss Outcome: A Systematic Review

BACKGROUND

Machine Learning models have been applied in various healthcare fields, including Audiology, to predict disease outcomes. The prognosis of sudden sensorineural hearing loss is difficult to predict due to the variable course of the disease. Hence, researchers have attempted to utilize ML models to predict the outcome of patients with sudden sensorineural hearing loss. The objectives of this study were to review the performance of these machine learning models and assess their applicability in real-world settings.

METHODS

A systematic search was conducted in PubMed, Web of Science and Scopus. Only studies that built machine learning prediction models were included, and studies that used algorithms such as logistic regression only for the purpose of adjusting for confounding variables were excluded. The risk of bias was assessed using the Prediction model Risk of Bias Assessment Tool (PROBAST).

RESULTS

After screening, a total of 7 papers were eligible for synthesis. In total, these studies built 48 ML models. The most common utilized algorithms were Logistic Regression, Support Vector Machine (SVM) and boosting. The area under the curve of the receiver operating characteristic curve ranged between 0.59 and 0.915. All of the included studies had a high risk of bias; hence there are concerns regarding their applicability.

CONCLUSION

Although these models showed great performance and promising results, future studies are still needed before these models can be applied in a real-world setting. Future studies should employ multiple cohorts, different feature selection methods, and external validation to further validate the models' applicability.

Identification and Structural Characterization of Degradation Products of Linagliptin by Mass Spectrometry Techniques

As part of the development and production of pharmaceuticals, the purity of Active Pharmaceutical Ingredients stands as a fundamental parameter that significantly influences the quality, safety, and efficacy of the final drug product. Impurities in Active Pharmaceutical Ingredients are various unwanted substances that can appear during the whole manufacturing process, from raw materials to the final product. These impurities can stem from multiple sources, including starting materials, intermediates, reagents, solvents, and even degradation products resulting from exposure to environmental factors such as heat, light, or moisture. Their presence can potentially compromise the therapeutic effect of the drug, introduce unexpected side effects, or even pose safety risks to patients. This study aims to conduct the forced degradation of linagliptin and subsequently attempt to identify the resulting degradants. The degradation procedures were carried out in accordance with the guidelines of the International Committee for Harmonization. The degradation profile of linagliptin was investigated under various conditions, including acid hydrolysis, alkaline hydrolysis, oxidation, heat, and light exposure, utilizing ultra-performance liquid chromatography connected to a photo array detector. Identification and characterization of the degradation products were achieved using an ultra-performance liquid chromatography coupled with a single quadrupole detector mass spectrometer and also a liquid chromatography coupled with a high-resolution mass spectrometry. The identified degradation products demonstrate that linagliptin is particularly susceptible to degradation when exposed to acid and peroxide. Whereas, no significant degradation effects were observed under alkali, thermolytic, and photolytic conditions.

Machine Learning Enabled Photoacoustic Spectroscopy for Noninvasive Assessment of Breast Tumor Progression In Vivo: A Preclinical Study

Breast cancer is a dreaded disease affecting women the most in cancer-related deaths over other cancers. However, early diagnosis of the disease can help increase survival rates. The existing breast cancer diagnosis tools do not support the early diagnosis of the disease. Therefore, there is a great need to develop early diagnostic tools for this cancer. Photoacoustic spectroscopy (PAS), being very sensitive to biochemical changes, can be relied upon for its application in detecting breast tumors in vivo. With this motivation, in the current study, an aseptic chamber integrated photoacoustic (PA) probe was designed and developed to monitor breast tumor progression in vivo, established in nude mice. The device served the dual purpose of transporting tumor-bearing animals to the laboratory from the animal house and performing PA experiments in the same chamber, maintaining sterility. In the current study, breast tumor was induced in the nude mice by MCF-7 cells injection and the corresponding PA spectra at different time points (day 0, 5, 10, 15, and 20) of tumor progression in vivo in the same animals. The recorded photoacoustic spectra were subsequently preprocessed, wavelet-transformed, and subjected to filter-based feature selection algorithm. The selected top 20 features, by minimum redundancy maximum relevance (mRMR) algorithm, were then used to build an input feature matrix for machine learning (ML)-based classification of the data. The performance of classification models demonstrated 100% specificity, whereas the sensitivity of 95, 100, 92.5, and 85% for the time points, day 5, 10, 15, and 20, respectively. These results suggest the potential of PA signal-based classification of breast tumor progression in a preclinical model. The PA signal contains information on the biochemical changes associated with disease progression, emphasizing its translational strength toward early disease diagnosis.

A primer on the use of machine learning to distil knowledge from data in biological psychiatry

Applications of machine learning in the biomedical sciences are growing rapidly. This growth has been spurred by diverse cross-institutional and interdisciplinary collaborations, public availability of large datasets, an increase in the accessibility of analytic routines, and the availability of powerful computing resources. With this increased access and exposure to machine learning comes a responsibility for education and a deeper understanding of its bases and bounds, borne equally by data scientists seeking to ply their analytic wares in medical research and by biomedical scientists seeking to harness such methods to glean knowledge from data. This article provides an accessible and critical review of machine learning for a biomedically informed audience, as well as its applications in psychiatry. The review covers definitions and expositions of commonly used machine learning methods, and historical trends of their use in psychiatry. We also provide a set of standards, namely Guidelines for REporting Machine Learning Investigations in Neuropsychiatry (GREMLIN), for designing and reporting studies that use machine learning as a primary data-analysis approach. Lastly, we propose the establishment of the Machine Learning in Psychiatry (MLPsych) Consortium, enumerate its objectives, and identify areas of opportunity for future applications of machine learning in biological psychiatry. This review serves as a cautiously optimistic primer on machine learning for those on the precipice as they prepare to dive into the field, either as methodological practitioners or well-informed consumers.

Antibody selection strategies and their impact in predicting clinical malaria based on multi-sera data

BACKGROUND

Nowadays, the chance of discovering the best antibody candidates for predicting clinical malaria has notably increased due to the availability of multi-sera data. The analysis of these data is typically divided into a feature selection phase followed by a predictive one where several models are constructed for predicting the outcome of interest. A key question in the analysis is to determine which antibodies  should be included in the predictive stage and whether they should be included in the original or a transformed scale (i.e. binary/dichotomized).

METHODS

To answer this question, we developed three approaches for antibody selection in the context of predicting clinical malaria: (i) a basic and simple approach based on selecting antibodies via the nonparametric Mann-Whitney-Wilcoxon test; (ii) an optimal dychotomizationdichotomization approach where each antibody was selected according to the optimal cut-off via maximization of the chi-squared (χ2) statistic for two-way tables; (iii) a hybrid parametric/non-parametric approach that integrates Box-Cox transformation followed by a t-test, together with the use of finite mixture models and the Mann-Whitney-Wilcoxon test as a last resort. We illustrated the application of these three approaches with published serological data of 36 Plasmodium falciparum antigens for predicting clinical malaria in 121 Kenyan children. The predictive analysis was based on a Super Learner where predictions from multiple classifiers including the Random Forest were pooled together.

RESULTS

Our results led to almost similar areas under the Receiver Operating Characteristic curves of 0.72 (95% CI = [0.62, 0.82]), 0.80 (95% CI = [0.71, 0.89]), 0.79 (95% CI = [0.7, 0.88]) for the simple, dichotomization and hybrid approaches, respectively. These approaches were based on 6, 20, and 16 antibodies, respectively.

CONCLUSIONS

The three feature selection strategies provided a better predictive performance of the outcome when compared to the previous results relying on Random Forest including all the 36 antibodies (AUC = 0.68, 95% CI = [0.57;0.79]). Given the similar predictive performance, we recommended that the three strategies should be used in conjunction in the same data set and selected according to their complexity.

Optimizing DUS testing for Chimonanthus praecox using feature selection based on a genetic algorithm

Chimonanthus praecox is a famous traditional flower in China with high ornamental value. It has numerous varieties, yet its classification is highly disorganized. The distinctness, uniformity, and stability (DUS) test enables the classification and nomenclature of various species; thus, it can be used to classify the Chimonanthus varieties. In this study, flower traits were quantified using an automatic system based on pattern recognition instead of traditional manual measurement to improve the efficiency of DUS testing. A total of 42 features were quantified, including 28 features in the DUS guidelines and 14 new features proposed in this study. Eight algorithms were used to classify wintersweet, and the random forest (RF) algorithm performed the best when all features were used. The classification accuracy of the outer perianth was the highest when the features of the different parts were used for classification. A genetic algorithm was used as the feature selection algorithm to select a set of 22 reduced core features and improve the accuracy and efficiency of the classification. Using the core feature set, the classification accuracy of the RF model improved to 99.13%. Finally, K-means was used to construct a pedigree cluster tree of 23 varieties of wintersweet; evidently, wintersweet was clustered into a single class, which can be the basis for further study of genetic relationships among varieties. This study provides a novel method for DUS detection, variety identification, and pedigree analysis.

Robustness evaluations of pathway activity inference methods on gene expression data

BACKGROUND

With the exponential growth of high-throughput technologies, multiple pathway analysis methods have been proposed to estimate pathway activities from gene expression profiles. These pathway activity inference methods can be divided into two main categories: non-Topology-Based (non-TB) and Pathway Topology-Based (PTB) methods. Although some review and survey articles discussed the topic from different aspects, there is a lack of systematic assessment and comparisons on the robustness of these approaches.

RESULTS

Thus, this study presents comprehensive robustness evaluations of seven widely used pathway activity inference methods using six cancer datasets based on two assessments. The first assessment seeks to investigate the robustness of pathway activity in pathway activity inference methods, while the second assessment aims to assess the robustness of risk-active pathways and genes predicted by these methods. The mean reproducibility power and total number of identified informative pathways and genes were evaluated. Based on the first assessment, the mean reproducibility power of pathway activity inference methods generally decreased as the number of pathway selections increased. Entropy-based Directed Random Walk (e-DRW) distinctly outperformed other methods in exhibiting the greatest reproducibility power across all cancer datasets. On the other hand, the second assessment shows that no methods provide satisfactory results across datasets.

CONCLUSION

However, PTB methods generally appear to perform better in producing greater reproducibility power and identifying potential cancer markers compared to non-TB methods.

Systems approach for congruence and selection of cancer models towards precision medicine

Cancer models are instrumental as a substitute for human studies and to expedite basic, translational, and clinical cancer research. For a given cancer type, a wide selection of models, such as cell lines, patient-derived xenografts, organoids and genetically modified murine models, are often available to researchers. However, how to quantify their congruence to human tumors and to select the most appropriate cancer model is a largely unsolved issue. Here, we present Congruence Analysis and Selection of CAncer Models (CASCAM), a statistical and machine learning framework for authenticating and selecting the most representative cancer models in a pathway-specific manner using transcriptomic data. CASCAM provides harmonization between human tumor and cancer model omics data, systematic congruence quantification, and pathway-based topological visualization to determine the most appropriate cancer model selection. The systems approach is presented using invasive lobular breast carcinoma (ILC) subtype and suggesting CAMA1 followed by UACC3133 as the most representative cell lines for ILC research. Two additional case studies for triple negative breast cancer (TNBC) and patient-derived xenograft/organoid (PDX/PDO) are further investigated. CASCAM is generalizable to any cancer subtype and will authenticate cancer models for faithful non-human preclinical research towards precision medicine.