Common statistical concepts in the supervised Machine Learning arena

Laboratory Preparation for Digital Medicine in Healthcare 4.0: An Investigation Into the Awareness and Applications of Big Data and Artificial Intelligence

Background

Healthcare 4.0. refers to the integration of advanced technologies, such as artificial intelligence (AI) and big data analysis, into the healthcare sector. Recognizing the impact of Healthcare 4.0 technologies in laboratory medicine (LM), we seek to assess the overall awareness and implementation of Healthcare 4.0 among members of the Korean Society for Laboratory Medicine (KSLM).

Methods

A web-based survey was conducted using an anonymous questionnaire. The survey comprised 36 questions covering demographic information (seven questions), big data (10 questions), and AI (19 questions).

Results

In total, 182 (17.9%) of 1,017 KSLM members participated in the survey. Thirty-two percent of respondents considered AI to be the most important technology in LM in the era of Healthcare 4.0, closely followed by 31% who favored big data. Approximately 80% of respondents were familiar with big data but had not conducted research using it, and 71% were willing to participate in future big data research conducted by the KSLM. Respondents viewed AI as the most valuable tool in molecular genetics within various divisions. More than half of the respondents were open to the notion of using AI as assistance rather than a complete replacement for their roles.

Conclusions

This survey highlighted KSLM members' awareness of the potential applications and implications of big data and AI. We emphasize the complexity of AI integration in healthcare, citing technical and ethical challenges leading to diverse opinions on its impact on employment and training. This highlights the need for a holistic approach to adopting new technologies.

Venous thromboembolism in the era of machine learning and artificial intelligence in medicine

In this review, we embark on a comprehensive exploration of venous thromboembolism (VTE) in the context of medical history and its current practice within medicine. We delve into the landscape of artificial intelligence (AI), exploring its present utility and envisioning its transformative roles within VTE management, from prevention to screening and beyond. Central to our discourse is a forward-looking perspective on the integration of AI within VTE in medicine, advocating for rigorous study design, robust validation processes, and meticulous statistical analysis to gauge the efficacy of AI applications. We further illuminate the potential of large language models and generative AI in revolutionizing VTE care, while acknowledging their inherent limitations and proposing innovative solutions to overcome challenges related to data availability and integrity, including the strategic use of synthetic data. The critical importance of navigating ethical, legal, and privacy concerns associated with AI is underscored, alongside the imperative for comprehensive governance and policy frameworks to regulate its deployment in VTE treatment. We conclude on a note of cautious optimism, where we highlight the significance of proactively addressing the myriad challenges that accompany the advent of AI in healthcare. Through diligent design, stringent validation, extensive education, and prudent regulation, we can harness AI's potential to significantly enhance our understanding and management of VTE. As we stand on the cusp of a new era, our commitment to these principles will be instrumental in ensuring that the promise of AI is fully realized within the realm of VTE care.

Intelligent salivary biosensors for periodontitis: in vitro simulation of oral oxidative stress conditions

ASTRACT

One of the most common oral diseases affecting millions of people worldwide is periodontitis. Usually, proteins in body fluids are used as biomarkers of diseases. This study focused on hydrogen peroxide, lipopolysaccharide (LPS), and lactic acid as salivary non-protein biomarkers for oxidative stress conditions of periodontitis. Electrochemical analysis of artificial saliva was done using Gamry with increasing hydrogen peroxide, bLPS, and lactic acid concentrations. Electrochemical impedance spectroscopy (EIS) and cyclic voltammetry (CV) were conducted. From EIS data, change in capacitance and CV plot area were calculated for each test condition. Hydrogen peroxide groups had a decrease in CV area and an increase in percentage change in capacitance, lipopolysaccharide groups had a decrease in CV area and a decrease in percentage change in capacitance, and lactic acid groups had an increase of CV area and an increase in percentage change in capacitance with increasing concentrations. These data showed a unique combination of electrochemical properties for the three biomarkers. Scanning electron microscopy (SEM) with energy dispersive spectroscopy (EDS) employed to observe the change in the electrode surface and elemental composition data present on the sensor surface also showed a unique trend of elemental weight percentages. Machine learning models using hydrogen peroxide, LPS, and lactic acid electrochemical data were applied for the prediction of risk levels of periodontitis. The detection of hydrogen peroxide, LPS, and lactic acid by electrochemical biosensors indicates the potential to use these molecules as electrochemical biomarkers and use the data for ML-driven prediction tool for the periodontitis risk levels.

Artificial intelligence in the clinical laboratory

Laboratory medicine has become a highly automated medical discipline. Nowadays, artificial intelligence (AI) applied to laboratory medicine is also gaining more and more attention, which can optimize the entire laboratory workflow and even revolutionize laboratory medicine in the future. However, only a few commercially available AI models are currently approved for use in clinical laboratories and have drawbacks such as high cost, lack of accuracy, and the need for manual review of model results. Furthermore, there are a limited number of literature reviews that comprehensively address the research status, challenges, and future opportunities of AI applications in laboratory medicine. Our article begins with a brief introduction to AI and some of its subsets, then reviews some AI models that are currently being used in clinical laboratories or that have been described in emerging studies, and explains the existing challenges associated with their application and possible solutions, finally provides insights into the future opportunities of the field. We highlight the current status of implementation and potential applications of AI models in different stages of the clinical testing process.

An Ensemble Classifiers for Improved Prediction of Native-Non-Native Protein-Protein Interaction

In this study, we present an innovative approach to improve the prediction of protein-protein interactions (PPIs) through the utilization of an ensemble classifier, specifically focusing on distinguishing between native and non-native interactions. Leveraging the strengths of various base models, including random forest, gradient boosting, extreme gradient boosting, and light gradient boosting, our ensemble classifier integrates these diverse predictions using a logistic regression meta-classifier. Our model was evaluated using a comprehensive dataset generated from molecular dynamics simulations. While the gains in AUC and other metrics might seem modest, they contribute to a model that is more robust, consistent, and adaptable. To assess the effectiveness of various approaches, we compared the performance of logistic regression to four baseline models. Our results indicate that logistic regression consistently underperforms across all evaluated metrics. This suggests that it may not be well-suited to capture the complex relationships within this dataset. Tree-based models, on the other hand, appear to be more effective for problems involving molecular dynamics simulations. Extreme gradient boosting (XGBoost) and light gradient boosting (LightGBM) are optimized for performance and speed, handling datasets effectively and incorporating regularizations to avoid over-fitting. Our findings indicate that the ensemble method enhances the predictive capability of PPIs, offering a promising tool for computational biology and drug discovery by accurately identifying potential interaction sites and facilitating the understanding of complex protein functions within biological systems.

The ChatGPT conundrum: Human-generated scientific manuscripts misidentified as AI creations by AI text detection tool

AI Chat Bots such as ChatGPT are revolutionizing our AI capabilities, especially in text generation, to help expedite many tasks, but they introduce new dilemmas. The detection of AI-generated text has become a subject of great debate considering the AI text detector's known and unexpected limitations. Thus far, much research in this area has focused on the detection of AI-generated text; however, the goal of this study was to evaluate the opposite scenario, an AI-text detection tool's ability to discriminate human-generated text. Thousands of abstracts from several of the most well-known scientific journals were used to test the predictive capabilities of these detection tools, assessing abstracts from 1980 to 2023. We found that the AI text detector erroneously identified up to 8% of the known real abstracts as AI-generated text. This further highlights the current limitations of such detection tools and argues for novel detectors or combined approaches that can address this shortcoming and minimize its unanticipated consequences as we navigate this new AI landscape.

Image Reconstruction Using Supervised Learning in Wearable Electrical Impedance Tomography of the Thorax

Electrical impedance tomography (EIT) is a non-invasive technique for visualizing the internal structure of a human body. Capacitively coupled electrical impedance tomography (CCEIT) is a new contactless EIT technique that can potentially be used as a wearable device. Recent studies have shown that a machine learning-based approach is very promising for EIT image reconstruction. Most of the studies concern models containing up to 22 electrodes and focus on using different artificial neural network models, from simple shallow networks to complex convolutional networks. However, the use of convolutional networks in image reconstruction with a higher number of electrodes requires further investigation. In this work, two different architectures of artificial networks were used for CCEIT image reconstruction: a fully connected deep neural network and a conditional generative adversarial network (cGAN). The training dataset was generated by the numerical simulation of a thorax phantom with healthy and illness-affected lungs. Three kinds of illnesses, pneumothorax, pleural effusion, and hydropneumothorax, were modeled using the electrical properties of the tissues. The thorax phantom included the heart, aorta, spine, and lungs. The sensor with 32 area electrodes was used in the numerical model. The ECTsim custom-designed toolbox for Matlab was used to solve the forward problem and measurement simulation. Two artificial neural networks were trained with supervision for image reconstruction. Reconstruction quality was compared between those networks and one-step algebraic reconstruction methods such as linear back projection and pseudoinverse with Tikhonov regularization. This evaluation was based on pixel-to-pixel metrics such as root-mean-square error, structural similarity index, 2D correlation coefficient, and peak signal-to-noise ratio. Additionally, the diagnostic value measured by the ROC AUC metric was used to assess the image quality. The results showed that obtaining information about regional lung function (regions affected by pneumothorax or pleural effusion) is possible using image reconstruction based on supervised learning and deep neural networks in EIT. The results obtained using cGAN are strongly better than those obtained using a fully connected network, especially in the case of noisy measurement data. However, diagnostic value estimation showed that even algebraic methods allow us to obtain satisfactory results.

A machine learning approach to predict cellular uptake of pBAE polyplexes

The delivery of genetic material (DNA and RNA) to cells can cure a wide range of diseases but is limited by the delivery efficiency of the carrier system. Poly β-amino esters (pBAEs) are promising polymer-based vectors that form polyplexes with negatively charged oligonucleotides, enabling cell membrane uptake and gene delivery. pBAE backbone polymer chemistry, as well as terminal oligopeptide modifications, define cellular uptake and transfection efficiency in a given cell line, along with nanoparticle size and polydispersity. Moreover, uptake and transfection efficiency of a given polyplex formulation also vary from cell type to cell type. Therefore, finding the optimal formulation leading to high uptake in a new cell line is dictated by trial and error, and requires time and resources. Machine learning (ML) is an ideal in silico screening tool to learn the non-linearities of complex data sets, like the one presented herein, with the aim of predicting cellular internalisation of pBAE polyplexes. A library of pBAE nanoparticles was fabricated and the uptake studied in 4 different cell lines, on which various ML models were successfully trained. The best performing models were found to be gradient-boosted trees and neural networks. The gradient-boosted trees model was then analysed using SHapley Additive exPlanations, to interpret the model and gain an understanding into the important features and their impact on the predicted outcome.

A microfluidic approach for label-free identification of small-sized microplastics in seawater

Marine microplastics are emerging as a growing environmental concern due to their potential harm to marine biota. The substantial variations in their physical and chemical properties pose a significant challenge when it comes to sampling and characterizing small-sized microplastics. In this study, we introduce a novel microfluidic approach that simplifies the trapping and identification process of microplastics in surface seawater, eliminating the need for labeling. We examine various models, including support vector machine, random forest, convolutional neural network (CNN), and residual neural network (ResNet34), to assess their performance in identifying 11 common plastics. Our findings reveal that the CNN method outperforms the other models, achieving an impressive accuracy of 93% and a mean area under the curve of 98 ± 0.02%. Furthermore, we demonstrate that miniaturized devices can effectively trap and identify microplastics smaller than 50 µm. Overall, this proposed approach facilitates efficient sampling and identification of small-sized microplastics, potentially contributing to crucial long-term monitoring and treatment efforts.

Artificial intelligence and machine learning overview in pathology & laboratory medicine: A general review of data preprocessing and basic supervised concepts

Machine learning (ML) is becoming an integral aspect of several domains in medicine. Yet, most pathologists and laboratory professionals remain unfamiliar with such tools and are unprepared for their inevitable integration. To bridge this knowledge gap, we present an overview of key elements within this emerging data science discipline. First, we will cover general, well-established concepts within ML, such as data type concepts, data preprocessing methods, and ML study design. We will describe common supervised and unsupervised learning algorithms and their associated common machine learning terms (provided within a comprehensive glossary of terms that are discussed within this review). Overall, this review will offer a broad overview of the key concepts and algorithms in machine learning, with a focus on pathology and laboratory medicine. The objective is to provide an updated useful reference for those new to this field or those who require a refresher.

MLcps: machine learning cumulative performance score for classification problems

BACKGROUND

Assessing the performance of machine learning (ML) models requires careful consideration of the evaluation metrics used. It is often necessary to utilize multiple metrics to gain a comprehensive understanding of a trained model's performance, as each metric focuses on a specific aspect. However, comparing the scores of these individual metrics for each model to determine the best-performing model can be time-consuming and susceptible to subjective user preferences, potentially introducing bias.

RESULTS

We propose the Machine Learning Cumulative Performance Score (MLcps), a novel evaluation metric for classification problems. MLcps integrates several precomputed evaluation metrics into a unified score, enabling a comprehensive assessment of the trained model's strengths and weaknesses. We tested MLcps on 4 publicly available datasets, and the results demonstrate that MLcps provides a holistic evaluation of the model's robustness, ensuring a thorough understanding of its overall performance.

CONCLUSIONS

By utilizing MLcps, researchers and practitioners no longer need to individually examine and compare multiple metrics to identify the best-performing models. Instead, they can rely on a single MLcps value to assess the overall performance of their ML models. This streamlined evaluation process saves valuable time and effort, enhancing the efficiency of model evaluation. MLcps is available as a Python package at https://pypi.org/project/MLcps/.