ReLU networks as surrogate models in mixed-integer linear programs

Embedding machine learning based toxicity models within radiotherapy treatment plan optimization

Objective.This study addresses radiation-induced toxicity (RIT) challenges in radiotherapy (RT) by developing a personalized treatment planning framework. It leverages patient-specific data and dosimetric information to create an optimization model that limits adverse side effects using constraints learned from historical data.Approach.The study uses the optimization with constraint learning (OCL) framework, incorporating patient-specific factors into the optimization process. It consists of three steps: optimizing the baseline treatment plan using population-wide dosimetric constraints; training a machine learning (ML) model to estimate the patient's RIT for the baseline plan; and adapting the treatment plan to minimize RIT using ML-learned patient-specific constraints. Various predictive models, including classification trees, ensembles of trees, and neural networks, are applied to predict the probability of grade 2+ radiation pneumonitis (RP2+) for non-small cell lung (NSCLC) cancer patients three months post-RT. The methodology is assessed with four high RP2+ risk NSCLC patients, with the goal of optimizing the dose distribution to constrain the RP2+ outcome below a pre-specified threshold. Conventional and OCL-enhanced plans are compared based on dosimetric parameters and predicted RP2+ risk. Sensitivity analysis on risk thresholds and data uncertainty is performed using a toy NSCLC case.Main results.Experiments show the methodology's capacity to directly incorporate all predictive models into RT treatment planning. In the four patients studied, mean lung dose and V20 were reduced by an average of 1.78 Gy and 3.66%, resulting in an average RP2+ risk reduction from 95% to 42%. Notably, this reduction maintains tumor coverage, although in two cases, sparing the lung slightly increased spinal cord max-dose (0.23 and 0.79 Gy).Significance.By integrating patient-specific information into learned constraints, the study significantly reduces adverse side effects like RP2+ without compromising target coverage. This unified framework bridges the gap between predicting toxicities and optimizing treatment plans in personalized RT decision-making.

Artificial intelligence-enabled 8-lead ECG detection of atrial septal defect among adults: a novel diagnostic tool

Background

Patients with atrial septal defect (ASD) exhibit distinctive electrocardiogram (ECG) patterns. However, ASD cannot be diagnosed solely based on these differences. Artificial intelligence (AI) has been widely used for specifically diagnosing cardiovascular diseases other than arrhythmia. Our study aimed to develop an artificial intelligence-enabled 8-lead ECG to detect ASD among adults.

Method

In this study, our AI model was trained and validated using 526 ECGs from patients with ASD and 2,124 ECGs from a control group with a normal cardiac structure in our hospital. External testing was conducted at Wuhan Central Hospital, involving 50 ECGs from the ASD group and 46 ECGs from the normal group. The model was based on a convolutional neural network (CNN) with a residual network to classify 8-lead ECG data into either the ASD or normal group. We employed a 10-fold cross-validation approach.

Results

Statistically significant differences (p < 0.05) were observed in the cited ECG features between the ASD and normal groups. Our AI model performed well in identifying ECGs in both the ASD group [accuracy of 0.97, precision of 0.90, recall of 0.97, specificity of 0.97, F1 score of 0.93, and area under the curve (AUC) of 0.99] and the normal group within the training and validation datasets from our hospital. Furthermore, these corresponding indices performed impressively in the external test data set with the accuracy of 0.82, precision of 0.90, recall of 0.74, specificity of 0.91, F1 score of 0.81 and the AUC of 0.87. And the series of experiments of subgroups to discuss specific clinic situations associated to this issue was remarkable as well.

Conclusion

An ECG-based detection of ASD using an artificial intelligence algorithm can be achieved with high diagnostic performance, and it shows great clinical promise. Our research on AI-enabled 8-lead ECG detection of ASD in adults is expected to provide robust references for early detection of ASD, healthy pregnancies, and related decision-making. A lower number of leads is also more favorable for the application of portable devices, which it is expected that this technology will bring significant economic and societal benefits.

Optimal training of integer-valued neural networks with mixed integer programming

Recent work has shown potential in using Mixed Integer Programming (MIP) solvers to optimize certain aspects of neural networks (NNs). However the intriguing approach of training NNs with MIP solvers is under-explored. State-of-the-art-methods to train NNs are typically gradient-based and require significant data, computation on GPUs, and extensive hyper-parameter tuning. In contrast, training with MIP solvers does not require GPUs or heavy hyper-parameter tuning, but currently cannot handle anything but small amounts of data. This article builds on recent advances that train binarized NNs using MIP solvers. We go beyond current work by formulating new MIP models which improve training efficiency and which can train the important class of integer-valued neural networks (INNs). We provide two novel methods to further the potential significance of using MIP to train NNs. The first method optimizes the number of neurons in the NN while training. This reduces the need for deciding on network architecture before training. The second method addresses the amount of training data which MIP can feasibly handle: we provide a batch training method that dramatically increases the amount of data that MIP solvers can use to train. We thus provide a promising step towards using much more data than before when training NNs using MIP models. Experimental results on two real-world data-limited datasets demonstrate that our approach strongly outperforms the previous state of the art in training NN with MIP, in terms of accuracy, training time and amount of data. Our methodology is proficient at training NNs when minimal training data is available, and at training with minimal memory requirements-which is potentially valuable for deploying to low-memory devices.

A Neural Network Based Superstructure Optimization Approach to Reverse Osmosis Desalination Plants

An ever-growing population together with globally depleting water resources pose immense stresses for water supply systems. Desalination technologies can reduce these stresses by generating fresh water from saline water sources. Reverse osmosis (RO), as the industry leading desalination technology, typically involves a complex network of membrane modules that separate unwanted particles from water. The optimal design and operation of these complex RO systems can be computationally expensive. In this work, we present a modeling and optimization strategy for addressing the optimal operation of an industrial-scale RO plant. We employ a feed-forward artificial neural network (ANN) surrogate modeling representation with rectified linear units as activation functions to capture the membrane behavior accurately. Several ANN set-ups and surrogate models are presented and evaluated, based on collected data from the H2Oaks RO desalination plant in South-Central Texas. The developed ANN is then transformed into a mixed-integer linear programming formulation for the purpose of minimizing energy consumption while maximizing water utilization. Trade-offs between the two competing objectives are visualized in a Pareto front, where indirect savings can be uncovered by comparing energy consumption for an array of water recoveries and feed flows.

A Machine Learning Approach as a Surrogate for a Finite Element Analysis: Status of Research and Application to One Dimensional Systems

Current maintenance intervals of mechanical systems are scheduled a priori based on the life of the system, resulting in expensive maintenance scheduling, and often undermining the safety of passengers. Going forward, the actual usage of a vehicle will be used to predict stresses in its structure, and therefore, to define a specific maintenance scheduling. Machine learning (ML) algorithms can be used to map a reduced set of data coming from real-time measurements of a structure into a detailed/high-fidelity finite element analysis (FEA) model of the same system. As a result, the FEA-based ML approach will directly estimate the stress distribution over the entire system during operations, thus improving the ability to define ad-hoc, safe, and efficient maintenance procedures. The paper initially presents a review of the current state-of-the-art of ML methods applied to finite elements. A surrogate finite element approach based on ML algorithms is also proposed to estimate the time-varying response of a one-dimensional beam. Several ML regression models, such as decision trees and artificial neural networks, have been developed, and their performance is compared for direct estimation of the stress distribution over a beam structure. The surrogate finite element models based on ML algorithms are able to estimate the response of the beam accurately, with artificial neural networks providing more accurate results.

Multiparametric Programming in Process Systems Engineering: Recent Developments and Path Forward

The inevitable presence of uncertain parameters in critical applications of process optimization can lead to undesirable or infeasible solutions. For this reason, optimization under parametric uncertainty was, and continues to be a core area of research within Process Systems Engineering. Multiparametric programming is a strategy that offers a holistic perspective for the solution of this class of mathematical programming problems. Specifically, multiparametric programming theory enables the derivation of the optimal solution as a function of the uncertain parameters, explicitly revealing the impact of uncertainty in optimal decision-making. By taking advantage of such a relationship, new breakthroughs in the solution of challenging formulations with uncertainty have been created. Apart from that, researchers have utilized multiparametric programming techniques to solve deterministic classes of problems, by treating specific elements of the optimization program as uncertain parameters. In the past years, there has been a significant number of publications in the literature involving multiparametric programming. The present review article covers recent theoretical, algorithmic, and application developments in multiparametric programming. Additionally, several areas for potential contributions in this field are discussed, highlighting the benefits of multiparametric programming in future research efforts.

Electric Field Evaluation Using the Finite Element Method and Proxy Models for the Design of Stator Slots in a Permanent Magnet Synchronous Motor

The efficiency of electric motors is being improved every day and projects with design variations can improve their performance. Among electric motors, the Permanent Magnet Synchronous Machine (PMSM) is being increasingly used, because of its growing use in electric vehicles. Simulating design variations using the Finite Element Method (FEM) can improve PMSM design, and by optimizing the parameters based on the FEM, even better results can be achieved. The design of the PMSM stator slots must be evaluated, as conductors are accommodated and an electrical potential is applied at this location. The FEM parameters are varied, and the results can be used to build an approximate model, known as a proxy model. The proxy model can then be used in a mathematical programming problem to optimize the design of stators that have less electric field in certain regions, thus reducing the chance of developing a failure. The results of the proposed methodology show that its application is promising for machine design and can also be used for the design of other systems.

Analyzing Malaria Disease Using Effective Deep Learning Approach

Medical tools used to bolster decision-making by medical specialists who offer malaria treatment include image processing equipment and a computer-aided diagnostic system. Malaria images can be employed to identify and detect malaria using these methods, in order to monitor the symptoms of malaria patients, although there may be atypical cases that need more time for an assessment. This research used 7000 images of Xception, Inception-V3, ResNet-50, NasNetMobile, VGG-16 and AlexNet models for verification and analysis. These are prevalent models that classify the image precision and use a rotational method to improve the performance of validation and the training dataset with convolutional neural network models. Xception, using the state of the art activation function (Mish) and optimizer (Nadam), improved the effectiveness, as found by the outcomes of the convolutional neural model evaluation of these models for classifying the malaria disease from thin blood smear images. In terms of the performance, recall, accuracy, precision, and F1 measure, a combined score of 99.28% was achieved. Consequently, 10% of all non-dataset training and testing images were evaluated utilizing this pattern. Notable aspects for the improvement of a computer-aided diagnostic to produce an optimum malaria detection approach have been found, supported by a 98.86% accuracy level.

Analyzing Lung Disease Using Highly Effective Deep Learning Techniques

Image processing technologies and computer-aided diagnosis are medical technologies used to support decision-making processes of radiologists and medical professionals who provide treatment for lung disease. These methods involve using chest X-ray images to diagnose and detect lung lesions, but sometimes there are abnormal cases that take some time to occur. This experiment used 5810 images for training and validation with the MobileNet, Densenet-121 and Resnet-50 models, which are popular networks used to classify the accuracy of images, and utilized a rotational technique to adjust the lung disease dataset to support learning with these convolutional neural network models. The results of the convolutional neural network model evaluation showed that Densenet-121, with a state-of-the-art Mish activation function and Nadam-optimized performance. All the rates for accuracy, recall, precision and F1 measures totaled 98.88%. We then used this model to test 10% of the total images from the non-dataset training and validation. The accuracy rate was 98.97% for the result which provided significant components for the development of a computer-aided diagnosis system to yield the best performance for the detection of lung lesions.

A Critical Review of the Modeling and Optimization of Combined Heat and Power Dispatch

Combined heat and power (CHP) systems are attracting increasing attention for their ability to improve the economics and sustainability of the electricity system. Determining how to best operate these systems is difficult because they can consist of many generating units whose operation is governed by complex nonlinear physics. Mathematical programming is a useful tool to support the operation of CHP systems, and has been the subject of substantial research attention since the early 1990s. This paper critically reviews the modeling and optimization work that has been done on the CHP economic dispatch problem, and the CHP economic and emission dispatch problem. A summary of the common models used for these problems is provided, along with comments on future modeling work that would beneficial to the field. The majority of optimization approaches studied for CHP system operation are metaheuristic algorithms. A discussion of the limitations and benefits of metaheuristic algorithms is given. Finally, a case study optimizing five classic CHP system test instances demonstrates the advantages of the using deterministic global search algorithms over metaheuristic search algorithms.