HY-POP: Hyperparameter optimization of machine learning models through parametric programming

TumorDetNet: A unified deep learning model for brain tumor detection and classification

Accurate diagnosis of the brain tumor type at an earlier stage is crucial for the treatment process and helps to save the lives of a large number of people worldwide. Because they are non-invasive and spare patients from having an unpleasant biopsy, magnetic resonance imaging (MRI) scans are frequently employed to identify tumors. The manual identification of tumors is difficult and requires considerable time due to the large number of three-dimensional images that an MRI scan of one patient's brain produces from various angles. Moreover, the variations in location, size, and shape of the brain tumor also make it challenging to detect and classify different types of tumors. Thus, computer-aided diagnostics (CAD) systems have been proposed for the detection of brain tumors. In this paper, we proposed a novel unified end-to-end deep learning model named TumorDetNet for brain tumor detection and classification. Our TumorDetNet framework employs 48 convolution layers with leaky ReLU (LReLU) and ReLU activation functions to compute the most distinctive deep feature maps. Moreover, average pooling and a dropout layer are also used to learn distinctive patterns and reduce overfitting. Finally, one fully connected and a softmax layer are employed to detect and classify the brain tumor into multiple types. We assessed the performance of our method on six standard Kaggle brain tumor MRI datasets for brain tumor detection and classification into (malignant and benign), and (glioma, pituitary, and meningioma). Our model successfully identified brain tumors with remarkable accuracy of 99.83%, classified benign and malignant brain tumors with an ideal accuracy of 100%, and meningiomas, pituitary, and gliomas tumors with an accuracy of 99.27%. These outcomes demonstrate the potency of the suggested methodology for the reliable identification and categorization of brain tumors.

Interpretable AI Explores Effective Components of CAD/CAM Resin Composites

High flexural strength of computer-aided manufacturing resin composite blocks (CAD/CAM RCBs) are required in clinical scenarios. However, the conventional in vitro approach of modifying materials’ composition by trial and error was not efficient to explore the effective components that contribute to the flexural strength. Machine learning (ML) is a powerful tool to achieve the above goals. Therefore, the aim of this study was to develop ML models to predict the flexural strength of CAD/CAM RCBs and explore the components that affect flexural strength as the first step. The composition of 12 commercially available products and flexural strength were collected from the manufacturers and literature. The initial data consisted of 16 attributes and 12 samples. Considering that the input data for each sample were recognized as a multidimensional vector, a fluctuation range of 0.1 was proposed for each vector and the number of samples was augmented to 120. Regression algorithms—that is, random forest (RF), extra trees, gradient boosting decision tree, light gradient boosting machine, and extreme gradient boosting—were used to develop 5 ML models to predict flexural strength. An exhaustive search and feature importance analysis were conducted to analyze the effective components that affected flexural strength. The R2 values for each model were 0.947, 0.997, 0.998, 0.983, and 0.927, respectively. The relative errors of all the algorithms were within 15%. Among the high predicted flexural strength group in the exhaustive search, urethane dimethacrylate was contained in all compositions. Filler content and triethylene glycol dimethacrylate were the top 2 features predicted by all models in the feature importance analysis. ZrSiO4 was the third important feature for all models, except the RF model. The ML models established in this study successfully predicted the flexural strength of CAD/CAM RCBs and identified the effective components that affected flexural strength based on the available data set.

Convolutional-Neural-Network-Based Handwritten Character Recognition: An Approach with Massive Multisource Data

Neural networks have made big strides in image classification. Convolutional neural networks (CNN) work successfully to run neural networks on direct images. Handwritten character recognition (HCR) is now a very powerful tool to detect traffic signals, translate language, and extract information from documents, etc. Although handwritten character recognition technology is in use in the industry, present accuracy is not outstanding, which compromises both performance and usability. Thus, the character recognition technologies in use are still not very reliable and need further improvement to be extensively deployed for serious and reliable tasks. On this account, characters of the English alphabet and digit recognition are performed by proposing a custom-tailored CNN model with two different datasets of handwritten images, i.e., Kaggle and MNIST, respectively, which are lightweight but achieve higher accuracies than state-of-the-art models. The best two models from the total of twelve designed are proposed by altering hyper-parameters to observe which models provide the best accuracy for which dataset. In addition, the classification reports (CRs) of these two proposed models are extensively investigated considering the performance matrices, such as precision, recall, specificity, and F1 score, which are obtained from the developed confusion matrix (CM). To simulate a practical scenario, the dataset is kept unbalanced and three more averages for the F measurement (micro, macro, and weighted) are calculated, which facilitates better understanding of the performances of the models. The highest accuracy of 99.642% is achieved for digit recognition, with the model using ‘RMSprop’, at a learning rate of 0.001, whereas the highest detection accuracy for alphabet recognition is 99.563%, which is obtained with the proposed model using ‘ADAM’ optimizer at a learning rate of 0.00001. The macro F1 and weighted F1 scores for the best two models are 0.998, 0.997:0.992, and 0.996, respectively, for digit and alphabet recognition.

Multiparametric Programming in Process Systems Engineering: Recent Developments and Path Forward

The inevitable presence of uncertain parameters in critical applications of process optimization can lead to undesirable or infeasible solutions. For this reason, optimization under parametric uncertainty was, and continues to be a core area of research within Process Systems Engineering. Multiparametric programming is a strategy that offers a holistic perspective for the solution of this class of mathematical programming problems. Specifically, multiparametric programming theory enables the derivation of the optimal solution as a function of the uncertain parameters, explicitly revealing the impact of uncertainty in optimal decision-making. By taking advantage of such a relationship, new breakthroughs in the solution of challenging formulations with uncertainty have been created. Apart from that, researchers have utilized multiparametric programming techniques to solve deterministic classes of problems, by treating specific elements of the optimization program as uncertain parameters. In the past years, there has been a significant number of publications in the literature involving multiparametric programming. The present review article covers recent theoretical, algorithmic, and application developments in multiparametric programming. Additionally, several areas for potential contributions in this field are discussed, highlighting the benefits of multiparametric programming in future research efforts.

Improved Handwritten Digit Recognition Using Convolutional Neural Networks (CNN)

Traditional systems of handwriting recognition have relied on handcrafted features and a large amount of prior knowledge. Training an Optical character recognition (OCR) system based on these prerequisites is a challenging task. Research in the handwriting recognition field is focused around deep learning techniques and has achieved breakthrough performance in the last few years. Still, the rapid growth in the amount of handwritten data and the availability of massive processing power demands improvement in recognition accuracy and deserves further investigation. Convolutional neural networks (CNNs) are very effective in perceiving the structure of handwritten characters/words in ways that help in automatic extraction of distinct features and make CNN the most suitable approach for solving handwriting recognition problems. Our aim in the proposed work is to explore the various design options like number of layers, stride size, receptive field, kernel size, padding and dilution for CNN-based handwritten digit recognition. In addition, we aim to evaluate various SGD optimization algorithms in improving the performance of handwritten digit recognition. A network's recognition accuracy increases by incorporating ensemble architecture. Here, our objective is to achieve comparable accuracy by using a pure CNN architecture without ensemble architecture, as ensemble architectures introduce increased computational cost and high testing complexity. Thus, a CNN architecture is proposed in order to achieve accuracy even better than that of ensemble architectures, along with reduced operational complexity and cost. Moreover, we also present an appropriate combination of learning parameters in designing a CNN that leads us to reach a new absolute record in classifying MNIST handwritten digits. We carried out extensive experiments and achieved a recognition accuracy of 99.87% for a MNIST dataset.