Breast Cancer Detection Using Infrared Thermal Imaging and a Deep Learning Model

MOB-CBAM: A dual-channel attention-based deep learning generalizable model for breast cancer molecular subtypes prediction using mammograms

BACKGROUND AND OBJECTIVE

Deep Learning models have emerged as a significant tool in generating efficient solutions for complex problems including cancer detection, as they can analyze large amounts of data with high efficiency and performance. Recent medical studies highlight the significance of molecular subtype detection in breast cancer, aiding the development of personalized treatment plans as different subtypes of cancer respond better to different therapies.

METHODS

In this work, we propose a novel lightweight dual-channel attention-based deep learning model MOB-CBAM that utilizes the backbone of MobileNet-V3 architecture with a Convolutional Block Attention Module to make highly accurate and precise predictions about breast cancer. We used the CMMD mammogram dataset to evaluate the proposed model in our study. Nine distinct data subsets were created from the original dataset to perform coarse and fine-grained predictions, enabling it to identify masses, calcifications, benign, malignant tumors and molecular subtypes of cancer, including Luminal A, Luminal B, HER-2 Positive, and Triple Negative. The pipeline incorporates several image pre-processing techniques, including filtering, enhancement, and normalization, for enhancing the model's generalization ability.

RESULTS

While identifying benign versus malignant tumors, i.e., coarse-grained classification, the MOB-CBAM model produced exceptional results with 99 % accuracy, precision, recall, and F1-score values of 0.99 and MCC of 0.98. In terms of fine-grained classification, the MOB-CBAM model has proven to be highly efficient in accurately identifying mass with (benign/malignant) and calcification with (benign/malignant) classification tasks with an impressive accuracy rate of 98 %. We have also cross-validated the efficiency of the proposed MOB-CBAM deep learning architecture on two datasets: MIAS and CBIS-DDSM. On the MIAS dataset, an accuracy of 97 % was reported for the task of classifying benign, malignant, and normal images, while on the CBIS-DDSM dataset, an accuracy of 98 % was achieved for the classification of mass with either benign or malignant, and calcification with benign and malignant tumors.

CONCLUSION

This study presents lightweight MOB-CBAM, a novel deep learning framework, to address breast cancer diagnosis and subtype prediction. The model's innovative incorporation of the CBAM enhances precise predictions. The extensive evaluation of the CMMD dataset and cross-validation on other datasets affirm the model's efficacy.

Deep Learning in Breast Cancer Imaging: State of the Art and Recent Advancements in Early 2024

The rapid advancement of artificial intelligence (AI) has significantly impacted various aspects of healthcare, particularly in the medical imaging field. This review focuses on recent developments in the application of deep learning (DL) techniques to breast cancer imaging. DL models, a subset of AI algorithms inspired by human brain architecture, have demonstrated remarkable success in analyzing complex medical images, enhancing diagnostic precision, and streamlining workflows. DL models have been applied to breast cancer diagnosis via mammography, ultrasonography, and magnetic resonance imaging. Furthermore, DL-based radiomic approaches may play a role in breast cancer risk assessment, prognosis prediction, and therapeutic response monitoring. Nevertheless, several challenges have limited the widespread adoption of AI techniques in clinical practice, emphasizing the importance of rigorous validation, interpretability, and technical considerations when implementing DL solutions. By examining fundamental concepts in DL techniques applied to medical imaging and synthesizing the latest advancements and trends, this narrative review aims to provide valuable and up-to-date insights for radiologists seeking to harness the power of AI in breast cancer care.

Use of artificial intelligence in breast surgery: a narrative review

Background and Objective

We have witnessed tremendous advances in artificial intelligence (AI) technologies. Breast surgery, a subspecialty of general surgery, has notably benefited from AI technologies. This review aims to evaluate how AI has been integrated into breast surgery practices, to assess its effectiveness in improving surgical outcomes and operational efficiency, and to identify potential areas for future research and application.

Methods

Two authors independently conducted a comprehensive search of PubMed, Google Scholar, EMBASE, and Cochrane CENTRAL databases from January 1, 1950, to September 4, 2023, employing keywords pertinent to AI in conjunction with breast surgery or cancer. The search focused on English language publications, where relevance was determined through meticulous screening of titles, abstracts, and full-texts, followed by an additional review of references within these articles. The review covered a range of studies illustrating the applications of AI in breast surgery encompassing lesion diagnosis to postoperative follow-up. Publications focusing specifically on breast reconstruction were excluded.

Key Content and Findings

AI models have preoperative, intraoperative, and postoperative applications in the field of breast surgery. Using breast imaging scans and patient data, AI models have been designed to predict the risk of breast cancer and determine the need for breast cancer surgery. In addition, using breast imaging scans and histopathological slides, models were used for detecting, classifying, segmenting, grading, and staging breast tumors. Preoperative applications included patient education and the display of expected aesthetic outcomes. Models were also designed to provide intraoperative assistance for precise tumor resection and margin status assessment. As well, AI was used to predict postoperative complications, survival, and cancer recurrence.

Conclusions

Extra research is required to move AI models from the experimental stage to actual implementation in healthcare. With the rapid evolution of AI, further applications are expected in the coming years including direct performance of breast surgery. Breast surgeons should be updated with the advances in AI applications in breast surgery to provide the best care for their patients.

Automated marker-free longitudinal infrared breast image registration by GA-PSO

The automated marker-free longitudinal Infrared (IR) breast image registration overcomes several challenges like no anatomic fiducial markers on the body surface, blurry boundaries, heat pattern variation by environmental and physiological factors, nonrigid deformation, etc, has the ability of quantitative pixel-wise analysis with the heat energy and patterns change in a time course study. To achieve the goal, scale-invariant feature transform, Harris corner, and Hessian matrix were employed to generate the feature points as anatomic fiducial markers, and hybrid genetic algorithm and particle swarm optimization minimizing the matching errors was used to find the appropriate corresponding pairs between the 1st IR image and thenth IR image. Moreover, the mechanism of the IR spectrogram hardware system has a high level of reproducibility. The performance of the proposed longitudinal image registration system was evaluated by the simulated experiments and the clinical trial. In the simulated experiments, the mean difference of our system is 1.64 mm, which increases 57.58% accuracy than manual determination and makes a 17.4% improvement than the previous study. In the clinical trial, 80 patients were captured several times of IR breast images during chemotherapy. Most of them were well aligned in the spatiotemporal domain. In the few cases with evident heat pattern dissipation and spatial deviation, it still provided a reliable comparison of vascular variation. Therefore, the proposed system is accurate and robust, which could be considered as a reliable tool for longitudinal approaches to breast cancer diagnosis.

Thermal profile classification of the back of sportive and sedentary healthy individuals

BACKGROUND

Infrared thermography (IRT) is a non-harmful, risk-free imaging technique and it has application for healthy and pathological population.

OBJECTIVE

The aim of this study is to evaluate the thermographic profiles of the back of sport practitioners from different disciplines and compare it with those of sedentary healthy individuals.

METHOD

The back of 160 healthy subjects were evaluated, and participants were grouped considering their sport practice: team sport (TS), individual sport (IS), weight training (WT), inactive (I). Three regions of interest were identified to analyze the cervical, thoracic and lumbar temperatures of the back.

RESULTS

The Multivariate analysis of variance (MANOVA) resulted significant showing statistical differences for the cervical (p < 0.001), dorsal (p = 0.0011), and lumbar areas (p = 0.0366). The Tukey post-hoc test for pairwise comparison showed statistically significant differences between groups. For the cervical area significance was found between the IN and WT group (p = 0.002), the IN and IS group (p < 0.001), IN and TS group (p = 0.020). The dorsal area resulted significant between the IN and WT group (p = 0.007), the IN and IS group (p < 0.001), IN and TS group. The lumbar area showed significant differences only between the IN and WT group and the IN and IS group (p = 0.043).

CONCLUSION

This study demonstrated that inactive individuals manifest a statistically significant higher temperature in the cervical, dorsal and lumbar area of the back compared to sportive individuals.

Cancer detection in breast cells using a hybrid method based on deep complex neural network and data mining

INTRODUCTION

Diagnosis of cancer in breast cells is an important and vital issue in the field of medicine. In this context, the use of advanced methods such as deep complex neural networks and data mining can significantly improve the accuracy and speed of diagnosis. A hybrid approach that can be effective in breast cancer diagnosis is the use of deep complex neural networks and data mining. Due to their powerful nonlinear capabilities in extracting complex features from data, deep neural networks have a very good ability to detect patterns related to cancer. By analyzing millions of data related to breast cells and recognizing common and unusual patterns in them, these networks are able to diagnose cancer with high accuracy. Also, the use of data mining method plays an important role in this process.

METHODOLOGY

Using data mining algorithms and techniques, useful information can be extracted from the available data and the characteristics of healthy and cancerous cells can be separated. This information can be given as input to the deep neural network to achieve more accurate diagnosis. Another method to diagnose breast cancer is the use of thermography, which we use in this research along with data mining and deep learning.

RESULTS

Thermography uses an infrared camera to record the temperature of the target area. This method of breast cancer imaging is less expensive and completely safe compared to other methods. A total of 187 volunteers including 152 healthy people and 35 cancer patients were evaluated. Each person had ten thermographic images, resulting in a total of 1870 thermographic images. Four alternative deep complex neural network models, namely ResNet18, ResNet50, VGG19, and Xception, were used to identify thermal images, including benign and malignant images.

CONCULSION

The evaluation results showed that the use of a combined method based on deep complex neural network and data mining in the diagnosis of cancer in breast cells can bring a significant improvement in the accuracy and speed of diagnosis of this important disease.

Best Practices for Body Temperature Measurement with Infrared Thermography: External Factors Affecting Accuracy

Infrared thermographs (IRTs) are commonly used during disease pandemics to screen individuals with elevated body temperature (EBT). To address the limited research on external factors affecting IRT accuracy, we conducted benchtop measurements and computer simulations with two IRTs, with or without an external temperature reference source (ETRS) for temperature compensation. The combination of an IRT and an ETRS forms a screening thermograph (ST). We investigated the effects of viewing angle (θ, 0-75°), ETRS set temperature (TETRS, 30-40 °C), ambient temperature (Tatm, 18-32 °C), relative humidity (RH, 15-80%), and working distance (d, 0.4-2.8 m). We discovered that STs exhibited higher accuracy compared to IRTs alone. Across the tested ranges of Tatm and RH, both IRTs exhibited absolute measurement errors of less than 0.97 °C, while both STs maintained absolute measurement errors of less than 0.12 °C. The optimal TETRS for EBT detection was 36-37 °C. When θ was below 30°, the two STs underestimated calibration source (CS) temperature (TCS) of less than 0.05 °C. The computer simulations showed absolute temperature differences of up to 0.28 °C and 0.04 °C between estimated and theoretical temperatures for IRTs and STs, respectively, considering d of 0.2-3.0 m, Tatm of 15-35 °C, and RH of 5-95%. The results highlight the importance of precise calibration and environmental control for reliable temperature readings and suggest proper ranges for these factors, aiming to enhance current standard documents and best practice guidelines. These insights enhance our understanding of IRT performance and their sensitivity to various factors, thereby facilitating the development of best practices for accurate EBT measurement.

Smart IoT in Breast Cancer Detection Using Optimal Deep Learning

IoT in healthcare systems is currently a viable option for providing higher-quality medical care for contemporary e-healthcare. Using an Internet of Things (IoT)-based smart healthcare system, a trustworthy breast cancer classification method called Feedback Artificial Crow Search (FACS)-based Shepherd Convolutional Neural Network (ShCNN) is developed in this research. To choose the best routes, the secure routing operation is first carried out using the recommended FACS while taking fitness measures such as distance, energy, link quality, and latency into account. Then, by merging the Crow Search Algorithm (CSA) and Feedback Artificial Tree, the produced FACS is put into practice (FAT). After the completion of routing phase, the breast cancer categorization process is started at the base station. The feature extraction step is then introduced to the pre-processed input mammography image. As a result, it is possible to successfully get features including area, mean, variance, energy, contrast, correlation, skewness, homogeneity, Gray Level Co-occurrence Matrix (GLCM), and Local Gabor Binary Pattern (LGBP). The quality of the image is next enhanced through data augmentation, and finally, the developed FACS algorithm's ShCNN is used to classify breast cancer. The performance of FACS-based ShCNN is examined using six metrics, including energy, delay, accuracy, sensitivity, specificity, and True Positive Rate (TPR), with the maximum energy of 0.562 J, the least delay of 0.452 s, the highest accuracy of 91.56%, the higher sensitivity of 96.10%, the highest specificity of 91.80%, and the maximum TPR of 99.45%.

A 3D Printed, Bionic Hand Powered by EMG Signals and Controlled by an Online Neural Network

About 8% of the Ecuadorian population suffers some type of amputation of upper or lower limbs. Due to the high cost of a prosthesis and the fact that the salary of an average worker in the country reached 248 USD in August 2021, they experience a great labor disadvantage and only 17% of them are employed. Thanks to advances in 3D printing and the accessibility of bioelectric sensors, it is now possible to create economically accessible proposals. This work proposes the design of a hand prosthesis that uses electromyography (EMG) signals and neural networks for real-time control. The integrated system has a mechanical and electronic design, and the latter integrates artificial intelligence for control. To train the algorithm, an experimental methodology was developed to record muscle activity in upper extremities associated with specific tasks, using three EMG surface sensors. These data were used to train a five-layer neural network. the trained model was compressed and exported using TensorflowLite. The prosthesis consisted of a gripper and a pivot base, which were designed in Fusion 360 considering the movement restrictions and the maximum loads. It was actuated in real time thanks to the design of an electronic circuit that used an ESP32 development board, which was responsible for recording, processing and classifying the EMG signals associated with a motor intention, and to actuate the hand prosthesis. As a result of this work, a database with 60 electromyographic activity records from three tasks was released. The classification algorithm was able to detect the three muscle tasks with an accuracy of 78.67% and a response time of 80 ms. Finally, the 3D printed prosthesis was able to support a weight of 500 g with a safety factor equal to 15.

Machine Learning Algorithms to Predict Breast Cancer Recurrence Using Structured and Unstructured Sources from Electronic Health Records

Recurrence is a critical aspect of breast cancer (BC) that is inexorably tied to mortality. Reuse of healthcare data through Machine Learning (ML) algorithms offers great opportunities to improve the stratification of patients at risk of cancer recurrence. We hypothesized that combining features from structured and unstructured sources would provide better prediction results for 5-year cancer recurrence than either source alone. We collected and preprocessed clinical data from a cohort of BC patients, resulting in 823 valid subjects for analysis. We derived three sets of features: structured information, features from free text, and a combination of both. We evaluated the performance of five ML algorithms to predict 5-year cancer recurrence and selected the best-performing to test our hypothesis. The XGB (eXtreme Gradient Boosting) model yielded the best performance among the five evaluated algorithms, with precision = 0.900, recall = 0.907, F1-score = 0.897, and area under the receiver operating characteristic AUROC = 0.807. The best prediction results were achieved with the structured dataset, followed by the unstructured dataset, while the combined dataset achieved the poorest performance. ML algorithms for BC recurrence prediction are valuable tools to improve patient risk stratification, help with post-cancer monitoring, and plan more effective follow-up. Structured data provides the best results when fed to ML algorithms. However, an approach based on natural language processing offers comparable results while potentially requiring less mapping effort.

BRMI-Net: Deep Learning Features and Flower Pollination-Controlled Regula Falsi-Based Feature Selection Framework for Breast Cancer Recognition in Mammography Images

The early detection of breast cancer using mammogram images is critical for lowering women's mortality rates and allowing for proper treatment. Deep learning techniques are commonly used for feature extraction and have demonstrated significant performance in the literature. However, these features do not perform well in several cases due to redundant and irrelevant information. We created a new framework for diagnosing breast cancer using entropy-controlled deep learning and flower pollination optimization from the mammogram images. In the proposed framework, a filter fusion-based method for contrast enhancement is developed. The pre-trained ResNet-50 model is then improved and trained using transfer learning on both the original and enhanced datasets. Deep features are extracted and combined into a single vector in the following phase using a serial technique known as serial mid-value features. The top features are then classified using neural networks and machine learning classifiers in the following stage. To accomplish this, a technique for flower pollination optimization with entropy control has been developed. The exercise used three publicly available datasets: CBIS-DDSM, INbreast, and MIAS. On these selected datasets, the proposed framework achieved 93.8, 99.5, and 99.8% accuracy, respectively. Compared to the current methods, the increase in accuracy and decrease in computational time are explained.

Qureshi A, Li J, Mahmood T. On the Analyses of Medical Images Using Traditional Machine Learning Techniques and Convolutional Neural Networks

Convolutional neural network (CNN) has shown dissuasive accomplishment on different areas especially Object Detection, Segmentation, Reconstruction (2D and 3D), Information Retrieval, Medical Image Registration, Multi-lingual translation, Local language Processing, Anomaly Detection on video and Speech Recognition. CNN is a special type of Neural Network, which has compelling and effective learning ability to learn features at several steps during augmentation of the data. Recently, different interesting and inspiring ideas of Deep Learning (DL) such as different activation functions, hyperparameter optimization, regularization, momentum and loss functions has improved the performance, operation and execution of CNN Different internal architecture innovation of CNN and different representational style of CNN has significantly improved the performance. This survey focuses on internal taxonomy of deep learning, different models of vonvolutional neural network, especially depth and width of models and in addition CNN components, applications and current challenges of deep learning.

A review and comparative study of cancer detection using machine learning: SBERT and SimCSE application

BACKGROUND

Using visual, biological, and electronic health records data as the sole input source, pretrained convolutional neural networks and conventional machine learning methods have been heavily employed for the identification of various malignancies. Initially, a series of preprocessing steps and image segmentation steps are performed to extract region of interest features from noisy features. Then, the extracted features are applied to several machine learning and deep learning methods for the detection of cancer.

METHODS

In this work, a review of all the methods that have been applied to develop machine learning algorithms that detect cancer is provided. With more than 100 types of cancer, this study only examines research on the four most common and prevalent cancers worldwide: lung, breast, prostate, and colorectal cancer. Next, by using state-of-the-art sentence transformers namely: SBERT (2019) and the unsupervised SimCSE (2021), this study proposes a new methodology for detecting cancer. This method requires raw DNA sequences of matched tumor/normal pair as the only input. The learnt DNA representations retrieved from SBERT and SimCSE will then be sent to machine learning algorithms (XGBoost, Random Forest, LightGBM, and CNNs) for classification. As far as we are aware, SBERT and SimCSE transformers have not been applied to represent DNA sequences in cancer detection settings.

RESULTS

The XGBoost model, which had the highest overall accuracy of 73 ± 0.13 % using SBERT embeddings and 75 ± 0.12 % using SimCSE embeddings, was the best performing classifier. In light of these findings, it can be concluded that incorporating sentence representations from SimCSE's sentence transformer only marginally improved the performance of machine learning models.

Intraoperative thermal infrared imaging in neurosurgery: machine learning approaches for advanced segmentation of tumors

Surgical resection is one of the most relevant practices in neurosurgery. Finding the correct surgical extent of the tumor is a key question and so far several techniques have been employed to assist the neurosurgeon in preserving the maximum amount of healthy tissue. Some of these methods are invasive for patients, not always allowing high precision in the detection of the tumor area. The aim of this study is to overcome these limitations, developing machine learning based models, relying on features obtained from a contactless and non-invasive technique, the thermal infrared (IR) imaging. The thermal IR videos of thirteen patients with heterogeneous tumors were recorded in the intraoperative context. Time (TD)- and frequency (FD)-domain features were extracted and fed different machine learning models. Models relying on FD features have proven to be the best solutions for the optimal detection of the tumor area (Average Accuracy = 90.45%; Average Sensitivity = 84.64%; Average Specificity = 93,74%). The obtained results highlight the possibility to accurately detect the tumor lesion boundary with a completely non-invasive, contactless, and portable technology, revealing thermal IR imaging as a very promising tool for the neurosurgeon.

Breast Cancer Diagnosis in Thermography Using Pre-Trained VGG16 with Deep Attention Mechanisms

One of the most prevalent cancers in women is breast cancer. The mortality rate related to this disease can be decreased by early, accurate diagnosis to increase the chance of survival. Infrared thermal imaging is one of the breast imaging modalities in which the temperature of the breast tissue is measured using a screening tool. The previous studies did not use pre-trained deep learning (DL) with deep attention mechanisms (AMs) on thermographic images for breast cancer diagnosis. Using thermal images from the Database for Research Mastology with Infrared Image (DMR-IR), the study investigates the use of a pre-trained Visual Geometry Group with 16 layers (VGG16) with AMs that can produce good diagnosis performance utilizing the thermal images of breast cancer. The symmetry of the three models resulting from the combination of VGG16 with three types of AMs is evident in all its stages in methodology. The models were compared to state-of-art breast cancer diagnosis approaches and tested for accuracy, sensitivity, specificity, precision, F1-score, AUC score, and Cohen’s kappa. The test accuracy rates for the AMs using the VGG16 model on the breast thermal dataset were encouraging, at 99.80%, 99.49%, and 99.32%. Test accuracy for VGG16 without AMs was 99.18%, whereas test accuracy for VGG16 with AMs improved by 0.62%. The proposed approaches also performed better than previous approaches examined in the related studies.

Assessment of chronic limb threatening ischemia using thermal imaging

OBJECTIVES

Current chronic limb threatening ischemia (CLTI) diagnostics require expensive equipment, using ionizing radiation or contrast agents, or summative surrogate methods lacking in spatial information. Our aim is to develop and improve contactless, non-ionizing and cost-effective diagnostic methods for CLTI assessment with high spatial accuracy by utilizing dynamic thermal imaging and the angiosome concept.

APPROACH

Dynamic thermal imaging test protocol was suggested and implemented with a number of computational parameters. Pilot data was measured from 3 healthy young subjects, 4 peripheral artery disease (PAD) patients and 4 CLTI patients. The protocol consists of clinical reference measurements, including ankle- and toe-brachial indices (ABI, TBI), and a modified patient bed for hydrostatic and thermal modulation tests. The data was analyzed using bivariate correlation.

RESULTS

The thermal recovery time constant was on average higher for the PAD (88%) and CLTI (83%) groups with respect to the healthy young subjects. The contralateral symmetry was high for the healthy young group and low for the CLTI group. The recovery time constants showed high negative correlation to TBI (ρ = -0.73) and ABI (ρ = -0.60). The relation of these clinical parameters to the hydrostatic response and absolute temperatures (|ρ|<0.3) remained unclear.

CONCLUSION

The lack of correlation for absolute temperatures or their contralateral differences with the clinical status, ABI and TBI disputes their use in CLTI diagnostics. Thermal modulation tests tend to augment the signs of thermoregulation deficiencies and accordingly high correlations were found with all reference metrics. The method is promising for establishing the connection between impaired perfusion and thermography. The hydrostatic modulation test requires more research with stricter test conditions.

Deep Learning Based Methods for Breast Cancer Diagnosis: A Systematic Review and Future Direction

Breast cancer is one of the precarious conditions that affect women, and a substantive cure has not yet been discovered for it. With the advent of Artificial intelligence (AI), recently, deep learning techniques have been used effectively in breast cancer detection, facilitating early diagnosis and therefore increasing the chances of patients' survival. Compared to classical machine learning techniques, deep learning requires less human intervention for similar feature extraction. This study presents a systematic literature review on the deep learning-based methods for breast cancer detection that can guide practitioners and researchers in understanding the challenges and new trends in the field. Particularly, different deep learning-based methods for breast cancer detection are investigated, focusing on the genomics and histopathological imaging data. The study specifically adopts the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), which offer a detailed analysis and synthesis of the published articles. Several studies were searched and gathered, and after the eligibility screening and quality evaluation, 98 articles were identified. The results of the review indicated that the Convolutional Neural Network (CNN) is the most accurate and extensively used model for breast cancer detection, and the accuracy metrics are the most popular method used for performance evaluation. Moreover, datasets utilized for breast cancer detection and the evaluation metrics are also studied. Finally, the challenges and future research direction in breast cancer detection based on deep learning models are also investigated to help researchers and practitioners acquire in-depth knowledge of and insight into the area.

Specificity for the correlation between the body surface and viscera in the pathological state of COPD: A prospective, controlled, and assessor-blinded trial

Background: The association between the body surface and viscera remains obscure, but a better understanding of the body surface-viscera correlation will maximize its diagnostic and therapeutic values in clinical practice. Therefore, this study aimed to investigate the specificity of body surface-viscera correlation in the pathological state. Methods: The study subjects included 40 participants with chronic obstructive pulmonary disease (COPD) in the COPD group and 40 age-matched healthy participants in the healthy control group. Laser Doppler flowmetry, infrared thermography, and functional near-infrared spectroscopy were respectively adopted to measure 1) the perfusion unit (PU), 2) temperature, and 3) regional oxygen saturation (rSO₂) of four specific sites distributed in the heart and lung meridians. These three outcome measures reflected the microcirculatory, thermal, and metabolic characteristics, respectively. Results: Regarding the microcirculatory and thermal characteristics of the body surface, the PU and temperature of specific sites on the body surface [i.e., Taiyuan (LU9) and Chize (LU5) in the lung meridian] in the COPD group were significantly increased compared with healthy controls (p < 0.05), whereas PU and temperature of other sites in the heart meridian [i.e., Shenmen (HT7) and Shaohai (HT3)] did not change significantly (p > 0.05). Regarding the metabolic characteristics, rSO₂ of specific sites in the lung meridian [i.e., Taiyuan (LU9) and Chize (LU5)] and Shaohai (HT3) of the heart meridian in the COPD group was significantly decreased compared with healthy controls (p < 0.01), whereas rSO₂ of Shenmen (HT7) in the heart meridian did not change significantly (p > 0.05). Conclusion: In the disease state of COPD, the microcirculatory, thermal, and metabolic characteristics of specific sites on the body surface in the lung meridian generally manifest more significant changes than those in the heart meridian, thereby supporting relative specificity for the body surface-viscera correlation in the pathological state.

The Use of Thermal Imaging in Free Perforator Flap Planning

Background. Preoperative planning and design of microsurgical perforator flaps are the main steps for successful operation. The aim of this study was to determine the concordance between thermographic images obtained with smartphone thermal imaging camera and hand-held Doppler in the anterolateral thigh flap (ALT) model. Methods. A concordance study of diagnostic tests was carried out in Hospital of Lithuanian University of Health Sciences Kaunas Clinics, Plastic and Reconstructive Surgery Department during 2020–2022. Patients’ who were scheduled to undergo reconstruction with ALT flap and healthy volunteers were included in the study. Dynamic thermal images were performed with smartphone thermal camera FLIR One PRO in the typical ALT flap territory. The number and distance of hotspots in the thermogram with respect to anterior superior iliac spine were recorded in the study protocol. Later, the examination was repeated with hand-held Doppler and the control of hotspot was performed. Sensitivity, specificity and concordance index calculations were performed. Statistical analysis was performed using IMB SPSS 23.0. Results. A total of 100 ALT flap territories were examined. 266 hotspots were detected with thermal imaging and 275 perforators with hand-held Doppler. In 96.6% of cases, hotspots detected by a thermal camera were confirmed by hand-held Doppler as perforators. The sensitivity and specificity of thermography for the detection of perforators with respect to the hand-held Doppler were 93.5% and 96.9% respectively. The measure of concordance kappa index was 0.095 (p = 0.001). Conclusion. Smartphone thermal imaging have a high concordance with hand-held Doppler in perforator mapping, thus could be considered a useful adjunct to conventional methods.

Artificial Intelligence (AI) in Breast Imaging: A Scientometric Umbrella Review

Artificial intelligence (AI), a rousing advancement disrupting a wide spectrum of applications with remarkable betterment, has continued to gain momentum over the past decades. Within breast imaging, AI, especially machine learning and deep learning, honed with unlimited cross-data/case referencing, has found great utility encompassing four facets: screening and detection, diagnosis, disease monitoring, and data management as a whole. Over the years, breast cancer has been the apex of the cancer cumulative risk ranking for women across the six continents, existing in variegated forms and offering a complicated context in medical decisions. Realizing the ever-increasing demand for quality healthcare, contemporary AI has been envisioned to make great strides in clinical data management and perception, with the capability to detect indeterminate significance, predict prognostication, and correlate available data into a meaningful clinical endpoint. Here, the authors captured the review works over the past decades, focusing on AI in breast imaging, and systematized the included works into one usable document, which is termed an umbrella review. The present study aims to provide a panoramic view of how AI is poised to enhance breast imaging procedures. Evidence-based scientometric analysis was performed in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guideline, resulting in 71 included review works. This study aims to synthesize, collate, and correlate the included review works, thereby identifying the patterns, trends, quality, and types of the included works, captured by the structured search strategy. The present study is intended to serve as a "one-stop center" synthesis and provide a holistic bird's eye view to readers, ranging from newcomers to existing researchers and relevant stakeholders, on the topic of interest.

Classification of White Blood Cells: A Comprehensive Study Using Transfer Learning Based on Convolutional Neural Networks

White blood cells (WBCs) in the human immune system defend against infection and protect the body from external hazardous objects. They are comprised of neutrophils, eosinophils, basophils, monocytes, and lymphocytes, whereby each accounts for a distinct percentage and performs specific functions. Traditionally, the clinical laboratory procedure for quantifying the specific types of white blood cells is an integral part of a complete blood count (CBC) test, which aids in monitoring the health of people. With the advancements in deep learning, blood film images can be classified in less time and with high accuracy using various algorithms. This paper exploits a number of state-of-the-art deep learning models and their variations based on CNN architecture. A comparative study on model performance based on accuracy, F1-score, recall, precision, number of parameters, and time was conducted, and DenseNet161 was found to demonstrate a superior performance among its counterparts. In addition, advanced optimization techniques such as normalization, mixed-up augmentation, and label smoothing were also employed on DenseNet to further refine its performance.

A Novel CNN pooling layer for breast cancer segmentation and classification from thermograms

Breast cancer is the second most frequent cancer worldwide, following lung cancer and the fifth leading cause of cancer death and a major cause of cancer death among women. In recent years, convolutional neural networks (CNNs) have been successfully applied for the diagnosis of breast cancer using different imaging modalities. Pooling is a main data processing step in CNN that decreases the feature maps’ dimensionality without losing major patterns. However, the effect of pooling layer was not studied efficiently in literature. In this paper, we propose a novel design for the pooling layer called vector pooling block (VPB) for the CCN algorithm. The proposed VPB consists of two data pathways, which focus on extracting features along horizontal and vertical orientations. The VPB makes the CNNs able to collect both global and local features by including long and narrow pooling kernels, which is different from the traditional pooling layer, that gathers features from a fixed square kernel. Based on the novel VPB, we proposed a new pooling module called AVG-MAX VPB. It can collect informative features by using two types of pooling techniques, maximum and average pooling. The VPB and the AVG-MAX VPB are plugged into the backbone CNNs networks, such as U-Net, AlexNet, ResNet18 and GoogleNet, to show the advantages in segmentation and classification tasks associated with breast cancer diagnosis from thermograms. The proposed pooling layer was evaluated using a benchmark thermogram database (DMR-IR) and its results compared with U-Net results which was used as base results. The U-Net results were as follows: global accuracy = 96.6%, mean accuracy = 96.5%, mean IoU = 92.07%, and mean BF score = 78.34%. The VBP-based results were as follows: global accuracy = 98.3%, mean accuracy = 97.9%, mean IoU = 95.87%, and mean BF score = 88.68% while the AVG-MAX VPB-based results were as follows: global accuracy = 99.2%, mean accuracy = 98.97%, mean IoU = 98.03%, and mean BF score = 94.29%. Other network architectures also demonstrate superior improvement considering the use of VPB and AVG-MAX VPB.

A nomogram based on radiomics signature and deep-learning signature for preoperative prediction of axillary lymph node metastasis in breast cancer

PURPOSE

To develop a nomogram based on radiomics signature and deep-learning signature for predicting the axillary lymph node (ALN) metastasis in breast cancer.

METHODS

A total of 151 patients were assigned to a training cohort (n = 106) and a test cohort (n = 45) in this study. Radiomics features were extracted from DCE-MRI images, and deep-learning features were extracted by VGG-16 algorithm. Seven machine learning models were built using the selected features to evaluate the predictive value of radiomics or deep-learning features for the ALN metastasis in breast cancer. A nomogram was then constructed based on the multivariate logistic regression model incorporating radiomics signature, deep-learning signature, and clinical risk factors.

RESULTS

Five radiomics features and two deep-learning features were selected for machine learning model construction. In the test cohort, the AUC was above 0.80 for most of the radiomics models except DecisionTree and ExtraTrees. In addition, the K-nearest neighbor (KNN), XGBoost, and LightGBM models using deep-learning features had AUCs above 0.80 in the test cohort. The nomogram, which incorporated the radiomics signature, deep-learning signature, and MRI-reported LN status, showed good calibration and performance with the AUC of 0.90 (0.85-0.96) in the training cohort and 0.90 (0.80-0.99) in the test cohort. The DCA showed that the nomogram could offer more net benefit than radiomics signature or deep-learning signature.

CONCLUSIONS

Both radiomics and deep-learning features are diagnostic for predicting ALN metastasis in breast cancer. The nomogram incorporating radiomics and deep-learning signatures can achieve better prediction performance than every signature used alone.

Towards an Accurate MRI Acute Ischemic Stroke Lesion Segmentation Based on Bioheat Equation and U-Net Model

Acute ischemic stroke represents a cerebrovascular disease, for which it is practical, albeit challenging to segment and differentiate infarct core from salvageable penumbra brain tissue. Ischemic stroke causes the variation of cerebral blood flow and heat generation due to metabolism. Therefore, the temperature is modified in the ischemic stroke region. In this paper, we incorporate acute ischemic stroke temperature profile to reinforce segmentation accuracy in MRI. Pennes bioheat equation was used to generate brain thermal images that may provide rich information regarding the temperature change in acute ischemic stroke lesions. The thermal images were generated by calculating the temperature of the brain with acute ischemic stroke. Then, U-Net was used in this paper for the segmentation of acute ischemic stroke. A dataset of 3192 images was created to train U-Net using k-fold crossvalidation. The training time was about 10 hours and 35 minutes in NVIDIA GPU. Next, the obtained trained model was compared with recent methods to analyze the effect of the ischemic stroke temperature profile in segmentation. The obtained results show that significant parts of acute ischemic stroke and background areas are segmented only in thermal images, which proves the importance of using thermal information to improve the segmentation outcomes in MRI diagnosis.

Early Prediction of Hemodynamic Shock in Pediatric Intensive Care Units With Deep Learning on Thermal Videos

Shock is one of the major killers in intensive care units, and early interventions can potentially reverse it. In this study, we advance a noncontact thermal imaging modality for continuous monitoring of hemodynamic shock working on 1,03,936 frames from 406 videos recorded longitudinally upon 22 pediatric patients. Deep learning was used to preprocess and extract the Center-to-Peripheral Difference (CPD) in temperature values from the videos. This time-series data along with the heart rate was finally analyzed using Long-Short Term Memory models to predict the shock status up to the next 6 h. Our models achieved the best area under the receiver operating characteristic curve of 0.81 ± 0.06 and area under the precision-recall curve of 0.78 ± 0.05 at 5 h, providing sufficient time to stabilize the patient. Our approach, thus, provides a reliable shock prediction using an automated decision pipeline that can provide better care and save lives.

Skin Temperature of Acupoints in Health and Disease: A Systematic Review

Introduction: Despite substantial progress made in the field of acupuncture research, the existence and specificity of acupoints remain controversial. In recent years, the concept of acupoint sensitization has emerged as a theoretical framework for understanding acupoints as dynamic functional entities that are sensitized in pathological conditions. Based on this premise, some have claimed that specific acupoints are thermally distinct between healthy and clinical populations, but no systematic review has been conducted to synthesize and evaluate the quality of studies supporting such claims. In this review, we provide a summary and quality assessment of the existing literature addressing the question of whether changes in skin temperature at specific acupoints are indicative of pathological conditions. Methods: A systematic literature search was performed in PubMed, EMBASE, and AltHealthWatch (EBSCO Host), by combining variations of search terms relevant to acupoints and temperature. The search was limited to the English language, and publication dates ranged from database inception to December 2020. Two authors independently screened all resulting abstracts and subsequently read full-text articles for eligibility. Information on study design, sample, acupoints, parameters of skin temperature assessments, and main findings were extracted from included studies. Quality of the thermal sensing methodology was evaluated using a thermal assessment checklist, adapted from the Thermographic Imaging in Sports and Exercise Medicine (TISEM) consensus checklist, and a modified Newcastle-Ottawa Scale (NOS) for case-control studies. Results: The search strategy yielded a total of 1771 studies, of which 10 articles met the eligibility criteria. Eight studies compared skin temperature at acupoints in healthy versus clinical populations, and two studies assessed within-subject changes in temperature of acupoints in relation to changes in health status. There were seven clinical conditions examined in the included studies: chronic bronchial asthma, chronic hepatitis, hyperplasia of mammary glands, infertility, intracranial hypertension, obesity, and primary dysmenorrhea. There were numerous methodological quality issues related to skin temperature measurements. Eight studies with case-control designs reported significant differences between healthy and clinical populations in temperature at certain acupoints. Two studies with pre-post designs reported that changes in health-disease status could be associated with changes in temperature at specific acupoints. Conclusion: A review of the available literature suggests that certain acupoints may be thermally distinct between healthy and unhealthy states. However, given the methodological limitations and heterogeneity across included studies, no definitive conclusion could be drawn as to whether changes in skin temperature at specific acupoints are indicative of pathological conditions.

Design of ensemble recurrent model with stacked fuzzy ARTMAP for breast cancer detection

Purpose

In time and accurate detection of cancer can save the life of the person affected. According to the World Health Organization (WHO), breast cancer occupies the most frequent incidence among all the cancers whereas breast cancer takes fifth place in the case of mortality numbers. Out of many image processing techniques, certain works have focused on convolutional neural networks (CNNs) for processing these images. However, deep learning models are to be explored well.

Design/methodology/approach

In this work, multivariate statistics-based kernel principal component analysis (KPCA) is used for essential features. KPCA is simultaneously helpful for denoising the data. These features are processed through a heterogeneous ensemble model that consists of three base models. The base models comprise recurrent neural network (RNN), long short-term memory (LSTM) and gated recurrent unit (GRU). The outcomes of these base learners are fed to fuzzy adaptive resonance theory mapping (ARTMAP) model for decision making as the nodes are added to the F_2ˆa layer if the winning criteria are fulfilled that makes the ARTMAP model more robust.

Findings

The proposed model is verified using breast histopathology image dataset publicly available at Kaggle. The model provides 99.36% training accuracy and 98.72% validation accuracy. The proposed model utilizes data processing in all aspects, i.e. image denoising to reduce the data redundancy, training by ensemble learning to provide higher results than that of single models. The final classification by a fuzzy ARTMAP model that controls the number of nodes depending upon the performance makes robust accurate classification.

Research limitations/implications

Research in the field of medical applications is an ongoing method. More advanced algorithms are being developed for better classification. Still, the scope is there to design the models in terms of better performance, practicability and cost efficiency in the future. Also, the ensemble models may be chosen with different combinations and characteristics. Only signal instead of images may be verified for this proposed model. Experimental analysis shows the improved performance of the proposed model. This method needs to be verified using practical models. Also, the practical implementation will be carried out for its real-time performance and cost efficiency.

Originality/value

The proposed model is utilized for denoising and to reduce the data redundancy so that the feature selection is done using KPCA. Training and classification are performed using heterogeneous ensemble model designed using RNN, LSTM and GRU as base classifiers to provide higher results than that of single models. Use of adaptive fuzzy mapping model makes the final classification accurate. The effectiveness of combining these methods to a single model is analyzed in this work.

Differential Screening of Herniated Lumbar Discs Based on Bag of Visual Words Image Classification Using Digital Infrared Thermographic Images

Doctors in primary hospitals can obtain the impression of lumbosacral radiculopathy with a physical exam and need to acquire medical images, such as an expensive MRI, for diagnosis. Then, doctors will perform a foraminal root block to the target root for pain control. However, there was insufficient screening medical image examination for precise L5 and S1 lumbosacral radiculopathy, which is most prevalent in the clinical field. Therefore, to perform differential screening of L5 and S1 lumbosacral radiculopathy, the authors applied digital infrared thermographic images (DITI) to the machine learning (ML) algorithm, which is the bag of visual words method. DITI dataset included data from the healthy population and radiculopathy patients with herniated lumbar discs (HLDs) L4/5 and L5/S1. A total of 842 patients were enrolled and the dataset was split into a 7:3 ratio as the training algorithm and test dataset to evaluate model performance. The average accuracy was 0.72 and 0.67, the average precision was 0.71 and 0.77, the average recall was 0.69 and 0.74, and the F1 score was 0.70 and 0.75 for the training and test datasets. Application of the bag of visual words algorithm to DITI classification will aid in the differential screening of lumbosacral radiculopathy and increase the therapeutic effect of primary pain interventions with economical cost.

Multi-Classification of Breast Cancer Lesions in Histopathological Images Using DEEP_Pachi: Multiple Self-Attention Head

Introduction and Background: Despite fast developments in the medical field, histological diagnosis is still regarded as the benchmark in cancer diagnosis. However, the input image feature extraction that is used to determine the severity of cancer at various magnifications is harrowing since manual procedures are biased, time consuming, labor intensive, and error-prone. Current state-of-the-art deep learning approaches for breast histopathology image classification take features from entire images (generic features). Thus, they are likely to overlook the essential image features for the unnecessary features, resulting in an incorrect diagnosis of breast histopathology imaging and leading to mortality. Methods: This discrepancy prompted us to develop DEEP_Pachi for classifying breast histopathology images at various magnifications. The suggested DEEP_Pachi collects global and regional features that are essential for effective breast histopathology image classification. The proposed model backbone is an ensemble of DenseNet201 and VGG16 architecture. The ensemble model extracts global features (generic image information), whereas DEEP_Pachi extracts spatial information (regions of interest). Statistically, the evaluation of the proposed model was performed on publicly available dataset: BreakHis and ICIAR 2018 Challenge datasets. Result: A detailed evaluation of the proposed model’s accuracy, sensitivity, precision, specificity, and f1-score metrics revealed the usefulness of the backbone model and the DEEP_Pachi model for image classifying. The suggested technique outperformed state-of-the-art classifiers, achieving an accuracy of 1.0 for the benign class and 0.99 for the malignant class in all magnifications of BreakHis datasets and an accuracy of 1.0 on the ICIAR 2018 Challenge dataset. Conclusion: The acquired findings were significantly resilient and proved helpful for the suggested system to assist experts at big medical institutions, resulting in early breast cancer diagnosis and a reduction in the death rate.

Ensemble Deep-Learning-Enabled Clinical Decision Support System for Breast Cancer Diagnosis and Classification on Ultrasound Images

Simple Summary

In the literature, there exist plenty of research works focused on the detection and classification of breast cancer. However, only a few works have focused on the classification of breast cancer using ultrasound scan images. Although deep transfer learning models are useful in breast cancer classification, owing to their outstanding performance in a number of applications, image pre-processing and segmentation techniques are essential. In this context, the current study developed a new Ensemble Deep-Learning-Enabled Clinical Decision Support System for the diagnosis and classification of breast cancer using ultrasound images. In the study, an optimal multi-level thresholding-based image segmentation technique was designed to identify the tumor-affected regions. The study also developed an ensemble of three deep learning models for feature extraction and an optimal machine learning classifier for breast cancer detection. The study offers a means of assisting radiologists and healthcare professionals in the breast cancer classification process.

Abstract

Clinical Decision Support Systems (CDSS) provide an efficient way to diagnose the presence of diseases such as breast cancer using ultrasound images (USIs). Globally, breast cancer is one of the major causes of increased mortality rates among women. Computer-Aided Diagnosis (CAD) models are widely employed in the detection and classification of tumors in USIs. The CAD systems are designed in such a way that they provide recommendations to help radiologists in diagnosing breast tumors and, furthermore, in disease prognosis. The accuracy of the classification process is decided by the quality of images and the radiologist’s experience. The design of Deep Learning (DL) models is found to be effective in the classification of breast cancer. In the current study, an Ensemble Deep-Learning-Enabled Clinical Decision Support System for Breast Cancer Diagnosis and Classification (EDLCDS-BCDC) technique was developed using USIs. The proposed EDLCDS-BCDC technique was intended to identify the existence of breast cancer using USIs. In this technique, USIs initially undergo pre-processing through two stages, namely wiener filtering and contrast enhancement. Furthermore, Chaotic Krill Herd Algorithm (CKHA) is applied with Kapur’s entropy (KE) for the image segmentation process. In addition, an ensemble of three deep learning models, VGG-16, VGG-19, and SqueezeNet, is used for feature extraction. Finally, Cat Swarm Optimization (CSO) with the Multilayer Perceptron (MLP) model is utilized to classify the images based on whether breast cancer exists or not. A wide range of simulations were carried out on benchmark databases and the extensive results highlight the better outcomes of the proposed EDLCDS-BCDC technique over recent methods.

Detection of Breast Cancer from Five-View Thermal Images Using Convolutional Neural Networks

Breast cancer is one of the most common forms of cancer. Its aggressive nature coupled with high mortality rates makes this cancer life-threatening; hence early detection gives the patient a greater chance of survival. Currently, the preferred diagnosis method is mammography. However, mammography is expensive and exposes the patient to radiation. A cost-effective and less invasive method known as thermography is gaining popularity. Bearing this in mind, the work aims to initially create machine learning models based on convolutional neural networks using multiple thermal views of the breast to detect breast cancer using the Visual DMR dataset. The performances of these models are then verified with the clinical data. Findings indicate that the addition of clinical data decisions to the model helped increase its performance. After building and testing two models with different architectures, the model used the same architecture for all three views performed best. It performed with an accuracy of 85.4%, which increased to 93.8% after the clinical data decision was added. After the addition of clinical data decisions, the model was able to classify more patients correctly with a specificity of 96.7% and sensitivity of 88.9% when considering sick patients as the positive class. Currently, thermography is among the lesser-known diagnosis methods with only one public dataset. We hope our work will divert more attention to this area.

Deep learning model for fully automated breast cancer detection system from thermograms

Breast cancer is one of the most common diseases among women worldwide. It is considered one of the leading causes of death among women. Therefore, early detection is necessary to save lives. Thermography imaging is an effective diagnostic technique which is used for breast cancer detection with the help of infrared technology. In this paper, we propose a fully automatic breast cancer detection system. First, U-Net network is used to automatically extract and isolate the breast area from the rest of the body which behaves as noise during the breast cancer detection model. Second, we propose a two-class deep learning model, which is trained from scratch for the classification of normal and abnormal breast tissues from thermal images. Also, it is used to extract more characteristics from the dataset that is helpful in training the network and improve the efficiency of the classification process. The proposed system is evaluated using real data (A benchmark, database (DMR-IR)) and achieved accuracy = 99.33%, sensitivity = 100% and specificity = 98.67%. The proposed system is expected to be a helpful tool for physicians in clinical use.

Artificial intelligence and infrared thermography as auxiliary tools in the diagnosis of temporomandibular disorder

OBJECTIVE

To assess three machine learning (ML) attribute extraction methods: radiomic, semantic and radiomic-semantic association on temporomandibular disorder (TMD) detection using infrared thermography (IT); and to determine which ML classifier, KNN, SVM and MLP, is the most efficient for this purpose.

METHODS AND MATERIALS

78 patients were selected by applying the Fonseca questionnaire and RDC/TMD to categorize control patients (37) and TMD patients (41). IT lateral projections of each patient were acquired. The masseter and temporal muscles were selected as regions of interest (ROI) for attribute extraction. Three methods of extracting attributes were assessed: radiomic, semantic and radiomic-semantic association. For radiomic attribute extraction, 20 texture attributes were assessed using co-occurrence matrix in a standardized angulation of 0°. The semantic features were the ROI mean temperature and pain intensity data. For radiomic-semantic association, a single dataset composed of 28 features was assessed. The classification algorithms assessed were KNN, SVM and MLP. Hopkins's statistic, Shapiro-Wilk, ANOVA and Tukey tests were used to assess data. The significance level was set at 5% (p < 0.05).

RESULTS

Training and testing accuracy values differed statistically for the radiomic-semantic association (p = 0.003). MLP differed from the other classifiers for the radiomic-semantic association (p = 0.004). Accuracy, precision and sensitivity values of semantic and radiomic-semantic association differed statistically from radiomic features (p = 0.008, p = 0.016 and p = 0.013).

CONCLUSION

Semantic and radiomic-semantic-associated ML feature extraction methods and MLP classifier should be chosen for TMD detection using IT images and pain scale data. IT associated with ML presents promising results for TMD detection.

Screening of breast cancer from thermogram images by edge detection aided deep transfer learning model

Breast cancer, the most common invasive cancer, causes deaths of thousands of women in the world every year. Early detection of the same is a remedy to lessen the death rate. Hence, screening of breast cancer in its early stage is utmost required. However, in the developing nations not many can afford the screening and detection procedures owing to its cost. Hence, an effective and less expensive way of detecting breast cancer is performed using thermography which, unlike other methods, can be used on women of various ages. To this end, we propose a computer aided breast cancer detection system that accepts thermal breast images to detect the same. Here, we use the pre-trained DenseNet121 model as a feature extractor to build a classifier for the said purpose. Before extracting features, we work on the original thermal breast images to get outputs using two edge detectors - Prewitt and Roberts. These two edge-maps along with the original image make the input to the DenseNet121 model as a 3-channel image. The thermal breast image dataset namely, Database for Mastology Research (DMR-IR) is used to evaluate performance of our model. We achieve the highest classification accuracy of 98.80% on the said database, which outperforms many state-of-the-art methods, thereby confirming the superiority of the proposed model. Source code of this work is available here: https://github.com/subro608/thermogram_breast_cancer.

Artificial intelligence for breast cancer analysis: Trends & directions

Breast cancer is one of the leading causes of death among women. Early detection of breast cancer can significantly improve the lives of millions of women across the globe. Given importance of finding solution/framework for early detection and diagnosis, recently many AI researchers are focusing to automate this task. The other reasons for surge in research activities in this direction are advent of robust AI algorithms (deep learning), availability of hardware that can run/train those robust and complex AI algorithms and accessibility of large enough dataset required for training AI algorithms. Different imaging modalities that have been exploited by researchers to automate the task of breast cancer detection are mammograms, ultrasound, magnetic resonance imaging, histopathological images or any combination of them. This article analyzes these imaging modalities and presents their strengths and limitations. It also enlists resources from where their datasets can be accessed for research purpose. This article then summarizes AI and computer vision based state-of-the-art methods proposed in the last decade to detect breast cancer using various imaging modalities. Primarily, in this article we have focused on reviewing frameworks that have reported results using mammograms as it is the most widely used breast imaging modality that serves as the first test that medical practitioners usually prescribe for the detection of breast cancer. Another reason for focusing on mammogram imaging modalities is the availability of its labelled datasets. Datasets availability is one of the most important aspects for the development of AI based frameworks as such algorithms are data hungry and generally quality of dataset affects performance of AI based algorithms. In a nutshell, this research article will act as a primary resource for the research community working in the field of automated breast imaging analysis.

A Comprehensive Survey on Deep-Learning-Based Breast Cancer Diagnosis

Breast cancer is now the most frequently diagnosed cancer in women, and its percentage is gradually increasing. Optimistically, there is a good chance of recovery from breast cancer if identified and treated at an early stage. Therefore, several researchers have established deep-learning-based automated methods for their efficiency and accuracy in predicting the growth of cancer cells utilizing medical imaging modalities. As of yet, few review studies on breast cancer diagnosis are available that summarize some existing studies. However, these studies were unable to address emerging architectures and modalities in breast cancer diagnosis. This review focuses on the evolving architectures of deep learning for breast cancer detection. In what follows, this survey presents existing deep-learning-based architectures, analyzes the strengths and limitations of the existing studies, examines the used datasets, and reviews image pre-processing techniques. Furthermore, a concrete review of diverse imaging modalities, performance metrics and results, challenges, and research directions for future researchers is presented.

State-of-the-Art Challenges and Perspectives in Multi-Organ Cancer Diagnosis via Deep Learning-Based Methods

Thus far, the most common cause of death in the world is cancer. It consists of abnormally expanding areas that are threatening to human survival. Hence, the timely detection of cancer is important to expanding the survival rate of patients. In this survey, we analyze the state-of-the-art approaches for multi-organ cancer detection, segmentation, and classification. This article promptly reviews the present-day works in the breast, brain, lung, and skin cancer domain. Afterwards, we analytically compared the existing approaches to provide insight into the ongoing trends and future challenges. This review also provides an objective description of widely employed imaging techniques, imaging modality, gold standard database, and related literature on each cancer in 2016-2021. The main goal is to systematically examine the cancer diagnosis systems for multi-organs of the human body as mentioned. Our critical survey analysis reveals that greater than 70% of deep learning researchers attain promising results with CNN-based approaches for the early diagnosis of multi-organ cancer. This survey includes the extensive discussion part along with current research challenges, possible solutions, and prospects. This research will endow novice researchers with valuable information to deepen their knowledge and also provide the room to develop new robust computer-aid diagnosis systems, which assist health professionals in bridging the gap between rapid diagnosis and treatment planning for cancer patients.

Driver drowsiness detection using facial thermal imaging in a driving simulator

Driver drowsiness causes fatal driving accidents. Thermal imaging is a suitable drowsiness detection method as it is non-invasive and robust against changes in the ambient light. In this paper, driver drowsiness is detected by measuring the forehead temperature at the region covering the supratrochlear artery and also the cheek temperature. About 30 subjects drove on a highway in a driving simulator in two sessions. A thermal camera was used to monitor the facial temperature pattern. The subjects' drowsiness levels were estimated by three human observers. The forehead and the cheek regions were located and tracked in each frame. The forehead and the cheek skin temperatures were obtained at three levels of drowsiness. The Support Vector Machine, the K-Nearest Neighbor, and the regression tree classifiers were used. From wakefulness to extreme drowsiness, the forehead skin temperature and the absolute cheek-forehead skin temperature gradient decreased by 0.46°C and 0.81°C, respectively. But the cheek skin temperature increased by 0.35°C in two sessions. The gradient difference is on average 50% higher than the forehead or the cheek temperature change alone. The results indicate that drowsiness can be detected with an accuracy of 82%, sensitivity of 85%, specificity of 90%, and precision of 84%. Driver drowsiness can be detected by monitoring changes in the forehead and the cheek temperature signal. Also, the temperature gradient can be used as a more robust and sensitive indicator of drowsiness.

Thermal-based early breast cancer detection using inception V3, inception V4 and modified inception MV4

Breast cancer is one of the most significant causes of death for women around the world. Breast thermography supported by deep convolutional neural networks is expected to contribute significantly to early detection and facilitate treatment at an early stage. The goal of this study is to investigate the behavior of different recent deep learning methods for identifying breast disorders. To evaluate our proposal, we built classifiers based on deep convolutional neural networks modelling inception V3, inception V4, and a modified version of the latter called inception MV4. MV4 was introduced to maintain the computational cost across all layers by making the resultant number of features and the number of pixel positions equal. DMR database was used for these deep learning models in classifying thermal images of healthy and sick patients. A set of epochs 3–30 were used in conjunction with learning rates 1 × 10^–3, 1 × 10^–4 and 1 × 10^–5, Minibatch 10 and different optimization methods. The training results showed that inception V4 and MV4 with color images, a learning rate of 1 × 10^–4, and SGDM optimization method, reached very high accuracy, verified through several experimental repetitions. With grayscale images, inception V3 outperforms V4 and MV4 by a considerable accuracy margin, for any optimization methods. In fact, the inception V3 (grayscale) performance is almost comparable to inception V4 and MV4 (color) performance but only after 20–30 epochs. inception MV4 achieved 7% faster classification response time compared to V4. The use of MV4 model is found to contribute to saving energy consumed and fluidity in arithmetic operations for the graphic processor. The results also indicate that increasing the number of layers may not necessarily be useful in improving the performance.

Fascinating MXene nanomaterials: emerging opportunities in the biomedical field

In recent years, there has been rapid progress in MXene research due to its distinctive two-dimensional structure and outstanding properties. Especially in biomedical applications, MXenes have attracted widespread favor with numerous studies on biosafety, bioimaging, therapy, and biosensing, although their development is still in the experimental stage. A comprehensive understanding of the current status of MXenes in biomedicine will promote their use in clinical applications. Here, we review advances in MXene research. First, we introduce the methods of synthesis, surface modification and functionalization of MXenes. Then, we summarize the biosafety and biocompatibility, paving the way for specific biomedical applications. On this basis, MXene nanostructures are described with respect to their use in antibacterial, bioimaging, cancer therapy, tissue regeneration and biosensor applications. Finally, we discuss MXene as a promising candidate material for further applications in biomedicine.

Artificial intelligence and the future of life sciences

Over the past few decades, the number of health and 'omics-related data' generated and stored has grown exponentially. Patient information can be collected in real time and explored using various artificial intelligence (AI) tools in clinical trials; mobile devices can also be used to improve aspects of both the diagnosis and treatment of diseases. In addition, AI can be used in the development of new drugs or for drug repurposing, in faster diagnosis and more efficient treatment for various diseases, as well as to identify data-driven hypotheses for scientists. In this review, we discuss how AI is starting to revolutionize the life sciences sector.

Medical Images Encryption Based on Adaptive-Robust Multi-Mode Synchronization of Chen Hyper-Chaotic Systems

In this paper, a novel medical image encryption method based on multi-mode synchronization of hyper-chaotic systems is presented. The synchronization of hyper-chaotic systems is of great significance in secure communication tasks such as encryption of images. Multi-mode synchronization is a novel and highly complex issue, especially if there is uncertainty and disturbance. In this work, an adaptive-robust controller is designed for multimode synchronized chaotic systems with variable and unknown parameters, despite the bounded disturbance and uncertainty with a known function in two modes. In the first case, it is a main system with some response systems, and in the second case, it is a circular synchronization. Using theorems it is proved that the two synchronization methods are equivalent. Our results show that, we are able to obtain the convergence of synchronization error and parameter estimation error to zero using Lyapunov's method. The new laws to update time-varying parameters, estimating disturbance and uncertainty bounds are proposed such that stability of system is guaranteed. To assess the performance of the proposed synchronization method, various statistical analyzes were carried out on the encrypted medical images and standard benchmark images. The results show effective performance of the proposed synchronization technique in the medical images encryption for telemedicine application.

[Connected bras for breast cancer detection in 2021: Analysis and perspectives]

OBJECTIVES

Breast cancer is the leading cancer in women worldwide with about 2 million new cases and 685,000 deaths each year. Mammography is the most widely used screening and diagnostic method. Currently, digital technologies advances facilitate the development of connected and portable devices. To overcome some of the disadvantages of mammography (breast compression, difficulty in analyzing dense breasts, radiation, limited accessibility in some countries, etc.), portable devices, conventionally known as connected bras (CB), have been created to offer an alternative method to mammography. The objective of our review was to list all the published CBs in order to know their main characteristics, their potential indications and their possible limitations.

METHOD

A bibliographical search in the PUBMED database selecting only articles written in French or English, between 2011 and 2020, found 7 CBs under development.

RESULTS

These CBs use thermal, ultrasonic and impedance sensors. Their advantages are an absence of irradiation, an absence of breast compression and a flexibility of use (outside an X-ray cabinet). Mammary gland analysis times vary, depending on the device, between 30min and 24h. They are all connected to data transmission systems and models that analyze the results.

DISCUSSION AND CONCLUSION

These CBs are mostly still undergoing clinical validation (only [iTBra] has been evaluated in a clinical trial) and require evaluation steps that will eventually allow their future use for breast cancer detection in high-risk women, particularly in women with dense breasts and in women between screening waves.

Microwave Radiometry (MWR) temperature measurement is related to symptom severity in patients with Low Back Pain (LBP)

Microwave Radiometry (MWR) has the advantage that measurements of internal (i.e. deep) tissue temperature may be obtained non-invasively by measuring naturally emitted radiation in GHz range. The goal of the present study is to further the development of MWR for clinical application in assessment of patients with Low Back Pain (LBP). In particular, a protocol was developed in which MWR was used to measure internal temperature at the level of the spinous processes of the L1 to L5 vertebral bodies along median and left and right para-vertebral lines. The protocol was used to study 48 patients with clinically confirmed acute or sub-acute LBP and 27 Controls. Analysis revealed there to be a significant increase in deep tissue temperature with increasing pain severity as measured by using a Visual Analogue Scale (VAS) in patients with LBP (p < 0.05). In conclusion, MWR potentially allows for objective assessment of the magnitude of clinical symptoms in patients with LBP and shows promise for measuring pain severity.

Generating tumor-selective conditionally active biologic anti-CTLA4 antibodies via protein-associated chemical switches

Anticytotoxic T lymphocyte-associated protein 4 (CTLA4) antibodies have shown potent antitumor activity, but systemic immune activation leads to severe immune-related adverse events, limiting clinical usage. We developed novel, conditionally active biologic (CAB) anti-CTLA4 antibodies that are active only in the acidic tumor microenvironment. In healthy tissue, this binding is reversibly inhibited by a novel mechanism using physiological chemicals as protein-associated chemical switches (PaCS). No enzymes or potentially immunogenic covalent modifications to the antibody are required for activation in the tumor. The novel anti-CTLA4 antibodies show similar efficacy in animal models compared to an analog of a marketed anti-CTLA4 biologic, but have markedly reduced toxicity in nonhuman primates (in combination with an anti-PD1 checkpoint inhibitor), indicating a widened therapeutic index (TI). The PaCS encompass mechanisms that are applicable to a wide array of antibody formats (e.g., ADC, bispecifics) and antigens. Examples shown here include antibodies to EpCAM, Her2, Nectin4, CD73, and CD3. Existing antibodies can be engineered readily to be made sensitive to PaCS, and the inhibitory activity can be optimized for each antigen's varying expression level and tissue distribution. PaCS can modulate diverse physiological molecular interactions and are applicable to various pathologic conditions, enabling differential CAB antibody activities in normal versus disease microenvironments.