YOLO Based Breast Masses Detection and Classification in Full-Field Digital Mammograms

A novel open-access artificial-intelligence-driven platform for CNS drug discovery utilizing adult zebrafish

BACKGROUND

Although zebrafish are increasingly utilized in biomedicine for CNS disease modelling and drug discovery, this generates big data necessitating objective, precise and reproducible analyses. The artificial intelligence (AI) applications have empowered automated image recognition and video-tracking to ensure more efficient behavioral testing.

NEW METHOD

Capitalizing on several AI tools that most recently became available, here we present a novel open-access AI-driven platform to analyze tracks of adult zebrafish collected from in vivo neuropharmacological experiments. For this, we trained the AI system to distinguish zebrafish behavioral patterns following systemic treatment with several well-studied psychoactive drugs - nicotine, caffeine and ethanol.

RESULTS

Experiment 1 showed the ability of the AI system to distinguish nicotine and caffeine with 75 % and ethanol with 88 % probability and high (81 %) accuracy following a post-training exposure to these drugs. Experiment 2 further validated our system with additional, previously unexposed compounds (cholinergic arecoline and varenicline, and serotonergic fluoxetine), used as positive and negative controls, respectively.

COMPARISON WITH EXISTING METHODS

The present study introduces a novel open-access AI-driven approach to analyze locomotor activity of adult zebrafish.

CONCLUSIONS

Taken together, these findings support the value of custom-made AI tools for unlocking full potential of zebrafish CNS drug research by monitoring, processing and interpreting the results of in vivo experiments.

ReBiA-Robotic Enabled Biological Automation: 3D Epithelial Tissue Production

The Food and Drug Administration's recent decision to eliminate mandatory animal testing for drug approval marks a significant shift to alternative methods. Similarly, the European Parliament is advocating for a faster transition, reflecting public preference for animal-free research practices. In vitro tissue models are increasingly recognized as valuable tools for regulatory assessments before clinical trials, in line with the 3R principles (Replace, Reduce, Refine). Despite their potential, barriers such as the need for standardization, availability, and cost hinder their widespread adoption. To address these challenges, the Robotic Enabled Biological Automation (ReBiA) system is developed. This system uses a dual-arm robot capable of standardizing laboratory processes within a closed automated environment, translating manual processes into automated ones. This reduces the need for process-specific developments, making in vitro tissue models more consistent and cost-effective. ReBiA's performance is demonstrated through producing human reconstructed epidermis, human airway epithelial models, and human intestinal organoids. Analyses confirm that these models match the morphology and protein expression of manually prepared and native tissues, with similar cell viability. These successes highlight ReBiA's potential to lower barriers to broader adoption of in vitro tissue models, supporting a shift toward more ethical and advanced research methods.

A lightweight detection algorithm for tooth cracks in optical images

OBJECTIVES

Cracked tooth syndrome (CTS) is one of the major causes of tooth loss, presents the problem of early microcrack symptoms that are difficult to distinguish. This paper aims to investigate the practicality and feasibility of an improved object detection algorithm for automatically detecting cracks in dental optical images.

METHODS

A total of 286 teeth were obtained from Sun Yat-sen University and Guangdong University of Technology, and simulated cracks were generated using thermal expansion and contraction. Over 3000 images of cracked teeth were collected, including 360 real clinical images. To make the model more lightweight and better suited for deployment on embedded devices, this paper improves the YOLOv8 model for detecting tooth cracks through model pruning and backbone replacement. Additionally, the impact of image enhancement modules and coordinate attention modules on optimizing our model was analyzed.

RESULTS

Through experimental validation, we conclude that that model pruning reduction maintains performance better than replacing a lightweight backbone network on a tooth crack detection task. This approach achieved a reduction in parameters and GFLOPs by 16.8 % and 24.3 %, respectively, with minimal impact on performance. These results affirm the effectiveness of the proposed method in identifying and labeling tooth fractures. In addition, this paper demonstrated that the impact of image enhancement modules and coordinate attention mechanisms on YOLOv8's performance in the task of tooth crack detection was minimal.

CONCLUSIONS

An improved object detection algorithm has been proposed to reduce model parameters. This lightweight model is easier to deploy and holds potential for assisting dentists in identifying cracks on tooth surfaces.

Human attention guided explainable artificial intelligence for computer vision models

Explainable artificial intelligence (XAI) has been increasingly investigated to enhance the transparency of black-box artificial intelligence models, promoting better user understanding and trust. Developing an XAI that is faithful to models and plausible to users is both a necessity and a challenge. This work examines whether embedding human attention knowledge into saliency-based XAI methods for computer vision models could enhance their plausibility and faithfulness. Two novel XAI methods for object detection models, namely FullGrad-CAM and FullGrad-CAM++, were first developed to generate object-specific explanations by extending the current gradient-based XAI methods for image classification models. Using human attention as the objective plausibility measure, these methods achieve higher explanation plausibility. Interestingly, all current XAI methods when applied to object detection models generally produce saliency maps that are less faithful to the model than human attention maps from the same object detection task. Accordingly, human attention-guided XAI (HAG-XAI) was proposed to learn from human attention how to best combine explanatory information from the models to enhance explanation plausibility by using trainable activation functions and smoothing kernels to maximize the similarity between XAI saliency map and human attention map. The proposed XAI methods were evaluated on widely used BDD-100K, MS-COCO, and ImageNet datasets and compared with typical gradient-based and perturbation-based XAI methods. Results suggest that HAG-XAI enhanced explanation plausibility and user trust at the expense of faithfulness for image classification models, and it enhanced plausibility, faithfulness, and user trust simultaneously and outperformed existing state-of-the-art XAI methods for object detection models.

ViT-MAENB7: An innovative breast cancer diagnosis model from 3D mammograms using advanced segmentation and classification process

Tumors are an important health concern in modern times. Breast cancer is one of the most prevalent causes of death for women. Breast cancer is rapidly becoming the leading cause of mortality among women globally. Early detection of breast cancer allows patients to obtain appropriate therapy, increasing their probability of survival. The adoption of 3-Dimensional (3D) mammography for the medical identification of abnormalities in the breast reduced the number of deaths dramatically. Classification and accurate detection of lumps in the breast in 3D mammography is especially difficult due to factors such as inadequate contrast and normal fluctuations in tissue density. Several Computer-Aided Diagnosis (CAD) solutions are under development to help radiologists accurately classify abnormalities in the breast. In this paper, a breast cancer diagnosis model is implemented to detect breast cancer in cancer patients to prevent death rates. The 3D mammogram images are gathered from the internet. Then, the gathered images are given to the preprocessing phase. The preprocessing is done using a median filter and image scaling method. The purpose of the preprocessing phase is to enhance the quality of the images and remove any noise or artifacts that may interfere with the detection of abnormalities. The median filter helps to smooth out any irregularities in the images, while the image scaling method adjusts the size and resolution of the images for better analysis. Once the preprocessing is complete, the preprocessed image is given to the segmentation phase. The segmentation phase is crucial in medical image analysis as it helps to identify and separate different structures within the image, such as organs or tumors. This process involves dividing the preprocessed image into meaningful regions or segments based on intensity, color, texture, or other features. The segmentation process is done using Adaptive Thresholding with Region Growing Fusion Model (AT-RGFM)". This model combines the advantages of both thresholding and region-growing techniques to accurately identify and delineate specific structures within the image. By utilizing AT-RGFM, the segmentation phase can effectively differentiate between different parts of the image, allowing for more precise analysis and diagnosis. It plays a vital role in the medical image analysis process, providing crucial insights for healthcare professionals. Here, the Modified Garter Snake Optimization Algorithm (MGSOA) is used to optimize the parameters. It helps to optimize parameters for accurately identifying and delineating specific structures within medical images and also helps healthcare professionals in providing more precise analysis and diagnosis, ultimately playing a vital role in the medical image analysis process. MGSOA enhances the segmentation phase by effectively differentiating between different parts of the image, leading to more accurate results. Then, the segmented image is fed into the detection phase. The tumor detection is performed by the Vision Transformer-based Multiscale Adaptive EfficientNetB7 (ViT-MAENB7) model. This model utilizes a combination of advanced algorithms and deep learning techniques to accurately identify and locate tumors within the segmented medical image. By incorporating a multiscale adaptive approach, the ViT-MAENB7 model can analyze the image at various levels of detail, improving the overall accuracy of tumor detection. This crucial step in the medical image analysis process allows healthcare professionals to make more informed decisions regarding patient treatment and care. Here, the created MGSOA algorithm is used to optimize the parameters for enhancing the performance of the model. The suggested breast cancer diagnosis performance is compared to conventional cancer diagnosis models and it showed high accuracy. The accuracy of the developed MGSOA-ViT-MAENB7 is 96.6 %, and others model like RNN, LSTM, EffNet, and ViT-MAENet given the accuracy to be 90.31 %, 92.79 %, 94.46 % and 94.75 %. The developed model's ability to analyze images at multiple scales, combined with the optimization provided by the MGSOA algorithm, results in a highly accurate and efficient system for detecting tumors in medical images. This cutting-edge technology not only improves the accuracy of diagnosis but also helps healthcare professionals tailor treatment plans to individual patients, ultimately leading to better outcomes. By outperforming traditional cancer diagnosis models, the proposed model is revolutionizing the field of medical imaging and setting a new standard for precision and effectiveness in healthcare.

Presegmenter Cascaded Framework for Mammogram Mass Segmentation

Accurate segmentation of breast masses in mammogram images is essential for early cancer diagnosis and treatment planning. Several deep learning (DL) models have been proposed for whole mammogram segmentation and mass patch/crop segmentation. However, current DL models for breast mammogram mass segmentation face several limitations, including false positives (FPs), false negatives (FNs), and challenges with the end-to-end approach. This paper presents a novel two-stage end-to-end cascaded breast mass segmentation framework that incorporates a saliency map of potential mass regions to guide the DL models for breast mass segmentation. The first-stage segmentation model of the cascade framework is used to generate a saliency map to establish a coarse region of interest (ROI), effectively narrowing the focus to probable mass regions. The proposed presegmenter attention (PSA) blocks are introduced in the second-stage segmentation model to enable dynamic adaptation to the most informative regions within the mammogram images based on the generated saliency map. Comparative analysis of the Attention U-net model with and without the cascade framework is provided in terms of dice scores, precision, recall, FP rates (FPRs), and FN outcomes. Experimental results consistently demonstrate enhanced breast mass segmentation performance by the proposed cascade framework across all three datasets: INbreast, CSAW-S, and DMID. The cascade framework shows superior segmentation performance by improving the dice score by about 6% for the INbreast dataset, 3% for the CSAW-S dataset, and 2% for the DMID dataset. Similarly, the FN outcomes were reduced by 10% for the INbreast dataset, 19% for the CSAW-S dataset, and 4% for the DMID dataset. Moreover, the proposed cascade framework's performance is validated with varying state-of-the-art segmentation models such as DeepLabV3+ and Swin transformer U-net. The presegmenter cascade framework has the potential to improve segmentation performance and mitigate FNs when integrated with any medical image segmentation framework, irrespective of the choice of the model.

Reproducibility and Explainability of Deep Learning in Mammography: A Systematic Review of Literature

Background  Although abundant literature is currently available on the use of deep learning for breast cancer detection in mammography, the quality of such literature is widely variable. Purpose  To evaluate published literature on breast cancer detection in mammography for reproducibility and to ascertain best practices for model design. Methods  The PubMed and Scopus databases were searched to identify records that described the use of deep learning to detect lesions or classify images into cancer or noncancer. A modification of Quality Assessment of Diagnostic Accuracy Studies (mQUADAS-2) tool was developed for this review and was applied to the included studies. Results of reported studies (area under curve [AUC] of receiver operator curve [ROC] curve, sensitivity, specificity) were recorded. Results  A total of 12,123 records were screened, of which 107 fit the inclusion criteria. Training and test datasets, key idea behind model architecture, and results were recorded for these studies. Based on mQUADAS-2 assessment, 103 studies had high risk of bias due to nonrepresentative patient selection. Four studies were of adequate quality, of which three trained their own model, and one used a commercial network. Ensemble models were used in two of these. Common strategies used for model training included patch classifiers, image classification networks (ResNet in 67%), and object detection networks (RetinaNet in 67%). The highest reported AUC was 0.927 ± 0.008 on a screening dataset, while it reached 0.945 (0.919-0.968) on an enriched subset. Higher values of AUC (0.955) and specificity (98.5%) were reached when combined radiologist and Artificial Intelligence readings were used than either of them alone. None of the studies provided explainability beyond localization accuracy. None of the studies have studied interaction between AI and radiologist in a real world setting. Conclusion  While deep learning holds much promise in mammography interpretation, evaluation in a reproducible clinical setting and explainable networks are the need of the hour.

Enhanced object detection in pediatric bronchoscopy images using YOLO-based algorithms with CBAM attention mechanism

Background and Objective

Bronchoscopy is a widely used diagnostic and therapeutic procedure for respiratory disorders such as infections and tumors. However, visualizing the bronchial tubes and lungs can be challenging due to the presence of various objects, such as mucus, blood, and foreign bodies. Accurately identifying the anatomical location of the bronchi can be quite challenging, especially for medical professionals who are new to the field. Deep learning-based object detection algorithms can assist doctors in analyzing images or videos of the bronchial tubes to identify key features such as the epiglottis, vocal cord, and right basal bronchus. This study aims to improve the accuracy of object detection in bronchoscopy images by integrating a YOLO-based algorithm with a CBAM attention mechanism.

Methods

The CBAM attention module is implemented in the YOLO-V7 and YOLO-V8 object detection models to improve their object identification and classification capabilities in bronchoscopy images. Various YOLO-based object detection algorithms, such as YOLO-V5, YOLO-V7, and YOLO-V8 are compared on this dataset. Experiments are conducted to evaluate the performance of the proposed method and different algorithms.

Results

The proposed method significantly improves the accuracy and reliability of object detection for bronchoscopy images. This approach demonstrates the potential benefits of incorporating an attention mechanism in medical imaging and the benefits of utilizing object detection algorithms in bronchoscopy. In the experiments, the YOLO-V8-based model achieved a mean Average Precision (mAP) of 87.09% on the given dataset with an Intersection over Union (IoU) threshold of 0.5. After incorporating the Convolutional Block Attention Module (CBAM) into the YOLO-V8 architecture, the proposed method achieved a significantly enhanced m A P 0.5 and m A P 0.5 : 0.95 of 88.27% and 55.39%, respectively.

Conclusions

Our findings indicate that by incorporating a CBAM attention mechanism with a YOLO-based algorithm, there is a noticeable improvement in object detection performance in bronchoscopy images. This study provides valuable insights into enhancing the performance of attention mechanisms for object detection in medical imaging.

Integrating attention mechanism and multi-scale feature extraction for fall detection

Addressing the critical need for accurate fall event detection due to their potentially severe impacts, this paper introduces the Spatial Channel and Pooling Enhanced You Only Look Once version 5 small (SCPE-YOLOv5s) model. Fall events pose a challenge for detection due to their varying scales and subtle pose features. To address this problem, SCPE-YOLOv5s introduces spatial attention to the Efficient Channel Attention (ECA) network, which significantly enhances the model's ability to extract features from spatial pose distribution. Moreover, the model integrates average pooling layers into the Spatial Pyramid Pooling (SPP) network to support the multi-scale extraction of fall poses. Meanwhile, by incorporating the ECA network into SPP, the model effectively combines global and local features to further enhance the feature extraction. This paper validates the SCPE-YOLOv5s on a public dataset, demonstrating that it achieves a mean Average Precision of 88.29 %, outperforming the You Only Look Once version 5 small by 4.87 %. Additionally, the model achieves 57.4 frames per second. Therefore, SCPE-YOLOv5s provides a novel solution for fall event detection.

Deep Learning in Breast Cancer Imaging: State of the Art and Recent Advancements in Early 2024

The rapid advancement of artificial intelligence (AI) has significantly impacted various aspects of healthcare, particularly in the medical imaging field. This review focuses on recent developments in the application of deep learning (DL) techniques to breast cancer imaging. DL models, a subset of AI algorithms inspired by human brain architecture, have demonstrated remarkable success in analyzing complex medical images, enhancing diagnostic precision, and streamlining workflows. DL models have been applied to breast cancer diagnosis via mammography, ultrasonography, and magnetic resonance imaging. Furthermore, DL-based radiomic approaches may play a role in breast cancer risk assessment, prognosis prediction, and therapeutic response monitoring. Nevertheless, several challenges have limited the widespread adoption of AI techniques in clinical practice, emphasizing the importance of rigorous validation, interpretability, and technical considerations when implementing DL solutions. By examining fundamental concepts in DL techniques applied to medical imaging and synthesizing the latest advancements and trends, this narrative review aims to provide valuable and up-to-date insights for radiologists seeking to harness the power of AI in breast cancer care.

Medical object detector jointly driven by knowledge and data

Most of the existing object detection algorithms are trained on medical datasets and then used for prediction. When the features of an object are not obvious in an image, these models are prone to mislocalize and misclassify it. In this paper, we propose a medical Object Detection algorithm jointly driven by Knowledge and Data (ODKD). It enables medical semantic knowledge provided by specialized physicians to be effective and helpful when traditional models have difficulty in correctly detecting objects relying on features alone. Our model consists of a base object detector together with a fusion module: the base object detector is trained based on medical datasets to obtain data-driven results; then we use a graph to represent external semantic knowledge and map the data-driven results to the nodes embedding of this graph structure. In the fusion module, a graph convolution network is used to fuse the data-driven results with the external semantic knowledge to output category adjustment coefficients. Finally, the adjustment coefficients are used to adjust the data-driven results to obtain results jointly driven by knowledge and data. Experiments show that professional medical semantic knowledge can effectively correct the erroneous results of the base detector, and the effect of our model outperforms Faster Rcnn, YOLOv5, YOLOv7, etc. on three medical datasets, Camus, Synapse, and AMOS.

Deep learning algorithm applied to plain CT images to identify superior mesenteric artery abnormalities

OBJECTIVES

Atypical presentations, lack of biomarkers, and low sensitivity of plain CT can delay the diagnosis of superior mesenteric artery (SMA) abnormalities, resulting in poor clinical outcomes. Our study aims to develop a deep learning (DL) model for detecting SMA abnormalities in plain CT and evaluate its performance in comparison with a clinical model and radiologist assessment.

MATERIALS AND METHODS

A total of 1048 patients comprised the internal (474 patients with SMA abnormalities, 474 controls) and external testing (50 patients with SMA abnormalities, 50 controls) cohorts. The internal cohort was divided into the training cohort (n = 776), validation cohort (n = 86), and internal testing cohort (n = 86). A total of 5 You Only Look Once version 8 (YOLOv8)-based DL submodels were developed, and the performance of the optimal submodel was compared with that of a clinical model and of experienced radiologists.

RESULTS

Of the submodels, YOLOv8x had the best performance. The area under the curve (AUC) of the YOLOv8x submodel was higher than that of the clinical model (internal test set: 0.990 vs 0.878, P =.002; external test set: 0.967 vs 0.912, P =.140) and that of all radiologists (P <.001). The YOLOv8x submodel, when compared with radiologist assessment, demonstrated higher sensitivity (internal test set: 100.0 % vs 70.7 %, P =.002; external test set: 96.0 % vs 68.8 %, P <.001) and specificity (internal test set: 90.7 % vs 66.0 %, P =.025; external test set: = 88.0 % vs 66.0 %, P <.001).

CONCLUSION

Using plain CT images, YOLOv8x was able to efficiently identify cases of SMA abnormalities. This could potentially improve early diagnosis accuracy and thus improve clinical outcomes.

Shallow and deep learning classifiers in medical image analysis

An increasingly strong connection between artificial intelligence and medicine has enabled the development of predictive models capable of supporting physicians' decision-making. Artificial intelligence encompasses much more than machine learning, which nevertheless is its most cited and used sub-branch in the last decade. Since most clinical problems can be modeled through machine learning classifiers, it is essential to discuss their main elements. This review aims to give primary educational insights on the most accessible and widely employed classifiers in radiology field, distinguishing between "shallow" learning (i.e., traditional machine learning) algorithms, including support vector machines, random forest and XGBoost, and "deep" learning architectures including convolutional neural networks and vision transformers. In addition, the paper outlines the key steps for classifiers training and highlights the differences between the most common algorithms and architectures. Although the choice of an algorithm depends on the task and dataset dealing with, general guidelines for classifier selection are proposed in relation to task analysis, dataset size, explainability requirements, and available computing resources. Considering the enormous interest in these innovative models and architectures, the problem of machine learning algorithms interpretability is finally discussed, providing a future perspective on trustworthy artificial intelligence.Relevance statement The growing synergy between artificial intelligence and medicine fosters predictive models aiding physicians. Machine learning classifiers, from shallow learning to deep learning, are offering crucial insights for the development of clinical decision support systems in healthcare. Explainability is a key feature of models that leads systems toward integration into clinical practice. Key points • Training a shallow classifier requires extracting disease-related features from region of interests (e.g., radiomics).• Deep classifiers implement automatic feature extraction and classification.• The classifier selection is based on data and computational resources availability, task, and explanation needs.

Dual view deep learning for enhanced breast cancer screening using mammography

Breast cancer has the highest incidence rate among women in Ethiopia compared to other types of cancer. Unfortunately, many cases are detected at a stage where a cure is delayed or not possible. To address this issue, mammography-based screening is widely accepted as an effective technique for early detection. However, the interpretation of mammography images requires experienced radiologists in breast imaging, a resource that is limited in Ethiopia. In this research, we have developed a model to assist radiologists in mass screening for breast abnormalities and prioritizing patients. Our approach combines an ensemble of EfficientNet-based classifiers with YOLOv5, a suspicious mass detection method, to identify abnormalities. The inclusion of YOLOv5 detection is crucial in providing explanations for classifier predictions and improving sensitivity, particularly when the classifier fails to detect abnormalities. To further enhance the screening process, we have also incorporated an abnormality detection model. The classifier model achieves an F1-score of 0.87 and a sensitivity of 0.82. With the addition of suspicious mass detection, sensitivity increases to 0.89, albeit at the expense of a slightly lower F1-score of 0.79.

A computer vision-based system for real-time component identification from waste printed circuit boards

With an exponential increase in consumers' need for electronic products, the world is facing an ever-increasing economic and environmental threat of electronic waste (e-waste). To minimize their adverse effects, e-waste recycling is one of the pivotal factors that can help in minimizing the environmental pollution andto increase recovery of valuable materials. For instance, Printed Circuit Boards (PCBs), while they have several valuable elements, they are hazardous too; and therefore, they form a large chunk of e-waste being generated today. Thus, in recycling PCBs, Electronic Components (ECs) are segregated at first, and separately processed for recovering key elements that could be re-used. However, in the current recycling process, especially in developing nations, humans manually screen ECs, which goes on to affect their health. It also causes losses of valuable materials. Therefore, automated solutions need to be adopted for both to classify and to segregate ECs from waste PCBs. The study proposes a robust EC identification system based on computer vision and deep learning algorithms (YOLOv3) to automate sorting process which would help in further processing. The study uses a publicly available dataset, and a PCB dataset which reflect challenging recycling environments like lighting conditions, cast shadows, orientations, viewpoints, and different cameras/resolutions. The outcome of YOLOv3 detection model based on training of both datasets presents satisfactory classification accuracy and capability of real-time competent identification, which in turn, could help in automatically segregating ECs, while leading towards effective e-waste recycling.

CAPNet: Context attention pyramid network for computer-aided detection of microcalcification clusters in digital breast tomosynthesis

BACKGROUND AND OBJECTIVE

Computer-aided detection (CADe) of microcalcification clusters (MCs) in digital breast tomosynthesis (DBT) is crucial in the early diagnosis of breast cancer. Although convolutional neural network (CNN)-based detection models have achieved excellent performance in medical lesion detection, they are subject to some limitations in MC detection: 1) Most existing models employ the feature pyramid network (FPN) for multi-scale object detection; however, the rough feature sharing between adjacent layers in the FPN may limit the detection ability for small and low-contrast MCs; and 2) the MCs region only accounts for a small part of the annotation box, so the features extracted indiscriminately within the whole box may easily be affected by the background. In this paper, we develop a novel CNN-based CADe method to alleviate the impacts of the above limitations for the accurate and rapid detection of MCs in DBT.

METHODS

The proposed method has two parts: a novel context attention pyramid network (CAPNet) for intra-layer MC detection in two-dimensional (2D) slices and a three-dimensional (3D) aggregation procedure for aggregating 2D intra-layer MCs into a 3D result according to their connectivity in 3D space. The proposed CAPNet is based on an anchor-free and one-stage detection architecture and contains a context feature selection fusion (CFSF) module and a microcalcification response (MCR) branch. The CFSF module can efficiently enrich shallow layers' features by the complementary selection of local context features, aiming to reduce the missed detection of small and low-contrast MCs. The MCR branch is a one-layer branch parallel to the classification branch, which can alleviate the influence of the background region within the annotation box on feature extraction and enhance the ability of the model to distinguish MCs from normal breast tissue.

RESULTS

We performed a comparison experiment on an in-house clinical dataset with 648 DBT volumes, and the proposed method achieved impressive performance with a sensitivity of 91.56 % at 1 false positive per DBT volume (FPs/volume) and 93.51 % at 2 FPs/volume, outperforming other representative detection models.

CONCLUSIONS

The experimental results indicate that the proposed method is effective in the detection of MCs in DBT. This method can provide objective, accurate, and quick diagnostic suggestions for radiologists, presenting potential clinical value for early breast cancer screening.

Artificial intelligence in breast imaging: Current situation and clinical challenges

Breast cancer ranks among the most prevalent malignant tumours and is the primary contributor to cancer-related deaths in women. Breast imaging is essential for screening, diagnosis, and therapeutic surveillance. With the increasing demand for precision medicine, the heterogeneous nature of breast cancer makes it necessary to deeply mine and rationally utilize the tremendous amount of breast imaging information. With the rapid advancement of computer science, artificial intelligence (AI) has been noted to have great advantages in processing and mining of image information. Therefore, a growing number of scholars have started to focus on and research the utility of AI in breast imaging. Here, an overview of breast imaging databases and recent advances in AI research are provided, the challenges and problems in this field are discussed, and then constructive advice is further provided for ongoing scientific developments from the perspective of the National Natural Science Foundation of China.

Classification of Breast Cancer Using Transfer Learning and Advanced Al-Biruni Earth Radius Optimization

Breast cancer is one of the most common cancers in women, with an estimated 287,850 new cases identified in 2022. There were 43,250 female deaths attributed to this malignancy. The high death rate associated with this type of cancer can be reduced with early detection. Nonetheless, a skilled professional is always necessary to manually diagnose this malignancy from mammography images. Many researchers have proposed several approaches based on artificial intelligence. However, they still face several obstacles, such as overlapping cancerous and noncancerous regions, extracting irrelevant features, and inadequate training models. In this paper, we developed a novel computationally automated biological mechanism for categorizing breast cancer. Using a new optimization approach based on the Advanced Al-Biruni Earth Radius (ABER) optimization algorithm, a boosting to the classification of breast cancer cases is realized. The stages of the proposed framework include data augmentation, feature extraction using AlexNet based on transfer learning, and optimized classification using a convolutional neural network (CNN). Using transfer learning and optimized CNN for classification improved the accuracy when the results are compared to recent approaches. Two publicly available datasets are utilized to evaluate the proposed framework, and the average classification accuracy is 97.95%. To ensure the statistical significance and difference between the proposed methodology, additional tests are conducted, such as analysis of variance (ANOVA) and Wilcoxon, in addition to evaluating various statistical analysis metrics. The results of these tests emphasized the effectiveness and statistical difference of the proposed methodology compared to current methods.

Diagnostic value of mammography density of breast masses by using deep learning

Objective

In order to explore the relationship between mammographic density of breast mass and its surrounding area and benign or malignant breast, this paper proposes a deep learning model based on C2FTrans to diagnose the breast mass using mammographic density.

Methods

This retrospective study included patients who underwent mammographic and pathological examination. Two physicians manually depicted the lesion edges and used a computer to automatically extend and segment the peripheral areas of the lesion (0, 1, 3, and 5 mm, including the lesion). We then obtained the mammary glands' density and the different regions of interest (ROI). A diagnostic model for breast mass lesions based on C2FTrans was constructed based on a 7: 3 ratio between the training and testing sets. Finally, receiver operating characteristic (ROC) curves were plotted. Model performance was assessed using the area under the ROC curve (AUC) with 95% confidence intervals (CI), sensitivity, and specificity.

Results

In total, 401 lesions (158 benign and 243 malignant) were included in this study. The probability of breast cancer in women was positively correlated with age and mass density and negatively correlated with breast gland classification. The largest correlation was observed for age (r = 0.47). Among all models, the single mass ROI model had the highest specificity (91.8%) with an AUC = 0.823 and the perifocal 5mm ROI model had the highest sensitivity (86.9%) with an AUC = 0.855. In addition, by combining the cephalocaudal and mediolateral oblique views of the perifocal 5 mm ROI model, we obtained the highest AUC (AUC = 0.877 P < 0.001).

Conclusions

Deep learning model of mammographic density can better distinguish benign and malignant mass-type lesions in digital mammography images and may become an auxiliary diagnostic tool for radiologists in the future.

A YOLO-based AI system for classifying calcifications on spot magnification mammograms

OBJECTIVES

Use of an AI system based on deep learning to investigate whether the system can aid in distinguishing malignant from benign calcifications on spot magnification mammograms, thus potentially reducing unnecessary biopsies.

METHODS

In this retrospective study, we included public and in-house datasets with annotations for the calcifications on both craniocaudal and mediolateral oblique vies, or both craniocaudal and mediolateral views of each case of mammograms. All the lesions had pathological results for correlation. Our system comprised an algorithm based on You Only Look Once (YOLO) named adaptive multiscale decision fusion module. The algorithm was pre-trained on a public dataset, Curated Breast Imaging Subset of Digital Database for Screening Mammography (CBIS-DDSM), then re-trained and tested on the in-house dataset of spot magnification mammograms. The performance of the system was investigated by receiver operating characteristic (ROC) analysis.

RESULTS

We included 1872 images from 753 calcification cases (414 benign and 339 malignant) from CBIS-DDSM. From the in-house dataset, 636 cases (432 benign and 204 malignant) with 1269 spot magnification mammograms were included, with all lesions being recommended for biopsy by radiologists. The area under the ROC curve for our system on the in-house testing dataset was 0.888 (95% CI 0.868-0.908), with a sensitivity of 88.4% (95% CI 86.9-8.99%), specificity of 80.8% (95% CI 77.6-84%), and an accuracy of 84.6% (95% CI 81.8-87.4%) at the optimal cutoff value. Using the system with two views of spot magnification mammograms, 80.8% benign biopsies could be avoided.

CONCLUSION

The AI system showed good accuracy for classification of calcifications on spot magnification mammograms which were all categorized as suspicious by radiologists, thereby potentially reducing unnecessary biopsies.

Medical image data augmentation: techniques, comparisons and interpretations

Designing deep learning based methods with medical images has always been an attractive area of research to assist clinicians in rapid examination and accurate diagnosis. Those methods need a large number of datasets including all variations in their training stages. On the other hand, medical images are always scarce due to several reasons, such as not enough patients for some diseases, patients do not want to allow their images to be used, lack of medical equipment or equipment, inability to obtain images that meet the desired criteria. This issue leads to bias in datasets, overfitting, and inaccurate results. Data augmentation is a common solution to overcome this issue and various augmentation techniques have been applied to different types of images in the literature. However, it is not clear which data augmentation technique provides more efficient results for which image type since different diseases are handled, different network architectures are used, and these architectures are trained and tested with different numbers of data sets in the literature. Therefore, in this work, the augmentation techniques used to improve performances of deep learning based diagnosis of the diseases in different organs (brain, lung, breast, and eye) from different imaging modalities (MR, CT, mammography, and fundoscopy) have been examined. Also, the most commonly used augmentation methods have been implemented, and their effectiveness in classifications with a deep network has been discussed based on quantitative performance evaluations. Experiments indicated that augmentation techniques should be chosen carefully according to image types.

Enhancement Technique Based on the Breast Density Level for Mammogram for Computer-Aided Diagnosis

Mass detection in mammograms has a limited approach to the presence of a mass in overlapping denser fibroglandular breast regions. In addition, various breast density levels could decrease the learning system's ability to extract sufficient feature descriptors and may result in lower accuracy performance. Therefore, this study is proposing a textural-based image enhancement technique named Spatial-based Breast Density Enhancement for Mass Detection (SbBDEM) to boost textural features of the overlapped mass region based on the breast density level. This approach determines the optimal exposure threshold of the images' lower contrast limit and optimizes the parameters by selecting the best intensity factor guided by the best Blind/Reference-less Image Spatial Quality Evaluator (BRISQUE) scores separately for both dense and non-dense breast classes prior to training. Meanwhile, a modified You Only Look Once v3 (YOLOv3) architecture is employed for mass detection by specifically assigning an extra number of higher-valued anchor boxes to the shallower detection head using the enhanced image. The experimental results show that the use of SbBDEM prior to training mass detection promotes superior performance with an increase in mean Average Precision (mAP) of 17.24% improvement over the non-enhanced trained image for mass detection, mass segmentation of 94.41% accuracy, and 96% accuracy for benign and malignant mass classification. Enhancing the mammogram images based on breast density is proven to increase the overall system's performance and can aid in an improved clinical diagnosis process.

Multiple-level thresholding for breast mass detection

Detection of breast mass plays a very important role in making the diagnosis of breast cancer. For faster detection of breast cancer caused by breast mass, we developed a novel and efficient patch-based breast mass detection system for mammography images. The proposed framework is comprised of three modules, including pre-processing, multiple-level breast tissue segmentation, and final breast mass detection. An improved Deeplabv3+ model for pectoral muscle removal is deployed in pre-processing. We then proposed a multiple-level thresholding segmentation method to segment breast mass and obtained the connected components (ConCs), where the corresponding image patch to each ConC is extracted for mass detection. In the final detection stage, each image patch is classified into breast mass and breast tissue background by trained deep learning models. The patches that are classified as breast mass are then taken as the candidates for breast mass. To reduce the false positive rate in the detection results, we applied the non-maximum suppression algorithm to combine the overlapped detection results. Once an image patch is considered a breast mass, the accurate detection result can then be retrieved from the corresponding ConC in the segmented images. Moreover, a coarse segmentation result can be simultaneously retrieved after detection. Compared to the state-of-the-art methods, the proposed method achieved comparable performance. On CBIS-DDSM, the proposed method achieved a detection sensitivity of 0.87 at 2.86 FPI (False Positive rate per Image), while the sensitivity reached 0.96 on INbreast with an FPI of only 1.29.

Deep learning radiomics model based on breast ultrasound video to predict HER2 expression status

Purpose

The detection of human epidermal growth factor receptor 2 (HER2) expression status is essential to determining the chemotherapy regimen for breast cancer patients and to improving their prognosis. We developed a deep learning radiomics (DLR) model combining time-frequency domain features of ultrasound (US) video of breast lesions with clinical parameters for predicting HER2 expression status.

Patients and Methods

Data for this research was obtained from 807 breast cancer patients who visited from February 2019 to July 2020. Ultimately, 445 patients were included in the study. Pre-operative breast ultrasound examination videos were collected and split into a training set and a test set. Building a training set of DLR models combining time-frequency domain features and clinical features of ultrasound video of breast lesions based on the training set data to predict HER2 expression status. Test the performance of the model using test set data. The final models integrated with different classifiers are compared, and the best performing model is finally selected.

Results

The best diagnostic performance in predicting HER2 expression status is provided by an Extreme Gradient Boosting (XGBoost)-based time-frequency domain feature classifier combined with a logistic regression (LR)-based clinical parameter classifier of clinical parameters combined DLR, particularly with a high specificity of 0.917. The area under the receiver operating characteristic curve (AUC) for the test cohort was 0.810.

Conclusion

Our study provides a non-invasive imaging biomarker to predict HER2 expression status in breast cancer patients.

ETECADx: Ensemble Self-Attention Transformer Encoder for Breast Cancer Diagnosis Using Full-Field Digital X-ray Breast Images

Early detection of breast cancer is an essential procedure to reduce the mortality rate among women. In this paper, a new AI-based computer-aided diagnosis (CAD) framework called ETECADx is proposed by fusing the benefits of both ensemble transfer learning of the convolutional neural networks as well as the self-attention mechanism of vision transformer encoder (ViT). The accurate and precious high-level deep features are generated via the backbone ensemble network, while the transformer encoder is used to diagnose the breast cancer probabilities in two approaches: Approach A (i.e., binary classification) and Approach B (i.e., multi-classification). To build the proposed CAD system, the benchmark public multi-class INbreast dataset is used. Meanwhile, private real breast cancer images are collected and annotated by expert radiologists to validate the prediction performance of the proposed ETECADx framework. The promising evaluation results are achieved using the INbreast mammograms with overall accuracies of 98.58% and 97.87% for the binary and multi-class approaches, respectively. Compared with the individual backbone networks, the proposed ensemble learning model improves the breast cancer prediction performance by 6.6% for binary and 4.6% for multi-class approaches. The proposed hybrid ETECADx shows further prediction improvement when the ViT-based ensemble backbone network is used by 8.1% and 6.2% for binary and multi-class diagnosis, respectively. For validation purposes using the real breast images, the proposed CAD system provides encouraging prediction accuracies of 97.16% for binary and 89.40% for multi-class approaches. The ETECADx has a capability to predict the breast lesions for a single mammogram in an average of 0.048 s. Such promising performance could be useful and helpful to assist the practical CAD framework applications providing a second supporting opinion of distinguishing various breast cancer malignancies.

Primary bone tumor detection and classification in full-field bone radiographs via YOLO deep learning model

OBJECTIVES

Automatic bone lesions detection and classifications present a critical challenge and are essential to support radiologists in making an accurate diagnosis of bone lesions. In this paper, we aimed to develop a novel deep learning model called You Only Look Once (YOLO) to handle detecting and classifying bone lesions on full-field radiographs with limited manual intervention.

METHODS

In this retrospective study, we used 1085 bone tumor radiographs and 345 normal bone radiographs from two centers between January 2009 and December 2020 to train and test our YOLO deep learning (DL) model. The trained model detected bone lesions and then classified these radiographs into normal, benign, intermediate, or malignant types. The intersection over union (IoU) was used to assess the model's performance in the detection task. Confusion matrices and Cohen's kappa scores were used for evaluating classification performance. Two radiologists compared diagnostic performance with the trained model using the external validation set.

RESULTS

In the detection task, the model achieved accuracies of 86.36% and 85.37% in the internal and external validation sets, respectively. In the DL model, radiologist 1 and radiologist 2 achieved Cohen's kappa scores of 0.8187, 0.7927, and 0.9077 for four-way classification in the external validation set, respectively. The YOLO DL model illustrated a significantly higher accuracy for intermediate bone tumor classification than radiologist 1 (95.73% vs 88.08%, p = 0.004).

CONCLUSIONS

The developed YOLO DL model could be used to assist radiologists at all stages of bone lesion detection and classification in full-field bone radiographs.

KEY POINTS

• YOLO DL model can automatically detect bone neoplasms from full-field radiographs in one shot and then simultaneously classify radiographs into normal, benign, intermediate, or malignant. • The dataset used in this retrospective study includes normal bone radiographs. • YOLO can detect even some challenging cases with small volumes.

Evaluation of the peritumoral features using radiomics and deep learning technology in non-spiculated and noncalcified masses of the breast on mammography

OBJECTIVE

To assess the significance of peritumoral features based on deep learning in classifying non-spiculated and noncalcified masses (NSNCM) on mammography.

METHODS

We retrospectively screened the digital mammography data of 2254 patients who underwent surgery for breast lesions in Harbin Medical University Cancer Hospital from January to December 2018. Deep learning and radiomics models were constructed. The classification efficacy in ROI and patient levels of AUC, accuracy, sensitivity, and specificity were compared. Stratified analysis was conducted to analyze the influence of primary factors on the AUC of the deep learning model. The image filter and CAM were used to visualize the radiomics and depth features.

RESULTS

For 1298 included patients, 771 (59.4%) were benign, and 527 (40.6%) were malignant. The best model was the deep learning combined model (2 mm), in which the AUC was 0.884 (P < 0.05); especially the AUC of breast composition B reached 0.941. All the deep learning models were superior to the radiomics models (P < 0.05), and the class activation map (CAM) showed a high expression of signals around the tumor of the deep learning model. The deep learning model achieved higher AUC for large size, age >60 years, and breast composition type B (P < 0.05).

CONCLUSION

Combining the tumoral and peritumoral features resulted in better identification of malignant NSNCM on mammography, and the performance of the deep learning model exceeded the radiomics model. Age, tumor size, and the breast composition type are essential for diagnosis.

A Hybrid Workflow of Residual Convolutional Transformer Encoder for Breast Cancer Classification Using Digital X-ray Mammograms

Breast cancer, which attacks the glandular epithelium of the breast, is the second most common kind of cancer in women after lung cancer, and it affects a significant number of people worldwide. Based on the advantages of Residual Convolutional Network and the Transformer Encoder with Multiple Layer Perceptron (MLP), this study proposes a novel hybrid deep learning Computer-Aided Diagnosis (CAD) system for breast lesions. While the backbone residual deep learning network is employed to create the deep features, the transformer is utilized to classify breast cancer according to the self-attention mechanism. The proposed CAD system has the capability to recognize breast cancer in two scenarios: Scenario A (Binary classification) and Scenario B (Multi-classification). Data collection and preprocessing, patch image creation and splitting, and artificial intelligence-based breast lesion identification are all components of the execution framework that are applied consistently across both cases. The effectiveness of the proposed AI model is compared against three separate deep learning models: a custom CNN, the VGG16, and the ResNet50. Two datasets, CBIS-DDSM and DDSM, are utilized to construct and test the proposed CAD system. Five-fold cross validation of the test data is used to evaluate the accuracy of the performance results. The suggested hybrid CAD system achieves encouraging evaluation results, with overall accuracies of 100% and 95.80% for binary and multiclass prediction challenges, respectively. The experimental results reveal that the proposed hybrid AI model could identify benign and malignant breast tissues significantly, which is important for radiologists to recommend further investigation of abnormal mammograms and provide the optimal treatment plan.

Automatic Breast Mass Segmentation and Classification Using Subtraction of Temporally Sequential Digital Mammograms

OBJECTIVE

Cancer remains a major cause of morbidity and mortality globally, with 1 in 5 of all new cancers arising in the breast. The introduction of mammography for the radiological diagnosis of breast abnormalities, significantly decreased their mortality rates. Accurate detection and classification of breast masses in mammograms is especially challenging for various reasons, including low contrast and the normal variations of breast tissue density. Various Computer-Aided Diagnosis (CAD) systems are being developed to assist radiologists with the accurate classification of breast abnormalities.

METHODS

In this study, subtraction of temporally sequential digital mammograms and machine learning are proposed for the automatic segmentation and classification of masses. The performance of the algorithm was evaluated on a dataset created especially for the purposes of this study, with 320 images from 80 patients (two time points and two views of each breast) with precisely annotated mass locations by two radiologists.

RESULTS

Ninety-six features were extracted and ten classifiers were tested in a leave-one-patient-out and k-fold cross-validation process. Using Neural Networks, the detection of masses was 99.9% accurate. The classification accuracy of the masses as benign or suspicious increased from 92.6%, using the state-of-the-art temporal analysis, to 98%, using the proposed methodology. The improvement was statistically significant (p-value < 0.05).

CONCLUSION

These results demonstrate the effectiveness of the subtraction of temporally consecutive mammograms for the diagnosis of breast masses. Clinical and Translational Impact Statement: The proposed algorithm has the potential to substantially contribute to the development of automated breast cancer Computer-Aided Diagnosis systems with significant impact on patient prognosis.

Spiking Neural Network Based on Multi-Scale Saliency Fusion for Breast Cancer Detection

Deep neural networks have been successfully applied in the field of image recognition and object detection, and the recognition results are close to or even superior to those from human beings. A deep neural network takes the activation function as the basic unit. It is inferior to the spiking neural network, which takes the spiking neuron model as the basic unit in the aspect of biological interpretability. The spiking neural network is considered as the third-generation artificial neural network, which is event-driven and has low power consumption. It modulates the process of nerve cells from receiving a stimulus to firing spikes. However, it is difficult to train spiking neural network directly due to the non-differentiable spiking neurons. In particular, it is impossible to train a spiking neural network using the back-propagation algorithm directly. Therefore, the application scenarios of spiking neural network are not as extensive as deep neural network, and a spiking neural network is mostly used in simple image classification tasks. This paper proposed a spiking neural network method for the field of object detection based on medical images using the method of converting a deep neural network to spiking neural network. The detection framework relies on the YOLO structure and uses the feature pyramid structure to obtain the multi-scale features of the image. By fusing the high resolution of low-level features and the strong semantic information of high-level features, the detection precision of the network is improved. The proposed method is applied to detect the location and classification of breast lesions with ultrasound and X-ray datasets, and the results are 90.67% and 92.81%, respectively.

An integrated framework for breast mass classification and diagnosis using stacked ensemble of residual neural networks

A computer-aided diagnosis (CAD) system requires automated stages of tumor detection, segmentation, and classification that are integrated sequentially into one framework to assist the radiologists with a final diagnosis decision. In this paper, we introduce the final step of breast mass classification and diagnosis using a stacked ensemble of residual neural network (ResNet) models (i.e. ResNet50V2, ResNet101V2, and ResNet152V2). The work presents the task of classifying the detected and segmented breast masses into malignant or benign, and diagnosing the Breast Imaging Reporting and Data System (BI-RADS) assessment category with a score from 2 to 6 and the shape as oval, round, lobulated, or irregular. The proposed methodology was evaluated on two publicly available datasets, the Curated Breast Imaging Subset of Digital Database for Screening Mammography (CBIS-DDSM) and INbreast, and additionally on a private dataset. Comparative experiments were conducted on the individual models and an average ensemble of models with an XGBoost classifier. Qualitative and quantitative results show that the proposed model achieved better performance for (1) Pathology classification with an accuracy of 95.13%, 99.20%, and 95.88%; (2) BI-RADS category classification with an accuracy of 85.38%, 99%, and 96.08% respectively on CBIS-DDSM, INbreast, and the private dataset; and (3) shape classification with 90.02% on the CBIS-DDSM dataset. Our results demonstrate that our proposed integrated framework could benefit from all automated stages to outperform the latest deep learning methodologies.

Early detection and classification of abnormality in prior mammograms using image-to-image translation and YOLO techniques

BACKGROUND AND OBJECTIVE

Computer-aided-detection (CAD) systems have been developed to assist radiologists on finding suspicious lesions in mammogram. Deep Learning technology have recently succeeded to increase the chance of recognizing abnormality at an early stage in order to avoid unnecessary biopsies and decrease the mortality rate. In this study, we investigated the effectiveness of an end-to-end fusion model based on You-Only-Look-Once (YOLO) architecture, to simultaneously detect and classify suspicious breast lesions on digital mammograms. Four categories of cases were included: Mass, Calcification, Architectural Distortions, and Normal from a private digital mammographic database including 413 cases. For all cases, Prior mammograms (typically scanned 1 year before) were all reported as Normal, while Current mammograms were diagnosed as cancerous (confirmed by biopsies) or healthy.

METHODS

We propose to apply the YOLO-based fusion model to the Current mammograms for breast lesions detection and classification. Then apply the same model retrospectively to synthetic mammograms for an early cancer prediction, where the synthetic mammograms were generated from the Prior mammograms by using the image-to-image translation models, CycleGAN and Pix2Pix.

RESULTS

Evaluation results showed that our methodology could significantly detect and classify breast lesions on Current mammograms with a highest rate of 93% ± 0.118 for Mass lesions, 88% ± 0.09 for Calcification lesions, and 95% ± 0.06 for Architectural Distortion lesions. In addition, we reported evaluation results on Prior mammograms with a highest rate of 36% ± 0.01 for Mass lesions, 14% ± 0.01 for Calcification lesions, and 50% ± 0.02 for Architectural Distortion lesions. Normal mammograms were accordingly classified with an accuracy rate of 92% ± 0.09 and 90% ± 0.06 respectively on Current and Prior exams.

CONCLUSIONS

Our proposed framework was first developed to help detecting and identifying suspicious breast lesions in X-ray mammograms on their Current screening. The work was also suggested to reduce the temporal changes between pairs of Prior and follow-up screenings for early predicting the location and type of abnormalities in Prior mammogram screening. The paper presented a CAD method to assist doctors and experts to identify the risk of breast cancer presence. Overall, the proposed CAD method incorporates the advances of image processing, deep learning and image-to-image translation for a biomedical application.

Image Augmentation Techniques for Mammogram Analysis

Research in the medical imaging field using deep learning approaches has become progressively contingent. Scientific findings reveal that supervised deep learning methods' performance heavily depends on training set size, which expert radiologists must manually annotate. The latter is quite a tiring and time-consuming task. Therefore, most of the freely accessible biomedical image datasets are small-sized. Furthermore, it is challenging to have big-sized medical image datasets due to privacy and legal issues. Consequently, not a small number of supervised deep learning models are prone to overfitting and cannot produce generalized output. One of the most popular methods to mitigate the issue above goes under the name of data augmentation. This technique helps increase training set size by utilizing various transformations and has been publicized to improve the model performance when tested on new data. This article surveyed different data augmentation techniques employed on mammogram images. The article aims to provide insights into basic and deep learning-based augmentation techniques.

Machine Learning Decision Support for Bedside Ultrasound to Detect Lipohypertrophy

BACKGROUND

The most common dermatological complication of insulin therapy is lipohypertrophy.

OBJECTIVE

As a proof-of-concept, we built and tested an automated model using a convolutional neural network (CNN) to detect the presence of lipohypertrophy in ultrasound images.

METHODS

Ultrasound images were obtained in a blinded fashion using a portable GE LOGIQe machine with an L8-18i-D probe (5-18 MHz; GE Healthcare, Frankfurt, Germany). The data was split into train, validation and test splits of 70%, 15%, and 15% respectively. Given the small size of the dataset, image augmentation techniques were used to expand the size of the training set and improve the model's generalizability. To compare the performance of the different architectures, the team considered the accuracy and recall of the models when tested on our test set.

RESULTS

The DenseNet CNN architecture was found to have the highest accuracy (76%) and recall (76%) in detecting lipohypertrophy in ultrasound images, when compared to other CNN architectures. Additional work showed that the YOLOv5m object detection model could be used to help identify the approximate location of lipohypertrophy in ultrasound images identified as containing lipohypertrophy by the DenseNet CNN.

CONCLUSIONS

We were able to demonstrate the ability of machine learning approaches to automate the process of detecting and locating lipohypertrophy.

CLINICALTRIAL

YOLOv4-Based CNN Model versus Nested Contours Algorithm in the Suspicious Lesion Detection on the Mammography Image: A Direct Comparison in the Real Clinical Settings

BACKGROUND

We directly compared the mammography image processing results obtained with the help of the YOLOv4 convolutional neural network (CNN) model versus those obtained with the help of the NCA-based nested contours algorithm model.

METHOD

We used 1080 images to train the YOLOv4, plus 100 images with proven breast cancer (BC) and 100 images with proven absence of BC to test both models.

RESULTS

the rates of true-positive, false-positive and false-negative outcomes were 60, 10 and 40, respectively, for YOLOv4, and 93, 63 and 7, respectively, for NCA. The sensitivities for the YOLOv4 and the NCA were comparable to each other for star-like lesions, masses with unclear borders, round- or oval-shaped masses with clear borders and partly visualized masses. On the contrary, the NCA was superior to the YOLOv4 in the case of asymmetric density and of changes invisible on the dense parenchyma background. Radiologists changed their earlier decisions in six cases per 100 for NCA. YOLOv4 outputs did not influence the radiologists' decisions.

CONCLUSIONS

in our set, NCA clinically significantly surpasses YOLOv4.

Automated Classification of Rheumatoid Arthritis, Osteoarthritis, and Normal Hand Radiographs with Deep Learning Methods

Rheumatoid arthritis and hand osteoarthritis are two different arthritis that causes pain, function limitation, and permanent joint damage in the hands. Plain hand radiographs are the most commonly used imaging methods for the diagnosis, differential diagnosis, and monitoring of rheumatoid arthritis and osteoarthritis. In this retrospective study, the You Only Look Once (YOLO) algorithm was used to obtain hand images from original radiographs without data loss, and classification was made by applying transfer learning with a pre-trained VGG-16 network. The data augmentation method was applied during training. The results of the study were evaluated with performance metrics such as accuracy, sensitivity, specificity, and precision calculated from the confusion matrix, and AUC (area under the ROC curve) calculated from ROC (receiver operating characteristic) curve. In the classification of rheumatoid arthritis and normal hand radiographs, 90.7%, 92.6%, 88.7%, 89.3%, and 0.97 accuracy, sensitivity, specificity, precision, and AUC results, respectively, and in the classification of osteoarthritis and normal hand radiographs, 90.8%, 91.4%, 90.2%, 91.4%, and 0.96 accuracy, sensitivity, specificity, precision, and AUC results were obtained, respectively. In the classification of rheumatoid arthritis, osteoarthritis, and normal hand radiographs, an 80.6% accuracy result was obtained. In this study, to develop an end-to-end computerized method, the YOLOv4 algorithm was used for object detection, and a pre-trained VGG-16 network was used for the classification of hand radiographs. This computer-aided diagnosis method can assist clinicians in interpreting hand radiographs, especially in rheumatoid arthritis and osteoarthritis.

Computed Tomography Image Features under Deep Learning Algorithm Applied in Staging Diagnosis of Bladder Cancer and Detection on Ceramide Glycosylation

The research is aimed at investigating computed tomography (CT) image based on deep learning algorithm and the application value of ceramide glycosylation in diagnosing bladder cancer. The images of ordinary CT detection were improved. In this study, 60 bladder cancer patients were selected and performed with ordinary CT detection, and the detection results were processed by CT based on deep learning algorithms and compared with pathological diagnosis. In addition, Western Blot technology was used to detect the expression of glucose ceramide synthase (GCS) in the cell membrane of tumor tissues and normal tissues of bladder. The comparison results found that, in simple CT clinical staging, the coincidence rates of T1 stage, T2a stage, T2b stage, T3 stage, and T4 stage were 28.56%, 62.51%, 78.94%, 84.61%, and 74.99%, respectively; and the total coincidence rate of CT clinical staging was 63.32%, which was greatly different from the clinical staging of pathological diagnosis (P < 0.05). In the clinical staging of algorithm-based CT test results, the coincidence rates of T1 stage and T2a stage were 50.01% and 91.65%, respectively; and those of T2b stage, T3 stage, and T4 stage were 100.00%; and the total coincidence rate was 96.69%, which was not obviously different from the clinical staging of pathological diagnosis (P > 0.05). Therefore, it could be concluded that the algorithm-based CT detection results were more accurate, and the use of CT scans based on deep learning algorithms in the preoperative staging and clinical treatment of bladder cancer showed reliable guiding significance and clinical value. In addition, it was found that the expression level of GCS in normal bladder tissues was much lower than that in bladder cancer tissues. This indicated that the changes in GCS were closely related to the development and prognosis of bladder cancer. Therefore, it was believed that GCS may be an effective target for the treatment of bladder cancer in the future, and further research was needed for specific conditions.