Deep Learning for Medical Image-Based Cancer Diagnosis

The Performance and Clinical Applicability of HER2 Digital Image Analysis in Breast Cancer: A Systematic Review

This systematic review aims to address the research gap in the performance of computational algorithms for the digital image analysis of HER2 images in clinical settings. While numerous studies have explored various aspects of these algorithms, there is a lack of comprehensive evaluation regarding their effectiveness in real-world clinical applications. We conducted a search of the Web of Science and PubMed databases for studies published from 31 December 2013 to 30 June 2024, focusing on performance effectiveness and components such as dataset size, diversity and source, ground truth, annotation, and validation methods. The study was registered with PROSPERO (CRD42024525404). Key questions guiding this review include the following: How effective are current computational algorithms at detecting HER2 status in digital images? What are the common validation methods and dataset characteristics used in these studies? Is there standardization of algorithm evaluations of clinical applications that can improve the clinical utility and reliability of computational tools for HER2 detection in digital image analysis? We identified 6833 publications, with 25 meeting the inclusion criteria. The accuracy rate with clinical datasets varied from 84.19% to 97.9%. The highest accuracy was achieved on the publicly available Warwick dataset at 98.8% in synthesized datasets. Only 12% of studies used separate datasets for external validation; 64% of studies used a combination of accuracy, precision, recall, and F1 as a set of performance measures. Despite the high accuracy rates reported in these studies, there is a notable absence of direct evidence supporting their clinical application. To facilitate the integration of these technologies into clinical practice, there is an urgent need to address real-world challenges and overreliance on internal validation. Standardizing study designs on real clinical datasets can enhance the reliability and clinical applicability of computational algorithms in improving the detection of HER2 cancer.

MR-CT image fusion method of intracranial tumors based on Res2Net

BACKGROUND

Information complementarity can be achieved by fusing MR and CT images, and fusion images have abundant soft tissue and bone information, facilitating accurate auxiliary diagnosis and tumor target delineation.

PURPOSE

The purpose of this study was to construct high-quality fusion images based on the MR and CT images of intracranial tumors by using the Residual-Residual Network (Res2Net) method.

METHODS

This paper proposes an MR and CT image fusion method based on Res2Net. The method comprises three components: feature extractor, fusion layer, and reconstructor. The feature extractor utilizes the Res2Net framework to extract multiscale features from source images. The fusion layer incorporates a fusion strategy based on spatial mean attention, adaptively adjusting fusion weights for feature maps at each position to preserve fine details from the source images. Finally, fused features are input into the feature reconstructor to reconstruct a fused image.

RESULTS

Qualitative results indicate that the proposed fusion method exhibits clear boundary contours and accurate localization of tumor regions. Quantitative results show that the method achieves average gradient, spatial frequency, entropy, and visual information fidelity for fusion metrics of 4.6771, 13.2055, 1.8663, and 0.5176, respectively. Comprehensive experimental results demonstrate that the proposed method preserves more texture details and structural information in fused images than advanced fusion algorithms, reducing spectral artifacts and information loss and performing better in terms of visual quality and objective metrics.

CONCLUSION

The proposed method effectively combines MR and CT image information, allowing the precise localization of tumor region boundaries, assisting clinicians in clinical diagnosis.

Integrating Omics Data and AI for Cancer Diagnosis and Prognosis

Cancer is one of the leading causes of death, making timely diagnosis and prognosis very important. Utilization of AI (artificial intelligence) enables providers to organize and process patient data in a way that can lead to better overall outcomes. This review paper aims to look at the varying uses of AI for diagnosis and prognosis and clinical utility. PubMed and EBSCO databases were utilized for finding publications from 1 January 2020 to 22 December 2023. Articles were collected using key search terms such as "artificial intelligence" and "machine learning." Included in the collection were studies of the application of AI in determining cancer diagnosis and prognosis using multi-omics data, radiomics, pathomics, and clinical and laboratory data. The resulting 89 studies were categorized into eight sections based on the type of data utilized and then further subdivided into two subsections focusing on cancer diagnosis and prognosis, respectively. Eight studies integrated more than one form of omics, namely genomics, transcriptomics, epigenomics, and proteomics. Incorporating AI into cancer diagnosis and prognosis alongside omics and clinical data represents a significant advancement. Given the considerable potential of AI in this domain, ongoing prospective studies are essential to enhance algorithm interpretability and to ensure safe clinical integration.

Prediction of metastases in confusing mediastinal lymph nodes based on flourine-18 fluorodeoxyglucose (18F-FDG) positron emission tomography/computed tomography (PET/CT) imaging using machine learning

Background

For patient management and prognosis, accurate assessment of mediastinal lymph node (LN) status is essential. This study aimed to use machine learning approaches to assess the status of confusing LNs in the mediastinum using positron emission tomography/computed tomography (PET/CT) images; the results were then compared with the diagnostic conclusions of nuclear medicine physicians.

Methods

A total of 509 confusing mediastinal LNs that had undergone pathological assessment or follow-up from 320 patients from three centres were retrospectively included in the study. LNs from centres I and II were randomised into a training cohort (N=324) and an internal validation cohort (N=81), while those from centre III patients formed an external validation cohort (N=104). Various parameters measured from PET and CT images and extracted radiomics and deep learning features were used to construct PET/CT-parameter, radiomics, and deep learning models, respectively. Model performance was compared with the diagnostic results of nuclear medicine physicians using the area under the curve (AUC), sensitivity, specificity, and decision curve analysis (DCA).

Results

The coupled model of gradient boosting decision tree-logistic regression (GBDT-LR) incorporating radiomic features showed AUCs of 92.2% [95% confidence interval (CI), 0.890-0.953], 84.6% (95% CI, 0.761-0.930) and 84.6% (95% CI, 0.770-0.922) across the three cohorts. It significantly outperformed the deep learning model, the parametric PET/CT model and the physician's diagnosis. DCA demonstrated the clinical usefulness of the GBDT-LR model.

Conclusions

The presented GBDT-LR model performed well in evaluating confusing mediastinal LNs in both internal and external validation sets. It not only crossed radiometric features but also avoided overfitting.

Enhancing brain tumor classification in MRI scans with a multi-layer customized convolutional neural network approach

Background

The necessity of prompt and accurate brain tumor diagnosis is unquestionable for optimizing treatment strategies and patient prognoses. Traditional reliance on Magnetic Resonance Imaging (MRI) analysis, contingent upon expert interpretation, grapples with challenges such as time-intensive processes and susceptibility to human error.

Objective

This research presents a novel Convolutional Neural Network (CNN) architecture designed to enhance the accuracy and efficiency of brain tumor detection in MRI scans.

Methods

The dataset used in the study comprises 7,023 brain MRI images from figshare, SARTAJ, and Br35H, categorized into glioma, meningioma, no tumor, and pituitary classes, with a CNN-based multi-task classification model employed for tumor detection, classification, and location identification. Our methodology focused on multi-task classification using a single CNN model for various brain MRI classification tasks, including tumor detection, classification based on grade and type, and tumor location identification.

Results

The proposed CNN model incorporates advanced feature extraction capabilities and deep learning optimization techniques, culminating in a groundbreaking paradigm shift in automated brain MRI analysis. With an exceptional tumor classification accuracy of 99%, our method surpasses current methodologies, demonstrating the remarkable potential of deep learning in medical applications.

Conclusion

This study represents a significant advancement in the early detection and treatment planning of brain tumors, offering a more efficient and accurate alternative to traditional MRI analysis methods.

A Novel Approach for the Detection and Severity Grading of Chronic Obstructive Pulmonary Disease Based on Transformed Volumetric Capnography

Chronic Obstructive Pulmonary Disease (COPD), as the third leading cause of death worldwide, is a major global health issue. The early detection and grading of COPD are pivotal for effective treatment. Traditional spirometry tests, requiring considerable physical effort and strict adherence to quality standards, pose challenges in COPD diagnosis. Volumetric capnography (VCap), which can be performed during natural breathing without requiring additional compliance, presents a promising alternative tool. In this study, the dataset comprised 279 subjects with normal pulmonary function and 148 patients diagnosed with COPD. We introduced a novel quantitative analysis method for VCap. Volumetric capnograms were converted into two-dimensional grayscale images through the application of Gramian Angular Field (GAF) transformation. Subsequently, a multi-scale convolutional neural network, CapnoNet, was conducted to extract features and facilitate classification. To improve CapnoNet's performance, two data augmentation techniques were implemented. The proposed model exhibited a detection accuracy for COPD of 95.83%, with precision, recall, and F1 measures of 95.21%, 95.70%, and 95.45%, respectively. In the task of grading the severity of COPD, the model attained an accuracy of 96.36%, complemented by precision, recall, and F1 scores of 88.49%, 89.99%, and 89.15%, respectively. This work provides a new perspective for the quantitative analysis of volumetric capnography and demonstrates the strong performance of the proposed CapnoNet in the diagnosis and grading of COPD. It offers direction and an effective solution for the clinical application of capnography.

Deep Learning Approaches for Medical Image Analysis and Diagnosis

In addition to enhancing diagnostic accuracy, deep learning techniques offer the potential to streamline workflows, reduce interpretation time, and ultimately improve patient outcomes. The scalability and adaptability of deep learning algorithms enable their deployment across diverse clinical settings, ranging from radiology departments to point-of-care facilities. Furthermore, ongoing research efforts focus on addressing the challenges of data heterogeneity, model interpretability, and regulatory compliance, paving the way for seamless integration of deep learning solutions into routine clinical practice. As the field continues to evolve, collaborations between clinicians, data scientists, and industry stakeholders will be paramount in harnessing the full potential of deep learning for advancing medical image analysis and diagnosis. Furthermore, the integration of deep learning algorithms with other technologies, including natural language processing and computer vision, may foster multimodal medical data analysis and clinical decision support systems to improve patient care. The future of deep learning in medical image analysis and diagnosis is promising. With each success and advancement, this technology is getting closer to being leveraged for medical purposes. Beyond medical image analysis, patient care pathways like multimodal imaging, imaging genomics, and intelligent operating rooms or intensive care units can benefit from deep learning models.

Applied Artificial Intelligence in Healthcare: A Review of Computer Vision Technology Application in Hospital Settings

Computer vision (CV), a type of artificial intelligence (AI) that uses digital videos or a sequence of images to recognize content, has been used extensively across industries in recent years. However, in the healthcare industry, its applications are limited by factors like privacy, safety, and ethical concerns. Despite this, CV has the potential to improve patient monitoring, and system efficiencies, while reducing workload. In contrast to previous reviews, we focus on the end-user applications of CV. First, we briefly review and categorize CV applications in other industries (job enhancement, surveillance and monitoring, automation, and augmented reality). We then review the developments of CV in the hospital setting, outpatient, and community settings. The recent advances in monitoring delirium, pain and sedation, patient deterioration, mechanical ventilation, mobility, patient safety, surgical applications, quantification of workload in the hospital, and monitoring for patient events outside the hospital are highlighted. To identify opportunities for future applications, we also completed journey mapping at different system levels. Lastly, we discuss the privacy, safety, and ethical considerations associated with CV and outline processes in algorithm development and testing that limit CV expansion in healthcare. This comprehensive review highlights CV applications and ideas for its expanded use in healthcare.

Interpretable CT radiomics model for invasiveness prediction in patients with ground-glass nodules

AIM

To evaluate the performance of an interpretable computed tomography (CT) radiomic model in predicting the invasiveness of ground-glass nodules (GGNs).

MATERIALS AND METHODS

The study was conducted retrospectively from 1 August 2017 to 1 August 2022, at three different centres. Two hundred and thirty patients with GGNs were enrolled at centre I as a training cohort. Centres II (n=157) and III (n=156) formed two external validation cohorts. Radiomics features extracted based on CT were reduced by a coarse-fine feature screening strategy. A radiomic model was developed through the use of the LASSO (least absolute shrinkage and selection operator) and XGBoost algorithms. Then, a radiological model was established through multivariate logistic regression analysis. Finally, the interpretability of the model was explored using SHapley Additive exPlanations (SHAP).

RESULTS

The radiomic XGBoost model outperformed the radiomic logistic model and radiological model in assessing the invasiveness of GGNs. The area under the curve (AUC) values for the radiomic XGBoost model were 0.885 (95% confidence interval [CI] 0.836-0.923), 0.853 (95% CI 0.790-0.906), and 0.838 (95% CI 0.773-0.902) in the training and the two external validation cohorts, respectively. The SHAP method allowed for both a quantitative and visual representation of how decisions were made using a given model for each individual patient. This can provide a deeper understanding of the decision-making mechanisms within the model and the factors that contribute to its prediction effectiveness.

CONCLUSIONS

The present interpretable CT radiomics model has the potential to preoperatively evaluate the invasiveness of GGNs. Furthermore, it can provide personalised, image-based clinical-decision support.

Graph Neural Networks in Cancer and Oncology Research: Emerging and Future Trends

Next-generation cancer and oncology research needs to take full advantage of the multimodal structured, or graph, information, with the graph data types ranging from molecular structures to spatially resolved imaging and digital pathology, biological networks, and knowledge graphs. Graph Neural Networks (GNNs) efficiently combine the graph structure representations with the high predictive performance of deep learning, especially on large multimodal datasets. In this review article, we survey the landscape of recent (2020-present) GNN applications in the context of cancer and oncology research, and delineate six currently predominant research areas. We then identify the most promising directions for future research. We compare GNNs with graphical models and "non-structured" deep learning, and devise guidelines for cancer and oncology researchers or physician-scientists, asking the question of whether they should adopt the GNN methodology in their research pipelines.

Innovations in imaging modalities: a comparative review of MRI, long-axial field-of-view PET, and full-ring CZT-SPECT in detecting bone metastases

The accurate diagnosis of bone metastasis, a condition in which cancer cells have spread to the bone, is essential for optimal patient care and outcome. This review provides a detailed overview of the current medical imaging techniques used to detect and diagnose this critical condition focusing on three cardinal imaging modalities: positron emission tomography (PET), single photon emission computed tomography (SPECT) and magnetic resonance imaging (MRI). Each of these techniques has unique advantages: PET/CT combines functional imaging with anatomical imaging, allowing precise localization of metabolic abnormalities; the SPECT/CT offers a wider range of radiopharmaceuticals for visualizing specific receptors and metabolic pathways; MRI stands out for its unparalleled ability to produce high-resolution images of bone marrow structures. However, as this paper shows, each modality has its own limitations. The comprehensive analysis does not stop at the technical aspects, but ventures into the wider implications of these techniques in a clinical setting. By understanding the synergies and shortcomings of these modalities, healthcare professionals can make diagnostic and therapeutic decisions. Furthermore, at a time when medical technology is evolving at a breakneck pace, this review casts a speculative eye towards future advances in the field of bone metastasis imaging, bridging the current state with future possibilities. Such insights are essential for both clinicians and researchers navigating the complex landscape of bone metastasis diagnosis.

An Innovative Solution Based on TSCA-ViT for Osteosarcoma Diagnosis in Resource-Limited Settings

Identifying and managing osteosarcoma pose significant challenges, especially in resource-constrained developing nations. Advanced diagnostic methods involve isolating the nucleus from cancer cells for comprehensive analysis. However, two main challenges persist: mitigating image noise during the capture and transmission of cellular sections, and providing an efficient, accurate, and cost-effective solution for cell nucleus segmentation. To tackle these issues, we introduce the Twin-Self and Cross-Attention Vision Transformer (TSCA-ViT). This pioneering AI-based system employs a directed filtering algorithm for noise reduction and features an innovative transformer architecture with a twin attention mechanism for effective segmentation. The model also incorporates cross-attention-enabled skip connections to augment spatial information. We evaluated our method on a dataset of 1000 osteosarcoma pathology slide images from the Second People's Hospital of Huaihua, achieving a remarkable average precision of 97.7%. This performance surpasses traditional methodologies. Furthermore, TSCA-ViT offers enhanced computational efficiency owing to its fewer parameters, which results in reduced time and equipment costs. These findings underscore the superior efficacy and efficiency of TSCA-ViT, offering a promising approach for addressing the ongoing challenges in osteosarcoma diagnosis and treatment, particularly in settings with limited resources.

Optimizing Clinical Diabetes Diagnosis through Generative Adversarial Networks: Evaluation and Validation

The escalating prevalence of Type 2 Diabetes (T2D) represents a substantial burden on global healthcare systems, especially in regions such as Mexico. Existing diagnostic techniques, although effective, often require invasive procedures and labor-intensive efforts. The promise of artificial intelligence and data science for streamlining and enhancing T2D diagnosis is well-recognized; however, these advancements are frequently constrained by the limited availability of comprehensive patient datasets. To mitigate this challenge, the present study investigated the efficacy of Generative Adversarial Networks (GANs) for augmenting existing T2D patient data, with a focus on a Mexican cohort. The researchers utilized a dataset of 1019 Mexican nationals, divided into 499 non-diabetic controls and 520 diabetic cases. GANs were applied to create synthetic patient profiles, which were subsequently used to train a Random Forest (RF) classification model. The study's findings revealed a notable improvement in the model's diagnostic accuracy, validating the utility of GAN-based data augmentation in a clinical context. The results bear significant implications for enhancing the robustness and reliability of Machine Learning tools in T2D diagnosis and management, offering a pathway toward more timely and effective patient care.