1
|
Liu Z, Kainth K, Zhou A, Deyer TW, Fayad ZA, Greenspan H, Mei X. A review of self-supervised, generative, and few-shot deep learning methods for data-limited magnetic resonance imaging segmentation. NMR IN BIOMEDICINE 2024; 37:e5143. [PMID: 38523402 DOI: 10.1002/nbm.5143] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Revised: 02/15/2024] [Accepted: 02/16/2024] [Indexed: 03/26/2024]
Abstract
Magnetic resonance imaging (MRI) is a ubiquitous medical imaging technology with applications in disease diagnostics, intervention, and treatment planning. Accurate MRI segmentation is critical for diagnosing abnormalities, monitoring diseases, and deciding on a course of treatment. With the advent of advanced deep learning frameworks, fully automated and accurate MRI segmentation is advancing. Traditional supervised deep learning techniques have advanced tremendously, reaching clinical-level accuracy in the field of segmentation. However, these algorithms still require a large amount of annotated data, which is oftentimes unavailable or impractical. One way to circumvent this issue is to utilize algorithms that exploit a limited amount of labeled data. This paper aims to review such state-of-the-art algorithms that use a limited number of annotated samples. We explain the fundamental principles of self-supervised learning, generative models, few-shot learning, and semi-supervised learning and summarize their applications in cardiac, abdomen, and brain MRI segmentation. Throughout this review, we highlight algorithms that can be employed based on the quantity of annotated data available. We also present a comprehensive list of notable publicly available MRI segmentation datasets. To conclude, we discuss possible future directions of the field-including emerging algorithms, such as contrastive language-image pretraining, and potential combinations across the methods discussed-that can further increase the efficacy of image segmentation with limited labels.
Collapse
Affiliation(s)
- Zelong Liu
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Komal Kainth
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Alexander Zhou
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Timothy W Deyer
- East River Medical Imaging, New York, New York, USA
- Department of Radiology, Cornell Medicine, New York, New York, USA
| | - Zahi A Fayad
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, New York, USA
- Department of Diagnostic, Molecular, and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Hayit Greenspan
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, New York, USA
- Department of Diagnostic, Molecular, and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Xueyan Mei
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, New York, USA
- Department of Diagnostic, Molecular, and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| |
Collapse
|
2
|
Namiot ED, Zembatov GM, Tregub PP. Insights into brain tumor diagnosis: exploring in situ hybridization techniques. Front Neurol 2024; 15:1393572. [PMID: 39022728 PMCID: PMC11252041 DOI: 10.3389/fneur.2024.1393572] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Accepted: 05/31/2024] [Indexed: 07/20/2024] Open
Abstract
Objectives Diagnosing brain tumors is critical due to their complex nature. This review explores the potential of in situ hybridization for diagnosing brain neoplasms, examining their attributes and applications in neurology and oncology. Methods The review surveys literature and cross-references findings with the OMIM database, examining 513 records. It pinpoints mutations suitable for in situ hybridization and identifies common chromosomal and gene anomalies in brain tumors. Emphasis is placed on mutations' clinical implications, including prognosis and drug sensitivity. Results Amplifications in EGFR, MDM2, and MDM4, along with Y chromosome loss, chromosome 7 polysomy, and deletions of PTEN, CDKN2/p16, TP53, and DMBT1, correlate with poor prognosis in glioma patients. Protective genetic changes in glioma include increased expression of ADGRB3/1, IL12B, DYRKA1, VEGFC, LRRC4, and BMP4. Elevated MMP24 expression worsens prognosis in glioma, oligodendroglioma, and meningioma patients. Meningioma exhibits common chromosomal anomalies like loss of chromosomes 1, 9, 17, and 22, with specific genes implicated in their development. Main occurrences in medulloblastoma include the formation of isochromosome 17q and SHH signaling pathway disruption. Increased expression of BARHL1 is associated with prolonged survival. Adenomas mutations were reviewed with a focus on adenoma-carcinoma transition and different subtypes, with MMP9 identified as the main metalloprotease implicated in tumor progression. Discussion Molecular-genetic diagnostics for common brain tumors involve diverse genetic anomalies. In situ hybridization shows promise for diagnosing and prognosticating tumors. Detecting tumor-specific alterations is vital for prognosis and treatment. However, many mutations require other methods, hindering in situ hybridization from becoming the primary diagnostic method.
Collapse
Affiliation(s)
- E. D. Namiot
- Department of Pathophysiology, First Moscow State Medical University (Sechenov University), Moscow, Russia
| | - G. M. Zembatov
- Department of Pathophysiology, First Moscow State Medical University (Sechenov University), Moscow, Russia
| | - P. P. Tregub
- Department of Pathophysiology, First Moscow State Medical University (Sechenov University), Moscow, Russia
- Brain Research Department, Federal State Scientific Center of Neurology, Moscow, Russia
- Scientific and Educational Resource Center, Innovative Technologies of Immunophenotyping, Digital Spatial Profiling and Ultrastructural Analysis, Peoples' Friendship University of Russia (RUDN University), Moscow, Russia
| |
Collapse
|
3
|
Abraham A, Jose R, Farooqui N, Mayer J, Ahmad J, Satti Z, Jacob TJ, Syed F, Toma M. The Role of ArtificiaI Intelligence in Brain Tumor Diagnosis: An Evaluation of a Machine Learning Model. Cureus 2024; 16:e61483. [PMID: 38952601 PMCID: PMC11215798 DOI: 10.7759/cureus.61483] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/01/2024] [Indexed: 07/03/2024] Open
Abstract
This research study explores of the effectiveness of a machine learning image classification model in the accurate identification of various types of brain tumors. The types of tumors under consideration in this study are gliomas, meningiomas, and pituitary tumors. These are some of the most common types of brain tumors and pose significant challenges in terms of accurate diagnosis and treatment. The machine learning model that is the focus of this study is built on the Google Teachable Machine platform (Alphabet Inc., Mountain View, CA). The Google Teachable Machine is a machine learning image classification platform that is built from Tensorflow, a popular open-source platform for machine learning. The Google Teachable Machine model was specifically evaluated for its ability to differentiate between normal brains and the aforementioned types of tumors in MRI images. MRI images are a common tool in the diagnosis of brain tumors, but the challenge lies in the accurate classification of the tumors. This is where the machine learning model comes into play. The model is trained to recognize patterns in the MRI images that correspond to the different types of tumors. The performance of the machine learning model was assessed using several metrics. These include precision, recall, and F1 score. These metrics were generated from a confusion matrix analysis and performance graphs. A confusion matrix is a table that is often used to describe the performance of a classification model. Precision is a measure of the model's ability to correctly identify positive instances among all instances it identified as positive. Recall, on the other hand, measures the model's ability to correctly identify positive instances among all actual positive instances. The F1 score is a measure that combines precision and recall providing a single metric for model performance. The results of the study were promising. The Google Teachable Machine model demonstrated high performance, with accuracy, precision, recall, and F1 scores ranging between 0.84 and 1.00. This suggests that the model is highly effective in accurately classifying the different types of brain tumors. This study provides insights into the potential of machine learning models in the accurate classification of brain tumors. The findings of this study lay the groundwork for further research in this area and have implications for the diagnosis and treatment of brain tumors. The study also highlights the potential of machine learning in enhancing the field of medical imaging and diagnosis. With the increasing complexity and volume of medical data, machine learning models like the one evaluated in this study could play a crucial role in improving the accuracy and efficiency of diagnoses. Furthermore, the study underscores the importance of continued research and development in this field to further refine these models and overcome any potential limitations or challenges. Overall, the study contributes to the field of medical imaging and machine learning and sets the stage for future research and advancements in this area.
Collapse
Affiliation(s)
- Adriel Abraham
- Department of Internal Medicine, New York Institute of Technology College of Osteopathic Medicine, New York, USA
| | - Rejath Jose
- Department of Internal Medicine, New York Institute of Technology College of Osteopathic Medicine, New York, USA
| | - Nabeel Farooqui
- Department of Computer and Information Science, University of Pennsylvania School of Engineering and Applied Science, Philadelphia, USA
| | - Jonathan Mayer
- Department of Clinical Sciences, New York Institute of Technology College of Osteopathic Medicine, New York, USA
| | - Jawad Ahmad
- Department of Clinical Sciences, New York Institute of Technology College of Osteopathic Medicine, New York, USA
| | - Zain Satti
- Department of Clinical Sciences, New York Institute of Technology College of Osteopathic Medicine, New York, USA
| | - Thomas J Jacob
- Department of Internal Medicine, New York Institute of Technology College of Osteopathic Medicine, New York, USA
| | - Faiz Syed
- Department of Internal Medicine, New York Institute of Technology College of Osteopathic Medicine, New York, USA
| | - Milan Toma
- Department of Osteopathic Manipulative Medicine, New York Institute of Technology College of Osteopathic Medicine, New York, USA
| |
Collapse
|
4
|
Batool A, Byun YC. Brain tumor detection with integrating traditional and computational intelligence approaches across diverse imaging modalities - Challenges and future directions. Comput Biol Med 2024; 175:108412. [PMID: 38691914 DOI: 10.1016/j.compbiomed.2024.108412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Revised: 03/18/2024] [Accepted: 04/02/2024] [Indexed: 05/03/2024]
Abstract
Brain tumor segmentation and classification play a crucial role in the diagnosis and treatment planning of brain tumors. Accurate and efficient methods for identifying tumor regions and classifying different tumor types are essential for guiding medical interventions. This study comprehensively reviews brain tumor segmentation and classification techniques, exploring various approaches based on image processing, machine learning, and deep learning. Furthermore, our study aims to review existing methodologies, discuss their advantages and limitations, and highlight recent advancements in this field. The impact of existing segmentation and classification techniques for automated brain tumor detection is also critically examined using various open-source datasets of Magnetic Resonance Images (MRI) of different modalities. Moreover, our proposed study highlights the challenges related to segmentation and classification techniques and datasets having various MRI modalities to enable researchers to develop innovative and robust solutions for automated brain tumor detection. The results of this study contribute to the development of automated and robust solutions for analyzing brain tumors, ultimately aiding medical professionals in making informed decisions and providing better patient care.
Collapse
Affiliation(s)
- Amreen Batool
- Department of Electronic Engineering, Institute of Information Science & Technology, Jeju National University, Jeju, 63243, South Korea
| | - Yung-Cheol Byun
- Department of Computer Engineering, Major of Electronic Engineering, Jeju National University, Institute of Information Science Technology, Jeju, 63243, South Korea.
| |
Collapse
|
5
|
Abd-Ellah MK, Awad AI, Khalaf AAM, Ibraheem AM. Automatic brain-tumor diagnosis using cascaded deep convolutional neural networks with symmetric U-Net and asymmetric residual-blocks. Sci Rep 2024; 14:9501. [PMID: 38664436 PMCID: PMC11045751 DOI: 10.1038/s41598-024-59566-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2023] [Accepted: 04/12/2024] [Indexed: 04/28/2024] Open
Abstract
The use of various kinds of magnetic resonance imaging (MRI) techniques for examining brain tissue has increased significantly in recent years, and manual investigation of each of the resulting images can be a time-consuming task. This paper presents an automatic brain-tumor diagnosis system that uses a CNN for detection, classification, and segmentation of glioblastomas; the latter stage seeks to segment tumors inside glioma MRI images. The structure of the developed multi-unit system consists of two stages. The first stage is responsible for tumor detection and classification by categorizing brain MRI images into normal, high-grade glioma (glioblastoma), and low-grade glioma. The uniqueness of the proposed network lies in its use of different levels of features, including local and global paths. The second stage is responsible for tumor segmentation, and skip connections and residual units are used during this step. Using 1800 images extracted from the BraTS 2017 dataset, the detection and classification stage was found to achieve a maximum accuracy of 99%. The segmentation stage was then evaluated using the Dice score, specificity, and sensitivity. The results showed that the suggested deep-learning-based system ranks highest among a variety of different strategies reported in the literature.
Collapse
Affiliation(s)
| | - Ali Ismail Awad
- College of Information Technology, United Arab Emirates University, P.O. Box 15551, Al Ain, United Arab Emirates.
- Faculty of Engineering, Al-Azhar University, P.O. Box 83513, Qena, Egypt.
| | - Ashraf A M Khalaf
- Department of Electrical Engineering, Faculty of Engineering, Minia University, Minia, 61519, Egypt
| | - Amira Mofreh Ibraheem
- Faculty of Artificial Intelligence, Egyptian Russian University, Cairo, 11829, Egypt
| |
Collapse
|
6
|
Yang C, Fan Y, Zhao D, Wang Z, Wang X, Wang H, Hu Y, He L, Zhang J, Wang Y, Liu Y, Sha X, Su J. Habitat-Based Radiomics for Predicting EGFR Mutations in Exon 19 and 21 From Brain Metastasis. Acad Radiol 2024:S1076-6332(24)00158-2. [PMID: 38599906 DOI: 10.1016/j.acra.2024.03.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2024] [Revised: 03/09/2024] [Accepted: 03/17/2024] [Indexed: 04/12/2024]
Abstract
RATIONALE AND OBJECTIVES To explore and externally validate habitat-based radiomics for preoperative prediction of epidermal growth factor receptor (EGFR) mutations in exon 19 and 21 from MRI imaging of non-small cell lung cancer (NSCLC)-originated brain metastasis (BM). METHODS A total of 170, 62 and 61 patients from center 1, center 2 and center 3, respectively were included. All patients underwent contrast-enhanced T1-weighted (T1CE) and T2-weighted (T2W) MRI scans. Radiomics features were extracted from the tumor active (TA) and peritumoral edema (PE) regions in each MRI slice. The most important features were selected by the least absolute shrinkage and selection operator regression to develop radiomics signatures based on TA (RS-TA), PE (RS-PE) and their combination (RS-Com). Receiver operating characteristic (ROC) curve analysis was performed to access performance of radiomics models for both internal and external validation cohorts. RESULTS 10, four and six most predictive features were identified to be strongly associated with the EGFR mutation status, exon 19 and exon 21, respectively. The RSs derived from the PE region outperformed those from the TA region for predicting the EGFR mutation, exon 19 and exon 21. The RS-Coms generated the highest performance in the primary training (AUCs, RS-EGFR-Com vs. RS-exon 19-Com vs. RS-exon 21-Com, 0.955 vs. 0.946 vs. 0.928), internal validation (AUCs, RS-EGFR-Com vs. RS-exon 19-Com vs. RS-exon 21-Com, 0.879 vs. 0.819 vs. 0.882), external validation 1 (AUCs, RS-EGFR-Com vs. RS-exon 19-Com vs. RS-exon 21-Com, 0.830 vs. 0.825 vs. 0.822), and external validation 2 (AUCs, RS-EGFR-Com vs. RS-exon 19-Com vs. RS-exon 21-Com, 0.812 vs. 0.818 vs. 0.800) cohort. CONCLUSION The developed habitat-based radiomics model can be used to accurately predict the EGFR mutation subtypes, which may potentially guide personalized treatments for NSCLC patients with BM.
Collapse
Affiliation(s)
- Chunna Yang
- School of Intelligent Medicine, China Medical University, Liaoning 110122, PR China
| | - Ying Fan
- School of Intelligent Medicine, China Medical University, Liaoning 110122, PR China
| | - Dan Zhao
- Department of Medical Imaging, Cancer Hospital of China Medical University, Liaoning Cancer Hospital and Institute, Liaoning 110042, PR China
| | - Zekun Wang
- Department of Medical Imaging, Cancer Hospital of China Medical University, Liaoning Cancer Hospital and Institute, Liaoning 110042, PR China
| | - Xiaoyu Wang
- Department of Radiology, Cancer Hospital of China Medical University, Liaoning Cancer Hospital and Institute, Liaoning 110042, PR China
| | - Huan Wang
- Radiation Oncology Department of Thoracic Cancer, Liaoning Cancer Hospital and Institute, Liaoning 110042, PR China
| | - Yanjun Hu
- Department of Medical Imaging, Cancer Hospital of China Medical University, Liaoning Cancer Hospital and Institute, Liaoning 110042, PR China
| | - Lingzi He
- Department of Medical Oncology, The First Hospital of China Medical University, Shenyang 110122, PR China
| | - Jin Zhang
- School of Intelligent Medicine, China Medical University, Liaoning 110122, PR China
| | - Yan Wang
- School of Intelligent Medicine, China Medical University, Liaoning 110122, PR China
| | - Yan Liu
- School of Intelligent Medicine, China Medical University, Liaoning 110122, PR China
| | - Xianzheng Sha
- School of Intelligent Medicine, China Medical University, Liaoning 110122, PR China
| | - Juan Su
- School of Intelligent Medicine, China Medical University, Liaoning 110122, PR China.
| |
Collapse
|
7
|
Saluja S, Trivedi MC, Saha A. Deep CNNs for glioma grading on conventional MRIs: Performance analysis, challenges, and future directions. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2024; 21:5250-5282. [PMID: 38872535 DOI: 10.3934/mbe.2024232] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2024]
Abstract
The increasing global incidence of glioma tumors has raised significant healthcare concerns due to their high mortality rates. Traditionally, tumor diagnosis relies on visual analysis of medical imaging and invasive biopsies for precise grading. As an alternative, computer-assisted methods, particularly deep convolutional neural networks (DCNNs), have gained traction. This research paper explores the recent advancements in DCNNs for glioma grading using brain magnetic resonance images (MRIs) from 2015 to 2023. The study evaluated various DCNN architectures and their performance, revealing remarkable results with models such as hybrid and ensemble based DCNNs achieving accuracy levels of up to 98.91%. However, challenges persisted in the form of limited datasets, lack of external validation, and variations in grading formulations across diverse literature sources. Addressing these challenges through expanding datasets, conducting external validation, and standardizing grading formulations can enhance the performance and reliability of DCNNs in glioma grading, thereby advancing brain tumor classification and extending its applications to other neurological disorders.
Collapse
Affiliation(s)
- Sonam Saluja
- Department of Computer Science and Engineering, National Institute of Technology Agartala, Tripura 799046, India
| | - Munesh Chandra Trivedi
- Department of Computer Science and Engineering, National Institute of Technology Agartala, Tripura 799046, India
| | - Ashim Saha
- Department of Computer Science and Engineering, National Institute of Technology Agartala, Tripura 799046, India
| |
Collapse
|
8
|
El-Assy AM, Amer HM, Ibrahim HM, Mohamed MA. A novel CNN architecture for accurate early detection and classification of Alzheimer's disease using MRI data. Sci Rep 2024; 14:3463. [PMID: 38342924 PMCID: PMC10859371 DOI: 10.1038/s41598-024-53733-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Accepted: 02/04/2024] [Indexed: 02/13/2024] Open
Abstract
Alzheimer's disease (AD) is a debilitating neurodegenerative disorder that requires accurate diagnosis for effective management and treatment. In this article, we propose an architecture for a convolutional neural network (CNN) that utilizes magnetic resonance imaging (MRI) data from the Alzheimer's disease Neuroimaging Initiative (ADNI) dataset to categorize AD. The network employs two separate CNN models, each with distinct filter sizes and pooling layers, which are concatenated in a classification layer. The multi-class problem is addressed across three, four, and five categories. The proposed CNN architecture achieves exceptional accuracies of 99.43%, 99.57%, and 99.13%, respectively. These high accuracies demonstrate the efficacy of the network in capturing and discerning relevant features from MRI images, enabling precise classification of AD subtypes and stages. The network architecture leverages the hierarchical nature of convolutional layers, pooling layers, and fully connected layers to extract both local and global patterns from the data, facilitating accurate discrimination between different AD categories. Accurate classification of AD carries significant clinical implications, including early detection, personalized treatment planning, disease monitoring, and prognostic assessment. The reported accuracy underscores the potential of the proposed CNN architecture to assist medical professionals and researchers in making precise and informed judgments regarding AD patients.
Collapse
Affiliation(s)
- A M El-Assy
- Electronics and Communications Engineering Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt.
| | - Hanan M Amer
- Electronics and Communications Engineering Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| | - H M Ibrahim
- Communication and Electronics Engineering Department, Nile Higher Institute for Engineering and Technology-IEEE Com Society Member, Mansoura, Egypt
| | - M A Mohamed
- Electronics and Communications Engineering Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| |
Collapse
|
9
|
Sánchez J, Martín-Landrove M. Multifractal Analysis of Brain Tumor Interface in Glioblastoma. ADVANCES IN NEUROBIOLOGY 2024; 36:487-499. [PMID: 38468049 DOI: 10.1007/978-3-031-47606-8_25] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/13/2024]
Abstract
The dynamics of tumor growth is a very complex process, generally accompanied by numerous chromosomal aberrations that determine its genetic and dynamical heterogeneity. Consequently, the tumor interface exhibits a non-regular and heterogeneous behavior often described by a single fractal dimension. A more suitable approach is to consider the tumor interface as a multifractal object that can be described by a set of generalized fractal dimensions. In the present work, detrended fluctuation and multifractal analysis are used to characterize the complexity of glioblastoma.
Collapse
Affiliation(s)
- Jacksson Sánchez
- Faculty of Science and Technology, Physics Department, Universidad Nacional Pedro Henríquez Ureña, Santo Domingo, Dominican Republic
| | - Miguel Martín-Landrove
- Centre for Medical Visualization, National Institute for Bioengineering, INABIO, Universidad Central de Venezuela and Centro de Diagnóstico Docente Las Mercedes, Caracas, Venezuela.
| |
Collapse
|
10
|
Sailunaz K, Alhajj S, Özyer T, Rokne J, Alhajj R. A survey on brain tumor image analysis. Med Biol Eng Comput 2024; 62:1-45. [PMID: 37700082 DOI: 10.1007/s11517-023-02873-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2022] [Accepted: 06/20/2023] [Indexed: 09/14/2023]
Abstract
Medical imaging, also known as radiology, is the field of medicine in which medical professionals recreate various images of parts of the body for diagnostic or treatment purposes. Medical imaging procedures include non-invasive tests that allow doctors to diagnose injuries and diseases without being intrusive TechTarget (n.d.). A number of tools and techniques are used to automate the analysis of medical images acquired with various image processing methods. The brain is one of the largest and most complex organs of the human body and anomaly detection from brain images (i.e., MRI, CT, PET, etc.) is one of the major research areas of medical image analysis. Image processing methods such as filtering and thresholding models, geometry models, graph models, region-based analysis, connected component analysis, machine learning (ML) models, the recent deep learning (DL) models, and various hybrid models are used in brain image analysis. Brain tumors are one of the most common brain diseases with a high mortality rate, and it is difficult to analyze from brain images for the versatility of the shape, location, size, texture, and other characteristics. In this paper, a comprehensive review on brain tumor image analysis is presented with basic ideas of brain tumor, brain imaging, brain image analysis tasks, brain image analysis models, brain tumor image features, performance metrics used for evaluating the models, and some available datasets on brain tumor/medical images. Some challenges of brain tumor analysis are also discussed including suggestions for future research directions. The graphical abstract summarizes the contributions of this paper.
Collapse
Affiliation(s)
- Kashfia Sailunaz
- Department of Computer Science, University of Calgary, Alberta, Canada
| | - Sleiman Alhajj
- International School of Medicine, Istanbul Medipol University, Istanbul, Turkey
| | - Tansel Özyer
- Department of Computer Engineering, Ankara Medipol University, Ankara, Turkey
| | - Jon Rokne
- Department of Computer Science, University of Calgary, Alberta, Canada
| | - Reda Alhajj
- Department of Computer Science, University of Calgary, Alberta, Canada.
- Department of Computer Engineering, Istanbul Medipol University, Istanbul, Turkey.
- Department of Health Informatics, University of Southern Denmark, Odense, Denmark.
| |
Collapse
|
11
|
Ahamed MF, Hossain MM, Nahiduzzaman M, Islam MR, Islam MR, Ahsan M, Haider J. A review on brain tumor segmentation based on deep learning methods with federated learning techniques. Comput Med Imaging Graph 2023; 110:102313. [PMID: 38011781 DOI: 10.1016/j.compmedimag.2023.102313] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Revised: 11/13/2023] [Accepted: 11/13/2023] [Indexed: 11/29/2023]
Abstract
Brain tumors have become a severe medical complication in recent years due to their high fatality rate. Radiologists segment the tumor manually, which is time-consuming, error-prone, and expensive. In recent years, automated segmentation based on deep learning has demonstrated promising results in solving computer vision problems such as image classification and segmentation. Brain tumor segmentation has recently become a prevalent task in medical imaging to determine the tumor location, size, and shape using automated methods. Many researchers have worked on various machine and deep learning approaches to determine the most optimal solution using the convolutional methodology. In this review paper, we discuss the most effective segmentation techniques based on the datasets that are widely used and publicly available. We also proposed a survey of federated learning methodologies to enhance global segmentation performance and ensure privacy. A comprehensive literature review is suggested after studying more than 100 papers to generalize the most recent techniques in segmentation and multi-modality information. Finally, we concentrated on unsolved problems in brain tumor segmentation and a client-based federated model training strategy. Based on this review, future researchers will understand the optimal solution path to solve these issues.
Collapse
Affiliation(s)
- Md Faysal Ahamed
- Department of Computer Science & Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | - Md Munawar Hossain
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | - Md Nahiduzzaman
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | - Md Rabiul Islam
- Department of Computer Science & Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | - Md Robiul Islam
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | - Mominul Ahsan
- Department of Computer Science, University of York, Deramore Lane, Heslington, York YO10 5GH, UK
| | - Julfikar Haider
- Department of Engineering, Manchester Metropolitan University, Chester St, Manchester M1 5GD, UK.
| |
Collapse
|
12
|
Song G, Xie G, Nie Y, Majid MS, Yavari I. Noninvasive grading of glioma brain tumors using magnetic resonance imaging and deep learning methods. J Cancer Res Clin Oncol 2023; 149:16293-16309. [PMID: 37698684 DOI: 10.1007/s00432-023-05389-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Accepted: 09/01/2023] [Indexed: 09/13/2023]
Abstract
PURPOSE Convolutional Neural Networks (ConvNets) have quickly become popular machine learning techniques in recent years, particularly in the classification and segmentation of medical images. One of the most prevalent types of brain cancers is glioma, and early, accurate diagnosis is essential for both treatment and survival. In this study, MRI scans were examined utilizing deep learning techniques to examine glioma diagnosis studies. METHODS In this systematic review, keywords were used to obtain English-language studies from the Arxiv, IEEE, Springer, ScienceDirect, and PubMed databases for the years 2010-2022. The material needed for review was then collected from the articles once they had been chosen based on the entry and exit criteria and in accordance with the research's goal. RESULTS Finally, 77 different academic articles were chosen. According to a study of published articles, glioma brain tumors were discovered, categorized, and segmented utilizing a coordinated approach that included image collecting, pre-processing, model design and execution, and model output evaluation. The majority of investigations have used publicly accessible photo databases and already-trained algorithms. The bulk of studies have employed Dice's classification accuracy and similarity coefficient metrics to assess model performance. CONCLUSION The results of this study indicate that glioma segmentation has received more attention from researchers than glioma detection and classification. It is advised that more research be done in the areas of glioma detection and, particularly, grading in order to be included in systems that support medical diagnosis.
Collapse
Affiliation(s)
- Guanghui Song
- School of Computer and Data Engineering, Ningbo Tech University, Ningbo, 315100, Zhejiang, China.
| | - Guanbao Xie
- School of Computer and Data Engineering, Ningbo Tech University, Ningbo, 315100, Zhejiang, China
| | - Yan Nie
- College of Science & Technology, Ningbo University, Ningbo, 315100, Zhejiang, China
| | - Mohammed Sh Majid
- Computer Techniques Engineering Department, Al-Mustaqbal University College, Babylon, 51001, Iraq
| | - Iman Yavari
- School of Computing and Technology, Eastern Mediterranean University, Northern Cyprus, Famagusta, Cyprus.
| |
Collapse
|
13
|
Shi J, Chen H, Wang X, Cao R, Chen Y, Cheng Y, Pang Z, Huang C. Using Radiomics to Differentiate Brain Metastases From Lung Cancer Versus Breast Cancer, Including Predicting Epidermal Growth Factor Receptor and human Epidermal Growth Factor Receptor 2 Status. J Comput Assist Tomogr 2023; 47:924-933. [PMID: 37948368 DOI: 10.1097/rct.0000000000001499] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/29/2023]
Abstract
OBJECTIVE We evaluated the feasibility of using multiregional radiomics to identify brain metastasis (BM) originating from lung adenocarcinoma (LA) and breast cancer (BC) and assess the epidermal growth factor receptor (EGFR) mutation and human epidermal growth factor receptor 2 (HER2) status. METHODS Our experiment included 160 patients with BM originating from LA (n = 70), BC (n = 67), and other tumor types (n = 23), between November 2017 and December 2021. All patients underwent contrast-enhanced T1- and T2-weighted magnetic resonance imaging (MRI) scans. A total of 1967 quantitative MRI features were calculated from the tumoral active area and peritumoral edema area and selected using least absolute shrinkage and selection operator regression with 5-fold cross-validation. We constructed radiomic signatures (RSs) based on the most predictive features for preoperative assessment of the metastatic origins, EGFR mutation, and HER2 status. Prediction performance of the constructed RSs was evaluated based on the receiver operating characteristic curve analysis. RESULTS The developed multiregion RSs generated good area under the receiver operating characteristic curve (AUC) for identifying the LA and BC origin in the training (AUCs, RS-LA vs RS-BC, 0.767 vs 0.898) and validation (AUCs, RS-LA vs RS-BC, 0.778 and 0.843) cohort and for predicting the EGFR and HER2 status in the training (AUCs, RS-EGFR vs RS-HER2, 0.837 vs 0.894) and validation (AUCs, RS-EGFR vs RS-HER2, 0.729 vs 0.784) cohorts. CONCLUSIONS Our results revealed associations between brain MRI-based radiomics and their metastatic origins, EGFR mutations, and HER2 status. The developed multiregion combined RSs may be considered noninvasive predictive markers for planning early treatment for BM patients.
Collapse
Affiliation(s)
- Jiaxin Shi
- From the School of Intelligent Medicine, China Medical University
| | - Huanhuan Chen
- Department of Oncology, Shengjing Hospital of China Medical University
| | - Xiaoyu Wang
- Department of Radiology, Cancer Hospital of China Medical University, Liaoning Cancer Hospital and Institute, Shenyang, People's Republic of China
| | - Ran Cao
- From the School of Intelligent Medicine, China Medical University
| | - Yu Chen
- From the School of Intelligent Medicine, China Medical University
| | - Yuan Cheng
- From the School of Intelligent Medicine, China Medical University
| | - Ziyan Pang
- From the School of Intelligent Medicine, China Medical University
| | | |
Collapse
|
14
|
Kushol R, Parnianpour P, Wilman AH, Kalra S, Yang YH. Effects of MRI scanner manufacturers in classification tasks with deep learning models. Sci Rep 2023; 13:16791. [PMID: 37798392 PMCID: PMC10556074 DOI: 10.1038/s41598-023-43715-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Accepted: 09/27/2023] [Indexed: 10/07/2023] Open
Abstract
Deep learning has become a leading subset of machine learning and has been successfully employed in diverse areas, ranging from natural language processing to medical image analysis. In medical imaging, researchers have progressively turned towards multi-center neuroimaging studies to address complex questions in neuroscience, leveraging larger sample sizes and aiming to enhance the accuracy of deep learning models. However, variations in image pixel/voxel characteristics can arise between centers due to factors including differences in magnetic resonance imaging scanners. Such variations create challenges, particularly inconsistent performance in machine learning-based approaches, often referred to as domain shift, where the trained models fail to achieve satisfactory or improved results when confronted with dissimilar test data. This study analyzes the performance of multiple disease classification tasks using multi-center MRI data obtained from three widely used scanner manufacturers (GE, Philips, and Siemens) across several deep learning-based networks. Furthermore, we investigate the efficacy of mitigating scanner vendor effects using ComBat-based harmonization techniques when applied to multi-center datasets of 3D structural MR images. Our experimental results reveal a substantial decline in classification performance when models trained on one type of scanner manufacturer are tested with data from different manufacturers. Moreover, despite applying ComBat-based harmonization, the harmonized images do not demonstrate any noticeable performance enhancement for disease classification tasks.
Collapse
Affiliation(s)
- Rafsanjany Kushol
- Department of Computing Science, University of Alberta, Edmonton, Canada.
| | - Pedram Parnianpour
- Neuroscience and Mental Health Institute, University of Alberta, Edmonton, Canada
| | - Alan H Wilman
- Departments of Radiology and Diagnostic Imaging and Biomedical Engineering, University of Alberta, Edmonton, Canada
| | - Sanjay Kalra
- Department of Computing Science, University of Alberta, Edmonton, Canada
- Neuroscience and Mental Health Institute, University of Alberta, Edmonton, Canada
- Division of Neurology, Department of Medicine, University of Alberta, Edmonton, Canada
| | - Yee-Hong Yang
- Department of Computing Science, University of Alberta, Edmonton, Canada
| |
Collapse
|
15
|
Kaifi R. A Review of Recent Advances in Brain Tumor Diagnosis Based on AI-Based Classification. Diagnostics (Basel) 2023; 13:3007. [PMID: 37761373 PMCID: PMC10527911 DOI: 10.3390/diagnostics13183007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Revised: 09/14/2023] [Accepted: 09/19/2023] [Indexed: 09/29/2023] Open
Abstract
Uncontrolled and fast cell proliferation is the cause of brain tumors. Early cancer detection is vitally important to save many lives. Brain tumors can be divided into several categories depending on the kind, place of origin, pace of development, and stage of progression; as a result, tumor classification is crucial for targeted therapy. Brain tumor segmentation aims to delineate accurately the areas of brain tumors. A specialist with a thorough understanding of brain illnesses is needed to manually identify the proper type of brain tumor. Additionally, processing many images takes time and is tiresome. Therefore, automatic segmentation and classification techniques are required to speed up and enhance the diagnosis of brain tumors. Tumors can be quickly and safely detected by brain scans using imaging modalities, including computed tomography (CT), magnetic resonance imaging (MRI), and others. Machine learning (ML) and artificial intelligence (AI) have shown promise in developing algorithms that aid in automatic classification and segmentation utilizing various imaging modalities. The right segmentation method must be used to precisely classify patients with brain tumors to enhance diagnosis and treatment. This review describes multiple types of brain tumors, publicly accessible datasets, enhancement methods, segmentation, feature extraction, classification, machine learning techniques, deep learning, and learning through a transfer to study brain tumors. In this study, we attempted to synthesize brain cancer imaging modalities with automatically computer-assisted methodologies for brain cancer characterization in ML and DL frameworks. Finding the current problems with the engineering methodologies currently in use and predicting a future paradigm are other goals of this article.
Collapse
Affiliation(s)
- Reham Kaifi
- Department of Radiological Sciences, College of Applied Medical Sciences, King Saud bin Abdulaziz University for Health Sciences, Jeddah City 22384, Saudi Arabia;
- King Abdullah International Medical Research Center, Jeddah City 22384, Saudi Arabia
- Medical Imaging Department, Ministry of the National Guard—Health Affairs, Jeddah City 11426, Saudi Arabia
| |
Collapse
|
16
|
Liang Y, Zhang M, Zhang Y, Zhang M. Ultrasound Sonosensitizers for Tumor Sonodynamic Therapy and Imaging: A New Direction with Clinical Translation. Molecules 2023; 28:6484. [PMID: 37764260 PMCID: PMC10537038 DOI: 10.3390/molecules28186484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Revised: 08/25/2023] [Accepted: 08/31/2023] [Indexed: 09/29/2023] Open
Abstract
With the rapid development of sonodynamic therapy (SDT), sonosensitizers have evolved from traditional treatments to comprehensive diagnostics and therapies. Sonosensitizers play a crucial role in the integration of ultrasound imaging (USI), X-ray computed tomography (CT), and magnetic resonance imaging (MRI) diagnostics while also playing a therapeutic role. This review was based on recent articles on multifunctional sonosensitizers that were used in SDT for the treatment of cancer and have the potential for clinical USI, CT, and MRI applications. Next, some of the shortcomings of the clinical examination and the results of sonosensitizers in animal imaging were described. Finally, this paper attempted to inform the future development of sonosensitizers in the field of integrative diagnostics and therapeutics and to point out current problems and prospects for their application.
Collapse
Affiliation(s)
- Yunlong Liang
- Second Clinical Medical College, Shaanxi University of Chinese Medicine, Xianyang 712046, China;
| | - Mingzhen Zhang
- School of Basic Medical Sciences, Xi’an Jiaotong University Health Science Center, Xi’an 710061, China;
| | - Yujie Zhang
- School of Basic Medical Sciences, Xi’an Jiaotong University Health Science Center, Xi’an 710061, China;
| | - Mingxin Zhang
- Department of Gastroenterology, The First Affiliated Hospital of Xi’an Medical University, Xi’an 710077, China
| |
Collapse
|
17
|
Raghavendra U, Gudigar A, Paul A, Goutham TS, Inamdar MA, Hegde A, Devi A, Ooi CP, Deo RC, Barua PD, Molinari F, Ciaccio EJ, Acharya UR. Brain tumor detection and screening using artificial intelligence techniques: Current trends and future perspectives. Comput Biol Med 2023; 163:107063. [PMID: 37329621 DOI: 10.1016/j.compbiomed.2023.107063] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2022] [Revised: 05/16/2023] [Accepted: 05/19/2023] [Indexed: 06/19/2023]
Abstract
A brain tumor is an abnormal mass of tissue located inside the skull. In addition to putting pressure on the healthy parts of the brain, it can lead to significant health problems. Depending on the region of the brain tumor, it can cause a wide range of health issues. As malignant brain tumors grow rapidly, the mortality rate of individuals with this cancer can increase substantially with each passing week. Hence it is vital to detect these tumors early so that preventive measures can be taken at the initial stages. Computer-aided diagnostic (CAD) systems, in coordination with artificial intelligence (AI) techniques, have a vital role in the early detection of this disorder. In this review, we studied 124 research articles published from 2000 to 2022. Here, the challenges faced by CAD systems based on different modalities are highlighted along with the current requirements of this domain and future prospects in this area of research.
Collapse
Affiliation(s)
- U Raghavendra
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India
| | - Anjan Gudigar
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India.
| | - Aritra Paul
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India
| | - T S Goutham
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India
| | - Mahesh Anil Inamdar
- Department of Mechatronics, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India
| | - Ajay Hegde
- Consultant Neurosurgeon Manipal Hospitals, Sarjapur Road, Bangalore, India
| | - Aruna Devi
- School of Education and Tertiary Access, University of the Sunshine Coast, Caboolture Campus, Australia
| | - Chui Ping Ooi
- School of Science and Technology, Singapore University of Social Sciences, Singapore, 599494, Singapore
| | - Ravinesh C Deo
- School of Mathematics, Physics, and Computing, University of Southern Queensland, Springfield, QLD, 4300, Australia
| | - Prabal Datta Barua
- Cogninet Brain Team, Cogninet Australia, Sydney, NSW, 2010, Australia; School of Business (Information Systems), Faculty of Business, Education, Law & Arts, University of Southern Queensland, Toowoomba, QLD, 4350, Australia; Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW, 2007, Australia
| | - Filippo Molinari
- Department of Electronics and Telecommunications, Politecnico di Torino, 10129, Torino, Italy
| | - Edward J Ciaccio
- Department of Medicine, Columbia University Medical Center, New York, NY, 10032, USA
| | - U Rajendra Acharya
- School of Mathematics, Physics, and Computing, University of Southern Queensland, Springfield, QLD, 4300, Australia; International Research Organization for Advanced Science and Technology (IROAST), Kumamoto University, Kumamoto, 860-8555, Japan
| |
Collapse
|
18
|
Abdusalomov AB, Mukhiddinov M, Whangbo TK. Brain Tumor Detection Based on Deep Learning Approaches and Magnetic Resonance Imaging. Cancers (Basel) 2023; 15:4172. [PMID: 37627200 PMCID: PMC10453020 DOI: 10.3390/cancers15164172] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Revised: 08/11/2023] [Accepted: 08/17/2023] [Indexed: 08/27/2023] Open
Abstract
The rapid development of abnormal brain cells that characterizes a brain tumor is a major health risk for adults since it can cause severe impairment of organ function and even death. These tumors come in a wide variety of sizes, textures, and locations. When trying to locate cancerous tumors, magnetic resonance imaging (MRI) is a crucial tool. However, detecting brain tumors manually is a difficult and time-consuming activity that might lead to inaccuracies. In order to solve this, we provide a refined You Only Look Once version 7 (YOLOv7) model for the accurate detection of meningioma, glioma, and pituitary gland tumors within an improved detection of brain tumors system. The visual representation of the MRI scans is enhanced by the use of image enhancement methods that apply different filters to the original pictures. To further improve the training of our proposed model, we apply data augmentation techniques to the openly accessible brain tumor dataset. The curated data include a wide variety of cases, such as 2548 images of gliomas, 2658 images of pituitary, 2582 images of meningioma, and 2500 images of non-tumors. We included the Convolutional Block Attention Module (CBAM) attention mechanism into YOLOv7 to further enhance its feature extraction capabilities, allowing for better emphasis on salient regions linked with brain malignancies. To further improve the model's sensitivity, we have added a Spatial Pyramid Pooling Fast+ (SPPF+) layer to the network's core infrastructure. YOLOv7 now includes decoupled heads, which allow it to efficiently glean useful insights from a wide variety of data. In addition, a Bi-directional Feature Pyramid Network (BiFPN) is used to speed up multi-scale feature fusion and to better collect features associated with tumors. The outcomes verify the efficiency of our suggested method, which achieves a higher overall accuracy in tumor detection than previous state-of-the-art models. As a result, this framework has a lot of potential as a helpful decision-making tool for experts in the field of diagnosing brain tumors.
Collapse
Affiliation(s)
| | | | - Taeg Keun Whangbo
- Department of Computer Engineering, Gachon University, Seongnam-si 13120, Republic of Korea;
| |
Collapse
|
19
|
Lv J, Roy S, Xie M, Yang X, Guo B. Contrast Agents of Magnetic Resonance Imaging and Future Perspective. NANOMATERIALS (BASEL, SWITZERLAND) 2023; 13:2003. [PMID: 37446520 DOI: 10.3390/nano13132003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/20/2023] [Revised: 07/01/2023] [Accepted: 07/03/2023] [Indexed: 07/15/2023]
Abstract
In recent times, magnetic resonance imaging (MRI) has emerged as a highly promising modality for diagnosing severe diseases. Its exceptional spatiotemporal resolution and ease of use have established it as an indispensable clinical diagnostic tool. Nevertheless, there are instances where MRI encounters challenges related to low contrast, necessitating the use of contrast agents (CAs). Significant efforts have been made by scientists to enhance the precision of observing diseased body parts by leveraging the synergistic potential of MRI in conjunction with other imaging techniques and thereby modifying the CAs. In this work, our focus is on elucidating the rational designing approach of CAs and optimizing their compatibility for multimodal imaging and other intelligent applications. Additionally, we emphasize the importance of incorporating various artificial intelligence tools, such as machine learning and deep learning, to explore the future prospects of disease diagnosis using MRI. We also address the limitations associated with these techniques and propose reasonable remedies, with the aim of advancing MRI as a cutting-edge diagnostic tool for the future.
Collapse
Affiliation(s)
- Jie Lv
- School of Computer Science and Engineering, Yulin Normal University, Yulin 537000, China
| | - Shubham Roy
- Shenzhen Key Laboratory of Flexible Printed Electronics Technology, School of Science, Harbin Institute of Technology, Shenzhen 518055, China
- Shenzhen Key Laboratory of Advanced Functional Carbon Materials Research and Comprehensive Application, School of Science, Harbin Institute of Technology, Shenzhen 518055, China
| | - Miao Xie
- School of Computer Science and Engineering, Yulin Normal University, Yulin 537000, China
| | - Xiulan Yang
- School of Computer Science and Engineering, Yulin Normal University, Yulin 537000, China
| | - Bing Guo
- Shenzhen Key Laboratory of Flexible Printed Electronics Technology, School of Science, Harbin Institute of Technology, Shenzhen 518055, China
- Shenzhen Key Laboratory of Advanced Functional Carbon Materials Research and Comprehensive Application, School of Science, Harbin Institute of Technology, Shenzhen 518055, China
| |
Collapse
|
20
|
Asiri AA, Shaf A, Ali T, Shakeel U, Irfan M, Mehdar KM, Halawani HT, Alghamdi AH, Alshamrani AFA, Alqhtani SM. Exploring the Power of Deep Learning: Fine-Tuned Vision Transformer for Accurate and Efficient Brain Tumor Detection in MRI Scans. Diagnostics (Basel) 2023; 13:2094. [PMID: 37370989 DOI: 10.3390/diagnostics13122094] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Revised: 06/06/2023] [Accepted: 06/13/2023] [Indexed: 06/29/2023] Open
Abstract
A brain tumor is a significant health concern that directly or indirectly affects thousands of people worldwide. The early and accurate detection of brain tumors is vital to the successful treatment of brain tumors and the improved quality of life of the patient. There are several imaging techniques used for brain tumor detection. Among these techniques, the most common are MRI and CT scans. To overcome the limitations associated with these traditional techniques, computer-aided analysis of brain images has gained attention in recent years as a promising approach for accurate and reliable brain tumor detection. In this study, we proposed a fine-tuned vision transformer model that uses advanced image processing and deep learning techniques to accurately identify the presence of brain tumors in the input data images. The proposed model FT-ViT involves several stages, including the processing of data, patch processing, concatenation, feature selection and learning, and fine tuning. Upon training the model on the CE-MRI dataset containing 5712 brain tumor images, the model could accurately identify the tumors. The FT-Vit model achieved an accuracy of 98.13%. The proposed method offers high accuracy and can significantly reduce the workload of radiologists, making it a practical approach in medical science. However, further research can be conducted to diagnose more complex and rare types of tumors with more accuracy and reliability.
Collapse
Affiliation(s)
- Abdullah A Asiri
- Radiological Sciences Department, College of Applied Medical Sciences, Najran University, Najran 61441, Saudi Arabia
| | - Ahmad Shaf
- Department of Computer Science, COMSATS University Islamabad, Sahiwal Campus, Sahiwal 57000, Pakistan
| | - Tariq Ali
- Department of Computer Science, COMSATS University Islamabad, Sahiwal Campus, Sahiwal 57000, Pakistan
| | - Unza Shakeel
- Department of Biosciences, COMSATS University Islamabad, Sahiwal Campus, Sahiwal 57000, Pakistan
| | - Muhammad Irfan
- Electrical Engineering Department, College of Engineering, Najran University, Najran 61441, Saudi Arabia
| | - Khlood M Mehdar
- Anatomy Department, Medicine College, Najran University, Najran 61441, Saudi Arabia
| | - Hanan Talal Halawani
- Computer Science Department, College of Computer Science and Information Systems, Najran University, Najran 61441, Saudi Arabia
| | - Ali H Alghamdi
- Department of Radiological Sciences, Faculty of Applied Medical Sciences, The University of Tabuk, Tabuk 47512, Saudi Arabia
| | - Abdullah Fahad A Alshamrani
- Department of Diagnostic Radiology Technology, College of Applied Medical Sciences, Taibah University, Madinah 41477, Saudi Arabia
| | - Samar M Alqhtani
- Department of Information Systems, College of Computer Science and Information Systems, Najran University, Najran 61441, Saudi Arabia
| |
Collapse
|
21
|
Muezzinoglu T, Baygin N, Tuncer I, Barua PD, Baygin M, Dogan S, Tuncer T, Palmer EE, Cheong KH, Acharya UR. PatchResNet: Multiple Patch Division-Based Deep Feature Fusion Framework for Brain Tumor Classification Using MRI Images. J Digit Imaging 2023; 36:973-987. [PMID: 36797543 PMCID: PMC10287865 DOI: 10.1007/s10278-023-00789-x] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2022] [Revised: 01/30/2023] [Accepted: 01/31/2023] [Indexed: 02/18/2023] Open
Abstract
Modern computer vision algorithms are based on convolutional neural networks (CNNs), and both end-to-end learning and transfer learning modes have been used with CNN for image classification. Thus, automated brain tumor classification models have been proposed by deploying CNNs to help medical professionals. Our primary objective is to increase the classification performance using CNN. Therefore, a patch-based deep feature engineering model has been proposed in this work. Nowadays, patch division techniques have been used to attain high classification performance, and variable-sized patches have achieved good results. In this work, we have used three types of patches of different sizes (32 × 32, 56 × 56, 112 × 112). Six feature vectors have been obtained using these patches and two layers of the pretrained ResNet50 (global average pooling and fully connected layers). In the feature selection phase, three selectors-neighborhood component analysis (NCA), Chi2, and ReliefF-have been used, and 18 final feature vectors have been obtained. By deploying k nearest neighbors (kNN), 18 results have been calculated. Iterative hard majority voting (IHMV) has been applied to compute the general classification accuracy of this framework. This model uses different patches, feature extractors (two layers of the ResNet50 have been utilized as feature extractors), and selectors, making this a framework that we have named PatchResNet. A public brain image dataset containing four classes (glioblastoma multiforme (GBM), meningioma, pituitary tumor, healthy) has been used to develop the proposed PatchResNet model. Our proposed PatchResNet attained 98.10% classification accuracy using the public brain tumor image dataset. The developed PatchResNet model obtained high classification accuracy and has the advantage of being a self-organized framework. Therefore, the proposed method can choose the best result validation prediction vectors and achieve high image classification performance.
Collapse
Affiliation(s)
- Taha Muezzinoglu
- Department of Computer Engineering, Faculty of Engineering, Munzur University, Tunceli, Turkey
| | - Nursena Baygin
- Department of Computer Engineering, Faculty of Engineering, Erzurum Technical University, Erzurum, Turkey
| | | | - Prabal Datta Barua
- School of Management & Enterprise, University of Southern Queensland, Toowoomba, Australia
- Faculty of Engineering and Information Technology, University of Technology Sydney, Ultimo, Australia
| | - Mehmet Baygin
- Department of Computer Engineering, Faculty of Engineering, Ardahan University, Ardahan, Turkey
| | - Sengul Dogan
- Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig, Turkey
| | - Turker Tuncer
- Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig, Turkey
| | - Elizabeth Emma Palmer
- Centre of Clinical Genetics, Sydney Children’s Hospitals Network, Randwick, 2031 Australia
- School of Women’s and Children’s Health, University of New South Wales, Randwick, 2031 Australia
| | - Kang Hao Cheong
- Science, Mathematics and Technology Cluster, Singapore University of Technology and Design, Singapore, S487372 Singapore
| | - U. Rajendra Acharya
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore, 599489 Singapore
- Department of Biomedical Engineering, School of Science and Technology, SUSS University, Singapore, Singapore
- Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung, Taiwan
| |
Collapse
|
22
|
Ghamry FM, Emara HM, Hagag A, El-Shafai W, El-Banby GM, Dessouky MI, El-Fishawy AS, El-Hag NA, El-Samie FEA. Efficient algorithms for compression and classification of brain tumor images. JOURNAL OF OPTICS 2023; 52:818-830. [DOI: 10.1007/s12596-022-01040-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Accepted: 11/29/2022] [Indexed: 09/02/2023]
|
23
|
Zhang X, Liu Y, Guo S, Song Z. EG-Unet: Edge-Guided cascaded networks for automated frontal brain segmentation in MR images. Comput Biol Med 2023; 158:106891. [PMID: 37044048 DOI: 10.1016/j.compbiomed.2023.106891] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Revised: 03/07/2023] [Accepted: 04/01/2023] [Indexed: 04/05/2023]
Abstract
Accurate segmentation of frontal lobe areas on magnetic resonance imaging (MRI) can assist in diagnosing and managing idiopathic normal-pressure hydrocephalus. However, frontal lobe segmentation is challenging due to the complexity of the degree and shape of damage and the ambiguity of the boundaries of frontal lobe sites. Therefore, to extract the rich edge information and feature representation of the frontal lobe, this paper designs an edge guidance (EG) module to enhance the representation of edge features. Accordingly, an edge-guided cascade network framework (EG-Net) is proposed to segment frontal lobe parts automatically. Two-dimensional MRI slice images are fed into the edge generation and segmentation networks. First, the edge generation network extracts the edge information from the input image. Then, the edge information is sent to the EG module to generate an edge attention map for feature representation enhancement. Meanwhile, multi-scale attentional convolution (MSA) is utilized in the feature coding stage of the segmentation network to obtain feature responses from different perceptual fields in the coding stage and enrich the spatial context information. Besides, the feature fusion module is employed to selectively aggregate the multi-scale features in the coding stage with the edge features output by the EG module. Finally, the two components are fused, and a decoder recovers the spatial information to generate the final prediction results. An extensive quantitative comparison is performed on a publicly available brain MRI dataset (MICCAI 2012) to evaluate the effectiveness of the proposed algorithm. The experimental results indicate that the proposed method achieves an average DICE score of 95.77% compared to some advanced methods, which is 4.96% better than the classical U-Net. The results demonstrate the potential of the proposed EG-Net in improving the accuracy of frontal edge pixel classification through edge guidance.
Collapse
Affiliation(s)
- Xiufeng Zhang
- Mechanical and Electrical Engineering, Dalian Minzu University, Liaohe West Road 18, Dalian, China
| | - Yansong Liu
- Mechanical and Electrical Engineering, Dalian Minzu University, Liaohe West Road 18, Dalian, China.
| | - Shengjin Guo
- Mechanical and Electrical Engineering, Dalian Minzu University, Liaohe West Road 18, Dalian, China
| | - Zhao Song
- Shenzhen Hospital, Southern Medical University, Xinhu Road 1333, Shenzhen, China
| |
Collapse
|
24
|
Sun X, Niwa T, Okazaki T, Kameda S, Shibukawa S, Horie T, Kazama T, Uchiyama A, Hashimoto J. Automatic detection of punctate white matter lesions in infants using deep learning of composite images from two cases. Sci Rep 2023; 13:4426. [PMID: 36932141 PMCID: PMC10023755 DOI: 10.1038/s41598-023-31403-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 03/11/2023] [Indexed: 03/19/2023] Open
Abstract
Punctate white matter lesions (PWMLs) in infants may be related to neurodevelopmental outcomes based on the location or number of lesions. This study aimed to assess the automatic detectability of PWMLs in infants on deep learning using composite images created from several cases. To create the initial composite images, magnetic resonance (MR) images of two infants with the most PWMLs were used; their PWMLs were extracted and pasted onto MR images of infants without abnormality, creating many composite PWML images. Deep learning models based on a convolutional neural network, You Only Look Once v3 (YOLOv3), were constructed using the training set of 600, 1200, 2400, and 3600 composite images. As a result, a threshold of detection probability of 20% and 30% for all deep learning model sets yielded a relatively high sensitivity for automatic PWML detection (0.908-0.957). Although relatively high false-positive detections occurred with the lower threshold of detection probability, primarily, in the partial volume of the cerebral cortex (≥ 85.8%), those can be easily distinguished from the white matter lesions. Relatively highly sensitive automatic detection of PWMLs was achieved by creating composite images from two cases using deep learning.
Collapse
Affiliation(s)
- Xuyang Sun
- Department of Radiology, Tokai University School of Medicine, 143 Shimokasuka, Isehara, 259-1193, Japan
| | - Tetsu Niwa
- Department of Radiology, Tokai University School of Medicine, 143 Shimokasuka, Isehara, 259-1193, Japan.
| | - Takashi Okazaki
- Department of Radiology, Tokai University School of Medicine, 143 Shimokasuka, Isehara, 259-1193, Japan
| | - Sadanori Kameda
- Department of Radiology, Tokai University School of Medicine, 143 Shimokasuka, Isehara, 259-1193, Japan
| | - Shuhei Shibukawa
- Department of Radiology, Tokai University School of Medicine, 143 Shimokasuka, Isehara, 259-1193, Japan
- Department of Radiological Technology, Faculty of Health Science, Juntendo University, Bunkyo-Ku, Tokyo, Japan
| | - Tomohiko Horie
- Department of Radiology, Tokai University Hospital, Isehara, Japan
| | - Toshiki Kazama
- Department of Radiology, Tokai University School of Medicine, 143 Shimokasuka, Isehara, 259-1193, Japan
| | - Atsushi Uchiyama
- Department of Pediatrics, Tokai University School of Medicine, Isehara, Japan
| | - Jun Hashimoto
- Department of Radiology, Tokai University School of Medicine, 143 Shimokasuka, Isehara, 259-1193, Japan
| |
Collapse
|
25
|
Zhou T, Noeuveglise A, Modzelewski R, Ghazouani F, Thureau S, Fontanilles M, Ruan S. Prediction of brain tumor recurrence location based on multi-modal fusion and nonlinear correlation learning. Comput Med Imaging Graph 2023; 106:102218. [PMID: 36947921 DOI: 10.1016/j.compmedimag.2023.102218] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Revised: 02/13/2023] [Accepted: 03/06/2023] [Indexed: 03/18/2023]
Abstract
Brain tumor is one of the leading causes of cancer death. The high-grade brain tumors are easier to recurrent even after standard treatment. Therefore, developing a method to predict brain tumor recurrence location plays an important role in the treatment planning and it can potentially prolong patient's survival time. There is still little work to deal with this issue. In this paper, we present a deep learning-based brain tumor recurrence location prediction network. Since the dataset is usually small, we propose to use transfer learning to improve the prediction. We first train a multi-modal brain tumor segmentation network on the public dataset BraTS 2021. Then, the pre-trained encoder is transferred to our private dataset for extracting the rich semantic features. Following that, a multi-scale multi-channel feature fusion model and a nonlinear correlation learning module are developed to learn the effective features. The correlation between multi-channel features is modeled by a nonlinear equation. To measure the similarity between the distributions of original features of one modality and the estimated correlated features of another modality, we propose to use Kullback-Leibler divergence. Based on this divergence, a correlation loss function is designed to maximize the similarity between the two feature distributions. Finally, two decoders are constructed to jointly segment the present brain tumor and predict its future tumor recurrence location. To the best of our knowledge, this is the first work that can segment the present tumor and at the same time predict future tumor recurrence location, making the treatment planning more efficient and precise. The experimental results demonstrated the effectiveness of our proposed method to predict the brain tumor recurrence location from the limited dataset.
Collapse
Affiliation(s)
- Tongxue Zhou
- School of Information Science and Technology, Hangzhou Normal University, Hangzhou 311121, China
| | | | - Romain Modzelewski
- Department of Nuclear Medicine, Henri Becquerel Cancer Center, Rouen, 76038, France
| | - Fethi Ghazouani
- Université de Rouen Normandie, LITIS - QuantIF, Rouen 76183, France
| | - Sébastien Thureau
- Department of Nuclear Medicine, Henri Becquerel Cancer Center, Rouen, 76038, France
| | - Maxime Fontanilles
- Department of Nuclear Medicine, Henri Becquerel Cancer Center, Rouen, 76038, France
| | - Su Ruan
- Université de Rouen Normandie, LITIS - QuantIF, Rouen 76183, France.
| |
Collapse
|
26
|
Chen Y, Li ZH, Zeng X, Zhang XZ. Bacteria-based bioactive materials for cancer imaging and therapy. Adv Drug Deliv Rev 2023; 193:114696. [PMID: 36632868 DOI: 10.1016/j.addr.2023.114696] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Revised: 12/02/2022] [Accepted: 01/07/2023] [Indexed: 01/11/2023]
Abstract
Owing to the unique biological functions, bacteria as biological materials have been widely used in biomedical field. With advances in biotechnology and nanotechnology, various bacteria-based bioactive materials were developed for cancer imaging and therapy. In this review, different types of bacteria-based bioactive materials and their construction strategies were summarized. The advantages and property-function relationship of bacteria-based bioactive materials were described. Representative researches of bacteria-based bioactive materials in cancer imaging and therapy were illustrated, revealing general ideas for their construction. Also, limitation and challenges of bacteria-based bioactive materials in cancer research were discussed.
Collapse
Affiliation(s)
- Ying Chen
- Key Laboratory of Biomedical Polymers of Ministry of Education & Department of Chemistry, Wuhan University, Wuhan 430072, PR China
| | - Zi-Hao Li
- Key Laboratory of Biomedical Polymers of Ministry of Education & Department of Chemistry, Wuhan University, Wuhan 430072, PR China
| | - Xuan Zeng
- Key Laboratory of Biomedical Polymers of Ministry of Education & Department of Chemistry, Wuhan University, Wuhan 430072, PR China
| | - Xian-Zheng Zhang
- Key Laboratory of Biomedical Polymers of Ministry of Education & Department of Chemistry, Wuhan University, Wuhan 430072, PR China; Wuhan Research Centre for Infectious Diseases and Cancer, Chinese Academy of Medical Sciences, Wuhan 430071, PR China.
| |
Collapse
|
27
|
Fang L, Wang X. Multi-input Unet model based on the integrated block and the aggregation connection for MRI brain tumor segmentation. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104027] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
28
|
Tolpadi AA, Han M, Calivà F, Pedoia V, Majumdar S. Region of interest-specific loss functions improve T 2 quantification with ultrafast T 2 mapping MRI sequences in knee, hip and lumbar spine. Sci Rep 2022; 12:22208. [PMID: 36564430 PMCID: PMC9789075 DOI: 10.1038/s41598-022-26266-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Accepted: 12/13/2022] [Indexed: 12/24/2022] Open
Abstract
MRI T2 mapping sequences quantitatively assess tissue health and depict early degenerative changes in musculoskeletal (MSK) tissues like cartilage and intervertebral discs (IVDs) but require long acquisition times. In MSK imaging, small features in cartilage and IVDs are crucial for diagnoses and must be preserved when reconstructing accelerated data. To these ends, we propose region of interest-specific postprocessing of accelerated acquisitions: a recurrent UNet deep learning architecture that provides T2 maps in knee cartilage, hip cartilage, and lumbar spine IVDs from accelerated T2-prepared snapshot gradient-echo acquisitions, optimizing for cartilage and IVD performance with a multi-component loss function that most heavily penalizes errors in those regions. Quantification errors in knee and hip cartilage were under 10% and 9% from acceleration factors R = 2 through 10, respectively, with bias for both under 3 ms for most of R = 2 through 12. In IVDs, mean quantification errors were under 12% from R = 2 through 6. A Gray Level Co-Occurrence Matrix-based scheme showed knee and hip pipelines outperformed state-of-the-art models, retaining smooth textures for most R and sharper ones through moderate R. Our methodology yields robust T2 maps while offering new approaches for optimizing and evaluating reconstruction algorithms to facilitate better preservation of small, clinically relevant features.
Collapse
Affiliation(s)
- Aniket A Tolpadi
- Department of Radiology and Biomedical Imaging, University of California, 1700, 4th Street, San Francisco, CA, 94158, USA.
| | - Misung Han
- Department of Radiology and Biomedical Imaging, University of California, 1700, 4th Street, San Francisco, CA, 94158, USA
| | - Francesco Calivà
- Department of Radiology and Biomedical Imaging, University of California, 1700, 4th Street, San Francisco, CA, 94158, USA
| | - Valentina Pedoia
- Department of Radiology and Biomedical Imaging, University of California, 1700, 4th Street, San Francisco, CA, 94158, USA
| | - Sharmila Majumdar
- Department of Radiology and Biomedical Imaging, University of California, 1700, 4th Street, San Francisco, CA, 94158, USA
| |
Collapse
|
29
|
Artificial Intelligence and Precision Medicine: A New Frontier for the Treatment of Brain Tumors. LIFE (BASEL, SWITZERLAND) 2022; 13:life13010024. [PMID: 36675973 PMCID: PMC9866715 DOI: 10.3390/life13010024] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Revised: 12/08/2022] [Accepted: 12/19/2022] [Indexed: 12/24/2022]
Abstract
Brain tumors are a widespread and serious neurological phenomenon that can be life- threatening. The computing field has allowed for the development of artificial intelligence (AI), which can mimic the neural network of the human brain. One use of this technology has been to help researchers capture hidden, high-dimensional images of brain tumors. These images can provide new insights into the nature of brain tumors and help to improve treatment options. AI and precision medicine (PM) are converging to revolutionize healthcare. AI has the potential to improve cancer imaging interpretation in several ways, including more accurate tumor genotyping, more precise delineation of tumor volume, and better prediction of clinical outcomes. AI-assisted brain surgery can be an effective and safe option for treating brain tumors. This review discusses various AI and PM techniques that can be used in brain tumor treatment. These new techniques for the treatment of brain tumors, i.e., genomic profiling, microRNA panels, quantitative imaging, and radiomics, hold great promise for the future. However, there are challenges that must be overcome for these technologies to reach their full potential and improve healthcare.
Collapse
|
30
|
Ramasubramanian B, Reddy VS, Chellappan V, Ramakrishna S. Emerging Materials, Wearables, and Diagnostic Advancements in Therapeutic Treatment of Brain Diseases. BIOSENSORS 2022; 12:1176. [PMID: 36551143 PMCID: PMC9775999 DOI: 10.3390/bios12121176] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Revised: 12/07/2022] [Accepted: 12/07/2022] [Indexed: 06/17/2023]
Abstract
Among the most critical health issues, brain illnesses, such as neurodegenerative conditions and tumors, lower quality of life and have a significant economic impact. Implantable technology and nano-drug carriers have enormous promise for cerebral brain activity sensing and regulated therapeutic application in the treatment and detection of brain illnesses. Flexible materials are chosen for implantable devices because they help reduce biomechanical mismatch between the implanted device and brain tissue. Additionally, implanted biodegradable devices might lessen any autoimmune negative effects. The onerous subsequent operation for removing the implanted device is further lessened with biodegradability. This review expands on current developments in diagnostic technologies such as magnetic resonance imaging, computed tomography, mass spectroscopy, infrared spectroscopy, angiography, and electroencephalogram while providing an overview of prevalent brain diseases. As far as we are aware, there hasn't been a single review article that addresses all the prevalent brain illnesses. The reviewer also looks into the prospects for the future and offers suggestions for the direction of future developments in the treatment of brain diseases.
Collapse
Affiliation(s)
- Brindha Ramasubramanian
- Department of Mechanical Engineering, Center for Nanofibers & Nanotechnology, National University of Singapore, Singapore 117574, Singapore
- Institute of Materials Research and Engineering (IMRE), Agency for Science, Technology and Research (A*STAR), #08-03, 2 Fusionopolis Way, Innovis, Singapore 138634, Singapore
| | - Vundrala Sumedha Reddy
- Department of Mechanical Engineering, Center for Nanofibers & Nanotechnology, National University of Singapore, Singapore 117574, Singapore
| | - Vijila Chellappan
- Institute of Materials Research and Engineering (IMRE), Agency for Science, Technology and Research (A*STAR), #08-03, 2 Fusionopolis Way, Innovis, Singapore 138634, Singapore
| | - Seeram Ramakrishna
- Department of Mechanical Engineering, Center for Nanofibers & Nanotechnology, National University of Singapore, Singapore 117574, Singapore
| |
Collapse
|
31
|
Brain tumor segmentation and classification using hybrid deep CNN with LuNetClassifier. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07934-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022]
|
32
|
Choudhury H, Pandey M, Mohgan R, Jong JSJ, David RN, Ngan WY, Chin TL, Ting S, Kesharwani P, Gorain B. Dendrimer-based delivery of macromolecules for the treatment of brain tumor. BIOMATERIALS ADVANCES 2022; 141:213118. [PMID: 36182834 DOI: 10.1016/j.bioadv.2022.213118] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/13/2022] [Revised: 09/06/2022] [Accepted: 09/11/2022] [Indexed: 06/16/2023]
Abstract
Brain tumor represents the most lethal form of cancer with the highest mortality and morbidity rates irrespective of age and sex. Advancements in macromolecule-based therapy (such as nucleic acids and peptides) have shown promising roles in the treatment of brain tumor where the phenomenon of severe toxicities due to the conventional chemotherapeutic agents can be circumvented. Despite its preclinical progress, successful targeting of these macromolecules across the blood-brain barrier without altering their physical and chemical characteristics is of great challenge. With the advent of nanotechnology, nowadays targeted delivery of therapeutics is being explored extensively and these macromolecules, including peptides and nucleic acids, have shown initial success in the treatment, where dendrimer has shown its potential for optimal delivery. Dendrimers are being favored as a mode of drug delivery due to their nano-spherical size and structure, high solubilization potential, multivalent surface, and high loading capacity, where biomolecule resembling characteristics of dendritic 3D structures has shown effective delivery of various therapeutic agents to the brain. Armed with targeting ligands to these dendrimers further expedite the transportation of these multifunctional shuttles specifically to the glioblastoma cells. Thus, a focus has been made in this review on therapeutic applications of dendrimer platforms in brain tumor treatment. The future development of dendrimers as a potential platform for nucleic acid and peptide delivery and its promising clinical application could provide effective and target-specific treatment against brain tumors.
Collapse
Affiliation(s)
- Hira Choudhury
- Department of Pharmaceutical Technology, School of Pharmacy, International Medical University, Bukit Jalil, 57000 Kuala Lumpur, Malaysia.
| | - Manisha Pandey
- Department of Pharmaceutical Technology, School of Pharmacy, International Medical University, Bukit Jalil, 57000 Kuala Lumpur, Malaysia; Department of Pharmaceutical Sciences, Central University of Haryana, SSH 17, Jant, Haryana 123031, India.
| | - Raxshanaa Mohgan
- Department of Pharmaceutical Technology, School of Pharmacy, International Medical University, Bukit Jalil, 57000 Kuala Lumpur, Malaysia
| | - Jim Sii Jack Jong
- Department of Pharmaceutical Technology, School of Pharmacy, International Medical University, Bukit Jalil, 57000 Kuala Lumpur, Malaysia
| | - Roshini Nicole David
- Department of Pharmaceutical Technology, School of Pharmacy, International Medical University, Bukit Jalil, 57000 Kuala Lumpur, Malaysia
| | - Wan Yi Ngan
- Department of Pharmaceutical Technology, School of Pharmacy, International Medical University, Bukit Jalil, 57000 Kuala Lumpur, Malaysia
| | - Tze Liang Chin
- Department of Pharmaceutical Technology, School of Pharmacy, International Medical University, Bukit Jalil, 57000 Kuala Lumpur, Malaysia
| | - Shereen Ting
- Department of Pharmaceutical Technology, School of Pharmacy, International Medical University, Bukit Jalil, 57000 Kuala Lumpur, Malaysia
| | - Prashant Kesharwani
- Department of Pharmaceutics, School of Pharmaceutical Education and Research, Jamia Hamdard, New Delhi 110062, India
| | - Bapi Gorain
- Department of Pharmaceutical Sciences and Technology, Birla Institute of Technology, Mesra, Ranchi 835215, Jharkhand, India
| |
Collapse
|
33
|
Kumar A. Study and analysis of different segmentation methods for brain tumor MRI application. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 82:7117-7139. [PMID: 35991584 PMCID: PMC9379244 DOI: 10.1007/s11042-022-13636-y] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/22/2021] [Revised: 04/26/2022] [Accepted: 08/01/2022] [Indexed: 06/15/2023]
Abstract
Medical Resonance Imaging (MRI) is one of the preferred imaging methods for brain tumor diagnosis and getting detailed information on tumor type, location, size, identification, and detection. Segmentation divides an image into multiple segments and describes the separation of the suspicious region from pre-processed MRI images to make the simpler image that is more meaningful and easier to examine. There are many segmentation methods, embedded with detection devices, and the response of each method is different. The study article focuses on comparing the performance of several image segmentation algorithms for brain tumor diagnosis, such as Otsu's, watershed, level set, K-means, HAAR Discrete Wavelet Transform (DWT), and Convolutional Neural Network (CNN). All of the techniques are simulated in MATLAB using online images from the Brain Tumor Image Segmentation Benchmark (BRATS) dataset-2018. The performance of these methods is analyzed based on response time and measures such as recall, precision, F-measures, and accuracy. The measured accuracy of Otsu's, watershed, level set, K-means, DWT, and CNN methods is 71.42%, 78.26%, 80.45%, 84.34%, 86.95%, and 91.39 respectively. The response time of CNN is 2.519 s in the MATLAB simulation environment for the designed algorithm. The novelty of the work is that CNN has been proven the best algorithm in comparison to all other methods for brain tumor image segmentation. The simulated and estimated parameters provide the direction to researchers to choose the specific algorithm for embedded hardware solutions and develop the optimal machine-learning models, as the industries are looking for the optimal solutions of CNN and deep learning-based hardware models for the brain tumor.
Collapse
Affiliation(s)
- Adesh Kumar
- Department of Electrical and Electronics Engineering, School of Engineering, University of Petroleum and Energy Studies, Dehradun, India
| |
Collapse
|
34
|
Maqsood S, Damaševičius R, Maskeliūnas R. Multi-Modal Brain Tumor Detection Using Deep Neural Network and Multiclass SVM. Medicina (B Aires) 2022; 58:medicina58081090. [PMID: 36013557 PMCID: PMC9413317 DOI: 10.3390/medicina58081090] [Citation(s) in RCA: 25] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2022] [Revised: 08/03/2022] [Accepted: 08/06/2022] [Indexed: 02/05/2023] Open
Abstract
Background and Objectives: Clinical diagnosis has become very significant in today's health system. The most serious disease and the leading cause of mortality globally is brain cancer which is a key research topic in the field of medical imaging. The examination and prognosis of brain tumors can be improved by an early and precise diagnosis based on magnetic resonance imaging. For computer-aided diagnosis methods to assist radiologists in the proper detection of brain tumors, medical imagery must be detected, segmented, and classified. Manual brain tumor detection is a monotonous and error-prone procedure for radiologists; hence, it is very important to implement an automated method. As a result, the precise brain tumor detection and classification method is presented. Materials and Methods: The proposed method has five steps. In the first step, a linear contrast stretching is used to determine the edges in the source image. In the second step, a custom 17-layered deep neural network architecture is developed for the segmentation of brain tumors. In the third step, a modified MobileNetV2 architecture is used for feature extraction and is trained using transfer learning. In the fourth step, an entropy-based controlled method was used along with a multiclass support vector machine (M-SVM) for the best features selection. In the final step, M-SVM is used for brain tumor classification, which identifies the meningioma, glioma and pituitary images. Results: The proposed method was demonstrated on BraTS 2018 and Figshare datasets. Experimental study shows that the proposed brain tumor detection and classification method outperforms other methods both visually and quantitatively, obtaining an accuracy of 97.47% and 98.92%, respectively. Finally, we adopt the eXplainable Artificial Intelligence (XAI) method to explain the result. Conclusions: Our proposed approach for brain tumor detection and classification has outperformed prior methods. These findings demonstrate that the proposed approach obtained higher performance in terms of both visually and enhanced quantitative evaluation with improved accuracy.
Collapse
|
35
|
An Efficient Multi-Scale Convolutional Neural Network Based Multi-Class Brain MRI Classification for SaMD. TOMOGRAPHY (ANN ARBOR, MICH.) 2022; 8:1905-1927. [PMID: 35894026 PMCID: PMC9330870 DOI: 10.3390/tomography8040161] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/10/2022] [Revised: 06/28/2022] [Accepted: 07/13/2022] [Indexed: 01/05/2023]
Abstract
A brain tumor is the growth of abnormal cells in certain brain tissues with a high mortality rate; therefore, it requires high precision in diagnosis, as a minor human judgment can eventually cause severe consequences. Magnetic Resonance Image (MRI) serves as a non-invasive tool to detect the presence of a tumor. However, Rician noise is inevitably instilled during the image acquisition process, which leads to poor observation and interferes with the treatment. Computer-Aided Diagnosis (CAD) systems can perform early diagnosis of the disease, potentially increasing the chances of survival, and lessening the need for an expert to analyze the MRIs. Convolutional Neural Networks (CNN) have proven to be very effective in tumor detection in brain MRIs. There have been multiple studies dedicated to brain tumor classification; however, these techniques lack the evaluation of the impact of the Rician noise on state-of-the-art deep learning techniques and the consideration of the scaling impact on the performance of the deep learning as the size and location of tumors vary from image to image with irregular shape and boundaries. Moreover, transfer learning-based pre-trained models such as AlexNet and ResNet have been used for brain tumor detection. However, these architectures have many trainable parameters and hence have a high computational cost. This study proposes a two-fold solution: (a) Multi-Scale CNN (MSCNN) architecture to develop a robust classification model for brain tumor diagnosis, and (b) minimizing the impact of Rician noise on the performance of the MSCNN. The proposed model is a multi-class classification solution that classifies MRIs into glioma, meningioma, pituitary, and non-tumor. The core objective is to develop a robust model for enhancing the performance of the existing tumor detection systems in terms of accuracy and efficiency. Furthermore, MRIs are denoised using a Fuzzy Similarity-based Non-Local Means (FSNLM) filter to improve the classification results. Different evaluation metrics are employed, such as accuracy, precision, recall, specificity, and F1-score, to evaluate and compare the performance of the proposed multi-scale CNN and other state-of-the-art techniques, such as AlexNet and ResNet. In addition, trainable and non-trainable parameters of the proposed model and the existing techniques are also compared to evaluate the computational efficiency. The experimental results show that the proposed multi-scale CNN model outperforms AlexNet and ResNet in terms of accuracy and efficiency at a lower computational cost. Based on experimental results, it is found that our proposed MCNN2 achieved accuracy and F1-score of 91.2% and 91%, respectively, which is significantly higher than the existing AlexNet and ResNet techniques. Moreover, our findings suggest that the proposed model is more effective and efficient in facilitating clinical research and practice for MRI classification.
Collapse
|
36
|
Jian A, Liu S, Di Ieva A. Artificial Intelligence for Survival Prediction in Brain Tumors on Neuroimaging. Neurosurgery 2022; 91:8-26. [PMID: 35348129 DOI: 10.1227/neu.0000000000001938] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Accepted: 01/08/2022] [Indexed: 12/30/2022] Open
Abstract
Survival prediction of patients affected by brain tumors provides essential information to guide surgical planning, adjuvant treatment selection, and patient counseling. Current reliance on clinical factors, such as Karnofsky Performance Status Scale, and simplistic radiological characteristics are, however, inadequate for survival prediction in tumors such as glioma that demonstrate molecular and clinical heterogeneity with variable survival outcomes. Advances in the domain of artificial intelligence have afforded powerful tools to capture a large number of hidden high-dimensional imaging features that reflect abundant information about tumor structure and physiology. Here, we provide an overview of current literature that apply computational analysis tools such as radiomics and machine learning methods to the pipeline of image preprocessing, tumor segmentation, feature extraction, and construction of classifiers to establish survival prediction models based on neuroimaging. We also discuss challenges relating to the development and evaluation of such models and explore ethical issues surrounding the future use of machine learning predictions.
Collapse
Affiliation(s)
- Anne Jian
- Computational NeuroSurgery (CNS) Lab, Macquarie Medical School, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, Australia
- Royal Melbourne Hospital, Melbourne, Australia
| | - Sidong Liu
- Computational NeuroSurgery (CNS) Lab, Macquarie Medical School, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, Australia
- Centre for Health Informatics, Australian Institute of Health Innovation, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, Australia
| | - Antonio Di Ieva
- Computational NeuroSurgery (CNS) Lab, Macquarie Medical School, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, Australia
| |
Collapse
|
37
|
Kumar R, Bhandari AK. Spatial mutual information based detail preserving magnetic resonance image enhancement. Comput Biol Med 2022; 146:105644. [DOI: 10.1016/j.compbiomed.2022.105644] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2022] [Revised: 05/08/2022] [Accepted: 05/14/2022] [Indexed: 11/28/2022]
|
38
|
Zhuang D, Zhang H, Hu G, Guo B. Recent development of contrast agents for magnetic resonance and multimodal imaging of glioblastoma. J Nanobiotechnology 2022; 20:284. [PMID: 35710493 PMCID: PMC9204881 DOI: 10.1186/s12951-022-01479-6] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Accepted: 05/29/2022] [Indexed: 11/28/2022] Open
Abstract
Glioblastoma (GBM) as the most common primary malignant brain tumor exhibits a high incidence and degree of malignancy as well as poor prognosis. Due to the existence of formidable blood–brain barrier (BBB) and the aggressive growth and infiltrating nature of GBM, timely diagnosis and treatment of GBM is still very challenging. Among different imaging modalities, magnetic resonance imaging (MRI) with merits including high soft tissue resolution, non-invasiveness and non-limited penetration depth has become the preferred tool for GBM diagnosis. Furthermore, multimodal imaging with combination of MRI and other imaging modalities would not only synergistically integrate the pros, but also overcome the certain limitation in each imaging modality, offering more accurate morphological and pathophysiological information of brain tumors. Since contrast agents contribute to amplify imaging signal output for unambiguous pin-pointing of tumors, tremendous efforts have been devoted to advances of contrast agents for MRI and multimodal imaging. Herein, we put special focus on summary of the most recent advances of not only MRI contrast agents including iron oxide-, manganese (Mn)-, gadolinium (Gd)-, 19F- and copper (Cu)-incorporated nanoplatforms for GBM imaging, but also dual-modal or triple-modal nanoprobes. Furthermore, potential obstacles and perspectives for future research and clinical translation of these contrast agents are discussed. We hope this review provides insights for scientists and students with interest in this area.
Collapse
Affiliation(s)
- Danping Zhuang
- The Second Clinical Medical College, Jinan University, Shenzhen, Guangdong, 518020, China
| | - Huifen Zhang
- Department of Radiology, Shenzhen People's Hospital (The Second Clinical Medical College, Jinan University; The First Affiliated Hospital, Southern University of Science and Technology), Shenzhen, 518020, Guangdong, China
| | - Genwen Hu
- Department of Radiology, Shenzhen People's Hospital (The Second Clinical Medical College, Jinan University; The First Affiliated Hospital, Southern University of Science and Technology), Shenzhen, 518020, Guangdong, China.
| | - Bing Guo
- School of Science and Shenzhen Key Laboratory of Flexible Printed Electronics Technology, Harbin Institute of Technology, Shenzhen, 518055, China.
| |
Collapse
|
39
|
A Hybrid Deep Learning Model for Brain Tumour Classification. ENTROPY 2022; 24:e24060799. [PMID: 35741521 PMCID: PMC9222774 DOI: 10.3390/e24060799] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/08/2022] [Revised: 06/03/2022] [Accepted: 06/04/2022] [Indexed: 11/16/2022]
Abstract
A brain tumour is one of the major reasons for death in humans, and it is the tenth most common type of tumour that affects people of all ages. However, if detected early, it is one of the most treatable types of tumours. Brain tumours are classified using biopsy, which is not usually performed before definitive brain surgery. An image classification technique for tumour diseases is important for accelerating the treatment process and avoiding surgery and errors from manual diagnosis by radiologists. The advancement of technology and machine learning (ML) can assist radiologists in tumour diagnostics using magnetic resonance imaging (MRI) images without invasive procedures. This work introduced a new hybrid CNN-based architecture to classify three brain tumour types through MRI images. The method suggested in this paper uses hybrid deep learning classification based on CNN with two methods. The first method combines a pre-trained Google-Net model of the CNN algorithm for feature extraction with SVM for pattern classification. The second method integrates a finely tuned Google-Net with a soft-max classifier. The proposed approach was evaluated using MRI brain images that contain a total of 1426 glioma images, 708 meningioma images, 930 pituitary tumour images, and 396 normal brain images. The reported results showed that an accuracy of 93.1% was achieved from the finely tuned Google-Net model. However, the synergy of Google-Net as a feature extractor with an SVM classifier improved recognition accuracy to 98.1%.
Collapse
|
40
|
Sharif MI, Li JP, Khan MA, Kadry S, Tariq U. M3BTCNet: multi model brain tumor classification using metaheuristic deep neural network features optimization. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07204-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
|
41
|
Convolutional Neural Networks to Detect Vestibular Schwannomas on Single MRI Slices: A Feasibility Study. Cancers (Basel) 2022; 14:cancers14092069. [PMID: 35565199 PMCID: PMC9104481 DOI: 10.3390/cancers14092069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Revised: 03/30/2022] [Accepted: 04/19/2022] [Indexed: 02/04/2023] Open
Abstract
Simple Summary Due to the fact that they take inter-slice information into account, 3D- and 2.5D-convolutional neural networks (CNNs) potentially perform better in tumor detection tasks than 2D-CNNs. However, this potential benefit is at the expense of increased computational power and the need for segmentations as an input. Therefore, in this study we aimed to detect vestibular schwannomas (VSs) in individual magnetic resonance imaging (MRI) slices by using a 2D-CNN. We retrained (539 patients) and internally validated (94 patients) a pretrained CNN using contrast-enhanced MRI slices from one institution. Furthermore, we externally validated the CNN using contrast-enhanced MRI slices from another institution. This resulted in an accuracy of 0.949 (95% CI 0.935–0.963) and 0.912 (95% CI 0.866–0.958) for the internal and external validation, respectively. Our findings indicate that 2D-CNNs might be a promising alternative to 2.5-/3D-CNNs for certain tasks thanks to the decreased requirement for computational power and the fact that there is no need for segmentations. Abstract In this study. we aimed to detect vestibular schwannomas (VSs) in individual magnetic resonance imaging (MRI) slices by using a 2D-CNN. A pretrained CNN (ResNet-34) was retrained and internally validated using contrast-enhanced T1-weighted (T1c) MRI slices from one institution. In a second step, the model was externally validated using T1c- and T1-weighted (T1) slices from a different institution. As a substitute, bisected slices were used with and without tumors originating from whole transversal slices that contained part of the unilateral VS. The model predictions were assessed based on the categorical accuracy and confusion matrices. A total of 539, 94, and 74 patients were included for training, internal validation, and external T1c validation, respectively. This resulted in an accuracy of 0.949 (95% CI 0.935–0.963) for the internal validation and 0.912 (95% CI 0.866–0.958) for the external T1c validation. We suggest that 2D-CNNs might be a promising alternative to 2.5-/3D-CNNs for certain tasks thanks to the decreased demand for computational power and the fact that there is no need for segmentations. However, further research is needed on the difference between 2D-CNNs and more complex architectures.
Collapse
|
42
|
Babailov SP, Polovkova MA, Zapolotsky EN, Kirakosyan GA, Martynov AG, Gorbunova YG. Nuclear magnetic resonance thermosensing properties of holmium(III) and thulium(III) tris(tetra-15-crown-5-phthalocyaninato) complexes. J PORPHYR PHTHALOCYA 2022. [DOI: 10.1142/s1088424622500201] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Temperature dependences of paramagnetic chemical shifts in NMR spectra of lanthanide tris-phthalocyaninates Ln2[(15C5)4Pc]3 (where [(15C5)4Pc][Formula: see text] is 2,3,9,10,16,17,24,25-tetrakis(15-crown-5)phthalocyaninate dianion, Ln = Ho(III), Tm(III)) have been studied in the physiological temperature range (from 303 to 323 K). The observed maximum temperature sensitivity [Formula: see text]/dTturns out to be 0.25 ppm/K for the signals of the thulium complex and 0.16 ppm/K for the holmium complex. By the example of Tm2[(15C5)4Pc]3, it has been shown that the use of temperature sensitivities normalized to signal half-widths ([Formula: see text]CT[Formula: see text]/[Formula: see text] is expedient to judge the applicability of the observed temperature dependences of LISs of analogous lanthanide complexes (Ln = Tb, Dy, Ho, Tm) for determining temperatures. The investigated kinetically and thermodynamically stable Ln2[(15C5)4Pc]3 complexes can be considered promising for the design of thermosensitive NMR probes for determination of the local temperature in nonpolar solutions.
Collapse
Affiliation(s)
- Sergey P. Babailov
- Nikolaev Institute of Inorganic Chemistry, Siberian Branch, Russian Academy of Sciences, Av. Lavrentyev 3, Novosibirsk, 630090, Russian Federation
| | - Marina A. Polovkova
- Frumkin Institute of Physical Chemistry and Electrochemistry, Russian Academy of Sciences, Leninskii pr. 31-4, Moscow, 119071, Russian Federation
| | - Evgeny N. Zapolotsky
- Nikolaev Institute of Inorganic Chemistry, Siberian Branch, Russian Academy of Sciences, Av. Lavrentyev 3, Novosibirsk, 630090, Russian Federation
| | - Gayane A. Kirakosyan
- Frumkin Institute of Physical Chemistry and Electrochemistry, Russian Academy of Sciences, Leninskii pr. 31-4, Moscow, 119071, Russian Federation
- Kurnakov Institute of General and Inorganic Chemistry, Russian Academy of Sciences, Leninskii pr. 31, Moscow 119991, Russian Federation
| | - Alexander G. Martynov
- Frumkin Institute of Physical Chemistry and Electrochemistry, Russian Academy of Sciences, Leninskii pr. 31-4, Moscow, 119071, Russian Federation
| | - Yulia G. Gorbunova
- Frumkin Institute of Physical Chemistry and Electrochemistry, Russian Academy of Sciences, Leninskii pr. 31-4, Moscow, 119071, Russian Federation
- Kurnakov Institute of General and Inorganic Chemistry, Russian Academy of Sciences, Leninskii pr. 31, Moscow 119991, Russian Federation
| |
Collapse
|
43
|
Das S, Nayak GK, Saba L, Kalra M, Suri JS, Saxena S. An artificial intelligence framework and its bias for brain tumor segmentation: A narrative review. Comput Biol Med 2022; 143:105273. [PMID: 35228172 DOI: 10.1016/j.compbiomed.2022.105273] [Citation(s) in RCA: 32] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2021] [Revised: 01/15/2022] [Accepted: 01/24/2022] [Indexed: 02/06/2023]
Abstract
BACKGROUND Artificial intelligence (AI) has become a prominent technique for medical diagnosis and represents an essential role in detecting brain tumors. Although AI-based models are widely used in brain lesion segmentation (BLS), understanding their effectiveness is challenging due to their complexity and diversity. Several reviews on brain tumor segmentation are available, but none of them describe a link between the threats due to risk-of-bias (RoB) in AI and its architectures. In our review, we focused on linking RoB and different AI-based architectural Cluster in popular DL framework. Further, due to variance in these designs and input data types in medical imaging, it is necessary to present a narrative review considering all facets of BLS. APPROACH The proposed study uses a PRISMA strategy based on 75 relevant studies found by searching PubMed, Scopus, and Google Scholar. Based on the architectural evolution, DL studies were subsequently categorized into four classes: convolutional neural network (CNN)-based, encoder-decoder (ED)-based, transfer learning (TL)-based, and hybrid DL (HDL)-based architectures. These studies were then analyzed considering 32 AI attributes, with clusters including AI architecture, imaging modalities, hyper-parameters, performance evaluation metrics, and clinical evaluation. Then, after these studies were scored for all attributes, a composite score was computed, normalized, and ranked. Thereafter, a bias cutoff (AP(ai)Bias 1.0, AtheroPoint, Roseville, CA, USA) was established to detect low-, moderate- and high-bias studies. CONCLUSION The four classes of architectures, from best-to worst-performing, are TL > ED > CNN > HDL. ED-based models had the lowest AI bias for BLS. This study presents a set of three primary and six secondary recommendations for lowering the RoB.
Collapse
Affiliation(s)
- Suchismita Das
- CSE Department, International Institute of Information Technology, Bhubaneswar, Odisha, India; CSE Department, KIIT Deemed to be University, Bhubaneswar, Odisha, India
| | - G K Nayak
- CSE Department, International Institute of Information Technology, Bhubaneswar, Odisha, India
| | - Luca Saba
- Department of Radiology, AOU, University of Cagliari, Cagliari, Italy
| | - Mannudeep Kalra
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA, USA
| | - Jasjit S Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™ LLC, Roseville, CA, USA.
| | - Sanjay Saxena
- CSE Department, International Institute of Information Technology, Bhubaneswar, Odisha, India
| |
Collapse
|
44
|
A survey of deep learning methods for multiple sclerosis identification using brain MRI images. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07099-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
|
45
|
Developing an Artificial Intelligence Model for Tumor Grading and Classification, Based on MRI Sequences of Human Brain Gliomas. INTERNATIONAL JOURNAL OF CANCER MANAGEMENT 2022. [DOI: 10.5812/ijcm.120638] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
Background: Artificial intelligence (AI) models have provided advanced applications to many scientific areas, including the prediction of the pathologic grade of tumors, utilizing radiology techniques. Gliomas are among the malignant brain tumors in human adults, and their efficient diagnosis is of high clinical significance. Objectives: Given the contribution of AI to medical diagnoses, we investigated the role of deep learning in the differential diagnosis and grading of human brain gliomas. Methods: This study developed a new AI diagnostic model, i.e., EfficientNetB0, to grade and classify human brain gliomas, using sequences from magnetic resonance imaging (MRI). Results: We validated the new AI model, using a standard dataset (BraTS-2019) and demonstrated that the AI components, i.e., convolutional neural networks and transfer learning, provided excellent performance for classifying and grading glioma images at 98.8% accuracy. Conclusions: The proposed model, EfficientNetB0, is capable to classify and grade glioma from MRI sequences at high accuracy, validity, and specificity. It can provide better performance and diagnostic results for human glioma images than models developed by previous studies.
Collapse
|
46
|
A Comprehensive Analysis of Recent Deep and Federated-Learning-Based Methodologies for Brain Tumor Diagnosis. J Pers Med 2022; 12:jpm12020275. [PMID: 35207763 PMCID: PMC8880689 DOI: 10.3390/jpm12020275] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Revised: 02/05/2022] [Accepted: 02/09/2022] [Indexed: 12/12/2022] Open
Abstract
Brain tumors are a deadly disease with a high mortality rate. Early diagnosis of brain tumors improves treatment, which results in a better survival rate for patients. Artificial intelligence (AI) has recently emerged as an assistive technology for the early diagnosis of tumors, and AI is the primary focus of researchers in the diagnosis of brain tumors. This study provides an overview of recent research on the diagnosis of brain tumors using federated and deep learning methods. The primary objective is to explore the performance of deep and federated learning methods and evaluate their accuracy in the diagnosis process. A systematic literature review is provided, discussing the open issues and challenges, which are likely to guide future researchers working in the field of brain tumor diagnosis.
Collapse
|
47
|
Huang Z, Zhao Y, Liu Y, Song G. AMF-Net: An adaptive multisequence fusing neural network for multi-modality brain tumor diagnosis. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103359] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
48
|
Sailunaz K, Bestepe D, Alhajj S, Özyer T, Rokne J, Alhajj R. Convex Hull in Brain Tumor Segmentation. Brain Inform 2022. [DOI: 10.1007/978-3-031-15037-1_18] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
|
49
|
Bhalodiya JM, Lim Choi Keung SN, Arvanitis TN. Magnetic resonance image-based brain tumour segmentation methods: A systematic review. Digit Health 2022; 8:20552076221074122. [PMID: 35340900 PMCID: PMC8943308 DOI: 10.1177/20552076221074122] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Revised: 11/20/2021] [Accepted: 12/27/2021] [Indexed: 01/10/2023] Open
Abstract
Background Image segmentation is an essential step in the analysis and subsequent characterisation of brain tumours through magnetic resonance imaging. In the literature, segmentation methods are empowered by open-access magnetic resonance imaging datasets, such as the brain tumour segmentation dataset. Moreover, with the increased use of artificial intelligence methods in medical imaging, access to larger data repositories has become vital in method development. Purpose To determine what automated brain tumour segmentation techniques can medical imaging specialists and clinicians use to identify tumour components, compared to manual segmentation. Methods We conducted a systematic review of 572 brain tumour segmentation studies during 2015-2020. We reviewed segmentation techniques using T1-weighted, T2-weighted, gadolinium-enhanced T1-weighted, fluid-attenuated inversion recovery, diffusion-weighted and perfusion-weighted magnetic resonance imaging sequences. Moreover, we assessed physics or mathematics-based methods, deep learning methods, and software-based or semi-automatic methods, as applied to magnetic resonance imaging techniques. Particularly, we synthesised each method as per the utilised magnetic resonance imaging sequences, study population, technical approach (such as deep learning) and performance score measures (such as Dice score). Statistical tests We compared median Dice score in segmenting the whole tumour, tumour core and enhanced tumour. Results We found that T1-weighted, gadolinium-enhanced T1-weighted, T2-weighted and fluid-attenuated inversion recovery magnetic resonance imaging are used the most in various segmentation algorithms. However, there is limited use of perfusion-weighted and diffusion-weighted magnetic resonance imaging. Moreover, we found that the U-Net deep learning technology is cited the most, and has high accuracy (Dice score 0.9) for magnetic resonance imaging-based brain tumour segmentation. Conclusion U-Net is a promising deep learning technology for magnetic resonance imaging-based brain tumour segmentation. The community should be encouraged to contribute open-access datasets so training, testing and validation of deep learning algorithms can be improved, particularly for diffusion- and perfusion-weighted magnetic resonance imaging, where there are limited datasets available.
Collapse
Affiliation(s)
- Jayendra M Bhalodiya
- Institute of Digital Healthcare, Warwick Manufacturing Group, The University of Warwick, UK
| | - Sarah N Lim Choi Keung
- Institute of Digital Healthcare, Warwick Manufacturing Group, The University of Warwick, UK
| | - Theodoros N Arvanitis
- Institute of Digital Healthcare, Warwick Manufacturing Group, The University of Warwick, UK
| |
Collapse
|
50
|
Li X, Qin J, Cao X, Ren Z, Cui T, Bao Y. The different structure-function correlation as measured by OCT and octopus perimetry cluster analysis in intracranial tumor and glaucoma patients. Front Endocrinol (Lausanne) 2022; 13:938952. [PMID: 35966105 PMCID: PMC9363760 DOI: 10.3389/fendo.2022.938952] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/08/2022] [Accepted: 05/31/2022] [Indexed: 11/20/2022] Open
Abstract
BACKGROUND To explore the correlation between visual field (VF) defect values and retinal nerve fiber layer (RNFL) thickness for intracranial tumor and glaucoma patients. METHODS Retrospective analysis is performed for the intracranial and glaucoma patients, whose VF defect values were measured with Octopus perimeter cluster analysis, RNFL thickness, ganglion cell layer (GCL) thickness, and optic disk parameters measured with swept-source OCT. The differences between VF and RNFL (including the data of optic disc) are calculated. The correlation between VF defect values and RNFL and GCL thickness are explored. RESULTS In total 43 eyes of 29 patients with intracranial tumor and 31 eyes of 19 patients with glaucoma were enrolled. The thickness of RNFL not only for the whole (360°), but also for the four quadrants was thinner in the glaucoma group than those of the intracranial tumor group (p<0.05), and similar to the thickness of GCL without significance (p>). There is no significant difference in VF for those two groups except glaucoma having lower sLV (p<0.05). A stronger correlation for mean deviations (MD)s of VF ten clusters and RNFL thickness of OCT twelve sectors is found in the glaucoma patients, but few in the intracranial tumor patients. Logistic regression also shows the loss of RNFL or increasing of vertical CDR and cup volume tending to the diagnosis of glaucoma and the irregular VF damage is inclined to the diagnosis of intracranial tumor. CONCLUSIONS Intracranial tumor has a weak correlation between the RNFL thickness and Octopus VF MD, compared with that of glaucoma. OCT and Octopus VF might provide more helpful information for the differential diagnosis of intracranial tumor and glaucoma.
Collapse
Affiliation(s)
- Xiaochun Li
- Department of Ophthalmology, Peking University People’s Hospital, Eye Diseases and Optometry Institute, Beijing Key Laboratory of Diagnosis and Therapy of Retinal and Choroid Diseases, College of Optometry, Peking University Health Science Center, Beijing, China
- Department of Ophthalmology, Peking University International Hospital, Beijing, China
| | - Jiayin Qin
- Department of Ophthalmology, Peking University People’s Hospital, Eye Diseases and Optometry Institute, Beijing Key Laboratory of Diagnosis and Therapy of Retinal and Choroid Diseases, College of Optometry, Peking University Health Science Center, Beijing, China
- Department of Ophthalmology, Peking University International Hospital, Beijing, China
| | - Xiaoguang Cao
- Department of Ophthalmology, Peking University People’s Hospital, Eye Diseases and Optometry Institute, Beijing Key Laboratory of Diagnosis and Therapy of Retinal and Choroid Diseases, College of Optometry, Peking University Health Science Center, Beijing, China
| | - Zeqin Ren
- Department of Ophthalmology, Peking University People’s Hospital, Eye Diseases and Optometry Institute, Beijing Key Laboratory of Diagnosis and Therapy of Retinal and Choroid Diseases, College of Optometry, Peking University Health Science Center, Beijing, China
| | - Ting Cui
- Department of Ophthalmology, Peking University International Hospital, Beijing, China
| | - Yongzhen Bao
- Department of Ophthalmology, Peking University People’s Hospital, Eye Diseases and Optometry Institute, Beijing Key Laboratory of Diagnosis and Therapy of Retinal and Choroid Diseases, College of Optometry, Peking University Health Science Center, Beijing, China
- *Correspondence: Yongzhen Bao,
| |
Collapse
|