Enhancing Automated Brain Tumor Detection Accuracy Using Artificial Intelligence Approaches for Healthcare Environments

Medical imaging and deep learning models are essential to the early identification and diagnosis of brain cancers, facilitating timely intervention and improving patient outcomes. This research paper investigates the integration of YOLOv5, a state-of-the-art object detection framework, with non-local neural networks (NLNNs) to improve brain tumor detection's robustness and accuracy. This study begins by curating a comprehensive dataset comprising brain MRI scans from various sources. To facilitate effective fusion, the YOLOv5 and NLNNs, K-means+, and spatial pyramid pooling fast+ (SPPF+) modules are integrated within a unified framework. The brain tumor dataset is used to refine the YOLOv5 model through the application of transfer learning techniques, adapting it specifically to the task of tumor detection. The results indicate that the combination of YOLOv5 and other modules results in enhanced detection capabilities in comparison to the utilization of YOLOv5 exclusively, proving recall rates of 86% and 83% respectively. Moreover, the research explores the interpretability aspect of the combined model. By visualizing the attention maps generated by the NLNNs module, the regions of interest associated with tumor presence are highlighted, aiding in the understanding and validation of the decision-making procedure of the methodology. Additionally, the impact of hyperparameters, such as NLNNs kernel size, fusion strategy, and training data augmentation, is investigated to optimize the performance of the combined model.

A Multidisciplinary Hyper-Modeling Scheme in Personalized In Silico Oncology: Coupling Cell Kinetics with Metabolism, Signaling Networks, and Biomechanics as Plug-In Component Models of a Cancer Digital Twin

The massive amount of human biological, imaging, and clinical data produced by multiple and diverse sources necessitates integrative modeling approaches able to summarize all this information into answers to specific clinical questions. In this paper, we present a hypermodeling scheme able to combine models of diverse cancer aspects regardless of their underlying method or scale. Describing tissue-scale cancer cell proliferation, biomechanical tumor growth, nutrient transport, genomic-scale aberrant cancer cell metabolism, and cell-signaling pathways that regulate the cellular response to therapy, the hypermodel integrates mutation, miRNA expression, imaging, and clinical data. The constituting hypomodels, as well as their orchestration and links, are described. Two specific cancer types, Wilms tumor (nephroblastoma) and non-small cell lung cancer, are addressed as proof-of-concept study cases. Personalized simulations of the actual anatomy of a patient have been conducted. The hypermodel has also been applied to predict tumor control after radiotherapy and the relationship between tumor proliferative activity and response to neoadjuvant chemotherapy. Our innovative hypermodel holds promise as a digital twin-based clinical decision support system and as the core of future in silico trial platforms, although additional retrospective adaptation and validation are necessary.

Automatic Brain Tumor Classification via Lion Plus Dragonfly Algorithm

Denoising, skull stripping, segmentation, feature extraction, and classification are five important processes in this paper's development of a brain tumor classification model. The brain tumor image will be imposed first using the entropy-based trilateral filter to de-noising and this image is imposed to skull stripping by means of morphological partition and Otsu thresholding. Adaptive contrast limited fuzzy adaptive histogram equalization (CLFAHE) is also used in the segmentation process. The gray-level co-occurrence matrix (GLCM) characteristics are derived from the segmented image. The collected GLCM features are used in a hybrid classifier that combines the neural network (NN) and deep belief network (DBN) ideas. As an innovation, the hidden neurons of the two classifiers are modified ideally to improve the prediction model's accuracy. The hidden neurons are optimized using a unique hybrid optimization technique known as lion with dragonfly separation update (L-DSU), which integrates the approaches from both DA and LA. Finally, the suggested model's performance is compared to that of the standard models concerning certain performance measures.

Multi-Modal Brain Tumor Detection Using Deep Neural Network and Multiclass SVM

Background and Objectives: Clinical diagnosis has become very significant in today's health system. The most serious disease and the leading cause of mortality globally is brain cancer which is a key research topic in the field of medical imaging. The examination and prognosis of brain tumors can be improved by an early and precise diagnosis based on magnetic resonance imaging. For computer-aided diagnosis methods to assist radiologists in the proper detection of brain tumors, medical imagery must be detected, segmented, and classified. Manual brain tumor detection is a monotonous and error-prone procedure for radiologists; hence, it is very important to implement an automated method. As a result, the precise brain tumor detection and classification method is presented. Materials and Methods: The proposed method has five steps. In the first step, a linear contrast stretching is used to determine the edges in the source image. In the second step, a custom 17-layered deep neural network architecture is developed for the segmentation of brain tumors. In the third step, a modified MobileNetV2 architecture is used for feature extraction and is trained using transfer learning. In the fourth step, an entropy-based controlled method was used along with a multiclass support vector machine (M-SVM) for the best features selection. In the final step, M-SVM is used for brain tumor classification, which identifies the meningioma, glioma and pituitary images. Results: The proposed method was demonstrated on BraTS 2018 and Figshare datasets. Experimental study shows that the proposed brain tumor detection and classification method outperforms other methods both visually and quantitatively, obtaining an accuracy of 97.47% and 98.92%, respectively. Finally, we adopt the eXplainable Artificial Intelligence (XAI) method to explain the result. Conclusions: Our proposed approach for brain tumor detection and classification has outperformed prior methods. These findings demonstrate that the proposed approach obtained higher performance in terms of both visually and enhanced quantitative evaluation with improved accuracy.

Hypothetical generalized framework for a new imaging endpoint of therapeutic activity in early phase clinical trials in brain tumors

Imaging response assessment is a cornerstone of patient care and drug development in oncology. Clinicians/clinical researchers rely on tumor imaging to estimate the impact of new treatments and guide decision making for patients and candidate therapies. This is important in brain cancer, where associations between tumor size/growth and emerging neurological deficits are strong. Accurately measuring the impact of a new therapy on tumor growth early in clinical development, where patient numbers are small, would be valuable for decision making regarding late-stage development activation. Current attempts to measure the impact of a new therapy have limited influence on clinical development, as determination of progression, stability or response does not currently account for individual tumor growth kinetics prior to the initiation of experimental therapies. Therefore, we posit that imaging-based response assessment, often used as a tool for estimating clinical effect, is incomplete as it does not adequately account for growth trajectories or biological characteristics of tumors prior to the introduction of an investigational agent. Here, we propose modifications to the existing framework for evaluating imaging assessment in primary brain tumors that will provide a more reliable understanding of treatment effects. Measuring tumor growth trajectories prior to a given intervention may allow us to more confidently conclude whether there is an anti-tumor effect. This updated approach to imaging-based tumor response assessment is intended to improve our ability to select candidate therapies for later-stage development, including those that may not meet currently sought thresholds for "response" and ultimately lead to identification of effective treatments.

Fibre tract segmentation for intraoperative diffusion MRI in neurosurgical patients using tract-specific orientation atlas and tumour deformation modelling

Purpose:

Intraoperative diffusion MRI could provide a means of visualising brain fibre tracts near a neurosurgical target after preoperative images have been invalidated by brain shift. We propose an atlas-based intraoperative tract segmentation method, as the standard preoperative method, streamline tractography, is unsuitable for intraoperative implementation.

Methods:

A tract-specific voxel-wise fibre orientation atlas is constructed from healthy training data. After registration with a target image, a radial tumour deformation model is applied to the orientation atlas to account for displacement caused by lesions. The final tract map is obtained from the inner product of the atlas and target image fibre orientation data derived from intraoperative diffusion MRI.

Results:

The simple tumour model takes only seconds to effectively deform the atlas into alignment with the target image. With minimal processing time and operator effort, maps of surgically relevant tracts can be achieved that are visually and qualitatively comparable with results obtained from streamline tractography.

Conclusion:

Preliminary results demonstrate feasibility of intraoperative streamline-free tract segmentation in challenging neurosurgical cases. Demonstrated results in a small number of representative sample subjects are realistic despite the simplicity of the tumour deformation model employed. Following this proof of concept, future studies will focus on achieving robustness in a wide range of tumour types and clinical scenarios, as well as quantitative validation of segmentations.

Multispectral co-occurrence of wavelet coefficients for malignancy assessment of brain tumors

Brain tumor is not most common, but truculent type of cancer. Therefore, correct prediction of its aggressiveness nature at an early stage would influence the treatment strategy. Although several diagnostic methods based on different modalities exist, a pre-operative method for determining tumor malignancy state still remains as an active research area. In this regard, the paper presents a new method for the assessment of tumor grades using conventional MR sequences namely, T1, T1 with contrast enhancement, T2 and FLAIR. The proposed method for tumor gradation is mainly based on feature extraction using multiresolution image analysis and classification using support vector machine. Since the wavelet features of different tumor subregions, obtained from single MR sequence, do not carry equally important information, a wavelet fusion technique is proposed based on the texture information content of each voxel. The concept of texture gradient, used in the proposed algorithm, fuses the wavelet coefficients of the given MR sequences. The feature vector is then derived from the co-occurrence of fused wavelet coefficients. As each wavelet subband contains distinct detail information, a novel concept of multispectral co-occurrence of wavelet coefficients is introduced to capture the spatial correlation among different subbands. It enables to convey more informative features to characterize the tumor type. The effectiveness of the proposed method is analyzed, with respect to six classification performance indices, on BRATS 2012 and BRATS 2014 data sets. The classification accuracy, sensitivity, specificity, positive predictive value, negative predictive value, and area under curve assessed by the ten-fold cross-validation are 91.3%, 96.8%, 66.7%, 92.4%, 88.4%, and 92.0%, respectively, on real brain MR data.

From tumour perfusion to drug delivery and clinical translation of in silico cancer models

In silico cancer models have demonstrated great potential as a tool to improve drug design, optimise the delivery of drugs to target sites in the host tissue and, hence, improve therapeutic efficacy and patient outcome. However, there are significant barriers to the successful translation of in silico technology from bench to bedside. More precisely, the specification of unknown model parameters, the necessity for models to adequately reflect in vivo conditions, and the limited amount of pertinent validation data to evaluate models' accuracy and assess their reliability, pose major obstacles in the path towards their clinical translation. This review aims to capture the state-of-the-art in in silico cancer modelling of vascularised solid tumour growth, and identify the important advances and barriers to success of these models in clinical oncology. Particular emphasis has been put on continuum-based models of cancer since they - amongst the class of mechanistic spatio-temporal modelling approaches - are well-established in simulating transport phenomena and the biomechanics of tissues, and have demonstrated potential for clinical translation. Three important avenues in in silico modelling are considered in this contribution: first, since systemic therapy is a major cancer treatment approach, we start with an overview of the tumour perfusion and angiogenesis in silico models. Next, we present the state-of-the-art in silico work encompassing the delivery of chemotherapeutic agents to cancer nanomedicines through the bloodstream, and then review continuum-based modelling approaches that demonstrate great promise for successful clinical translation. We conclude with a discussion of what we view to be the key challenges and opportunities for in silico modelling in personalised and precision medicine.

An in silico hybrid continuum-/agent-based procedure to modelling cancer development: Interrogating the interplay amongst glioma invasion, vascularity and necrosis

This paper develops a three-dimensional in silico hybrid model of cancer, which describes the multi-variate phenotypic behaviour of tumour and host cells. The model encompasses the role of cell migration and adhesion, the influence of the extracellular matrix, the effects of oxygen and nutrient availability, and the signalling triggered by chemical cues and growth factors. The proposed in silico hybrid modelling framework combines successfully the advantages of continuum-based and discrete methods, namely the finite element and agent-based method respectively. The framework is thus used to realistically model cancer mechano-biology in a multiscale fashion while maintaining the resolution power of each method in a computationally cost-effective manner. The model is tailored to simulate glioma progression, and is subsequently used to interrogate the balance between the host cells and small sized gliomas, while the go-or-grow phenotype characteristic in glioblastomas is also investigated. Also, cell-cell and cell-matrix interactions are examined with respect to their effect in (macroscopic) tumour growth, brain tissue perfusion and tumour necrosis. Finally, we use the in silico framework to assess differences between low-grade and high-grade glioma growth, demonstrating significant differences in the distribution of cancer as well as host cells, in accordance with reported experimental findings.

Brain Tumor Classification Using Convolutional Neural Networks

The brain tumors, are the most common and aggressive disease, leading to a very short life expectancy in their highest grade. Thus, treatment planning is a key stage to improve the quality of life of patients. Generally, various image techniques such as Computed Tomography (CT), Magnetic Resonance Imaging (MRI) and ultrasound image are used to evaluate the tumor in a brain, lung, liver, breast, prostate…etc. Especially, in this work MRI images are used to diagnose tumor in the brain. However the huge amount of data generated by MRI scan thwarts manual classification of tumor vs non-tumor in a particular time. But it having some limitation (i.e) accurate quantitative measurements is provided for limited number of images. Hence trusted and automatic classification scheme are essential to prevent the death rate of human. The automatic brain tumor classification is very challenging task in large spatial and structural variability of surrounding region of brain tumor. In this work, automatic brain tumor detection is proposed by using Convolutional Neural Networks (CNN) classification. The deeper architecture design is performed by using small kernels. The weight of the neuron is given as small. Experimental results show that the CNN archives rate of 97.5% accuracy with low complexity and compared with the all other state of arts methods.

A novel fully automatic multilevel thresholding technique based on optimized intuitionistic fuzzy sets and tsallis entropy for MR brain tumor image segmentation

In the present paper, a hybrid multilevel thresholding technique that combines intuitionistic fuzzy sets and tsallis entropy has been proposed for the automatic delineation of the tumor from magnetic resonance images having vague boundaries and poor contrast. This novel technique takes into account both the image histogram and the uncertainty information for the computation of multiple thresholds. The benefit of the methodology is that it provides fast and improved segmentation for the complex tumorous images with imprecise gray levels. To further boost the computational speed, the mutation based particle swarm optimization is used that selects the most optimal threshold combination. The accuracy of the proposed segmentation approach has been validated on simulated, real low-grade glioma tumor volumes taken from MICCAI brain tumor segmentation (BRATS) challenge 2012 dataset and the clinical tumor images, so as to corroborate its generality and novelty. The designed technique achieves an average Dice overlap equal to 0.82010, 0.78610 and 0.94170 for three datasets. Further, a comparative analysis has also been made between the eight existing multilevel thresholding implementations so as to show the superiority of the designed technique. In comparison, the results indicate a mean improvement in Dice by an amount equal to 4.00% (p < 0.005), 9.60% (p < 0.005) and 3.58% (p < 0.005), respectively in contrast to the fuzzy tsallis approach.

A Numerical Handling of the Boundary Conditions Imposed by the Skull on an Inhomogeneous Diffusion-Reaction Model of Glioblastoma Invasion Into the Brain: Clinical Validation Aspects

A novel explicit triscale reaction-diffusion numerical model of glioblastoma multiforme tumor growth is presented. The model incorporates the handling of Neumann boundary conditions imposed by the cranium and takes into account both the inhomogeneous nature of human brain and the complexity of the skull geometry. The finite-difference time-domain method is adopted. To demonstrate the workflow of a possible clinical validation procedure, a clinical case/scenario is addressed. A good agreement of the in silico calculated value of the doubling time (ie, the time for tumor volume to double) with the value of the same quantity based on tomographic imaging data has been observed. A theoretical exploration suggests that a rough but still quite informative value of the doubling time may be calculated based on a homogeneous brain model. The model could serve as the main component of a continuous mathematics-based glioblastoma oncosimulator aiming at supporting the clinician in the optimal patient-individualized design of treatment using the patient's multiscale data and experimenting in silico (ie, on the computer).

Extended Modality Propagation: Image Synthesis of Pathological Cases

This paper describes a novel generative model for the synthesis of multi-modal medical images of pathological cases based on a single label map. Our model builds upon i) a generative model commonly used for label fusion and multi-atlas patch-based segmentation of healthy anatomical structures, ii) the Modality Propagation iterative strategy used for a spatially-coherent synthesis of subject-specific scans of desired image modalities. The expression Extended Modality Propagation is coined to refer to the extension of Modality Propagation to the synthesis of images of pathological cases. Moreover, image synthesis uncertainty is estimated. An application to Magnetic Resonance Imaging synthesis of glioma-bearing brains is i) validated on the training dataset of a Multimodal Brain Tumor Image Segmentation challenge, ii) compared to the state-of-the-art in glioma image synthesis, and iii) illustrated using the output of two different tumor growth models. Such a generative model allows the generation of a large dataset of synthetic cases, which could prove useful for the training, validation, or benchmarking of image processing algorithms.

A Generative Probabilistic Model and Discriminative Extensions for Brain Lesion Segmentation--With Application to Tumor and Stroke

We introduce a generative probabilistic model for segmentation of brain lesions in multi-dimensional images that generalizes the EM segmenter, a common approach for modelling brain images using Gaussian mixtures and a probabilistic tissue atlas that employs expectation-maximization (EM), to estimate the label map for a new image. Our model augments the probabilistic atlas of the healthy tissues with a latent atlas of the lesion. We derive an estimation algorithm with closed-form EM update equations. The method extracts a latent atlas prior distribution and the lesion posterior distributions jointly from the image data. It delineates lesion areas individually in each channel, allowing for differences in lesion appearance across modalities, an important feature of many brain tumor imaging sequences. We also propose discriminative model extensions to map the output of the generative model to arbitrary labels with semantic and biological meaning, such as "tumor core" or "fluid-filled structure", but without a one-to-one correspondence to the hypo- or hyper-intense lesion areas identified by the generative model. We test the approach in two image sets: the publicly available BRATS set of glioma patient scans, and multimodal brain images of patients with acute and subacute ischemic stroke. We find the generative model that has been designed for tumor lesions to generalize well to stroke images, and the extended discriminative -discriminative model to be one of the top ranking methods in the BRATS evaluation.

Multimodal imaging of gliomas in the context of evolving cellular and molecular therapies

The vast majority of malignant gliomas relapse after surgery and standard radio-chemotherapy. Novel molecular and cellular therapies are thus being developed, targeting specific aspects of tumor growth. While histopathology remains the gold standard for tumor classification, neuroimaging has over the years taken a central role in the diagnosis and treatment follow up of brain tumors. It is used to detect and localize lesions, define the target area for biopsies, plan surgical and radiation interventions and assess tumor progression and treatment outcome. In recent years the application of novel drugs including anti-angiogenic agents that affect the tumor vasculature, has drastically modulated the outcome of brain tumor imaging. To properly evaluate the effects of emerging experimental therapies and successfully support treatment decisions, neuroimaging will have to evolve. Multi-modal imaging systems with existing and new contrast agents, molecular tracers, technological advances and advanced data analysis can all contribute to the establishment of disease relevant biomarkers that will improve disease management and patient care. In this review, we address the challenges of glioma imaging in the context of novel molecular and cellular therapies, and take a prospective look at emerging experimental and pre-clinical imaging techniques that bear the promise of meeting these challenges.

A survey of MRI-based medical image analysis for brain tumor studies

MRI-based medical image analysis for brain tumor studies is gaining attention in recent times due to an increased need for efficient and objective evaluation of large amounts of data. While the pioneering approaches applying automated methods for the analysis of brain tumor images date back almost two decades, the current methods are becoming more mature and coming closer to routine clinical application. This review aims to provide a comprehensive overview by giving a brief introduction to brain tumors and imaging of brain tumors first. Then, we review the state of the art in segmentation, registration and modeling related to tumor-bearing brain images with a focus on gliomas. The objective in the segmentation is outlining the tumor including its sub-compartments and surrounding tissues, while the main challenge in registration and modeling is the handling of morphological changes caused by the tumor. The qualities of different approaches are discussed with a focus on methods that can be applied on standard clinical imaging protocols. Finally, a critical assessment of the current state is performed and future developments and trends are addressed, giving special attention to recent developments in radiological tumor assessment guidelines.