A deep convolutional neural network-based automatic detection of brain metastases with and without blood vessel suppression

Improvement of image quality for bright-blood image in VISIBLE (volume isotropic simultaneous interleaved bright- and black-blood examination) by using k-space reordering and startup echoes

PURPOSE

A volume isotropic simultaneous interleaved bright- and black-blood examination (VISIBLE) can simultaneously acquire images with suppressed vascular signals (black-blood images) and images without suppression (bright-blood images). We aimed to improve of the bright-blood images by adjusting the k-space filling and using startup echo.

METHODS

The k-space arrangement of bright-blood images in the conventional VISIBLE followed a low-to-high frequency order, whereas that in the proposed VISIBLE sequence was in the reversed order, and a startup echo was added. The effects of startup echo on the signal-to-noise ratio (SNR) were evaluated using phantoms, considering both white matter (WM) and post-contrast blood. Data from copper sulfate phantoms were acquired in 1D Fourier transform mode using both the conventional and proposed methods of the two VISIBLE sequences. The signal behavior with each sequence was evaluated. Fourteen patients with a total of 21 metastases were included in the study. For each patient, VISIBLE images of both conventional and proposed methods were obtained consecutively after the contrast agent administration. Using clinical images, we conducted a comparison of the SNR and contrast-to-noise ratio (CNR) for tumors, normal WM, and blood vessels between the conventional and proposed VISIBLE sequences.

RESULTS

There was no significant difference in SNRs for both black- and bright-blood images between the conventional sequence and the proposed sequence with different number of startup echoes, however, the SNR of the proposed sequence decreased with increasing number of startup echoes in both black- and bright-images. The signal behavior of the bright-blood image reached a "steady state" when the startup echo exceeded 20. The SNRs of blood vessels in the bright-blood images did not differ significantly between conventional and proposed VISIBLE sequences. The SNRs of WM in the bright-blood images was significantly larger in the conventional sequence than in the proposed sequence. The SNRs of tumors in bright blood images was significantly larger in the proposed sequence than in the conventional sequence. The CNRs between tumors and WM, vessels and WM in the bright-blood images were significantly higher in the proposed sequence than in the conventional sequence.

CONCLUSION

The use of the startup echo in combination with the high-to-low frequency k-space ordering method resulted in improved CNR of the bright-blood images in the VISIBLE sequence.

Reducing false positives in deep learning-based brain metastasis detection by using both gradient-echo and spin-echo contrast-enhanced MRI: validation in a multi-center diagnostic cohort

OBJECTIVES

To develop a deep learning (DL) for detection of brain metastasis (BM) that incorporates both gradient- and turbo spin-echo contrast-enhanced MRI (dual-enhanced DL) and evaluate it in a clinical cohort in comparison with human readers and DL using gradient-echo-based imaging only (GRE DL).

MATERIALS AND METHODS

DL detection was developed using data from 200 patients with BM (training set) and tested in 62 (internal) and 48 (external) consecutive patients who underwent stereotactic radiosurgery and diagnostic dual-enhanced imaging (dual-enhanced DL) and later guide GRE imaging (GRE DL). The detection sensitivity and positive predictive value (PPV) were compared between two DLs. Two neuroradiologists independently analyzed BM and reference standards for BM were separately drawn by another neuroradiologist. The relative differences (RDs) from the reference standard BM numbers were compared between the DLs and neuroradiologists.

RESULTS

Sensitivity was similar between GRE DL (93%, 95% confidence interval [CI]: 90-96%) and dual-enhanced DL (92% [89-94%]). The PPV of the dual-enhanced DL was higher (89% [86-92%], p < .001) than that of GRE DL (76%, [72-80%]). GRE DL significantly overestimated the number of metastases (false positives; RD: 0.05, 95% CI: 0.00-0.58) compared with neuroradiologists (RD: 0.00, 95% CI: - 0.28, 0.15, p < .001), whereas dual-enhanced DL (RD: 0.00, 95% CI: 0.00-0.15) did not show a statistically significant difference from neuroradiologists (RD: 0.00, 95% CI: - 0.20-0.10, p = .913).

CONCLUSION

The dual-enhanced DL showed improved detection of BM and reduced overestimation compared with GRE DL, achieving similar performance to neuroradiologists.

CLINICAL RELEVANCE STATEMENT

The use of deep learning-based brain metastasis detection with turbo spin-echo imaging reduces false positive detections, aiding in the guidance of stereotactic radiosurgery when gradient-echo imaging alone is employed.

KEY POINTS

•Deep learning for brain metastasis detection improved by using both gradient- and turbo spin-echo contrast-enhanced MRI (dual-enhanced deep learning). •Dual-enhanced deep learning increased true positive detections and reduced overestimation. •Dual-enhanced deep learning achieved similar performance to neuroradiologists for brain metastasis counts.

Comparison of diagnostic performance of radiologist- and AI-based assessments of T2-FLAIR mismatch sign and quantitative assessment using synthetic MRI in the differential diagnosis between astrocytoma, IDH-mutant and oligodendroglioma, IDH-mutant and 1p/19q-codeleted

PURPOSE

This study aimed to compare assessments by radiologists, artificial intelligence (AI), and quantitative measurement using synthetic MRI (SyMRI) for differential diagnosis between astrocytoma, IDH-mutant and oligodendroglioma, and IDH-mutant and 1p/19q-codeleted and to identify the superior method.

METHODS

Thirty-three cases (men, 14; women, 19) comprising 19 astrocytomas and 14 oligodendrogliomas were evaluated. Four radiologists independently evaluated the presence of the T2-FLAIR mismatch sign. A 3D convolutional neural network (CNN) model was trained using 50 patients outside the test group (28 astrocytomas and 22 oligodendrogliomas) and transferred to evaluate the T2-FLAIR mismatch lesions in the test group. If the CNN labeled more than 50% of the T2-prolonged lesion area, the result was considered positive. The T1/T2-relaxation times and proton density (PD) derived from SyMRI were measured in both gliomas. Each quantitative parameter (T1, T2, and PD) was compared between gliomas using the Mann-Whitney U-test. Receiver-operating characteristic analysis was used to evaluate the diagnostic performance.

RESULTS

The mean sensitivity, specificity, and area under the curve (AUC) of radiologists vs. AI were 76.3% vs. 94.7%; 100% vs. 92.9%; and 0.880 vs. 0.938, respectively. The two types of diffuse gliomas could be differentiated using a cutoff value of 2290/128 ms for a combined 90th percentile of T1 and 10th percentile of T2 relaxation times with 94.4/100% sensitivity/specificity with an AUC of 0.981.

CONCLUSION

Compared to the radiologists' assessment using the T2-FLAIR mismatch sign, the AI and the SyMRI assessments increased both sensitivity and objectivity, resulting in improved diagnostic performance in differentiating gliomas.

Deep learning-based detection and quantification of brain metastases on black-blood imaging can provide treatment suggestions: a clinical cohort study

OBJECTIVES

We aimed to evaluate whether deep learning-based detection and quantification of brain metastasis (BM) may suggest treatment options for patients with BMs.

METHODS

The deep learning system (DLS) for detection and quantification of BM was developed in 193 patients and applied to 112 patients that were newly detected on black-blood contrast-enhanced T1-weighted imaging. Patients were assigned to one of 3 treatment suggestion groups according to the European Association of Neuro-Oncology (EANO)-European Society for Medical Oncology (ESMO) recommendations using number and volume of the BMs detected by the DLS: short-term imaging follow-up without treatment (group A), surgery or stereotactic radiosurgery (limited BM, group B), or whole-brain radiotherapy or systemic chemotherapy (extensive BM, group C). The concordance between the DLS-based groups and clinical decisions was analyzed with or without consideration of targeted agents. The performance of distinguishing high-risk (B + C) was calculated.

RESULTS

Among 112 patients (mean age 64.3 years, 63 men), group C had the largest number and volume of BM, followed by group B (4.4 and 851.6 mm3) and A (1.5 and 15.5 mm3). The DLS-based groups were concordant with the actual clinical decisions, with an accuracy of 76.8% (86 of 112). Modified accuracy considering targeted agents was 81.3% (91 of 112). The DLS showed 95% (82/86) sensitivity and 81% (21/26) specificity for distinguishing the high risk.

CONCLUSION

DLS-based detection and quantification of BM have the potential to be helpful in the determination of treatment options for both low- and high-risk groups of limited and extensive BMs.

CLINICAL RELEVANCE STATEMENT

For patients with newly diagnosed brain metastasis, deep learning-based detection and quantification may be used in clinical settings where prompt and accurate treatment decisions are required, which can lead to better patient outcomes.

KEY POINTS

• Deep learning-based brain metastasis detection and quantification showed excellent agreement with ground-truth classifications. • By setting an algorithm to suggest treatment based on the number and volume of brain metastases detected by the deep learning system, the concordance was 81.3%. • When dividing patients into low- and high-risk groups, the sensitivity for detecting the latter was 95%.

Brain metastasis tumor segmentation and detection using deep learning algorithms: A systematic review and meta-analysis

BACKGROUND

Manual detection of brain metastases is both laborious and inconsistent, driving the need for more efficient solutions. Accordingly, our systematic review and meta-analysis assessed the efficacy of deep learning algorithms in detecting and segmenting brain metastases from various primary origins in MRI images.

METHODS

We conducted a comprehensive search of PubMed, Embase, and Web of Science up to May 24, 2023, which yielded 42 relevant studies for our analysis. We assessed the quality of these studies using the QUADAS-2 and CLAIM tools. Using a random-effect model, we calculated the pooled lesion-wise dice score as well as patient-wise and lesion-wise sensitivity. We performed subgroup analyses to investigate the influence of factors such as publication year, study design, training center of the model, validation methods, slice thickness, model input dimensions, MRI sequences fed to the model, and the specific deep learning algorithms employed. Additionally, meta-regression analyses were carried out considering the number of patients in the studies, count of MRI manufacturers, count of MRI models, training sample size, and lesion number.

RESULTS

Our analysis highlighted that deep learning models, particularly the U-Net and its variants, demonstrated superior segmentation accuracy. Enhanced detection sensitivity was observed with an increased diversity in MRI hardware, both in terms of manufacturer and model variety. Furthermore, slice thickness was identified as a significant factor influencing lesion-wise detection sensitivity. Overall, the pooled results indicated a lesion-wise dice score of 79%, with patient-wise and lesion-wise sensitivities at 86% and 87%, respectively.

CONCLUSIONS

The study underscores the potential of deep learning in improving brain metastasis diagnostics and treatment planning. Still, more extensive cohorts and larger meta-analysis are needed for more practical and generalizable algorithms. Future research should prioritize these areas to advance the field. This study was funded by the Gen. & Mrs. M.C. Peng Fellowship and registered under PROSPERO (CRD42023427776).

Feature pyramid network-based computer-aided detection and monitoring treatment response of brain metastases on contrast-enhanced MRI

AIM

To investigate the value of feature pyramid network (FPN)-based computer-aided detection (CAD) of brain metastases (BMs) before and after non-surgical treatment, and to evaluate its performance in monitoring treatment response of BM on contrast-enhanced (CE) magnetic resonance imaging (MRI).

MATERIAL AND METHODS

Eighty-five cancer patients newly diagnosed with BM who had undergone initial and follow-up three-dimensional (3D) CE MRI at Liaocheng People's Hospital were included retrospectively in this study. Manual detection (MD) was performed by reviewer 1. Computer-aided detection (CAD) was performed by reviewer 2 using uAI Discover-BMs software. The treatment response was assessed by the two reviewers for each patient separately. A paired chi-square test was used to compare the differences in the detection of BM between MD and CAD. Agreement between MD and CAD in monitoring treatment response was assessed by kappa test.

RESULTS

The sensitivities of MD and CAD on initial 3D CE MRI were 78.65% and 99.13%, respectively. The sensitivities of MD and CAD on follow-up 3D CE MRI were 76.32% and 98.24%, respectively. There was a very good agreement between Reviewer 1 and Reviewer 2 in evaluating the treatment response of BM.

CONCLUSION

FPN-based CAD has a higher sensitivity of close to 100% and lower false negatives (FNs) for BM detection, compared to MD. Although CAD had a few shortcomings in reflecting changes of BMs after treatment, it had high performance in monitoring treatment response of BM on CE MRI.

Construction and evaluation of a gated high-resolution neural network for automatic brain metastasis detection and segmentation

OBJECTIVES

To construct and evaluate a gated high-resolution convolutional neural network for detecting and segmenting brain metastasis (BM).

METHODS

This retrospective study included craniocerebral MRI scans of 1392 patients with 14,542 BMs and 200 patients with no BM between January 2012 and April 2022. A primary dataset including 1000 cases with 11,686 BMs was employed to construct the model, while an independent dataset including 100 cases with 1069 BMs from other hospitals was used to examine the generalizability. The potential of the model for clinical use was also evaluated by comparing its performance in BM detection and segmentation to that of radiologists, and comparing radiologists' lesion detecting performances with and without model assistance.

RESULTS

Our model yielded a recall of 0.88, a dice similarity coefficient (DSC) of 0.90, a positive predictive value (PPV) of 0.93 and a false positives per patient (FP) of 1.01 in the test set, and a recall of 0.85, a DSC of 0.89, a PPV of 0.93, and a FP of 1.07 in dataset from other hospitals. With the model's assistance, the BM detection rates of 4 radiologists improved significantly, ranging from 5.2 to 15.1% (all p < 0.001), and also for detecting small BMs with diameter ≤ 5 mm (ranging from 7.2 to 27.0%, all p < 0.001).

CONCLUSIONS

The proposed model enables accurate BM detection and segmentation with higher sensitivity and less time consumption, showing the potential to augment radiologists' performance in detecting BM.

CLINICAL RELEVANCE STATEMENT

This study offers a promising computer-aided tool to assist the brain metastasis detection and segmentation in routine clinical practice for cancer patients.

KEY POINTS

• The GHR-CNN could accurately detect and segment BM on contrast-enhanced 3D-T1W images. • The GHR-CNN improved the BM detection rate of radiologists, including the detection of small lesions. • The GHR-CNN enabled automated segmentation of BM in a very short time.

Artificial Intelligence in Neuroradiology: A Review of Current Topics and Competition Challenges

There is an expanding body of literature that describes the application of deep learning and other machine learning and artificial intelligence methods with potential relevance to neuroradiology practice. In this article, we performed a literature review to identify recent developments on the topics of artificial intelligence in neuroradiology, with particular emphasis on large datasets and large-scale algorithm assessments, such as those used in imaging AI competition challenges. Numerous applications relevant to ischemic stroke, intracranial hemorrhage, brain tumors, demyelinating disease, and neurodegenerative/neurocognitive disorders were discussed. The potential applications of these methods to spinal fractures, scoliosis grading, head and neck oncology, and vascular imaging were also reviewed. The AI applications examined perform a variety of tasks, including localization, segmentation, longitudinal monitoring, diagnostic classification, and prognostication. While research on this topic is ongoing, several applications have been cleared for clinical use and have the potential to augment the accuracy or efficiency of neuroradiologists.

False-negative and false-positive outcomes of computer-aided detection on brain metastasis: Secondary analysis of a multicenter, multireader study

BACKGROUND

Errors have seldom been evaluated in computer-aided detection on brain metastases. This study aimed to analyze false negatives (FNs) and false positives (FPs) generated by a brain metastasis detection system (BMDS) and by readers.

METHODS

A deep learning-based BMDS was developed and prospectively validated in a multicenter, multireader study. Ad hoc secondary analysis was restricted to the prospective participants (148 with 1,066 brain metastases and 152 normal controls). Three trainees and 3 experienced radiologists read the MRI images without and with the BMDS. The number of FNs and FPs per patient, jackknife alternative free-response receiver operating characteristic figure of merit (FOM), and lesion features associated with FNs were analyzed for the BMDS and readers using binary logistic regression.

RESULTS

The FNs, FPs, and the FOM of the stand-alone BMDS were 0.49, 0.38, and 0.97, respectively. Compared with independent reading, BMDS-assisted reading generated 79% fewer FNs (1.98 vs 0.42, P < .001); 41% more FPs (0.17 vs 0.24, P < .001) but 125% more FPs for trainees (P < .001); and higher FOM (0.87 vs 0.98, P < .001). Lesions with small size, greater number, irregular shape, lower signal intensity, and located on nonbrain surface were associated with FNs for readers. Small, irregular, and necrotic lesions were more frequently found in FNs for BMDS. The FPs mainly resulted from small blood vessels for the BMDS and the readers.

CONCLUSIONS

Despite the improvement in detection performance, attention should be paid to FPs and small lesions with lower enhancement for radiologists, especially for less-experienced radiologists.

Deep Learning for Detecting Brain Metastases on MRI: A Systematic Review and Meta-Analysis

Since manual detection of brain metastases (BMs) is time consuming, studies have been conducted to automate this process using deep learning. The purpose of this study was to conduct a systematic review and meta-analysis of the performance of deep learning models that use magnetic resonance imaging (MRI) to detect BMs in cancer patients. A systematic search of MEDLINE, EMBASE, and Web of Science was conducted until 30 September 2022. Inclusion criteria were: patients with BMs; deep learning using MRI images was applied to detect the BMs; sufficient data were present in terms of detective performance; original research articles. Exclusion criteria were: reviews, letters, guidelines, editorials, or errata; case reports or series with less than 20 patients; studies with overlapping cohorts; insufficient data in terms of detective performance; machine learning was used to detect BMs; articles not written in English. Quality Assessment of Diagnostic Accuracy Studies-2 and Checklist for Artificial Intelligence in Medical Imaging was used to assess the quality. Finally, 24 eligible studies were identified for the quantitative analysis. The pooled proportion of patient-wise and lesion-wise detectability was 89%. Articles should adhere to the checklists more strictly. Deep learning algorithms effectively detect BMs. Pooled analysis of false positive rates could not be estimated due to reporting differences.

Development and external validation of an MRI-based neural network for brain metastasis segmentation in the AURORA multicenter study

BACKGROUND

Stereotactic radiotherapy is a standard treatment option for patients with brain metastases. The planning target volume is based on gross tumor volume (GTV) segmentation. The aim of this work is to develop and validate a neural network for automatic GTV segmentation to accelerate clinical daily routine practice and minimize interobserver variability.

METHODS

We analyzed MRIs (T1-weighted sequence ± contrast-enhancement, T2-weighted sequence, and FLAIR sequence) from 348 patients with at least one brain metastasis from different cancer primaries treated in six centers. To generate reference segmentations, all GTVs and the FLAIR hyperintense edematous regions were segmented manually. A 3D-U-Net was trained on a cohort of 260 patients from two centers to segment the GTV and the surrounding FLAIR hyperintense region. During training varying degrees of data augmentation were applied. Model validation was performed using an independent international multicenter test cohort (n = 88) including four centers.

RESULTS

Our proposed U-Net reached a mean overall Dice similarity coefficient (DSC) of 0.92 ± 0.08 and a mean individual metastasis-wise DSC of 0.89 ± 0.11 in the external test cohort for GTV segmentation. Data augmentation improved the segmentation performance significantly. Detection of brain metastases was effective with a mean F1-Score of 0.93 ± 0.16. The model performance was stable independent of the center (p = 0.3). There was no correlation between metastasis volume and DSC (Pearson correlation coefficient 0.07).

CONCLUSION

Reliable automated segmentation of brain metastases with neural networks is possible and may support radiotherapy planning by providing more objective GTV definitions.

Automated detection and quantification of brain metastases on clinical MRI data using artificial neural networks

Background

Reliable detection and precise volumetric quantification of brain metastases (BM) on MRI are essential for guiding treatment decisions. Here we evaluate the potential of artificial neural networks (ANN) for automated detection and quantification of BM.

Methods

A consecutive series of 308 patients with BM was used for developing an ANN (with a 4:1 split for training/testing) for automated volumetric assessment of contrast-enhancing tumors (CE) and non-enhancing FLAIR signal abnormality including edema (NEE). An independent consecutive series of 30 patients was used for external testing. Performance was assessed case-wise for CE and NEE and lesion-wise for CE using the case-wise/lesion-wise DICE-coefficient (C/L-DICE), positive predictive value (L-PPV) and sensitivity (C/L-Sensitivity).

Results

The performance of detecting CE lesions on the validation dataset was not significantly affected when evaluating different volumetric thresholds (0.001–0.2 cm3; P = .2028). The median L-DICE and median C-DICE for CE lesions were 0.78 (IQR = 0.6–0.91) and 0.90 (IQR = 0.85–0.94) in the institutional as well as 0.79 (IQR = 0.67–0.82) and 0.84 (IQR = 0.76–0.89) in the external test dataset. The corresponding median L-Sensitivity and median L-PPV were 0.81 (IQR = 0.63–0.92) and 0.79 (IQR = 0.63–0.93) in the institutional test dataset, as compared to 0.85 (IQR = 0.76–0.94) and 0.76 (IQR = 0.68–0.88) in the external test dataset. The median C-DICE for NEE was 0.96 (IQR = 0.92–0.97) in the institutional test dataset as compared to 0.85 (IQR = 0.72–0.91) in the external test dataset.

Conclusion

The developed ANN-based algorithm (publicly available at www.github.com/NeuroAI-HD/HD-BM) allows reliable detection and precise volumetric quantification of CE and NEE compartments in patients with BM.