Artificial Intelligence for Breast MRI in 2008-2018: A Systematic Mapping Review

Image quality of DWI at breast MRI depends on the amount of fibroglandular tissue: implications for unenhanced screening

OBJECTIVES

To compare image quality of diffusion-weighted imaging (DWI) and contrast-enhanced breast MRI (DCE-T1) stratified by the amount of fibroglandular tissue (FGT) as a measure of breast density.

METHODS

Retrospective, multi-reader, bicentric visual grading analysis study on breast density (A-D) and overall image and fat suppression quality of DWI and DCE-T1, scored on a standard 5-point Likert scale. Cross tabulations and visual grading characteristic (VGC) curves were calculated for fatty breasts (A/B) versus dense breasts (C/D).

RESULTS

Image quality of DWI was higher in the case of increased breast density, with good scores (score 3-5) in 85.9% (D) and 88.4% (C), compared to 61.6% (B) and 53.5% (A). Overall image quality of DWI was in favor of dense breasts (C/D), with an area under the VGC curve of 0.659 (p < 0.001). Quality of DWI and DCE-T1 fat suppression increased with higher breast density, with good scores (score 3-5) for 86.9% and 45.7% of density D, and 90.2% and 42.9% of density C cases, compared to 76.0% and 33.6% for density B and 54.7% and 29.6% for density A (DWI and DCE-T1 respectively).

CONCLUSIONS

Dense breasts show excellent fat suppression and substantially higher image quality in DWI images compared with non-dense breasts. These results support the setup of studies exploring DWI-based MR imaging without IV contrast for additional screening of women with dense breasts.

CLINICAL RELEVANCE STATEMENT

Our findings demonstrate that image quality of DWI is robust in women with an increased amount of fibroglandular tissue, technically supporting the feasibility of exploring applications such as screening of women with mammographically dense breasts.

KEY POINTS

• Image and fat suppression quality of diffusion-weighted imaging are dependent on the amount of fibroglandular tissue (FGT) which is closely connected to breast density. • Fat suppression quality in diffusion-weighted imaging of the breast is best in women with a high amount of fibroglandular tissue. • High image quality of diffusion-weighted imaging in women with a high amount of FGT in MRI supports that the technical feasibility of DWI can be explored in the additional screening of women with mammographically dense breasts.

New Frontiers in Breast Cancer Imaging: The Rise of AI

Artificial intelligence (AI) has been implemented in multiple fields of medicine to assist in the diagnosis and treatment of patients. AI implementation in radiology, more specifically for breast imaging, has advanced considerably. Breast cancer is one of the most important causes of cancer mortality among women, and there has been increased attention towards creating more efficacious methods for breast cancer detection utilizing AI to improve radiologist accuracy and efficiency to meet the increasing demand of our patients. AI can be applied to imaging studies to improve image quality, increase interpretation accuracy, and improve time efficiency and cost efficiency. AI applied to mammography, ultrasound, and MRI allows for improved cancer detection and diagnosis while decreasing intra- and interobserver variability. The synergistic effect between a radiologist and AI has the potential to improve patient care in underserved populations with the intention of providing quality and equitable care for all. Additionally, AI has allowed for improved risk stratification. Further, AI application can have treatment implications as well by identifying upstage risk of ductal carcinoma in situ (DCIS) to invasive carcinoma and by better predicting individualized patient response to neoadjuvant chemotherapy. AI has potential for advancement in pre-operative 3-dimensional models of the breast as well as improved viability of reconstructive grafts.

Application and prospects of AI-based radiomics in ultrasound diagnosis

Artificial intelligence (AI)-based radiomics has attracted considerable research attention in the field of medical imaging, including ultrasound diagnosis. Ultrasound imaging has unique advantages such as high temporal resolution, low cost, and no radiation exposure. This renders it a preferred imaging modality for several clinical scenarios. This review includes a detailed introduction to imaging modalities, including Brightness-mode ultrasound, color Doppler flow imaging, ultrasound elastography, contrast-enhanced ultrasound, and multi-modal fusion analysis. It provides an overview of the current status and prospects of AI-based radiomics in ultrasound diagnosis, highlighting the application of AI-based radiomics to static ultrasound images, dynamic ultrasound videos, and multi-modal ultrasound fusion analysis.

A Narrative Review of the Use of Artificial Intelligence in Breast, Lung, and Prostate Cancer

Artificial intelligence (AI) has been an important topic within radiology. Currently, AI is used clinically to assist with the detection of lesions through detection systems. However, a number of recent studies have demonstrated the increased value of neural networks in radiology. With an increasing number of screening requirements for cancers, this review aims to study the accuracy of the numerous AI models used in the detection and diagnosis of breast, lung, and prostate cancers. This study summarizes pertinent findings from reviewed articles and provides analysis on the relevancy to clinical radiology. This study found that whereas AI is showing continual improvement in radiology, AI alone does not surpass the effectiveness of a radiologist. Additionally, it was found that there are multiple variations on how AI should be integrated with a radiologist's workflow.

Deep Learning-based Automatic Diagnosis of Breast Cancer on MRI Using Mask R-CNN for Detection Followed by ResNet50 for Classification

RATIONALE AND OBJECTIVES

Diagnosis of breast cancer on MRI requires, first, the identification of suspicious lesions; second, the characterization to give a diagnostic impression. We implemented Mask Reginal-Convolutional Neural Network (R-CNN) to detect abnormal lesions, followed by ResNet50 to estimate the malignancy probability.

MATERIALS AND METHODS

Two datasets were used. The first set had 176 cases, 103 cancer, and 73 benign. The second set had 84 cases, 53 cancer, and 31 benign. For detection, the pre-contrast image and the subtraction images of left and right breasts were used as inputs, so the symmetry could be considered. The detected suspicious area was characterized by ResNet50, using three DCE parametric maps as inputs. The results obtained using slice-based analyses were combined to give a lesion-based diagnosis.

RESULTS

In the first dataset, 101 of 103 cancers were detected by Mask R-CNN as suspicious, and 99 of 101 were correctly classified by ResNet50 as cancer, with a sensitivity of 99/103 = 96%. 48 of 73 benign lesions and 131 normal areas were identified as suspicious. Following classification by ResNet50, only 16 benign and 16 normal areas remained as malignant. The second dataset was used for independent testing. The sensitivity was 43/53 = 81%. Of the total of 121 identified non-cancerous lesions, only 6 of 31 benign lesions and 22 normal tissues were classified as malignant.

CONCLUSION

ResNet50 could eliminate approximately 80% of false positives detected by Mask R-CNN. Combining Mask R-CNN and ResNet50 has the potential to develop a fully-automatic computer-aided diagnostic system for breast cancer on MRI.

False-positive incidental lesions detected on contrast-enhanced breast MRI: clinical and imaging features

PURPOSE

To identify demographic and imaging features of MRI-detected enhancing lesions without clinical, ultrasound, and mammographic correlation associated with false-positive outcomes, impacting patient care.

MATERIALS AND METHODS

A retrospective multi-institutional study of imaging studies and patient's chart review of consecutive women with MRI-detected enhancing lesions without clinical, mammogram, or ultrasound correlation between January and December 2018, who underwent MRI-guided biopsy. According to the BI-RADS lexicon, lesions' frequency and imaging features were recorded. The demographic and imaging characteristics variables were correlated with histopathology as the gold standard and an uneventful follow-up of at least one year. Univariate logistic regression analysis was used to explore the correlation between the baseline variables such as age, genetic mutation, family history of breast cancer, personal history of breast cancer, MRI indication, background parenchymal enhancement, and MRI characteristic of the lesion with the false-positive results in main data and subgroup analysis.

RESULTS

Two hundred nineteen women (median age 49 years; range 26-85 years) with 219 MRI-detected enhancing lesions that underwent MRI-guided vacuum-assisted biopsy during the study period fulfilled the study criteria and formed the study cohort. Out of 219, 180 lesions (82.2%) yielded benign pathology results, including 137 benign outcomes (76%) and 43 high-risk lesions (24%). Most demographic and imaging characteristics variables did not help to differentiate malignant from benign lesions. The variables that showed statistically significant association with true-positive results in univariate analyses were age (OR 1.05; 95% CI 1.02-1.08; p = 0.0015), irregular mass-lesion shape when compared with oval/round mass lesion (OR 11.2; 95% CI 1.6-78.4; p = 0.015), and clumped and clustered ring of enhancement when compared with homogeneous (OR 3.22, 95% CI 1.40-7.40; p = 0.0058). For participants with mass breast lesion, the hyperintense signal on the T2-weighted sequence (compared to the normal fibroglandular signal) was significantly related to the false-positive result (OR 0.13; 95% CI 0.02-0.76; p = 0.024).

CONCLUSION

Young patients, oval/round mass-lesion shape, and homogeneous pattern of non-mass enhancement showed the strongest association with false-positive results of enhancing lesions depicted by MRI. For participants with mass breast lesion, T2-bright mass lesion showed significant association with false-positive result. It may impact the patient's management with a suggestion of follow-up rather than interventional procedure when these demographic and imaging parameters are present, consequently decreasing the patient's anxiety and health care costs.

How Radiomics Can Improve Breast Cancer Diagnosis and Treatment

Recent technological advances in the field of artificial intelligence hold promise in addressing medical challenges in breast cancer care, such as early diagnosis, cancer subtype determination and molecular profiling, prediction of lymph node metastases, and prognostication of treatment response and probability of recurrence. Radiomics is a quantitative approach to medical imaging, which aims to enhance the existing data available to clinicians by means of advanced mathematical analysis using artificial intelligence. Various published studies from different fields in imaging have highlighted the potential of radiomics to enhance clinical decision making. In this review, we describe the evolution of AI in breast imaging and its frontiers, focusing on handcrafted and deep learning radiomics. We present a typical workflow of a radiomics analysis and a practical "how-to" guide. Finally, we summarize the methodology and implementation of radiomics in breast cancer, based on the most recent scientific literature to help researchers and clinicians gain fundamental knowledge of this emerging technology. Alongside this, we discuss the current limitations of radiomics and challenges of integration into clinical practice with conceptual consistency, data curation, technical reproducibility, adequate accuracy, and clinical translation. The incorporation of radiomics with clinical, histopathological, and genomic information will enable physicians to move forward to a higher level of personalized management of patients with breast cancer.

In vivo magnetic resonance <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow><mml:msup><mml:mrow/> <mml:mrow><mml:mn>31</mml:mn></mml:mrow> </mml:msup> </mml:mrow> </mml:math> P-Spectral Analysis With Neural Networks: 31P-SPAWNN

PURPOSE

We have introduced an artificial intelligence framework, 31P-SPAWNN, in order to fully analyze phosphorus-31 ( <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:semantics> <mml:mrow><mml:msup><mml:mrow/> <mml:mrow><mml:mn>31</mml:mn></mml:mrow> </mml:msup> </mml:mrow> <mml:annotation>$$ {}^{31} $$</mml:annotation></mml:semantics> </mml:math> P) magnetic resonance spectra. The flexibility and speed of the technique rival traditional least-square fitting methods, with the performance of the two approaches, are compared in this work.

THEORY AND METHODS

Convolutional neural network architectures have been proposed for the analysis and quantification of <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:semantics> <mml:mrow><mml:msup><mml:mrow/> <mml:mrow><mml:mn>31</mml:mn></mml:mrow> </mml:msup> </mml:mrow> <mml:annotation>$$ {}^{31} $$</mml:annotation></mml:semantics> </mml:math> P-spectroscopy. The generation of training and test data using a fully parameterized model is presented herein. In vivo unlocalized free induction decay and three-dimensional <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:semantics> <mml:mrow><mml:msup><mml:mrow/> <mml:mrow><mml:mn>31</mml:mn></mml:mrow> </mml:msup> </mml:mrow> <mml:annotation>$$ {}^{31} $$</mml:annotation></mml:semantics> </mml:math> P-magnetic resonance spectroscopy imaging data were acquired from healthy volunteers before being quantified using either 31P-SPAWNN or traditional least-square fitting techniques.

RESULTS

The presented experiment has demonstrated both the reliability and accuracy of 31P-SPAWNN for estimating metabolite concentrations and spectral parameters. Simulated test data showed improved quantification using 31P-SPAWNN compared with LCModel. In vivo data analysis revealed higher accuracy at low signal-to-noise ratio using 31P-SPAWNN, yet with equivalent precision. Processing time using 31P-SPAWNN can be further shortened up to two orders of magnitude.

CONCLUSION

The accuracy, reliability, and computational speed of the method open new perspectives for integrating these applications in a clinical setting.

The potential of predictive and prognostic breast MRI (P2-bMRI)

Magnetic resonance imaging (MRI) is an important part of breast cancer diagnosis and multimodal workup. It provides unsurpassed soft tissue contrast to analyse the underlying pathophysiology, and it is adopted for a variety of clinical indications. Predictive and prognostic breast MRI (P2-bMRI) is an emerging application next to these indications. The general objective of P2-bMRI is to provide predictive and/or prognostic biomarkers in order to support personalisation of breast cancer treatment. We believe P2-bMRI has a great clinical potential, thanks to the in vivo examination of the whole tumour and of the surrounding tissue, establishing a link between pathophysiology and response to therapy (prediction) as well as patient outcome (prognostication). The tools used for P2-bMRI cover a wide spectrum: standard and advanced multiparametric pulse sequences; structured reporting criteria (for instance BI-RADS descriptors); artificial intelligence methods, including machine learning (with emphasis on radiomics data analysis); and deep learning that have shown compelling potential for this purpose. P2-bMRI reuses the imaging data of examinations performed in the current practice. Accordingly, P2-bMRI could optimise clinical workflow, enabling cost savings and ultimately improving personalisation of treatment. This review introduces the concept of P2-bMRI, focusing on the clinical application of P2-bMRI by using semantic criteria.

Development and validation of a deep learning model for breast lesion segmentation and characterization in multiparametric MRI

Importance

The utilization of artificial intelligence for the differentiation of benign and malignant breast lesions in multiparametric MRI (mpMRI) assists radiologists to improve diagnostic performance.

Objectives

To develop an automated deep learning model for breast lesion segmentation and characterization and to evaluate the characterization performance of AI models and radiologists.

Materials and methods

For lesion segmentation, 2,823 patients were used for the training, validation, and testing of the VNet-based segmentation models, and the average Dice similarity coefficient (DSC) between the manual segmentation by radiologists and the mask generated by VNet was calculated. For lesion characterization, 3,303 female patients with 3,607 pathologically confirmed lesions (2,213 malignant and 1,394 benign lesions) were used for the three ResNet-based characterization models (two single-input and one multi-input models). Histopathology was used as the diagnostic criterion standard to assess the characterization performance of the AI models and the BI-RADS categorized by the radiologists, in terms of sensitivity, specificity, accuracy, and the area under the receiver operating characteristic curve (AUC). An additional 123 patients with 136 lesions (81 malignant and 55 benign lesions) from another institution were available for external testing.

Results

Of the 5,811 patients included in the study, the mean age was 46.14 (range 11–89) years. In the segmentation task, a DSC of 0.860 was obtained between the VNet-generated mask and manual segmentation by radiologists. In the characterization task, the AUCs of the multi-input and the other two single-input models were 0.927, 0.821, and 0.795, respectively. Compared to the single-input DWI or DCE model, the multi-input DCE and DWI model obtained a significant increase in sensitivity, specificity, and accuracy (0.831 vs. 0.772/0.776, 0.874 vs. 0.630/0.709, 0.846 vs. 0.721/0.752). Furthermore, the specificity of the multi-input model was higher than that of the radiologists, whether using BI-RADS category 3 or 4 as a cutoff point (0.874 vs. 0.404/0.841), and the accuracy was intermediate between the two assessment methods (0.846 vs. 0.773/0.882). For the external testing, the performance of the three models remained robust with AUCs of 0.812, 0.831, and 0.885, respectively.

Conclusions

Combining DCE with DWI was superior to applying a single sequence for breast lesion characterization. The deep learning computer-aided diagnosis (CADx) model we developed significantly improved specificity and achieved comparable accuracy to the radiologists with promise for clinical application to provide preliminary diagnoses.

MRI as a biomarker for breast cancer diagnosis and prognosis

Breast cancer (BC) is the most frequently diagnosed female invasive cancer in Western countries and the leading cause of cancer-related death worldwide. Nowadays, tumor heterogeneity is a well-known characteristic of BC, since it includes several nosological entities characterized by different morphologic features, clinical course and response to treatment. Thus, with the spread of molecular biology technologies and the growing knowledge of the biological processes underlying the development of BC, the importance of imaging biomarkers as non-invasive information about tissue hallmarks has progressively grown. To date, breast magnetic resonance imaging (MRI) is considered indispensable in breast imaging practice, with widely recognized indications such as BC screening in females at increased risk, locoregional staging and neoadjuvant therapy (NAT) monitoring. Moreover, breast MRI is increasingly used to assess not only the morphologic features of the pathological process but also to characterize individual phenotypes for targeted therapies, building on developments in genomics and molecular biology features. The aim of this review is to explore the role of breast multiparametric MRI in providing imaging biomarkers, leading to an improved differentiation of benign and malignant breast lesions and to a customized management of BC patients in monitoring and predicting response to treatment. Finally, we discuss how breast MRI biomarkers offer one of the most fertile ground for artificial intelligence (AI) applications. In the era of personalized medicine, with the development of omics-technologies, machine learning and big data, the role of imaging biomarkers is embracing new opportunities for BC diagnosis and treatment.

Breast Tumor Identification in Ultrafast MRI Using Temporal and Spatial Information

Simple Summary

The diagnosis of breast cancer with MRI is based on both morphological evaluation and kinetic curve assessment. Current computer-aided diagnosis methods for malignancy determination mainly focus on morphology features but ignored the temporal information in dynamic contrast-enhanced MRI sequences. Malignant and benign lesions usually have different enhancement patterns during the wash-in phase. Ultrafast breast MRI with high temporal resolution can capture the inflow of contrast in breast lesions. This advantage of ultrafast MRI enables the combination of both temporal and spatial information for automatic breast lesion analysis model development. We found that temporal information helps to significantly improve the performance of breast lesion classification. This suggests that ultrafast MRI provides useful information for malignancy identification and temporal information, which is indispensable for similar model development.

Abstract

Purpose: To investigate the feasibility of using deep learning methods to differentiate benign from malignant breast lesions in ultrafast MRI with both temporal and spatial information. Methods: A total of 173 single breasts of 122 women (151 examinations) with lesions above 5 mm were retrospectively included. A total of 109 out of 173 lesions were benign. Maximum intensity projection (MIP) images were generated from each of the 14 contrast-enhanced T1-weighted acquisitions in the ultrafast MRI scan. A 2D convolutional neural network (CNN) and a long short-term memory (LSTM) network were employed to extract morphological and temporal features, respectively. The 2D CNN model was trained with the MIPs from the last four acquisitions to ensure the visibility of the lesions, while the LSTM model took MIPs of an entire scan as input. The performance of each model and their combination were evaluated with 100-times repeated stratified four-fold cross-validation. Those models were then compared with models developed with standard DCE-MRI which followed the same data split. Results: In the differentiation between benign and malignant lesions, the ultrafast MRI-based 2D CNN achieved a mean AUC of 0.81 ± 0.06, and the LSTM network achieved a mean AUC of 0.78 ± 0.07; their combination showed a mean AUC of 0.83 ± 0.06 in the cross-validation. The mean AUC values were significantly higher for ultrafast MRI-based models than standard DCE-MRI-based models. Conclusion: Deep learning models developed with ultrafast breast MRI achieved higher performances than standard DCE-MRI for malignancy discrimination. The improved AUC values of the combined models indicate an added value of temporal information extracted by the LSTM model in breast lesion characterization.

Weakly Supervised Deep Learning Approach to Breast MRI Assessment

RATIONALE AND OBJECTIVES

To evaluate a weakly supervised deep learning approach to breast Magnetic Resonance Imaging (MRI) assessment without pixel level segmentation in order to improve the specificity of breast MRI lesion classification.

MATERIALS AND METHODS

In this IRB approved study, the dataset consisted of 278,685 image slices from 438 patients. The weakly supervised network was based on the Resnet-101 architecture. Training was implemented using the Adam optimizer and a final SoftMax score threshold of 0.5 was used for two class classification (malignant or benign). 278,685 image slices were combined into 92,895 3-channel images. 79,871 (85%) images were used for training and validation while 13,024 (15%) images were separated for testing. Of the testing dataset, 11,498 (88%) were benign and 1531 (12%) were malignant. Model performance was assessed.

RESULTS

The weakly supervised network achieved an AUC of 0.92 (SD ± 0.03) in distinguishing malignant from benign images. The model had an accuracy of 94.2% (SD ± 3.4) with a sensitivity and specificity of 74.4% (SD ± 8.5) and 95.3% (SD ± 3.3) respectively.

CONCLUSION

It is feasible to use a weakly supervised deep learning approach to assess breast MRI images without the need for pixel-by-pixel segmentation yielding a high degree of specificity in lesion classification.

Automatic Detection and Segmentation of Breast Cancer on MRI Using Mask R-CNN Trained on Non-Fat-Sat Images and Tested on Fat-Sat Images

RATIONALE AND OBJECTIVES

Computer-aided methods have been widely applied to diagnose lesions on breast magnetic resonance imaging (MRI). The first step was to identify abnormal areas. A deep learning Mask Regional Convolutional Neural Network (R-CNN) was implemented to search the entire set of images and detect suspicious lesions.

MATERIALS AND METHODS

Two DCE-MRI datasets were used, 241 patients acquired using non-fat-sat sequence for training, and 98 patients acquired using fat-sat sequence for testing. All patients have confirmed unilateral mass cancers. The tumor was segmented using fuzzy c-means clustering algorithm to serve as the ground truth. Mask R-CNN was implemented with ResNet-101 as the backbone. The neural network output the bounding boxes and the segmented tumor for evaluation using the Dice Similarity Coefficient (DSC). The detection performance, and the trade-off between sensitivity and specificity, was analyzed using free response receiver operating characteristic.

RESULTS

When the precontrast and subtraction image of both breasts were used as input, the false positive from the heart and normal parenchymal enhancements could be minimized. The training set had 1469 positive slices (containing lesion) and 9135 negative slices. In 10-fold cross-validation, the mean accuracy = 0.86 and DSC = 0.82. The testing dataset had 1568 positive and 7264 negative slices, with accuracy = 0.75 and DSC = 0.79. When the obtained per-slice results were combined, 240 of 241 (99.5%) lesions in the training and 98 of 98 (100%) lesions in the testing datasets were identified.

CONCLUSION

Deep learning using Mask R-CNN provided a feasible method to search breast MRI, localize, and segment lesions. This may be integrated with other artificial intelligence algorithms to develop a fully automatic breast MRI diagnostic system.

Vascularity and Dynamic Contrast-Enhanced Breast Magnetic Resonance Imaging

Angiogenesis is a key step in the initiation and progression of an invasive breast cancer. High microvessel density by morphological characterization predicts metastasis and poor survival in women with invasive breast cancers. However, morphologic characterization is subject to variability and only can evaluate a limited portion of an invasive breast cancer. Consequently, breast Magnetic Resonance Imaging (MRI) is currently being evaluated to assess vascularity. Recently, through the new field of radiomics, dynamic contrast enhanced (DCE)-MRI is being used to evaluate vascular density, vascular morphology, and detection of aggressive breast cancer biology. While DCE-MRI is a highly sensitive tool, there are specific features that limit computational evaluation of blood vessels. These include (1) DCE-MRI evaluates gadolinium contrast and does not directly evaluate biology, (2) the resolution of DCE-MRI is insufficient for imaging small blood vessels, and (3) DCE-MRI images are very difficult to co-register. Here we review computational approaches for detection and analysis of blood vessels in DCE-MRI images and present some of the strategies we have developed for co-registry of DCE-MRI images and early detection of vascularization.

Updates in Artificial Intelligence for Breast Imaging

Artificial intelligence (AI) for breast imaging has rapidly moved from the experimental to implementation phase. As of this writing, Food and Drug Administration (FDA)-approved mammographic applications are available for triage, lesion detection and classification, and breast density assessment. For sonography and MRI, FDA-approved applications are available for lesion classification. Numerous other interpretive and noninterpretive AI applications are in the development phase. This article reviews AI applications for mammography, sonography, and MRI that are currently available for clinical use. In addition, clinical implementation and the future of AI for breast imaging are discussed.

What's Hot in Breast MRI

Several articles in the literature have demonstrated a promising role for breast MRI techniques that are more economic in total exam time than others when used as supplement to mammography for detection and diagnosis of breast cancer. There are many technical factors that must be considered in the shortened breast MRI protocols to cut down time of standard ones, including using optimal fat suppression, gadolinium-chelates intravascular contrast administrations for dynamic imaging with post processing subtractions and maximum intensity projections (MIP) high spatial and temporal resolution among others. Multiparametric breast MRI that includes both gadolinium-dependent, i.e., dynamic contrast-enhanced (DCE-MRI) and gadolinium-free techniques, i.e., diffusion-weighted/diffusion-tensor magnetic resonance imaging (DWI/DTI) are shown by several investigators that can provide extremely high sensitivity and specificity for detection of breast cancer. This article provides an overview of the proven indications for breast MRI including breast cancer screening for higher than average risk, determining chemotherapy induced tumor response, detecting residual tumor after incomplete surgical excision, detecting occult cancer in patients presenting with axillary node metastasis, detecting residual tumor after incomplete breast cancer surgical excision, detecting cancer when results of conventional imaging are equivocal, as well patients suspicious of having breast implant rupture. Despite having the highest sensitivity for breast cancer detection, there are pitfalls, however, secondary to false positive and false negative contrast enhancement and contrast-free MRI techniques. Awareness of the strengths and limitations of different approaches to obtain state of the art MR images of the breast will facilitate the work-up of patients with suspicious breast lesions.

Machine learning algorithms trained with pre-hospital acquired history-taking data can accurately differentiate diagnoses in patients with hip complaints

Background and purpose - Machine learning (ML) techniques are a form of artificial intelligence able to analyze big data. Analyzing the outcome of (digital) questionnaires, ML might recognize different patterns in answers that might relate to different types of pathology. With this study, we investigated the proof-of-principle of ML-based diagnosis in patients with hip complaints using a digital questionnaire and the Kellgren and Lawrence (KL) osteoarthritis score.Patients and methods - 548 patients (> 55 years old) scheduled for consultation of hip complaints were asked to participate in this study and fill in an online questionnaire. Our questionnaire consists of 27 questions related to general history-taking and validated patient-related outcome measures (Oxford Hip Score and a Numeric Rating Scale for pain). 336 fully completed questionnaires were related to their classified diagnosis (either hip osteoarthritis, bursitis or tendinitis, or other pathology). Different AI techniques were used to relate questionnaire outcome and hip diagnoses. Resulting area under the curve (AUC) and classification accuracy (CA) are reported to identify the best scoring AI model. The accuracy of different ML models was compared using questionnaire outcome with and without radiologic KL scores for degree of osteoarthritis.Results - The most accurate ML model for diagnosis of patients with hip complaints was the Random Forest model (AUC 82%, 95% CI 0.78-0.86; CA 69%, CI 0.64-0.74) and most accurate analysis with addition of KL scores was with a Support Vector Machine model (AUC 89%, CI 0.86-0.92; CA 83%, CI 0.79-0.87).Interpretation - Analysis of self-reported online questionnaires related to hip complaints can differentiate between basic hip pathologies. The addition of radiological scores for osteoarthritis further improves these outcomes.

Images Are Data: A Breast Imaging Perspective on a Contemporary Paradigm

BACKGROUND

 Considering radiological examinations not as mere images, but as a source of data, has become the key paradigm in the diagnostic imaging field. This change of perspective is particularly popular in breast imaging. It allows breast radiologists to apply algorithms derived from computer science, to realize innovative clinical applications, and to refine already established methods. In this context, the terminology "imaging biomarker", "radiomics", and "artificial intelligence" are of pivotal importance. These methods promise noninvasive, low-cost (e. g., in comparison to multigene arrays), and workflow-friendly (automated, only one examination, instantaneous results, etc.) delivery of clinically relevant information.

METHODS AND RESULTS

 This paper is designed as a narrative review on the previously mentioned paradigm. The focus is on key concepts in breast imaging and important buzzwords are explained. For all areas of breast imaging, exemplary studies and potential clinical use cases are discussed.

CONCLUSION

 Considering radiological examination as a source of data may optimize patient management by guiding individualized breast cancer diagnosis and oncologic treatment in the age of precision medicine.

KEY POINTS

  · In conventional breast imaging, examinations are interpreted based on patterns perceivable by visual inspection.. · The radiomics paradigm treats breast images as a source of data, containing information beyond what is visible to our eyes.. · This results in radiomic signatures that may be considered as imaging biomarkers, as they provide diagnostic, predictive, and prognostic information.. · Radiomics derived imaging biomarkers may be used to individualize breast cancer treatment in the era of precision medicine.. · The concept and key research of radiomics in the field of breast imaging will be discussed in this narrative review..

CITATION FORMAT

· Dietzel M, Clauser P, Kapetas P et al. Images Are Data: A Breast Imaging Perspective on a Contemporary Paradigm. Fortschr Röntgenstr 2021; 193: 898 - 908.

MRI-Derived Tumour-to-Breast Volume Is Associated with the Extent of Breast Surgery

The tumour-to-breast volume ratio (TBVR) is a metric that may help surgical decision making. In this retrospective Ethics-Committee–approved study, we assessed the correlation between magnetic resonance imaging (MRI)-derived TBVR and the performed surgery. The TBVR was obtained using a fully manual method for the segmentation of the tumour volume (TV) and a growing region semiautomatic method for the segmentation of the whole breast volume (WBV). Two specifically-trained residents (R1 and R2) independently segmented T1-weighted datasets of 51 cancer cases in 51 patients (median age 57 years). The intraobserver and interobserver TBVR reproducibility were calculated. Mann-Whitney U, Spearman correlations, and Bland-Altman statistics were used. Breast-conserving surgery (BCS) was performed in 31/51 cases (61%); mastectomy was performed in 20/51 cases (39%). The median TBVR was 2.08‰ (interquartile range 0.70–9.13‰) for Reader 1, and 2.28‰ (interquartile range 0.71–9.61‰) for Reader 2, with an 84% inter-reader reproducibility. The median segmentation times were 54 s for the WBV and 141 s for the TV. Significantly-lower TBVR values were observed in the breast-conserving surgery group (median 1.14‰, interquartile range 0.49–2.55‰) than in the mastectomy group (median 10.52‰, interquartile range 2.42–14.73‰) for both readers (p < 0.001). Large scale prospective studies are needed in order to validate MRI-derived TBVR as a predictor of the type of breast surgery.

One step further into the blackbox: a pilot study of how to build more confidence around an AI-based decision system of breast nodule assessment in 2D ultrasound

OBJECTIVES

To investigate how a DL model makes decisions in lesion classification with a newly defined region of evidence (ROE) by incorporating "explainable AI" (xAI) techniques.

METHODS

A data set of 785 2D breast ultrasound images acquired from 367 females. The DenseNet-121 was used to classify whether the lesion is benign or malignant. For performance assessment, classification results are evaluated by calculating accuracy, sensitivity, specificity, and receiver operating characteristic for experiments of both coarse and fine regions of interest (ROIs). The area under the curve (AUC) was evaluated, and the true-positive, false-positive, true-negative, and false-negative results with breakdown in high, medium, and low resemblance on test sets were also reported.

RESULTS

The two models with coarse and fine ROIs of ultrasound images as input achieve an AUC of 0.899 and 0.869, respectively. The accuracy, sensitivity, and specificity of the model with coarse ROIs are 88.4%, 87.9%, and 89.2%, and with fine ROIs are 86.1%, 87.9%, and 83.8%, respectively. The DL model captures ROE with high resemblance of physicians' consideration as they assess the image.

CONCLUSIONS

We have demonstrated the effectiveness of using DenseNet to classify breast lesions with limited quantity of 2D grayscale ultrasound image data. We have also proposed a new ROE-based metric system that can help physicians and patients better understand how AI makes decisions in reading images, which can potentially be integrated as a part of evidence in early screening or triaging of patients undergoing breast ultrasound examinations.

KEY POINTS

• The two models with coarse and fine ROIs of ultrasound images as input achieve an AUC of 0.899 and 0.869, respectively. The accuracy, sensitivity, and specificity of the model with coarse ROIs are 88.4%, 87.9%, and 89.2%, and with fine ROIs are 86.1%, 87.9%, and 83.8%, respectively. • The first model with coarse ROIs is slightly better than the second model with fine ROIs according to these evaluation metrics. • The results from coarse ROI and fine ROI are consistent and the peripheral tissue is also an impact factor in breast lesion classification.

Breast Cancer Image Classification: A Review

BACKGROUND

Breast cancer represents uncontrolled breast cell growth. Breast cancer is the most diagnosed cancer in women worldwide. Early detection of breast cancer improves the chances of survival and increases treatment options. There are various methods for screening breast cancer, such as mammogram, ultrasound, computed tomography and Magnetic Resonance Imaging (MRI). MRI is gaining prominence as an alternative screening tool for early detection and breast cancer diagnosis. Nevertheless, MRI can hardly be examined without the use of a Computer-Aided Diagnosis (CAD) framework, due to the vast amount of data.

OBJECTIVE

This paper aims to cover the approaches used in the CAD system for the detection of breast cancer.

METHODS

In this paper, the methods used in CAD systems are categories into two classes: the conventional approach and artificial intelligence (AI) approach.

RESULTS

The conventional approach covers the basic steps of image processing, such as preprocessing, segmentation, feature extraction and classification. The AI approach covers the various convolutional and deep learning networks used for diagnosis.

CONCLUSION

This review discusses some of the core concepts used in breast cancer and presents a comprehensive review of efforts in the past to address this problem.

The Application of Artificial Intelligence in Prostate Cancer Management—What Improvements Can Be Expected? A Systematic Review

Artificial Intelligence (AI) is progressively remodeling our daily life. A large amount of information from “big data” now enables machines to perform predictions and improve our healthcare system. AI has the potential to reshape prostate cancer (PCa) management thanks to growing applications in the field. The purpose of this review is to provide a global overview of AI in PCa for urologists, pathologists, radiotherapists, and oncologists to consider future changes in their daily practice. A systematic review was performed, based on PubMed MEDLINE, Google Scholar, and DBLP databases for original studies published in English from January 2009 to January 2019 relevant to PCa, AI, Machine Learning, Artificial Neural Networks, Convolutional Neural Networks, and Natural-Language Processing. Only articles with full text accessible were considered. A total of 1008 articles were reviewed, and 48 articles were included. AI has potential applications in all fields of PCa management: analysis of genetic predispositions, diagnosis in imaging, and pathology to detect PCa or to differentiate between significant and non-significant PCa. AI also applies to PCa treatment, whether surgical intervention or radiotherapy, skills training, or assessment, to improve treatment modalities and outcome prediction. AI in PCa management has the potential to provide a useful role by predicting PCa more accurately, using a multiomic approach and risk-stratifying patients to provide personalized medicine.

Current Status and Future Perspectives of Artificial Intelligence in Magnetic Resonance Breast Imaging

Recent advances in artificial intelligence (AI) and deep learning (DL) have impacted many scientific fields including biomedical maging. Magnetic resonance imaging (MRI) is a well-established method in breast imaging with several indications including screening, staging, and therapy monitoring. The rapid development and subsequent implementation of AI into clinical breast MRI has the potential to affect clinical decision-making, guide treatment selection, and improve patient outcomes. The goal of this review is to provide a comprehensive picture of the current status and future perspectives of AI in breast MRI. We will review DL applications and compare them to standard data-driven techniques. We will emphasize the important aspect of developing quantitative imaging biomarkers for precision medicine and the potential of breast MRI and DL in this context. Finally, we will discuss future challenges of DL applications for breast MRI and an AI-augmented clinical decision strategy.

MRI-guided vacuum-assisted breast biopsy: experience of a single tertiary referral cancer centre and prospects for the future

MRI-guided vacuum-assisted breast biopsy (VABB) is used for suspicious breast cancer (BC) lesions which are detectable only with MRI: because the high sensitivity but limited specificity of breast MRI it is a fundamental tool in breast imaging divisions. We analyse our experience of MRI-guided VABB and critically discuss the potentialities of diffusion-weighted imaging (DWI) and artificial intelligence (AI) in this matter. We retrospectively analysed a population of consecutive women underwent VABB at our tertiary referral BC centre from 01/2011 to 01/2019. Reference standard was histological diagnosis or at least 1-year negative follow-up. McNemar, Mann-Whitney and χ² tests at 95% level of significance were used as statistical exams. 217 women (mean age = 52, 18-72 years) underwent MRI-guided VABB; 11 were excluded and 208 MRI-guided VABB lesions were performed: 34/208 invasive carcinomas, 32/208 DCIS, 8/208 LCIS, 3/208 high-risk lesions and 131/208 benign lesions were reported. Accuracy of MRI-guided VABB was 97%. The predictive features for malignancy were mass with irregular shape (OR 8.4; 95% CI 0.59-31.6), size of the lesion (OR 4.4; 95% CI 1.69-9.7) and mass with irregular/spiculated margins (OR 5.4; 95% CI 6.8-31.1). Six-month follow-up showed 4 false-negative cases (1.9%). Invasive BC showed a statistically significant higher hyperintense signal at DWI compared to benign lesions (p = 0.03). No major complications occurred. MR-guided VABB showed high accuracy. Benign-concordant lesions should be followed up with breast MRI in 6-12 months due to the risk of false-negative results. DWI and AI applications showed potential benefit as support tools for radiologists.

Recent Advances of Bioresponsive Nano-Sized Contrast Agents for Ultra-High-Field Magnetic Resonance Imaging

The ultra-high-field magnetic resonance imaging (MRI) nowadays has been receiving enormous attention in both biomaterial research and clinical diagnosis. MRI contrast agents are generally comprising of T1-weighted and T2-weighted contrast agent types, where T1-weighted contrast agents show positive contrast enhancement with brighter images by decreasing the proton's longitudinal relaxation times and T2-weighted contrast agents show negative contrast enhancement with darker images by decreasing the proton's transverse relaxation times. To meet the incredible demand of MRI, ultra-high-field T2 MRI is gradually attracting the attention of research and medical needs owing to its high resolution and high accuracy for detection. It is anticipated that high field MRI contrast agents can achieve high performance in MRI imaging, where parameters of chemical composition, molecular structure and size of varied contrast agents show contrasted influence in each specific diagnostic test. This review firstly presents the recent advances of nanoparticle contrast agents for MRI. Moreover, multimodal molecular imaging with MRI for better monitoring is discussed during biological process. To fasten the process of developing better contrast agents, deep learning of artificial intelligent (AI) can be well-integrated into optimizing the crucial parameters of nanoparticle contrast agents and achieving high resolution MRI prior to the clinical applications. Finally, prospects and challenges are summarized.

Will traditional biopsy be substituted by radiomics and liquid biopsy for breast cancer diagnosis and characterisation?

The diagnosis of breast cancer currently relies on radiological and clinical evaluation, confirmed by histopathological examination. However, such approach has some limitations as the suboptimal sensitivity, the long turnaround time for recall tests, the invasiveness of the procedure and the risk that some features of target lesions may remain undetected, making re-biopsy a necessity. Recent technological advances in the field of artificial intelligence hold promise in addressing such medical challenges not only in cancer diagnosis, but also in treatment assessment, and monitoring of disease progression. In the perspective of a truly personalised medicine, based on the early diagnosis and individually tailored treatments, two new technologies, namely radiomics and liquid biopsy, are rising as means to obtain information from diagnosis to molecular profiling and response assessment, without the need of a biopsied tissue sample. Radiomics works through the extraction of quantitative peculiar features of cancer from radiological data, while liquid biopsy gets the whole of the malignancy's biology from something as easy as a blood sample. Both techniques hopefully will identify diagnostic and prognostic information of breast cancer potentially reducing the need for invasive (and often difficult to perform) biopsies and favouring an approach that is as personalised as possible for each patient. Nevertheless, such techniques will not substitute tissue biopsy in the near future, and even in further times they will require the aid of other parameters to be correctly interpreted and acted upon.

Current Resources for Evidence-Based Practice, March 2020

An extensive review of new resources to support the provision of evidence-based care for women and infants. The current column includes a discussion of the concept of overdiagnosis and implications for research and commentaries on reviews focused on exogenous progestogen to maintain pregnancies and cancer risk among children conceived using fertility treatments.

Automated Segmentation of Tissues Using CT and MRI: A Systematic Review

RATIONALE AND OBJECTIVES

The automated segmentation of organs and tissues throughout the body using computed tomography and magnetic resonance imaging has been rapidly increasing. Research into many medical conditions has benefited greatly from these approaches by allowing the development of more rapid and reproducible quantitative imaging markers. These markers have been used to help diagnose disease, determine prognosis, select patients for therapy, and follow responses to therapy. Because some of these tools are now transitioning from research environments to clinical practice, it is important for radiologists to become familiar with various methods used for automated segmentation.

MATERIALS AND METHODS

The Radiology Research Alliance of the Association of University Radiologists convened an Automated Segmentation Task Force to conduct a systematic review of the peer-reviewed literature on this topic.

RESULTS

The systematic review presented here includes 408 studies and discusses various approaches to automated segmentation using computed tomography and magnetic resonance imaging for neurologic, thoracic, abdominal, musculoskeletal, and breast imaging applications.

CONCLUSION

These insights should help prepare radiologists to better evaluate automated segmentation tools and apply them not only to research, but eventually to clinical practice.

Impact of artificial intelligence on radiology: a EuroAIM survey among members of the European Society of Radiology

We report the results of a survey conducted among ESR members in November and December 2018, asking for expectations about artificial intelligence (AI) in 5-10 years. Of 24,000 ESR members contacted, 675 (2.8%) completed the survey, 454 males (67%), 555 (82%) working at academic/public hospitals. AI impact was mostly expected (≥ 30% of responders) on breast, oncologic, thoracic, and neuro imaging, mainly involving mammography, computed tomography, and magnetic resonance. Responders foresee AI impact on: job opportunities (375/675, 56%), 218/375 (58%) expecting increase, 157/375 (42%) reduction; reporting workload (504/675, 75%), 256/504 (51%) expecting reduction, 248/504 (49%) increase; radiologist's profile, becoming more clinical (364/675, 54%) and more subspecialised (283/675, 42%). For 374/675 responders (55%) AI-only reports would be not accepted by patients, for 79/675 (12%) accepted, for 222/675 (33%) it is too early to answer. For 275/675 responders (41%) AI will make the radiologist-patient relation more interactive, for 140/675 (21%) more impersonal, for 259/675 (38%) unchanged. If AI allows time saving, radiologists should interact more with clinicians (437/675, 65%) and/or patients (322/675, 48%). For all responders, involvement in AI-projects is welcome, with different roles: supervision (434/675, 64%), task definition (359/675, 53%), image labelling (197/675, 29%). Of 675 responders, 321 (48%) do not currently use AI, 138 (20%) use AI, 205 (30%) are planning to do it. According to 277/675 responders (41%), radiologists will take responsibility for AI outcome, while 277/675 (41%) suggest shared responsibility with other professionals. To summarise, responders showed a general favourable attitude towards AI.

Upgrade Rate of Percutaneously Diagnosed Pure Atypical Ductal Hyperplasia: Systematic Review and Meta-Analysis of 6458 Lesions

Background Management of percutaneously diagnosed pure atypical ductal hyperplasia (ADH) is an unresolved clinical issue. Purpose To calculate the pooled upgrade rate of percutaneously diagnosed pure ADH. Materials and Methods A search of MEDLINE and EMBASE databases was performed in October 2018. Preferred Reporting Items for Systematic Reviews and Meta-Analyses, or PRISMA, guidelines were followed. A fixed- or random-effects model was used, along with subgroup and meta-regression analyses. The Newcastle-Ottawa scale was used for study quality, and the Egger test was used for publication bias. Results Of 521 articles, 93 were analyzed, providing data for 6458 ADHs (5911 were managed with surgical excision and 547 with follow-up). Twenty-four studies used core-needle biopsy; 44, vacuum-assisted biopsy; 21, both core-needle and vacuum-assisted biopsy; and four, unspecified techniques. Biopsy was performed with stereotactic guidance in 29 studies; with US guidance in nine, with MRI guidance in nine, and with mixed guidance in eight. Overall heterogeneity was high (I² = 80%). Subgroup analysis according to management yielded a pooled upgrade rate of 29% (95% confidence interval [CI]: 26%, 32%) for surgically excised lesions and 5% (95% CI: 4%, 8%) for lesions managed with follow-up (P < .001). Heterogeneity was entirely associated with surgically excised lesions (I² = 78%) rather than those managed with follow-up (I² = 0%). Most variability was explained by guidance and needle caliper (P = .15). At subgroup analysis of surgically excised lesions, the pooled upgrade rate was 42% (95% CI: 31%, 53%) for US guidance, 23% (95% CI: 19%, 27%) for stereotactic biopsy, and 32% (95% CI: 22%, 43%) for MRI guidance, with heterogeneity (52%, 63%, and 56%, respectively) still showing the effect of needle caliper. When the authors considered patients with apparent complete lesion removal after biopsy (subgroups in 14 studies), the pooled upgrade rate was 14% (95% CI: 8%, 23%). Study quality was low to medium; the risk of publication bias was low (P = .10). Conclusion Because of a pooled upgrade rate higher than 2% (independent of biopsy technique, needle size, imaging guidance, and apparent complete lesion removal), atypical ductal hyperplasia diagnosed with percutaneous needle biopsy should be managed with surgical excision. © RSNA, 2019 Online supplemental material is available for this article. See also the editorial by Brem in this issue.

What the radiologist should know about artificial intelligence - an ESR white paper

This paper aims to provide a review of the basis for application of AI in radiology, to discuss the immediate ethical and professional impact in radiology, and to consider possible future evolution.Even if AI does add significant value to image interpretation, there are implications outside the traditional radiology activities of lesion detection and characterisation. In radiomics, AI can foster the analysis of the features and help in the correlation with other omics data. Imaging biobanks would become a necessary infrastructure to organise and share the image data from which AI models can be trained. AI can be used as an optimising tool to assist the technologist and radiologist in choosing a personalised patient's protocol, tracking the patient's dose parameters, providing an estimate of the radiation risks. AI can also aid the reporting workflow and help the linking between words, images, and quantitative data. Finally, AI coupled with CDS can improve the decision process and thereby optimise clinical and radiological workflow.