1
|
Ren Y, Liang Z, Ge J, Xu X, Go J, Nguyen DL, Lo JY, Grimm LJ. Improving Computer-aided Detection for Digital Breast Tomosynthesis by Incorporating Temporal Change. Radiol Artif Intell 2024; 6:e230391. [PMID: 39140867 PMCID: PMC11427939 DOI: 10.1148/ryai.230391] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Revised: 07/05/2024] [Accepted: 08/03/2024] [Indexed: 08/15/2024]
Abstract
Purpose To develop a deep learning algorithm that uses temporal information to improve the performance of a previously published framework of cancer lesion detection for digital breast tomosynthesis. Materials and Methods This retrospective study analyzed the current and the 1-year-prior Hologic digital breast tomosynthesis screening examinations from eight different institutions between 2016 and 2020. The dataset contained 973 cancer and 7123 noncancer cases. The front end of this algorithm was an existing deep learning framework that performed single-view lesion detection followed by ipsilateral view matching. For this study, PriorNet was implemented as a cascaded deep learning module that used the additional growth information to refine the final probability of malignancy. Data from seven of the eight sites were used for training and validation, while the eighth site was reserved for external testing. Model performance was evaluated using localization receiver operating characteristic curves. Results On the validation set, PriorNet showed an area under the receiver operating characteristic curve (AUC) of 0.931 (95% CI: 0.930, 0.931), which outperformed both baseline models using single-view detection (AUC, 0.892 [95% CI: 0.891, 0.892]; P < .001) and ipsilateral matching (AUC, 0.915 [95% CI: 0.914, 0.915]; P < .001). On the external test set, PriorNet achieved an AUC of 0.896 (95% CI: 0.885, 0.896), outperforming both baselines (AUC, 0.846 [95% CI: 0.846, 0.847]; P < .001 and AUC, 0.865 [95% CI: 0.865, 0.866]; P < .001, respectively). In the high sensitivity range of 0.9 to 1.0, the partial AUC of PriorNet was significantly higher (P < .001) relative to both baselines. Conclusion PriorNet using temporal information further improved the breast cancer detection performance of an existing digital breast tomosynthesis cancer detection framework. Keywords: Digital Breast Tomosynthesis, Computer-aided Detection, Breast Cancer, Deep Learning © RSNA, 2024 See also commentary by Lee in this issue.
Collapse
Affiliation(s)
- Yinhao Ren
- From the Departments of Biomedical Engineering (Y.R.), Bioinformatics (X.X.), Radiology (D.L.N., J.Y.L., L.J.G.), and Electrical and Computer Engineering and Biomedical Engineering (J.Y.L.), Duke University, 2424 Erwin Rd, Studio #302, Durham, NC 27705; and iCAD Inc, Nashua, NH (Y.R., Z.L., J. Ge, J. Go)
| | - Zisheng Liang
- From the Departments of Biomedical Engineering (Y.R.), Bioinformatics (X.X.), Radiology (D.L.N., J.Y.L., L.J.G.), and Electrical and Computer Engineering and Biomedical Engineering (J.Y.L.), Duke University, 2424 Erwin Rd, Studio #302, Durham, NC 27705; and iCAD Inc, Nashua, NH (Y.R., Z.L., J. Ge, J. Go)
| | - Jun Ge
- From the Departments of Biomedical Engineering (Y.R.), Bioinformatics (X.X.), Radiology (D.L.N., J.Y.L., L.J.G.), and Electrical and Computer Engineering and Biomedical Engineering (J.Y.L.), Duke University, 2424 Erwin Rd, Studio #302, Durham, NC 27705; and iCAD Inc, Nashua, NH (Y.R., Z.L., J. Ge, J. Go)
| | - Xiaoming Xu
- From the Departments of Biomedical Engineering (Y.R.), Bioinformatics (X.X.), Radiology (D.L.N., J.Y.L., L.J.G.), and Electrical and Computer Engineering and Biomedical Engineering (J.Y.L.), Duke University, 2424 Erwin Rd, Studio #302, Durham, NC 27705; and iCAD Inc, Nashua, NH (Y.R., Z.L., J. Ge, J. Go)
| | - Jonathan Go
- From the Departments of Biomedical Engineering (Y.R.), Bioinformatics (X.X.), Radiology (D.L.N., J.Y.L., L.J.G.), and Electrical and Computer Engineering and Biomedical Engineering (J.Y.L.), Duke University, 2424 Erwin Rd, Studio #302, Durham, NC 27705; and iCAD Inc, Nashua, NH (Y.R., Z.L., J. Ge, J. Go)
| | - Derek L Nguyen
- From the Departments of Biomedical Engineering (Y.R.), Bioinformatics (X.X.), Radiology (D.L.N., J.Y.L., L.J.G.), and Electrical and Computer Engineering and Biomedical Engineering (J.Y.L.), Duke University, 2424 Erwin Rd, Studio #302, Durham, NC 27705; and iCAD Inc, Nashua, NH (Y.R., Z.L., J. Ge, J. Go)
| | - Joseph Y Lo
- From the Departments of Biomedical Engineering (Y.R.), Bioinformatics (X.X.), Radiology (D.L.N., J.Y.L., L.J.G.), and Electrical and Computer Engineering and Biomedical Engineering (J.Y.L.), Duke University, 2424 Erwin Rd, Studio #302, Durham, NC 27705; and iCAD Inc, Nashua, NH (Y.R., Z.L., J. Ge, J. Go)
| | - Lars J Grimm
- From the Departments of Biomedical Engineering (Y.R.), Bioinformatics (X.X.), Radiology (D.L.N., J.Y.L., L.J.G.), and Electrical and Computer Engineering and Biomedical Engineering (J.Y.L.), Duke University, 2424 Erwin Rd, Studio #302, Durham, NC 27705; and iCAD Inc, Nashua, NH (Y.R., Z.L., J. Ge, J. Go)
| |
Collapse
|
2
|
Pfob A, Barr RG, Duda V, Büsch C, Bruckner T, Spratte J, Nees J, Togawa R, Ho C, Fastner S, Riedel F, Schaefgen B, Hennigs A, Sohn C, Heil J, Golatta M. A New Practical Decision Rule to Better Differentiate BI-RADS 3 or 4 Breast Masses on Breast Ultrasound. JOURNAL OF ULTRASOUND IN MEDICINE : OFFICIAL JOURNAL OF THE AMERICAN INSTITUTE OF ULTRASOUND IN MEDICINE 2022; 41:427-436. [PMID: 33942358 DOI: 10.1002/jum.15722] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/13/2021] [Revised: 03/29/2021] [Accepted: 03/31/2021] [Indexed: 06/12/2023]
Abstract
OBJECTIVES The BI-RADS classification provides a standardized way to describe ultrasound findings in breast cancer diagnostics. However, there is little information regarding which BI-RADS descriptors are most strongly associated with malignancy, to better distinguish BI-RADS 3 (follow-up imaging) and 4 (diagnostic biopsy) breast masses. METHODS Patients were recruited as part of an international, multicenter trial (NCT02638935). The trial enrolled 1294 women (6 excluded) categorized as BI-RADS 3 or 4 upon routine B-mode ultrasound examination. Ultrasound images were evaluated by three expert physicians according to BI-RADS. All patients underwent histopathological confirmation (reference standard). We performed univariate and multivariate analyses (chi-square test, logistic regression, and Krippendorff's alpha). RESULTS Histopathologic evaluation showed malignancy in 368 of 1288 masses (28.6%). Upon performing multivariate analysis, the following descriptors were significantly associated with malignancy (P < .05): age ≥50 years (OR 8.99), non-circumscribed indistinct (OR 4.05) and microlobulated margin (OR 2.95), nonparallel orientation (OR 2.69), and calcification (OR 2.64). A clinical decision rule informed by these results demonstrated a 97% sensitivity and missed fewer cancers compared to three physician experts (range of sensitivity 79-95%) and a previous decision rule (sensitivity 59%). Specificity was 44% versus 22-83%, respectively. The inter-reader reliability of the BI-RADS descriptors and of the final BI-RADS score was fair-moderate. CONCLUSIONS A patient should undergo a diagnostic biopsy (BI-RADS 4) instead of follow-up imaging (BI-RADS 3) if the patient is 50 years or older or exhibits at least one of the following features: calcification, nonparallel orientation of mass, non-circumscribed margin, or posterior shadowing.
Collapse
Affiliation(s)
- André Pfob
- Department of Gynecology and Obstetrics, Heidelberg University Hospital, Heidelberg, Germany
| | - Richard G Barr
- Department of Radiology, Northeast Ohio Medical University, Ravenna, Ohio, USA
| | - Volker Duda
- Department of Gynecology and Obstetrics, University of Marburg, Marburg, Germany
| | - Christopher Büsch
- Institute of Medical Biometry and Informatics (IMBI), Heidelberg University, Heidelberg, Germany
| | - Thomas Bruckner
- Institute of Medical Biometry and Informatics (IMBI), Heidelberg University, Heidelberg, Germany
| | - Julia Spratte
- Department of Gynecology and Obstetrics, Heidelberg University Hospital, Heidelberg, Germany
| | - Juliane Nees
- Department of Gynecology and Obstetrics, Heidelberg University Hospital, Heidelberg, Germany
| | - Riku Togawa
- Department of Gynecology and Obstetrics, Heidelberg University Hospital, Heidelberg, Germany
| | - Chi Ho
- Department of Public Health Sciences, University of Virginia School of Medicine, Charlottesville, Virginia, USA
| | - Sarah Fastner
- Department of Gynecology and Obstetrics, Heidelberg University Hospital, Heidelberg, Germany
| | - Fabian Riedel
- Department of Gynecology and Obstetrics, Heidelberg University Hospital, Heidelberg, Germany
| | - Benedikt Schaefgen
- Department of Gynecology and Obstetrics, Heidelberg University Hospital, Heidelberg, Germany
| | - André Hennigs
- Department of Gynecology and Obstetrics, Heidelberg University Hospital, Heidelberg, Germany
| | - Christof Sohn
- Department of Gynecology and Obstetrics, Heidelberg University Hospital, Heidelberg, Germany
| | - Joerg Heil
- Department of Gynecology and Obstetrics, Heidelberg University Hospital, Heidelberg, Germany
| | - Michael Golatta
- Department of Gynecology and Obstetrics, Heidelberg University Hospital, Heidelberg, Germany
| |
Collapse
|
3
|
Wen W, Liu J, Wang J, Jiang H, Peng Y. A National Chinese Survey on Ultrasound Feature Interpretation and Risk Assessment of Breast Masses Under ACR BI-RADS. Cancer Manag Res 2021; 13:9107-9115. [PMID: 34924771 PMCID: PMC8674576 DOI: 10.2147/cmar.s341314] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2021] [Accepted: 11/27/2021] [Indexed: 02/05/2023] Open
Abstract
Purpose Through this nationwide survey on ACR BI-RADS including ultrasound images of 10 selected breast lesions, we aimed to learn about consistency in feature interpretation and assessment categories and to identify factors that might contribute to inconsistencies, thereby promoting the application of BI-RADS in China. Materials and Methods The survey was delivered through a self-developed website about blinded image interpretation and was released to the public through online platforms and social media. A total of 10 representative lesions were selected by an experienced radiologist to gather information about the general practice of BI-RADS lexicons and categories. The Kappa statistic, the chi-squared test, and descriptive statistics were used for data analysis. Results Nine hundred ultrasound workers completed the questionnaire, coming from all provinces and major cities in China. They had different positions, grades of work organization, and seniority. The interrater agreement of BI-RADS features was fair to substantial (kappa value: 0.37–0.66). For BI-RADS categories, the highest agreement was observed in the typical benign group (average constituent rate = 74.78%), and generally lower agreement was observed in the typical malignant (average constituent rate = 36.03%) and suspicious groups (average constituent rate = 39.02%). Conclusion We found inconsistencies in BI-RADS applications, providing direction for image feature research using big data. Therefore, we call for more efforts to improve the consistency of BI-RADS application and provide an evidence-based basis for identifying benign and malignant lesions by sonographic features.
Collapse
Affiliation(s)
- Wen Wen
- Department of Ultrasound, West China Hospital, Sichuan University, Chengdu, Sichuan, People's Republic of China
| | - Jingyan Liu
- Department of Ultrasound, West China Hospital, Sichuan University, Chengdu, Sichuan, People's Republic of China
| | - Junren Wang
- Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, Sichuan, People's Republic of China
| | - Heng Jiang
- College of Medicine, University of Nebraska Medical Center, Omaha, NE, USA
| | - Yulan Peng
- Department of Ultrasound, West China Hospital, Sichuan University, Chengdu, Sichuan, People's Republic of China
| |
Collapse
|
4
|
Dao KA, Rives AF, Quintana LM, Kritselis MA, Fishman MDC, Sarangi R, Slanetz PJ. BI-RADS 5: More than Cancer. Radiographics 2021; 40:1203-1204. [PMID: 32870767 DOI: 10.1148/rg.2020200054] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Affiliation(s)
- Kimberly A Dao
- From the Departments of Radiology (K.A.D., A.F.R., M.D.C.F., R.S., P.J.S.) and Pathology (M.A.K.), Boston University Medical Center, Boston University School of Medicine, 830 Harrison Ave, Moakley Building Ste 1300, Boston, MA 02118; and Department of Pathology, Beth Israel Medical Center, Harvard Medical School, Boston, Mass (L.M.Q.)
| | - Anna F Rives
- From the Departments of Radiology (K.A.D., A.F.R., M.D.C.F., R.S., P.J.S.) and Pathology (M.A.K.), Boston University Medical Center, Boston University School of Medicine, 830 Harrison Ave, Moakley Building Ste 1300, Boston, MA 02118; and Department of Pathology, Beth Israel Medical Center, Harvard Medical School, Boston, Mass (L.M.Q.)
| | - Liza M Quintana
- From the Departments of Radiology (K.A.D., A.F.R., M.D.C.F., R.S., P.J.S.) and Pathology (M.A.K.), Boston University Medical Center, Boston University School of Medicine, 830 Harrison Ave, Moakley Building Ste 1300, Boston, MA 02118; and Department of Pathology, Beth Israel Medical Center, Harvard Medical School, Boston, Mass (L.M.Q.)
| | - Michael A Kritselis
- From the Departments of Radiology (K.A.D., A.F.R., M.D.C.F., R.S., P.J.S.) and Pathology (M.A.K.), Boston University Medical Center, Boston University School of Medicine, 830 Harrison Ave, Moakley Building Ste 1300, Boston, MA 02118; and Department of Pathology, Beth Israel Medical Center, Harvard Medical School, Boston, Mass (L.M.Q.)
| | - Michael D C Fishman
- From the Departments of Radiology (K.A.D., A.F.R., M.D.C.F., R.S., P.J.S.) and Pathology (M.A.K.), Boston University Medical Center, Boston University School of Medicine, 830 Harrison Ave, Moakley Building Ste 1300, Boston, MA 02118; and Department of Pathology, Beth Israel Medical Center, Harvard Medical School, Boston, Mass (L.M.Q.)
| | - Rutuparna Sarangi
- From the Departments of Radiology (K.A.D., A.F.R., M.D.C.F., R.S., P.J.S.) and Pathology (M.A.K.), Boston University Medical Center, Boston University School of Medicine, 830 Harrison Ave, Moakley Building Ste 1300, Boston, MA 02118; and Department of Pathology, Beth Israel Medical Center, Harvard Medical School, Boston, Mass (L.M.Q.)
| | - Priscilla J Slanetz
- From the Departments of Radiology (K.A.D., A.F.R., M.D.C.F., R.S., P.J.S.) and Pathology (M.A.K.), Boston University Medical Center, Boston University School of Medicine, 830 Harrison Ave, Moakley Building Ste 1300, Boston, MA 02118; and Department of Pathology, Beth Israel Medical Center, Harvard Medical School, Boston, Mass (L.M.Q.)
| |
Collapse
|
5
|
Hao W, Gong J, Wang S, Zhu H, Zhao B, Peng W. Application of MRI Radiomics-Based Machine Learning Model to Improve Contralateral BI-RADS 4 Lesion Assessment. Front Oncol 2020; 10:531476. [PMID: 33194589 PMCID: PMC7660748 DOI: 10.3389/fonc.2020.531476] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2020] [Accepted: 09/24/2020] [Indexed: 12/16/2022] Open
Abstract
Objective This study aimed to explore the potential of magnetic resonance imaging (MRI) radiomics-based machine learning to improve assessment and diagnosis of contralateral Breast Imaging Reporting and Data System (BI-RADS) category 4 lesions in women with primary breast cancer. Materials and Methods A total of 178 contralateral BI-RADS 4 lesions (97 malignant and 81 benign) collected from 178 breast cancer patients were involved in our retrospective dataset. T1 + C and T2 weighted images were used for radiomics analysis. These lesions were randomly assigned to the training (n = 124) dataset and an independent testing dataset (n = 54). A three-dimensional semi-automatic segmentation method was performed to segment lesions depicted on T2 and T1 + C images, 1,046 radiomic features were extracted from each segmented region, and a least absolute shrinkage and operator feature selection method reduced feature dimensionality. Three support vector machine (SVM) classifiers were trained to build classification models based on the T2, T1 + C, and fusion image features, respectively. The diagnostic performance of each model was evaluated and tested using the independent testing dataset. The area under the receiver operating characteristic curve (AUC) was used as a performance metric. Results The T1+C image feature-based model and T2 image feature-based model yielded AUCs of 0.71 ± 0.07 and 0.69 ± 0.07 respectively, and the difference between them was not significant (P > 0.05). After fusing T1 + C and T2 imaging features, the proposed model’s AUC significantly improved to 0.77 ± 0.06 (P < 0.001). The fusion model yielded an accuracy of 74.1%, which was higher than that of the T1 + C (66.7%) and T2 (59.3%) image feature-based models. Conclusion The MRI radiomics-based machine learning model is a feasible method to assess contralateral BI-RADS 4 lesions. T2 and T1 + C image features provide complementary information in discriminating benign and malignant contralateral BI-RADS 4 lesions.
Collapse
Affiliation(s)
- Wen Hao
- Department of Radiology, Fudan University Shanghai Cancer Center, Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China.,Shandong Medical Imaging Research Institute, Shandong University, Jinan, China
| | - Jing Gong
- Department of Radiology, Fudan University Shanghai Cancer Center, Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China
| | - Shengping Wang
- Department of Radiology, Fudan University Shanghai Cancer Center, Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China
| | - Hui Zhu
- Department of Radiology, Fudan University Shanghai Cancer Center, Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China
| | - Bin Zhao
- Shandong Medical Imaging Research Institute, Shandong University, Jinan, China
| | - Weijun Peng
- Department of Radiology, Fudan University Shanghai Cancer Center, Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China
| |
Collapse
|