1
|
Belue MJ, Harmon SA, Yang D, An JY, Gaur S, Law YM, Turkbey E, Xu Z, Tetreault J, Lay NS, Yilmaz EC, Phelps TE, Simon B, Lindenberg L, Mena E, Pinto PA, Bagci U, Wood BJ, Citrin DE, Dahut WL, Madan RA, Gulley JL, Xu D, Choyke PL, Turkbey B. Deep Learning-Based Detection and Classification of Bone Lesions on Staging Computed Tomography in Prostate Cancer: A Development Study. Acad Radiol 2024:S1076-6332(24)00008-4. [PMID: 38262813 DOI: 10.1016/j.acra.2024.01.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Revised: 01/02/2024] [Accepted: 01/04/2024] [Indexed: 01/25/2024]
Abstract
RATIONALE AND OBJECTIVES Efficiently detecting and characterizing metastatic bone lesions on staging CT is crucial for prostate cancer (PCa) care. However, it demands significant expert time and additional imaging such as PET/CT. We aimed to develop an ensemble of two automated deep learning AI models for 1) bone lesion detection and segmentation and 2) benign vs. metastatic lesion classification on staging CTs and to compare its performance with radiologists. MATERIALS AND METHODS This retrospective study developed two AI models using 297 staging CT scans (81 metastatic) with 4601 benign and 1911 metastatic lesions in PCa patients. Metastases were validated by follow-up scans, bone biopsy, or PET/CT. Segmentation AI (3DAISeg) was developed using the lesion contours delineated by a radiologist. 3DAISeg performance was evaluated with the Dice similarity coefficient, and classification AI (3DAIClass) performance on AI and radiologist contours was assessed with F1-score and accuracy. Training/validation/testing data partitions of 70:15:15 were used. A multi-reader study was performed with two junior and two senior radiologists within a subset of the testing dataset (n = 36). RESULTS In 45 unseen staging CT scans (12 metastatic PCa) with 669 benign and 364 metastatic lesions, 3DAISeg detected 73.1% of metastatic (266/364) and 72.4% of benign lesions (484/669). Each scan averaged 12 extra segmentations (range: 1-31). All metastatic scans had at least one detected metastatic lesion, achieving a 100% patient-level detection. The mean Dice score for 3DAISeg was 0.53 (median: 0.59, range: 0-0.87). The F1 for 3DAIClass was 94.8% (radiologist contours) and 92.4% (3DAISeg contours), with a median false positive of 0 (range: 0-3). Using radiologist contours, 3DAIClass had PPV and NPV rates comparable to junior and senior radiologists: PPV (semi-automated approach AI 40.0% vs. Juniors 32.0% vs. Seniors 50.0%) and NPV (AI 96.2% vs. Juniors 95.7% vs. Seniors 91.9%). When using 3DAISeg, 3DAIClass mimicked junior radiologists in PPV (pure-AI 20.0% vs. Juniors 32.0% vs. Seniors 50.0%) but surpassed seniors in NPV (pure-AI 93.8% vs. Juniors 95.7% vs. Seniors 91.9%). CONCLUSION Our lesion detection and classification AI model performs on par with junior and senior radiologists in discerning benign and metastatic lesions on staging CTs obtained for PCa.
Collapse
Affiliation(s)
- Mason J Belue
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, 10 Center Dr., MSC 1182, Building 10, Room B3B85, Bethesda, Maryland, USA (M.J.B., S.A.H., N.S.L., E.C.Y., T.E.P., B.S., L.L., E.M., P.L.C., B.T.)
| | - Stephanie A Harmon
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, 10 Center Dr., MSC 1182, Building 10, Room B3B85, Bethesda, Maryland, USA (M.J.B., S.A.H., N.S.L., E.C.Y., T.E.P., B.S., L.L., E.M., P.L.C., B.T.)
| | - Dong Yang
- NVIDIA Corporation, Santa Clara, California, USA (D.Y., Z.X., J.T., D.X.)
| | - Julie Y An
- Department of Radiology, University of California, San Diego, California, USA (J.Y.A.)
| | - Sonia Gaur
- Department of Radiology, Massachusetts General Hospital, Boston, Massachusetts, USA (S.G.)
| | - Yan Mee Law
- Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Evrim Turkbey
- Department of Radiology, Clinical Center, National Institutes of Health, Bethesda, Maryland, USA (E.T., B.J.W.)
| | - Ziyue Xu
- NVIDIA Corporation, Santa Clara, California, USA (D.Y., Z.X., J.T., D.X.)
| | - Jesse Tetreault
- NVIDIA Corporation, Santa Clara, California, USA (D.Y., Z.X., J.T., D.X.)
| | - Nathan S Lay
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, 10 Center Dr., MSC 1182, Building 10, Room B3B85, Bethesda, Maryland, USA (M.J.B., S.A.H., N.S.L., E.C.Y., T.E.P., B.S., L.L., E.M., P.L.C., B.T.)
| | - Enis C Yilmaz
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, 10 Center Dr., MSC 1182, Building 10, Room B3B85, Bethesda, Maryland, USA (M.J.B., S.A.H., N.S.L., E.C.Y., T.E.P., B.S., L.L., E.M., P.L.C., B.T.)
| | - Tim E Phelps
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, 10 Center Dr., MSC 1182, Building 10, Room B3B85, Bethesda, Maryland, USA (M.J.B., S.A.H., N.S.L., E.C.Y., T.E.P., B.S., L.L., E.M., P.L.C., B.T.)
| | - Benjamin Simon
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, 10 Center Dr., MSC 1182, Building 10, Room B3B85, Bethesda, Maryland, USA (M.J.B., S.A.H., N.S.L., E.C.Y., T.E.P., B.S., L.L., E.M., P.L.C., B.T.)
| | - Liza Lindenberg
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, 10 Center Dr., MSC 1182, Building 10, Room B3B85, Bethesda, Maryland, USA (M.J.B., S.A.H., N.S.L., E.C.Y., T.E.P., B.S., L.L., E.M., P.L.C., B.T.)
| | - Esther Mena
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, 10 Center Dr., MSC 1182, Building 10, Room B3B85, Bethesda, Maryland, USA (M.J.B., S.A.H., N.S.L., E.C.Y., T.E.P., B.S., L.L., E.M., P.L.C., B.T.)
| | - Peter A Pinto
- Urologic Oncology Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA (P.A.P.)
| | - Ulas Bagci
- Radiology and Biomedical Engineering Department, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA (U.B.)
| | - Bradford J Wood
- Department of Radiology, Clinical Center, National Institutes of Health, Bethesda, Maryland, USA (E.T., B.J.W.); Center for Interventional Oncology, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA (B.J.W.)
| | - Deborah E Citrin
- Radiation Oncology Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA (D.E.C.)
| | - William L Dahut
- Genitourinary Malignancies Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA (W.L.D., R.A.M.)
| | - Ravi A Madan
- Genitourinary Malignancies Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA (W.L.D., R.A.M.)
| | - James L Gulley
- Center for Immuno-Oncology, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA (J.L.G.)
| | - Daguang Xu
- NVIDIA Corporation, Santa Clara, California, USA (D.Y., Z.X., J.T., D.X.)
| | - Peter L Choyke
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, 10 Center Dr., MSC 1182, Building 10, Room B3B85, Bethesda, Maryland, USA (M.J.B., S.A.H., N.S.L., E.C.Y., T.E.P., B.S., L.L., E.M., P.L.C., B.T.)
| | - Baris Turkbey
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, 10 Center Dr., MSC 1182, Building 10, Room B3B85, Bethesda, Maryland, USA (M.J.B., S.A.H., N.S.L., E.C.Y., T.E.P., B.S., L.L., E.M., P.L.C., B.T.).
| |
Collapse
|