3
|
Ye Z, Qian JM, Hosny A, Zeleznik R, Plana D, Likitlersuang J, Zhang Z, Mak RH, Aerts HJWL, Kann BH. Deep Learning-based Detection of Intravenous Contrast Enhancement on CT Scans. Radiol Artif Intell 2022; 4:e210285. [PMID: 35652117 DOI: 10.1148/ryai.210285] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2021] [Revised: 03/24/2022] [Accepted: 04/14/2022] [Indexed: 11/11/2022]
Abstract
Identifying the presence of intravenous contrast material on CT scans is an important component of data curation for medical imaging-based artificial intelligence model development and deployment. Use of intravenous contrast material is often poorly documented in imaging metadata, necessitating impractical manual annotation by clinician experts. Authors developed a convolutional neural network (CNN)-based deep learning platform to identify intravenous contrast enhancement on CT scans. For model development and validation, authors used six independent datasets of head and neck (HN) and chest CT scans, totaling 133 480 axial two-dimensional sections from 1979 scans, which were manually annotated by clinical experts. Five CNN models were trained first on HN scans for contrast enhancement detection. Model performances were evaluated at the patient level on a holdout set and external test set. Models were then fine-tuned on chest CT data and externally validated. This study found that Digital Imaging and Communications in Medicine metadata tags for intravenous contrast material were missing or erroneous for 1496 scans (75.6%). An EfficientNetB4-based model showed the best performance, with areas under the curve (AUCs) of 0.996 and 1.0 in HN holdout (n = 216) and external (n = 595) sets, respectively, and AUCs of 1.0 and 0.980 in the chest holdout (n = 53) and external (n = 402) sets, respectively. This automated, scan-to-prediction platform is highly accurate at CT contrast enhancement detection and may be helpful for artificial intelligence model development and clinical application. Keywords: CT, Head and Neck, Supervised Learning, Transfer Learning, Convolutional Neural Network (CNN), Machine Learning Algorithms, Contrast Material Supplemental material is available for this article. © RSNA, 2022.
Collapse
Affiliation(s)
- Zezhong Ye
- Artificial Intelligence in Medicine Program, Mass General Brigham, Harvard Medical School, Harvard Institutes of Medicine, Boston, Mass (Z.Y., J.M.Q., A.H., R.Z., D.P., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.); Departments of Radiation Oncology (Z.Y., J.M.Q., A.H., R.Z., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.) and Radiology (H.J.W.L.A.), Dana-Farber Cancer Institute, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115; Harvard-MIT Division of Health Sciences & Technology, Cambridge, Mass (D.P.); and Department of Radiology and Nuclear Medicine, School for Cardiovascular Diseases (CARIM) & School for Oncology and Reproduction (GROW), Maastricht University, Maastricht, the Netherlands (H.J.W.L.A.)
| | - Jack M Qian
- Artificial Intelligence in Medicine Program, Mass General Brigham, Harvard Medical School, Harvard Institutes of Medicine, Boston, Mass (Z.Y., J.M.Q., A.H., R.Z., D.P., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.); Departments of Radiation Oncology (Z.Y., J.M.Q., A.H., R.Z., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.) and Radiology (H.J.W.L.A.), Dana-Farber Cancer Institute, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115; Harvard-MIT Division of Health Sciences & Technology, Cambridge, Mass (D.P.); and Department of Radiology and Nuclear Medicine, School for Cardiovascular Diseases (CARIM) & School for Oncology and Reproduction (GROW), Maastricht University, Maastricht, the Netherlands (H.J.W.L.A.)
| | - Ahmed Hosny
- Artificial Intelligence in Medicine Program, Mass General Brigham, Harvard Medical School, Harvard Institutes of Medicine, Boston, Mass (Z.Y., J.M.Q., A.H., R.Z., D.P., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.); Departments of Radiation Oncology (Z.Y., J.M.Q., A.H., R.Z., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.) and Radiology (H.J.W.L.A.), Dana-Farber Cancer Institute, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115; Harvard-MIT Division of Health Sciences & Technology, Cambridge, Mass (D.P.); and Department of Radiology and Nuclear Medicine, School for Cardiovascular Diseases (CARIM) & School for Oncology and Reproduction (GROW), Maastricht University, Maastricht, the Netherlands (H.J.W.L.A.)
| | - Roman Zeleznik
- Artificial Intelligence in Medicine Program, Mass General Brigham, Harvard Medical School, Harvard Institutes of Medicine, Boston, Mass (Z.Y., J.M.Q., A.H., R.Z., D.P., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.); Departments of Radiation Oncology (Z.Y., J.M.Q., A.H., R.Z., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.) and Radiology (H.J.W.L.A.), Dana-Farber Cancer Institute, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115; Harvard-MIT Division of Health Sciences & Technology, Cambridge, Mass (D.P.); and Department of Radiology and Nuclear Medicine, School for Cardiovascular Diseases (CARIM) & School for Oncology and Reproduction (GROW), Maastricht University, Maastricht, the Netherlands (H.J.W.L.A.)
| | - Deborah Plana
- Artificial Intelligence in Medicine Program, Mass General Brigham, Harvard Medical School, Harvard Institutes of Medicine, Boston, Mass (Z.Y., J.M.Q., A.H., R.Z., D.P., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.); Departments of Radiation Oncology (Z.Y., J.M.Q., A.H., R.Z., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.) and Radiology (H.J.W.L.A.), Dana-Farber Cancer Institute, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115; Harvard-MIT Division of Health Sciences & Technology, Cambridge, Mass (D.P.); and Department of Radiology and Nuclear Medicine, School for Cardiovascular Diseases (CARIM) & School for Oncology and Reproduction (GROW), Maastricht University, Maastricht, the Netherlands (H.J.W.L.A.)
| | - Jirapat Likitlersuang
- Artificial Intelligence in Medicine Program, Mass General Brigham, Harvard Medical School, Harvard Institutes of Medicine, Boston, Mass (Z.Y., J.M.Q., A.H., R.Z., D.P., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.); Departments of Radiation Oncology (Z.Y., J.M.Q., A.H., R.Z., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.) and Radiology (H.J.W.L.A.), Dana-Farber Cancer Institute, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115; Harvard-MIT Division of Health Sciences & Technology, Cambridge, Mass (D.P.); and Department of Radiology and Nuclear Medicine, School for Cardiovascular Diseases (CARIM) & School for Oncology and Reproduction (GROW), Maastricht University, Maastricht, the Netherlands (H.J.W.L.A.)
| | - Zhongyi Zhang
- Artificial Intelligence in Medicine Program, Mass General Brigham, Harvard Medical School, Harvard Institutes of Medicine, Boston, Mass (Z.Y., J.M.Q., A.H., R.Z., D.P., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.); Departments of Radiation Oncology (Z.Y., J.M.Q., A.H., R.Z., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.) and Radiology (H.J.W.L.A.), Dana-Farber Cancer Institute, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115; Harvard-MIT Division of Health Sciences & Technology, Cambridge, Mass (D.P.); and Department of Radiology and Nuclear Medicine, School for Cardiovascular Diseases (CARIM) & School for Oncology and Reproduction (GROW), Maastricht University, Maastricht, the Netherlands (H.J.W.L.A.)
| | - Raymond H Mak
- Artificial Intelligence in Medicine Program, Mass General Brigham, Harvard Medical School, Harvard Institutes of Medicine, Boston, Mass (Z.Y., J.M.Q., A.H., R.Z., D.P., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.); Departments of Radiation Oncology (Z.Y., J.M.Q., A.H., R.Z., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.) and Radiology (H.J.W.L.A.), Dana-Farber Cancer Institute, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115; Harvard-MIT Division of Health Sciences & Technology, Cambridge, Mass (D.P.); and Department of Radiology and Nuclear Medicine, School for Cardiovascular Diseases (CARIM) & School for Oncology and Reproduction (GROW), Maastricht University, Maastricht, the Netherlands (H.J.W.L.A.)
| | - Hugo J W L Aerts
- Artificial Intelligence in Medicine Program, Mass General Brigham, Harvard Medical School, Harvard Institutes of Medicine, Boston, Mass (Z.Y., J.M.Q., A.H., R.Z., D.P., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.); Departments of Radiation Oncology (Z.Y., J.M.Q., A.H., R.Z., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.) and Radiology (H.J.W.L.A.), Dana-Farber Cancer Institute, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115; Harvard-MIT Division of Health Sciences & Technology, Cambridge, Mass (D.P.); and Department of Radiology and Nuclear Medicine, School for Cardiovascular Diseases (CARIM) & School for Oncology and Reproduction (GROW), Maastricht University, Maastricht, the Netherlands (H.J.W.L.A.)
| | - Benjamin H Kann
- Artificial Intelligence in Medicine Program, Mass General Brigham, Harvard Medical School, Harvard Institutes of Medicine, Boston, Mass (Z.Y., J.M.Q., A.H., R.Z., D.P., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.); Departments of Radiation Oncology (Z.Y., J.M.Q., A.H., R.Z., J.L., Z.Z., R.H.M., H.J.W.L.A., B.H.K.) and Radiology (H.J.W.L.A.), Dana-Farber Cancer Institute, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115; Harvard-MIT Division of Health Sciences & Technology, Cambridge, Mass (D.P.); and Department of Radiology and Nuclear Medicine, School for Cardiovascular Diseases (CARIM) & School for Oncology and Reproduction (GROW), Maastricht University, Maastricht, the Netherlands (H.J.W.L.A.)
| |
Collapse
|