1
|
Huang W, Gao W, Hou C, Zhang X, Wang X, Zhang J. Simultaneous vessel segmentation and unenhanced prediction using self-supervised dual-task learning in 3D CTA (SVSUP). COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 224:107001. [PMID: 35810508 DOI: 10.1016/j.cmpb.2022.107001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/23/2021] [Revised: 06/05/2022] [Accepted: 07/01/2022] [Indexed: 06/15/2023]
Abstract
BACKGROUND AND OBJECTIVE The vessel segmentation in CT angiography (CTA) provides an important basis for automatic diagnosis and hemodynamics analysis. Virtual unenhanced (VU) CT images obtained by dual-energy CT can assist clinical diagnosis and reduce radiation dose by obviating true unenhanced imaging (UECT). However, accurate segmentation of all vessels in the head-neck CTA (HNCTA) remains a challenge, and VU images are currently not available from conventional single-energy CT imaging. METHODS In this paper, we proposed a self-supervised dual-task deep learning strategy to fully automatically segment all vessels and predict unenhanced CT images from single-energy HNCTA based on a developed iterative residual-sharing scheme. The underlying idea was to use the correlation between the two tasks to improve task performance while avoiding manual annotation for model training. RESULTS The feasibility of the strategy was verified using the data of 24 patients. For vessel segmentation task, the proposed model achieves a significantly higher average Dice coefficient (84.83%, P-values 10-3 in paired t-test) than the state-of-the-art segmentation model, vanilla VNet (78.94%), and several popular 3D vessel segmentation models, including Hessian-matrix based filter (62.59%), optically-oriented flux (66.33%), spherical flux model (66.91%), and deep vessel net (66.47%). For the unenhanced prediction task, the average ROI-based error compared to the UECT in the artery tissue is 6.1±4.5 HU, similar to previously reported 6.4±5.1 HU for VU reconstruction. CONCLUSIONS Results show that the proposed dual-task framework can effectively improve the accuracy of vessel segmentation in HNCTA, and it is feasible to predict the unenhanced image from single-energy CTA, providing a potential new approach for radiation dose saving. Moreover, to our best knowledge, this is the first reported annotation-free deep learning-based full-image vessel segmentation for HNCTA.
Collapse
Affiliation(s)
- Wenjian Huang
- Academy for Advanced Interdisciplinary Studies, Peking University, No.5 Yiheyuan Rd., Beijing, 100871, China.
| | - Weizheng Gao
- Academy for Advanced Interdisciplinary Studies, Peking University, No.5 Yiheyuan Rd., Beijing, 100871, China
| | - Chao Hou
- Department of Radiology, Peking University First Hospital, No.8 Xishiku Street, Beijing, 100034, China
| | - Xiaodong Zhang
- Department of Radiology, Peking University First Hospital, No.8 Xishiku Street, Beijing, 100034, China
| | - Xiaoying Wang
- Academy for Advanced Interdisciplinary Studies, Peking University, No.5 Yiheyuan Rd., Beijing, 100871, China; Department of Radiology, Peking University First Hospital, No.8 Xishiku Street, Beijing, 100034, China.
| | - Jue Zhang
- Academy for Advanced Interdisciplinary Studies, Peking University, No.5 Yiheyuan Rd., Beijing, 100871, China; College of Engineering, Peking University, No.5 Yiheyuan Rd., Beijing, 100871, China.
| |
Collapse
|
2
|
Kruis MF. Improving radiation physics, tumor visualisation, and treatment quantification in radiotherapy with spectral or dual-energy CT. J Appl Clin Med Phys 2021; 23:e13468. [PMID: 34743405 PMCID: PMC8803285 DOI: 10.1002/acm2.13468] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2022] [Revised: 10/13/2021] [Accepted: 10/19/2021] [Indexed: 12/11/2022] Open
Abstract
Over the past decade, spectral or dual‐energy CT has gained relevancy, especially in oncological radiology. Nonetheless, its use in the radiotherapy (RT) clinic remains limited. This review article aims to give an overview of the current state of spectral CT and to explore opportunities for applications in RT. In this article, three groups of benefits of spectral CT over conventional CT in RT are recognized. Firstly, spectral CT provides more information of physical properties of the body, which can improve dose calculation. Furthermore, it improves the visibility of tumors, for a wide variety of malignancies as well as organs‐at‐risk OARs, which could reduce treatment uncertainty. And finally, spectral CT provides quantitative physiological information, which can be used to personalize and quantify treatment.
Collapse
|
3
|
Sananmuang T, Agarwal M, Maleki F, Muthukrishnan N, Marquez JC, Chankowsky J, Forghani R. Dual Energy Computed Tomography in Head and Neck Imaging. Neuroimaging Clin N Am 2020; 30:311-323. [DOI: 10.1016/j.nic.2020.04.003] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
|
4
|
Seidler M, Forghani B, Reinhold C, Pérez-Lara A, Romero-Sanchez G, Muthukrishnan N, Wichmann JL, Melki G, Yu E, Forghani R. Dual-Energy CT Texture Analysis With Machine Learning for the Evaluation and Characterization of Cervical Lymphadenopathy. Comput Struct Biotechnol J 2019; 17:1009-1015. [PMID: 31406557 PMCID: PMC6682309 DOI: 10.1016/j.csbj.2019.07.004] [Citation(s) in RCA: 56] [Impact Index Per Article: 11.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2018] [Revised: 07/09/2019] [Accepted: 07/10/2019] [Indexed: 12/16/2022] Open
Abstract
Purpose To determine whether machine learning assisted-texture analysis of multi-energy virtual monochromatic image (VMI) datasets from dual-energy CT (DECT) can be used to differentiate metastatic head and neck squamous cell carcinoma (HNSCC) lymph nodes from lymphoma, inflammatory, or normal lymph nodes. Materials and methods A retrospective evaluation of 412 cervical nodes from 5 different patient groups (50 patients in total) having undergone DECT of the neck between 2013 and 2015 was performed: (1) HNSCC with pathology proven metastatic adenopathy, (2) HNSCC with pathology proven benign nodes (controls for (1)), (3) lymphoma, (4) inflammatory, and (5) normal nodes (controls for (3) and (4)). Texture analysis was performed with TexRAD® software using two independent sets of contours to assess the impact of inter-rater variation. Two machine learning algorithms (Random Forests (RF) and Gradient Boosting Machine (GBM)) were used with independent training and testing sets and determination of accuracy, sensitivity, specificity, PPV, NPV, and AUC. Results In the independent testing (prediction) sets, the accuracy for distinguishing different groups of pathologic nodes or normal nodes ranged between 80 and 95%. The models generated using texture data extracted from the independent contour sets had substantial to almost perfect agreement. The accuracy, sensitivity, specificity, PPV, and NPV for correctly classifying a lymph node as malignant (i.e. metastatic HNSCC or lymphoma) versus benign were 92%, 91%, 93%, 95%, 87%, respectively. Conclusion Machine learning assisted-DECT texture analysis can help distinguish different nodal pathology and normal nodes with a high accuracy.
Collapse
Affiliation(s)
- Matthew Seidler
- Department of Radiology, McGill University, Rm C5 118, 1650 Cedar Avenue, Montreal, Quebec H3G 1A4, Canada
| | - Behzad Forghani
- Department of Radiology and Research Institute of McGill University Health Centre, 1001 boul. Decarie Blvd, Montreal, Quebec H3A 3J1, Canada
| | - Caroline Reinhold
- Department of Radiology, McGill University, Rm C5 118, 1650 Cedar Avenue, Montreal, Quebec H3G 1A4, Canada.,Department of Radiology and Research Institute of McGill University Health Centre, 1001 boul. Decarie Blvd, Montreal, Quebec H3A 3J1, Canada
| | - Almudena Pérez-Lara
- Department of Radiology, McGill University, Rm C5 118, 1650 Cedar Avenue, Montreal, Quebec H3G 1A4, Canada
| | - Griselda Romero-Sanchez
- Department of Radiology, McGill University, Rm C5 118, 1650 Cedar Avenue, Montreal, Quebec H3G 1A4, Canada
| | - Nikesh Muthukrishnan
- Segal Cancer Centre and Lady Davis Institute for Medical Research, Jewish General Hospital, Rm C-212.1, 3755 Cote Ste-Catherine Road, Montreal, Quebec H3T 1E2, Canada
| | - Julian L Wichmann
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Theodor-Stern-Kai 7, 60590 Frankfurt, Germany
| | - Gabriel Melki
- Segal Cancer Centre and Lady Davis Institute for Medical Research, Jewish General Hospital, Rm C-212.1, 3755 Cote Ste-Catherine Road, Montreal, Quebec H3T 1E2, Canada
| | - Eugene Yu
- Joint Department of Medical Imaging, Princess Margaret Hospital, University Health Network, University of Toronto, Rm 3-959, 610 University Ave, Toronto, Ontario M5G 2M9, Canada
| | - Reza Forghani
- Department of Radiology, McGill University, Rm C5 118, 1650 Cedar Avenue, Montreal, Quebec H3G 1A4, Canada.,Department of Radiology and Research Institute of McGill University Health Centre, 1001 boul. Decarie Blvd, Montreal, Quebec H3A 3J1, Canada.,Segal Cancer Centre and Lady Davis Institute for Medical Research, Jewish General Hospital, Rm C-212.1, 3755 Cote Ste-Catherine Road, Montreal, Quebec H3T 1E2, Canada.,Gerald Bronfman Department of Oncology, McGill University, Suite 720, 5100 Maisonneuve Blvd West, Montreal, Quebec H4A3T2, Canada.,Department of Otolaryngology, Head and Neck Surgery, Royal Victoria Hospital, McGill University Health Centre, 1001 boul. Decarie Blvd, Montreal, Quebec H3A 3J1, Canada
| |
Collapse
|
5
|
Forghani R, Chatterjee A, Reinhold C, Pérez-Lara A, Romero-Sanchez G, Ueno Y, Bayat M, Alexander JWM, Kadi L, Chankowsky J, Seuntjens J, Forghani B. Head and neck squamous cell carcinoma: prediction of cervical lymph node metastasis by dual-energy CT texture analysis with machine learning. Eur Radiol 2019; 29:6172-6181. [PMID: 30980127 DOI: 10.1007/s00330-019-06159-y] [Citation(s) in RCA: 73] [Impact Index Per Article: 14.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2019] [Revised: 02/27/2019] [Accepted: 03/13/2019] [Indexed: 01/01/2023]
Abstract
OBJECTIVES This study was conducted in order to evaluate a novel risk stratification model using dual-energy CT (DECT) texture analysis of head and neck squamous cell carcinoma (HNSCC) with machine learning to (1) predict associated cervical lymphadenopathy and (2) compare the accuracy of spectral versus single-energy (65 keV) texture evaluation for endpoint prediction. METHODS Eighty-seven patients with HNSCC were evaluated. Texture feature extraction was performed on virtual monochromatic images (VMIs) at 65 keV alone or different sets of multi-energy VMIs ranging from 40 to 140 keV, in addition to iodine material decomposition maps and other clinical information. Random forests (RF) models were constructed for outcome prediction with internal cross-validation in addition to the use of separate randomly selected training (70%) and testing (30%) sets. Accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were determined for predicting positive versus negative nodal status in the neck. RESULTS Depending on the model used and subset of patients evaluated, an accuracy, sensitivity, specificity, PPV, and NPV of up to 88, 100, 67, 83, and 100%, respectively, could be achieved using multi-energy texture analysis. Texture evaluation of VMIs at 65 keV alone or in combination with only iodine maps had a much lower accuracy. CONCLUSIONS Multi-energy DECT texture analysis of HNSCC is superior to texture analysis of 65 keV VMIs and iodine maps alone and can be used to predict cervical nodal metastases with relatively high accuracy, providing information not currently available by expert evaluation of the primary tumor alone. KEY POINTS • Texture features of HNSCC tumor are predictive of nodal status. • Multi-energy texture analysis is superior to analysis of datasets at a single energy. • Dual-energy CT texture analysis with machine learning can enhance noninvasive diagnostic tumor evaluation.
Collapse
Affiliation(s)
- Reza Forghani
- Department of Radiology and Research Institute of the McGill University Health Centre, McGill University, Room C02.5821, 1001 Decarie Blvd, Montreal, QC, H4A 3J1, Canada. .,Segal Cancer Centre and Lady Davis Institute for Medical Research, Jewish General Hospital, Room C-212.1, 3755 Cote Ste-Catherine Road, Montreal, QC, H3T 1E2, Canada. .,Department of Radiology, Royal Victoria Hospital, McGill University Health Centre, 1001 Decarie Blvd, Montreal, QC, H4A 3J1, Canada. .,Gerald Bronfman Department of Oncology, McGill University, Montreal, QC, Canada.
| | - Avishek Chatterjee
- Medical Physics Unit, Cedars Cancer Centre, McGill University Health Centre, 1001 Decarie Blvd, Montreal, QC, H4A 3J1, Canada
| | - Caroline Reinhold
- Department of Radiology and Research Institute of the McGill University Health Centre, McGill University, Room C02.5821, 1001 Decarie Blvd, Montreal, QC, H4A 3J1, Canada.,Department of Radiology, Royal Victoria Hospital, McGill University Health Centre, 1001 Decarie Blvd, Montreal, QC, H4A 3J1, Canada
| | - Almudena Pérez-Lara
- Segal Cancer Centre and Lady Davis Institute for Medical Research, Jewish General Hospital, Room C-212.1, 3755 Cote Ste-Catherine Road, Montreal, QC, H3T 1E2, Canada.,Department of Radiology, Hospital Regional Universitario de Málaga, Avenida Carlos Haya, S/N, 29010, Málaga, Spain
| | - Griselda Romero-Sanchez
- Segal Cancer Centre and Lady Davis Institute for Medical Research, Jewish General Hospital, Room C-212.1, 3755 Cote Ste-Catherine Road, Montreal, QC, H3T 1E2, Canada
| | - Yoshiko Ueno
- Department of Radiology, Royal Victoria Hospital, McGill University Health Centre, 1001 Decarie Blvd, Montreal, QC, H4A 3J1, Canada.,Department of Radiology, Kobe University Graduate School of Medicine, 7-5-2, Kusunoki-cho, Chuo-ku, Kobe, Hyogo, 650-0017, Japan
| | - Maryam Bayat
- Segal Cancer Centre and Lady Davis Institute for Medical Research, Jewish General Hospital, Room C-212.1, 3755 Cote Ste-Catherine Road, Montreal, QC, H3T 1E2, Canada
| | - James W M Alexander
- Segal Cancer Centre and Lady Davis Institute for Medical Research, Jewish General Hospital, Room C-212.1, 3755 Cote Ste-Catherine Road, Montreal, QC, H3T 1E2, Canada
| | - Lynda Kadi
- Segal Cancer Centre and Lady Davis Institute for Medical Research, Jewish General Hospital, Room C-212.1, 3755 Cote Ste-Catherine Road, Montreal, QC, H3T 1E2, Canada.,Faculty of Medicine, Université de Montréal, Montreal, QC, Canada
| | - Jeffrey Chankowsky
- Department of Radiology, Royal Victoria Hospital, McGill University Health Centre, 1001 Decarie Blvd, Montreal, QC, H4A 3J1, Canada
| | - Jan Seuntjens
- Gerald Bronfman Department of Oncology, McGill University, Montreal, QC, Canada.,Medical Physics Unit, Cedars Cancer Centre, McGill University Health Centre, 1001 Decarie Blvd, Montreal, QC, H4A 3J1, Canada
| | - Behzad Forghani
- Department of Radiology and Research Institute of the McGill University Health Centre, McGill University, Room C02.5821, 1001 Decarie Blvd, Montreal, QC, H4A 3J1, Canada.,Gerald Bronfman Department of Oncology, McGill University, Montreal, QC, Canada
| |
Collapse
|
6
|
Spectral multi-energy CT texture analysis with machine learning for tissue classification: an investigation using classification of benign parotid tumours as a testing paradigm. Eur Radiol 2018; 28:2604-2611. [PMID: 29294157 DOI: 10.1007/s00330-017-5214-0] [Citation(s) in RCA: 38] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2017] [Revised: 11/18/2017] [Accepted: 11/24/2017] [Indexed: 12/13/2022]
Abstract
OBJECTIVE There is a rich amount of quantitative information in spectral datasets generated from dual-energy CT (DECT). In this study, we compare the performance of texture analysis performed on multi-energy datasets to that of virtual monochromatic images (VMIs) at 65 keV only, using classification of the two most common benign parotid neoplasms as a testing paradigm. METHODS Forty-two patients with pathologically proven Warthin tumour (n = 25) or pleomorphic adenoma (n = 17) were evaluated. Texture analysis was performed on VMIs ranging from 40 to 140 keV in 5-keV increments (multi-energy analysis) or 65-keV VMIs only, which is typically considered equivalent to single-energy CT. Random forest (RF) models were constructed for outcome prediction using separate randomly selected training and testing sets or the entire patient set. RESULTS Using multi-energy texture analysis, tumour classification in the independent testing set had accuracy, sensitivity, specificity, positive predictive value, and negative predictive value of 92%, 86%, 100%, 100%, and 83%, compared to 75%, 57%, 100%, 100%, and 63%, respectively, for single-energy analysis. CONCLUSIONS Multi-energy texture analysis demonstrates superior performance compared to single-energy texture analysis of VMIs at 65 keV for classification of benign parotid tumours. KEY POINTS • We present and validate a paradigm for texture analysis of DECT scans. • Multi-energy dataset texture analysis is superior to single-energy dataset texture analysis. • DECT texture analysis has high accura\cy for diagnosis of benign parotid tumours. • DECT texture analysis with machine learning can enhance non-invasive diagnostic tumour evaluation.
Collapse
|
7
|
George E, Wortman JR, Fulwadhva UP, Uyeda JW, Sodickson AD. Dual energy CT applications in pancreatic pathologies. Br J Radiol 2017; 90:20170411. [PMID: 28936888 PMCID: PMC6047640 DOI: 10.1259/bjr.20170411] [Citation(s) in RCA: 42] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2017] [Revised: 09/05/2017] [Accepted: 09/13/2017] [Indexed: 02/06/2023] Open
Abstract
Dual energy CT (DECT) is a technology that is gaining widespread acceptance, particularly for its abdominopelvic applications. Pancreatic pathologies are an ideal application for the many advantages offered by dual energy post-processing. This article reviews the current literature on dual energy CT pancreatic imaging, specifically in the evaluation of pancreatic adenocarcinoma, other solid and cystic pancreatic neoplasms, and pancreatitis. The advantages in characterization and quantification of enhancement, detection of subtle lesions, and potential reduction of imaging phases and contrast usage are reviewed. We also discuss directions for future research, and the ideal use of dual energy CT in routine clinical practice.
Collapse
Affiliation(s)
- Elizabeth George
- Department of Radiology, Division of Emergency Radiology, Brigham and Women’s Hospital and Harvard Medical School, Boston, MA, USA
| | - Jeremy R Wortman
- Department of Radiology, Division of Emergency Radiology, Brigham and Women’s Hospital and Harvard Medical School, Boston, MA, USA
| | - Urvi P Fulwadhva
- Department of Radiology, Division of Emergency Radiology, Brigham and Women’s Hospital and Harvard Medical School, Boston, MA, USA
| | - Jennifer W Uyeda
- Department of Radiology, Division of Emergency Radiology, Brigham and Women’s Hospital and Harvard Medical School, Boston, MA, USA
| | - Aaron D Sodickson
- Department of Radiology, Division of Emergency Radiology, Brigham and Women’s Hospital and Harvard Medical School, Boston, MA, USA
| |
Collapse
|