1
|
Zhang J, Zou W, Hu N, Zhang B, Wang J. S-Net: an S-shaped network for nodule detection in 3D CT images. Phys Med Biol 2024; 69:075013. [PMID: 38382097 DOI: 10.1088/1361-6560/ad2b96] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2023] [Accepted: 02/21/2024] [Indexed: 02/23/2024]
Abstract
Objective. Accurate and automatic detection of pulmonary nodules is critical for early lung cancer diagnosis, and promising progress has been achieved in developing effective deep models for nodule detection. However, most existing nodule detection methods merely focus on integrating elaborately designed feature extraction modules into the backbone of the detection network to extract rich nodule features while ignore disadvantages of the structure of detection network itself. This study aims to address these disadvantages and develop a deep learning-based algorithm for pulmonary nodule detection to improve the accuracy of early lung cancer diagnosis.Approach. In this paper, an S-shaped network called S-Net is developed with the U-shaped network as backbone, where an information fusion branch is used to propagate lower-level details and positional information critical for nodule detection to higher-level feature maps, head shared scale adaptive detection strategy is utilized to capture information from different scales for better detecting nodules with different shapes and sizes and the feature decoupling detection head is used to allow the classification and regression branches to focus on the information required for their respective tasks. A hybrid loss function is utilized to fully exploit the interplay between the classification and regression branches.Main results. The proposed S-Net network with ResSENet and other three U-shaped backbones from SANet, OSAF-YOLOv3 and MSANet (R+SC+ECA) models achieve average CPM scores of 0.914, 0.915, 0.917 and 0.923 on the LUNA16 dataset, which are significantly higher than those achieved with other existing state-of-the-art models.Significance. The experimental results demonstrate that our proposed method effectively improves nodule detection performance, which implies potential applications of the proposed method in clinical practice.
Collapse
Affiliation(s)
- JingYu Zhang
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006, People's Republic of China
| | - Wei Zou
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006, People's Republic of China
| | - Nan Hu
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006, People's Republic of China
| | - Bin Zhang
- Department of Nuclear Medicine, the First Affiliated Hospital of Soochow University, Suzhou 215006, People's Republic of China
| | - Jiajun Wang
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006, People's Republic of China
| |
Collapse
|
2
|
Lam S, Wynes MW, Connolly C, Ashizawa K, Atkar-Khattra S, Belani CP, DiNatale D, Henschke CI, Hochhegger B, Jacomelli C, Jelitto M, Jirapatnakul A, Kelly KL, Krishnan K, Kobayashi T, Logan J, Mattos J, Mayo J, McWilliams A, Mitsudomi T, Pastorino U, Polańska J, Rzyman W, Sales Dos Santos R, Scagliotti GV, Wakelee H, Yankelevitz DF, Field JK, Mulshine JL, Avila R. The International Association for the Study of Lung Cancer Early Lung Imaging Confederation Open-Source Deep Learning and Quantitative Measurement Initiative. J Thorac Oncol 2024; 19:94-105. [PMID: 37595684 DOI: 10.1016/j.jtho.2023.08.016] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Revised: 08/07/2023] [Accepted: 08/11/2023] [Indexed: 08/20/2023]
Abstract
INTRODUCTION With global adoption of computed tomography (CT) lung cancer screening, there is increasing interest to use artificial intelligence (AI) deep learning methods to improve the clinical management process. To enable AI research using an open-source, cloud-based, globally distributed, screening CT imaging data set and computational environment that are compliant with the most stringent international privacy regulations that also protect the intellectual properties of researchers, the International Association for the Study of Lung Cancer sponsored development of the Early Lung Imaging Confederation (ELIC) resource in 2018. The objective of this report is to describe the updated capabilities of ELIC and illustrate how this resource can be used for clinically relevant AI research. METHODS In this second phase of the initiative, metadata and screening CT scans from two time points were collected from 100 screening participants in seven countries. An automated deep learning AI lung segmentation algorithm, automated quantitative emphysema metrics, and a quantitative lung nodule volume measurement algorithm were run on these scans. RESULTS A total of 1394 CTs were collected from 697 participants. The LAV950 quantitative emphysema metric was found to be potentially useful in distinguishing lung cancer from benign cases using a combined slice thickness more than or equal to 2.5 mm. Lung nodule volume change measurements had better sensitivity and specificity for classifying malignant from benign lung nodules when applied to solid lung nodules from high-quality CT scans. CONCLUSIONS These initial experiments revealed that ELIC can support deep learning AI and quantitative imaging analyses on diverse and globally distributed cloud-based data sets.
Collapse
Affiliation(s)
- Stephen Lam
- Department of Integrative Oncology, The British Columbia Cancer Research Institute and Department of Medicine, University of British Columbia, Vancouver, British Columbia, Canada.
| | - Murry W Wynes
- International Association for the Study of Lung Cancer, Denver, Colorado
| | - Casey Connolly
- International Association for the Study of Lung Cancer, Denver, Colorado
| | - Kazuto Ashizawa
- Department of Clinical Oncology, Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan
| | - Sukhinder Atkar-Khattra
- Department of Integrative Oncology, British Columbia Cancer Research Institute, Vancouver, British Columbia, Canada
| | - Chandra P Belani
- Department of Medicine, Penn State College of Medicine, Hershey, Pennsylvania
| | | | - Claudia I Henschke
- Department of Radiology, Icahn School of Medicine at Mount Sinai, New York, New York
| | - Bruno Hochhegger
- Department of Radiology, University of Florida, Gainesville, Florida
| | | | | | - Artit Jirapatnakul
- Department of Radiology, Icahn School of Medicine at Mount Sinai, New York, New York
| | - Karen L Kelly
- International Association for the Study of Lung Cancer, Denver, Colorado
| | | | - Takeshi Kobayashi
- Department of Diagnostic and Interventional Radiology, Ishikawa Prefectural Central Hospital, Kanazawa, Ishikawa, Japan
| | | | - Juliane Mattos
- Federal University of Health Sciences of Porto Alegre, Porto Alegre, Brazil
| | - John Mayo
- Department of Radiology, Vancouver General Hospital and the University of British Columbia, Vancouver, British Columbia, Canada
| | - Annette McWilliams
- Fiona Stanley Hospital, University of Western Australia, Perth, Western Australia, Australia
| | - Tetsuya Mitsudomi
- Department of Surgery, Division of Thoracic Surgery, Kindai University Faculty of Medicine, Osaka-Sayama, Japan
| | - Ugo Pastorino
- Department of Surgery, Section of Thoracic Surgery, National Cancer Institute of Milan, Milan, Italy
| | - Joanna Polańska
- Department of Data Science and Engineering, Silesian University of Technology, Gliwice, Poland
| | - Witold Rzyman
- Department of Thoracic Surgery, Medical University of Gdańsk, Gdańsk, Poland
| | | | | | - Heather Wakelee
- Stanford Cancer Institute, Stanford University, Stanford, California
| | - David F Yankelevitz
- Department of Radiology, Icahn School of Medicine at Mount Sinai, New York, New York
| | - John K Field
- Roy Castle Lung Cancer Research Programme, The University of Liverpool, Department of Molecular and Clinical Cancer Medicine, Liverpool, United Kingdom
| | - James L Mulshine
- Internal Medicine, Graduate College, Rush University Medical Center, Chicago, Illinois
| | | |
Collapse
|
3
|
Prosper AE, Kammer MN, Maldonado F, Aberle DR, Hsu W. Expanding Role of Advanced Image Analysis in CT-detected Indeterminate Pulmonary Nodules and Early Lung Cancer Characterization. Radiology 2023; 309:e222904. [PMID: 37815447 PMCID: PMC10623199 DOI: 10.1148/radiol.222904] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Revised: 03/23/2023] [Accepted: 03/30/2023] [Indexed: 10/11/2023]
Abstract
The implementation of low-dose chest CT for lung screening presents a crucial opportunity to advance lung cancer care through early detection and interception. In addition, millions of pulmonary nodules are incidentally detected annually in the United States, increasing the opportunity for early lung cancer diagnosis. Yet, realization of the full potential of these opportunities is dependent on the ability to accurately analyze image data for purposes of nodule classification and early lung cancer characterization. This review presents an overview of traditional image analysis approaches in chest CT using semantic characterization as well as more recent advances in the technology and application of machine learning models using CT-derived radiomic features and deep learning architectures to characterize lung nodules and early cancers. Methodological challenges currently faced in translating these decision aids to clinical practice, as well as the technical obstacles of heterogeneous imaging parameters, optimal feature selection, choice of model, and the need for well-annotated image data sets for the purposes of training and validation, will be reviewed, with a view toward the ultimate incorporation of these potentially powerful decision aids into routine clinical practice.
Collapse
Affiliation(s)
- Ashley Elizabeth Prosper
- From the Department of Radiological Sciences, David Geffen School of
Medicine at UCLA, 924 Westwood Blvd, Suite 420, Los Angeles, CA 90024 (A.E.P.,
D.R.A., W.H.); Division of Allergy, Pulmonary and Critical Care Medicine,
Department of Medicine, Vanderbilt University Medical Center, Nashville, Tenn
(M.N.K., F.M.); and Department of Bioengineering, UCLA Samueli School of
Engineering, Los Angeles, Calif (D.R.A., W.H.)
| | - Michael N. Kammer
- From the Department of Radiological Sciences, David Geffen School of
Medicine at UCLA, 924 Westwood Blvd, Suite 420, Los Angeles, CA 90024 (A.E.P.,
D.R.A., W.H.); Division of Allergy, Pulmonary and Critical Care Medicine,
Department of Medicine, Vanderbilt University Medical Center, Nashville, Tenn
(M.N.K., F.M.); and Department of Bioengineering, UCLA Samueli School of
Engineering, Los Angeles, Calif (D.R.A., W.H.)
| | - Fabien Maldonado
- From the Department of Radiological Sciences, David Geffen School of
Medicine at UCLA, 924 Westwood Blvd, Suite 420, Los Angeles, CA 90024 (A.E.P.,
D.R.A., W.H.); Division of Allergy, Pulmonary and Critical Care Medicine,
Department of Medicine, Vanderbilt University Medical Center, Nashville, Tenn
(M.N.K., F.M.); and Department of Bioengineering, UCLA Samueli School of
Engineering, Los Angeles, Calif (D.R.A., W.H.)
| | - Denise R. Aberle
- From the Department of Radiological Sciences, David Geffen School of
Medicine at UCLA, 924 Westwood Blvd, Suite 420, Los Angeles, CA 90024 (A.E.P.,
D.R.A., W.H.); Division of Allergy, Pulmonary and Critical Care Medicine,
Department of Medicine, Vanderbilt University Medical Center, Nashville, Tenn
(M.N.K., F.M.); and Department of Bioengineering, UCLA Samueli School of
Engineering, Los Angeles, Calif (D.R.A., W.H.)
| | - William Hsu
- From the Department of Radiological Sciences, David Geffen School of
Medicine at UCLA, 924 Westwood Blvd, Suite 420, Los Angeles, CA 90024 (A.E.P.,
D.R.A., W.H.); Division of Allergy, Pulmonary and Critical Care Medicine,
Department of Medicine, Vanderbilt University Medical Center, Nashville, Tenn
(M.N.K., F.M.); and Department of Bioengineering, UCLA Samueli School of
Engineering, Los Angeles, Calif (D.R.A., W.H.)
| |
Collapse
|
4
|
Sato M, Kondo Y, Okamoto M. Development of a computer-aided quality assurance support system for identifying hand X-ray image direction using deep convolutional neural network. Radiol Phys Technol 2022; 15:358-366. [PMID: 36001273 DOI: 10.1007/s12194-022-00675-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2022] [Revised: 08/15/2022] [Accepted: 08/16/2022] [Indexed: 11/29/2022]
Abstract
The convenience of imaging has improved with digitization; however, there has been no progress in the methods used to prevent human error. Therefore, radiographic incidents and accidents are not prevented. In Japan, image interpretation is conducted for incident prevention; nevertheless, in some cases, incidents are overlooked. Thus, assistance from a computer-aided quality assurance support system is important. This study developed a method to identify hand image direction, which is an elementary technology of a computer-aided quality assurance support system. In total, 14,236 hand X-ray images were used to classify hand directions (upward, downward, rightward, and leftward) commonly evaluated in clinical settings. The accuracy of the conventional classification method using original images, classification method with histogram equation images, and a novel classification method using binarization images for background removal via U-Net segmentation was evaluated. The following classification accuracy rates were achieved: 89.20% if the original image was input, 99.10% if the histogram equation image was input, and 99.70% if binarization images for background removal via U-Net segmentation was input. Our computer-aided quality assurance support system can be used to identify hand direction with high accuracy.
Collapse
Affiliation(s)
- Mitsuru Sato
- Department of Radiological Technology, School of Health Sciences, Niigata University, 2-746 Asahimachi-dori, Chuo-ku, Niigata, Niigata, 951-8518, Japan.
| | - Yohan Kondo
- Department of Radiological Technology, School of Health Sciences, Niigata University, 2-746 Asahimachi-dori, Chuo-ku, Niigata, Niigata, 951-8518, Japan
| | - Masashi Okamoto
- Department of Radiological Technology, School of Health Sciences, Niigata University, 2-746 Asahimachi-dori, Chuo-ku, Niigata, Niigata, 951-8518, Japan
| |
Collapse
|