1
|
de Andrade JMC, Olescki G, Escuissato DL, Oliveira LF, Basso ACN, Salvador GL. Pixel-level annotated dataset of computed tomography angiography images of acute pulmonary embolism. Sci Data 2023; 10:518. [PMID: 37542053 PMCID: PMC10403591 DOI: 10.1038/s41597-023-02374-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Accepted: 07/11/2023] [Indexed: 08/06/2023] Open
Abstract
Pulmonary embolism has a high incidence and mortality, especially if undiagnosed. The examination of choice for diagnosing the disease is computed tomography pulmonary angiography. As many factors can lead to misinterpretations and diagnostic errors, different groups are utilizing deep learning methods to help improve this process. The diagnostic accuracy of these methods tends to increase by augmenting the training dataset. Deep learning methods can potentially benefit from the use of images acquired with devices from different vendors. To the best of our knowledge, we have developed the first public dataset annotated at the pixel and image levels and the first pixel-level annotated dataset to contain examinations performed with equipment from Toshiba and GE. This dataset includes 40 examinations, half performed with each piece of equipment, representing samples from two medical services. We also included measurements related to the cardiac and circulatory consequences of pulmonary embolism. We encourage the use of this dataset to develop, evaluate and compare the performance of new AI algorithms designed to diagnose PE.
Collapse
Affiliation(s)
| | - Gabriel Olescki
- Department of Informatics, Federal University of Paraná, Curitiba, Brazil
| | - Dante Luiz Escuissato
- Department of Radiology and Image Diagnosis, Hospital de Clínicas, Federal University of Paraná, Curitiba, Brazil
| | | | - Ana Carolina Nicolleti Basso
- Department of Radiology and Image Diagnosis, Hospital de Clínicas, Federal University of Paraná, Curitiba, Brazil
| | - Gabriel Lucca Salvador
- Department of Radiology and Image Diagnosis, Hospital de Clínicas, Federal University of Paraná, Curitiba, Brazil
| |
Collapse
|
2
|
Tang CX, Zhou CS, Schoepf UJ, Mastrodicasa D, Duguay T, Cline A, Zhao YE, Lu L, Li X, Tao SM, Lu MJ, Lu GM, Zhang LJ. Computer-assisted detection of acute pulmonary embolism at CT pulmonary angiography in children and young adults: a diagnostic performance analysis. Acta Radiol 2019; 60:1011-1019. [PMID: 30376717 DOI: 10.1177/0284185118808547] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
Background To diagnose pulmonary embolism (PE) in children and adults since evaluating tiny pulmonary vasculature beyond segmental level is a challenging and demanding task with thousands of images. Purpose To evaluate the effect of computer-assisted detection (CAD) on acute PE on CTPA in children and young adults by readers with varying experience levels. Material and Methods Six radiologists were retrospectively divided into three groups according to experience levels and assessed the CTPA studies on a per-emboli basis. All readers identified independently the PE presence, and ranked diagnostic confidence on a 5-point scale with and without CAD. Reading time, sensitivities, specificities, accuracies, positive predictive values (PPVs), and negative predictive values (NPVs) were calculated for each reading. Results The sensitivities and NPVs differed significantly in most readers ( P = 0.004, 0.001, 0.010, 0.010, and 0.012 for sensitivities and P = 0.011, 0.003, 0.016, 0.017, and 0.019 for NPVs) except for reader 6 ( P = 0.148 and 0.165, respectively), and the accuracies of all readers differed significantly (all P < 0.05) in peripheral PE (beyond segmental level) detection readings with CAD versus without CAD between two reading methods. The overall time using CAD was longer than those without CAD (76.6 ± 54.4 s vs. 49.4 ± 17.7 s, P = 0.000) for all readers. Significant differences were found for confidence scores in inter-group measurements with CAD ( P = 0.045) and without CAD ( P < 0.001). Conclusion At the expense of longer reading time, the use of the CAD algorithms improves sensitivities, NPVs, and the accuracies of readers in peripheral PE detection, especially for readers with a poor level of interpretation experience.
Collapse
Affiliation(s)
- Chun Xiang Tang
- Department of Medical Imaging, Jinling Hospital, Medical School of Nanjing University, Nanjing, Jiangsu, PR China
| | - Chang Sheng Zhou
- Department of Medical Imaging, Jinling Hospital, Medical School of Nanjing University, Nanjing, Jiangsu, PR China
| | - Uwe Joseph Schoepf
- Department of Medical Imaging, Jinling Hospital, Medical School of Nanjing University, Nanjing, Jiangsu, PR China
- Division of Cardiovascular Imaging, Department of Radiology and Radiological Science, Medical University of South Carolina, Charleston, SC, USA
| | - Domenico Mastrodicasa
- Division of Cardiovascular Imaging, Department of Radiology and Radiological Science, Medical University of South Carolina, Charleston, SC, USA
| | - Taylor Duguay
- Division of Cardiovascular Imaging, Department of Radiology and Radiological Science, Medical University of South Carolina, Charleston, SC, USA
| | - Anna Cline
- Division of Cardiovascular Imaging, Department of Radiology and Radiological Science, Medical University of South Carolina, Charleston, SC, USA
| | - Yan E Zhao
- Department of Medical Imaging, Jinling Hospital, Medical School of Nanjing University, Nanjing, Jiangsu, PR China
| | - Li Lu
- Department of Medical Imaging, Jinling Hospital, Medical School of Nanjing University, Nanjing, Jiangsu, PR China
| | - Xie Li
- Department of Medical Imaging, Jinling Hospital, Medical School of Nanjing University, Nanjing, Jiangsu, PR China
| | - Shu Min Tao
- Department of Medical Imaging, Jinling Hospital, Medical School of Nanjing University, Nanjing, Jiangsu, PR China
| | - Meng Jie Lu
- Department of Medical Imaging, Jinling Hospital, Medical School of Nanjing University, Nanjing, Jiangsu, PR China
| | - Guang Ming Lu
- Department of Medical Imaging, Jinling Hospital, Medical School of Nanjing University, Nanjing, Jiangsu, PR China
| | - Long Jiang Zhang
- Department of Medical Imaging, Jinling Hospital, Medical School of Nanjing University, Nanjing, Jiangsu, PR China
| |
Collapse
|
3
|
van Beek EJR, Murchison JT. Artificial Intelligence and Computer-Assisted Evaluation of Chest Pathology. Artif Intell Med Imaging 2019. [DOI: 10.1007/978-3-319-94878-2_12] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/19/2022] Open
|
4
|
Wang R, Yu N, Zhou S, Dong F, Wang J, Yin N, Bai L, Shen C, Guo Y. Limitations of an automated embolism segmentation method in clinical practice. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2018; 26:667-680. [PMID: 29710762 DOI: 10.3233/xst-18369] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
PURPOSE Automated pulmonary embolism (PE) segmentation is frequently used as a preprocessing step in the quantitative analysis of pulmonary embolism. Objective of this study is to analyze the potential limitation in automated PE segmentation using clinical cases. METHODS A database of 304 computer tomography pulmonary angiography (CTPA) examinations was collected and confirmed to be PE. After processing using an automated scheme, two radiologists classified these cases into four groups of A, B, C and D, which represent 4 different segmentation results namely, (1) entire pulmonary artery identified without motivation artifacts, (2) entire pulmonary artery identified with motivation artifacts, (3) part of the pulmonary artery identified, and (4) none of the pulmonary artery identified. Then, the possible failed reasons in PE segmentation were analyzed and determined based on the image characterization of the diseases and the applied CTPA scanning protocols. RESULTS In the study, 143 (47.0%., 30 (9.9%., 110 (36.2%. and 21 (6.9%. examinations were classified into groups A, B, C and D, respectively. Group C and D included the cases with failed segmentation. Fifteen failure reasons, including intrapulmonary abnormalities, extra-pulmonary abnormalities, diffuse pulmonary diseases, enlarged heart, absolute occluded vessels, embolism attached to artery wall, delayed scan time, skewed location, low scan dose, obvious artifact of superior vena cava, previous chest surgery, congenital deformities of the chest, incorrect positioning, missed images and other unknown reasons, were determined with corresponding case percentages ranging from 0.3%.o 9.2%. CONCLUSIONS Automated segmentation failures were caused by specific lung diseases, anatomy varieties, improper scan time, improper scan dose, manual errors or other unknown reasons. Realization of those limitations is crucial for developing robust automated schemes to handle these issues in a single pass when a large number of CTPA examinations need to be analyzed.
Collapse
Affiliation(s)
- Ruifeng Wang
- Department of Radiology, The First Affiliated Hospital of Medical School of Xi'an Jiaotong University, Xi'an, Shaanxi, China
- Department of Radiology, The Affiliated Hospital of Shaanxi University of Traditional Chinese Medicine, Shaanxi, China
| | - Nan Yu
- Department of Radiology, The First Affiliated Hospital of Medical School of Xi'an Jiaotong University, Xi'an, Shaanxi, China
- Department of Radiology, The Affiliated Hospital of Shaanxi University of Traditional Chinese Medicine, Shaanxi, China
| | - Sheng Zhou
- Department of Radiology, The First Affiliated Hospital of Medical School of Xi'an Jiaotong University, Xi'an, Shaanxi, China
- Department of Radiology, Gansu Provincial Hospital of Traditional Chinese Medicine, Lanzhou, Gansu, China
| | - Fuwen Dong
- Department of Radiology, The First Affiliated Hospital of Medical School of Xi'an Jiaotong University, Xi'an, Shaanxi, China
- Department of Radiology, Gansu Provincial Hospital of Traditional Chinese Medicine, Lanzhou, Gansu, China
| | - Jun Wang
- Department of Radiology, The First Affiliated Hospital of Medical School of Xi'an Jiaotong University, Xi'an, Shaanxi, China
| | - Nan Yin
- Department of Radiology, The First Affiliated Hospital of Medical School of Xi'an Jiaotong University, Xi'an, Shaanxi, China
| | - Lu Bai
- Department of Radiology, The First Affiliated Hospital of Medical School of Xi'an Jiaotong University, Xi'an, Shaanxi, China
| | - Cong Shen
- Department of Radiology, The First Affiliated Hospital of Medical School of Xi'an Jiaotong University, Xi'an, Shaanxi, China
| | - Youmin Guo
- Department of Radiology, The First Affiliated Hospital of Medical School of Xi'an Jiaotong University, Xi'an, Shaanxi, China
| |
Collapse
|
5
|
Kröger JR, Hickethier T, Pahn G, Gerhardt F, Maintz D, Bunck AC. Influence of spectral detector CT based monoenergetic images on the computer-aided detection of pulmonary artery embolism. Eur J Radiol 2017; 95:242-248. [DOI: 10.1016/j.ejrad.2017.08.034] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2017] [Accepted: 08/28/2017] [Indexed: 11/26/2022]
|
6
|
Missed pulmonary emboli on CT angiography: assessment with pulmonary embolism-computer-aided detection. AJR Am J Roentgenol 2014; 202:65-73. [PMID: 24370130 DOI: 10.2214/ajr.13.11049] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
OBJECTIVE The purpose of this study is to assess the use of a pulmonary embolism (PE)- computer-aided detection (CADx) program in the detection of PE missed in clinical practice. MATERIALS AND METHODS Pulmonary CT angiography (CTA) studies (n = 6769) performed between January 2009 and July 2012 were retrospectively assessed by a thoracic radiologist. In studies that were positive for PE, all prior contrast-enhanced pulmonary CTA studies were reviewed. Missed PE was deemed to have occurred if PE was not described in the final interpretation. The presence, proximal extent, and number of PEs were agreed on by three thoracic radiologists. Studies with missed acute PE and available slice thickness of 2 mm or less were assessed with a prototype PE-CADx program. False-positive PE-CADx marks were analyzed. Outcomes of missed acute PEs were assessed in patients with both follow-up imaging and clinical data. RESULTS Fifty-three studies with overlooked acute PE met our inclusion criteria for PE-CADx assessment. The PE-CADx program identified at least one PE in 77.4% of instances (41/53). PE-CADx correctly marked at least one PE in 23 of 23 cases (100%) with multiple PEs and 18 of 30 (60%) cases with a solitary PE (p < 0.001). PE-CADx per-study sensitivity was significantly higher for segmental (65.5%) than for subsegmental (91.7%) PEs (p = 0.002). PE-CADx averaged 3.8 false-positive marks per case (range, 0-23 marks). Fourteen patients with missed PE who were not receiving anticoagulation therapy developed new PEs, including nine with an isolated subsegmental PE on the initial CT scan. CONCLUSION PE-CADx correctly identified 77.4% of cases of acute PE that were previously missed in clinical practice.
Collapse
|
7
|
Remy-Jardin M, Pontana F, Faivre JB, Molinari F, Pagniez J, Khung S, Remy J. New Insights in Thromboembolic Disease. Radiol Clin North Am 2014; 52:183-93. [DOI: 10.1016/j.rcl.2013.08.003] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
8
|
Baqué-Juston M, Mondot L, Leroy S, Padovani B. Multiple lung parenchymal abnormalities: Don't panic, let's be pragmatic! The 6 question rule - a checklist strategy. Diagn Interv Imaging 2013; 95:361-76. [PMID: 24055120 DOI: 10.1016/j.diii.2013.08.014] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
Analysis of multiple lung parenchymal abnormalities on HRCT is a real diagnostic challenge. These abnormalities may be due to a disease of the pulmonary interstitial tissue, the bronchial tree, the cardiovascular system or to abnormal alveolar filling with fluid, blood, cells or tumor, several of these etiologies possibly being concomitant. Systematic pathophysiological reasoning, in the form of a logical checklist, guides reflection and covers many of the most frequent diagnoses and potentially treatable emergencies that can be identified by the non-specialist radiologist. This approach also provides a basis for deepening knowledge of each area. The use of the mnemonic FIBROVAKIM (fibrosis-bronchi-vascular-cancer-infection-medication) is easy to apply and summarizes this strategy.
Collapse
Affiliation(s)
- M Baqué-Juston
- Radiology Department, Pasteur Hospital, 30, avenue de la Voie-Romaine, Nice cedex 1, France.
| | - L Mondot
- Radiology Department, Pasteur Hospital, 30, avenue de la Voie-Romaine, Nice cedex 1, France
| | - S Leroy
- Respiratory Department, Pasteur Hospital, 30, avenue de la Voie-Romaine, Nice cedex 1, France
| | - B Padovani
- Radiology Department, Pasteur Hospital, 30, avenue de la Voie-Romaine, Nice cedex 1, France
| |
Collapse
|
9
|
Computerassistiertes Diagnoseverfahren für die Mehrschichtcomputertomographie zur Beurteilung der pulmonalarteriellen Strombahn. Radiologe 2012; 52:366-72. [DOI: 10.1007/s00117-012-2304-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
10
|
Wittenberg R, Berger FH, Peters JF, Weber M, van Hoorn F, Beenen LFM, van Doorn MMAC, van Schuppen J, Zijlstra IJAJ, Prokop M, Schaefer-Prokop CM. Acute Pulmonary Embolism: Effect of a Computer-assisted Detection Prototype on Diagnosis—An Observer Study. Radiology 2012; 262:305-13. [DOI: 10.1148/radiol.11110372] [Citation(s) in RCA: 31] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
11
|
Wittenberg R, Peters JF, Weber M, Lely RJ, Cobben LPJ, Prokop M, Schaefer-Prokop CM. Stand-alone performance of a computer-assisted detection prototype for detection of acute pulmonary embolism: a multi-institutional comparison. Br J Radiol 2011; 85:758-64. [PMID: 22167514 DOI: 10.1259/bjr/26769569] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022] Open
Abstract
OBJECTIVE To assess whether the performance of a computer-assisted detection (CAD) algorithm for acute pulmonary embolism (PE) differs in pulmonary CT angiographies acquired at various institutions. METHODS In this retrospective study, we included 40 consecutive scans with and 40 without PE from 3 institutions (n = 240) using 64-slice scanners made by different manufacturers (General Electric; Philips; Siemens). CAD markers were classified as true or false positive (FP) using independent evaluation by two readers and consultation of a third chest radiologist in discordant cases. Image quality parameters were subjectively scored using 4/5-point scales. Image noise and vascular enhancement were measured. Statistical analysis was done to correlate image quality of the three institutions with CAD stand-alone performance. RESULTS Patient groups were comparable with respect to age (p = 0.22), accompanying lung disease (p = 0.12) and inpatient/outpatient ratio (p = 0.67). The sensitivity was 100% (34/34), 97% (37/38) and 92% (33/36), and the specificity was 18% (8/44), 15% (6/41) and 13% (5/39). Neither significantly differed between the institutions (p = 0.21 and p = 0.820, respectively). The mean number of FP findings (4.5, 6.2 and 3.7) significantly varied (p = 0.02 and p = 0.03), but median numbers (2, 3 and 3) were comparable. Image quality parameters were significantly associated with the number of FP findings (p<0.05) but not with sensitivity. After correcting for noise and vascular enhancement, the number of FPs did not significantly differ between the three institutions (p = 0.43). CONCLUSIONS CAD stand-alone performance is independent of scanner type but strongly related to image quality and thus scanning protocols.
Collapse
Affiliation(s)
- R Wittenberg
- Department of Radiology, University Medical Centre Utrecht, Utrecht, the Netherlands.
| | | | | | | | | | | | | |
Collapse
|
12
|
Impact of Image Quality on the Performance of Computer-Aided Detection of Pulmonary Embolism. AJR Am J Roentgenol 2011; 196:95-101. [DOI: 10.2214/ajr.09.4165] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
|