1
|
Shia WC, Chen DR. Classification of malignant tumors in breast ultrasound using a pretrained deep residual network model and support vector machine. Comput Med Imaging Graph 2020; 87:101829. [PMID: 33302247 DOI: 10.1016/j.compmedimag.2020.101829] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2020] [Revised: 10/26/2020] [Accepted: 11/18/2020] [Indexed: 12/22/2022]
Abstract
In this study, a transfer learning method was utilized to recognize and classify benign and malignant breast tumors, using two-dimensional breast ultrasound (US) images, to decrease the effort expended by physicians and improve the quality of clinical diagnosis. The pretrained deep residual network model was utilized for image feature extraction from the convolutional layer of the trained network; whereas, the linear support vector machine (SVM), with a sequential minimal optimization solver, was used to classify the extracted feature. We used an image dataset with 2099 unlabeled two-dimensional breast US images, collected from 543 patients (benign: 302, malignant: 241). The classification performance yielded a sensitivity of 94.34 % and a specificity of 93.22 % for malignant images (Area under curve = 0.938). The positive and negative predictive values were 92.6 and 94.8, respectively. A comparison between the diagnosis made by the physician and the automated classification by a trained classifier, showed that the latter had significantly better outcomes. This indicates the potential applicability of the proposed approach that incorporates both the pretrained deep learning network and a well-trained classifier, to improve the quality and efficacy of clinical diagnosis.
Collapse
Affiliation(s)
- Wei-Chung Shia
- Molecular Medicine Laboratory, Department of Research, Changhua Christian Hospital, 8F., No. 235, XuGuang Road, Changhua, Taiwan.
| | - Dar-Ren Chen
- Comprehensive Breast Cancer Center, Changhua Christian Hospital, No. 135, NanXiao Street, Changhua, Taiwan.
| |
Collapse
|
2
|
Lian J, Li K. A Review of Breast Density Implications and Breast Cancer Screening. Clin Breast Cancer 2020; 20:283-290. [DOI: 10.1016/j.clbc.2020.03.004] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2019] [Revised: 02/10/2020] [Accepted: 03/12/2020] [Indexed: 12/15/2022]
|
3
|
Green CA, Goodsitt MM, Roubidoux MA, Brock KK, Davis CL, Lau JH, Carson PL. Deformable mapping using biomechanical models to relate corresponding lesions in digital breast tomosynthesis and automated breast ultrasound images. Med Image Anal 2020; 60:101599. [DOI: 10.1016/j.media.2019.101599] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2019] [Revised: 10/24/2019] [Accepted: 10/31/2019] [Indexed: 11/25/2022]
|
4
|
Šroubek F, Bartoš M, Schier J, Bílková Z, Zitová B, Vydra J, Macová I, Daneš J, Lambert L. A computer-assisted system for handheld whole-breast ultrasonography. Int J Comput Assist Radiol Surg 2019; 14:509-516. [DOI: 10.1007/s11548-018-01909-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2018] [Accepted: 12/28/2018] [Indexed: 12/01/2022]
|
5
|
Rella R, Belli P, Giuliani M, Bufi E, Carlino G, Rinaldi P, Manfredi R. Automated Breast Ultrasonography (ABUS) in the Screening and Diagnostic Setting: Indications and Practical Use. Acad Radiol 2018; 25:1457-1470. [PMID: 29555568 DOI: 10.1016/j.acra.2018.02.014] [Citation(s) in RCA: 61] [Impact Index Per Article: 10.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2018] [Revised: 02/10/2018] [Accepted: 02/11/2018] [Indexed: 10/17/2022]
Abstract
Automated breast ultrasonography (ABUS) is a new imaging technology for automatic breast scanning through ultrasound. It was first developed to overcome the limitation of operator dependency and lack of standardization and reproducibility of handheld ultrasound. ABUS provides a three-dimensional representation of breast tissue and allows images reformatting in three planes, and the generated coronal plane has been suggested to improve diagnostic accuracy. This technique has been first used in the screening setting to improve breast cancer detection, especially in mammographically dense breasts. In recent years, numerous studies also evaluated its use in the diagnostic setting: they showed its suitability for breast cancer staging, evaluation of tumor response to neoadjuvant chemotherapy, and second-look ultrasound after magnetic resonance imaging. The purpose of this article is to provide a comprehensive review of the current body of literature about the clinical performance of ABUS, summarize available evidence, and identify gaps in knowledge for future research.
Collapse
|
6
|
Green CA, Goodsitt MM, Brock KK, Davis CL, Larson ED, Lau JH, Carson PL. Deformable mapping technique to correlate lesions in digital breast tomosynthesis and automated breast ultrasound images. Med Phys 2018; 45:4402-4417. [PMID: 30066340 DOI: 10.1002/mp.13113] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2017] [Revised: 07/22/2018] [Accepted: 07/26/2018] [Indexed: 11/06/2022] Open
Abstract
PURPOSE To develop a deformable mapping technique to match corresponding lesions between digital breast tomosynthesis (DBT) and automated breast ultrasound (ABUS) images. METHODS External fiducial markers were attached to the surface of two CIRS multi-modality compressible breast phantoms (A and B) containing multiple simulated lesions. Both phantoms were imaged with DBT (upright positioning with cranial-caudal compression) and ABUS (supine positioning with anterior-to-chest wall compression). The lesions and markers were manually segmented by three different readers. Reader segmentation similarity and reader reproducibility were assessed using Dice similarity coefficients (DSC) and distances between centers of mass (dCOM ). For deformable mapping between the modalities each reader's segmented dataset was processed with an automated deformable mapping algorithm as follows: First, Morfeus, a finite element (FE) based multi-organ deformable image registration platform, converted segmentations into triangular surface meshes. Second, Altair HyperMesh, a FE pre-processor, created base FE models for the ABUS and DBT data sets. All deformation is performed on the DBT image data; the ABUS image sets remain fixed throughout the process. Deformation was performed on the external skin contour (DBT image set) to match the external skin contour on the ABUS set, and the locations of the external markers were used to morph the skin contours to be within a user-defined distance. Third, the base DBT-FE model was deformed with the FE analysis solver, Optistruct. Deformed DBT lesions were correlated with matching lesions in the base ABUS FE model. Performance (lesion correlation) was assessed with dCOM for all corresponding lesions and lesion overlap. Analysis was performed to determine the minimum number of external fiducial markers needed to create the desired correlation and the improvement of correlation with the use of external markers. RESULTS Average DSC for reader similarity ranged from 0.88 to 0.91 (ABUS) and 0.57 to 0.83 (DBT). Corresponding dCOM ranged from 0.20 to 0.36 mm (ABUS) and 0.11 to 1.16 mm (DBT). Lesion correlation is maximized when all corresponding markers are within a maximum distance of 5 mm. For deformable mapping of phantom A, without the use of external markers, only two of six correlated lesions showed overlap with an average lesion dCOM of 6.8 ± 2.8 mm. With use of three external fiducial markers, five of six lesions overlapped and average dCOM improved to 4.9 ± 2.4 mm. For deformable mapping of Phantom B without external markers analysis, four lesions were correlated of seven with overlap between only one of seven lesions, and an average lesion dCOM of 9.7 ± 3.5 mm. With three external markers, all seven possible lesions were correlated with overlap between four of seven lesions. The average dCOM was 8.5 ± 4.0 mm. CONCLUSION This work demonstrates the potential for a deformable mapping technique to relate corresponding lesions in DBT and ABUS images by showing improved lesion correspondence and reduced lesion registration errors with the use of external fiducial markers. The technique should improve radiologists' characterization of breast lesions which can reduce patient callbacks, misdiagnoses and unnecessary biopsies.
Collapse
Affiliation(s)
- Crystal A Green
- Department of Nuclear Engineering and Radiological Sciences, University of Michigan, Ann Arbor, MI, 48109, USA.,Department of Radiology, University of Michigan Health System, Ann Arbor, MI, 48109, USA
| | - Mitchell M Goodsitt
- Department of Nuclear Engineering and Radiological Sciences, University of Michigan, Ann Arbor, MI, 48109, USA.,Department of Radiology, University of Michigan Health System, Ann Arbor, MI, 48109, USA
| | - Kristy K Brock
- Department of Nuclear Engineering and Radiological Sciences, University of Michigan, Ann Arbor, MI, 48109, USA.,Imaging Physics, University of Texas MD Anderson Cancer Center, Houston, TX, 77030, USA
| | | | - Eric D Larson
- Department of Radiology, University of Michigan Health System, Ann Arbor, MI, 48109, USA
| | - Jasmine H Lau
- Department of Radiology, University of Michigan Health System, Ann Arbor, MI, 48109, USA
| | - Paul L Carson
- Department of Radiology, University of Michigan Health System, Ann Arbor, MI, 48109, USA
| |
Collapse
|
7
|
Jintamethasawat R, Lee WM, Carson PL, Hooi FM, Fowlkes JB, Goodsitt MM, Sampson R, Wenisch TF, Wei S, Zhou J, Chakrabarti C, Kripfgans OD. Error analysis of speed of sound reconstruction in ultrasound limited angle transmission tomography. ULTRASONICS 2018; 88:174-184. [PMID: 29674228 DOI: 10.1016/j.ultras.2018.03.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/18/2017] [Revised: 02/07/2018] [Accepted: 03/29/2018] [Indexed: 06/08/2023]
Abstract
We have investigated limited angle transmission tomography to estimate speed of sound (SOS) distributions for breast cancer detection. That requires both accurate delineations of major tissues, in this case by segmentation of prior B-mode images, and calibration of the relative positions of the opposed transducers. Experimental sensitivity evaluation of the reconstructions with respect to segmentation and calibration errors is difficult with our current system. Therefore, parametric studies of SOS errors in our bent-ray reconstructions were simulated. They included mis-segmentation of an object of interest or a nearby object, and miscalibration of relative transducer positions in 3D. Close correspondence of reconstruction accuracy was verified in the simplest case, a cylindrical object in homogeneous background with induced segmentation and calibration inaccuracies. Simulated mis-segmentation in object size and lateral location produced maximum SOS errors of 6.3% within 10 mm diameter change and 9.1% within 5 mm shift, respectively. Modest errors in assumed transducer separation produced the maximum SOS error from miscalibrations (57.3% within 5 mm shift), still, correction of this type of error can easily be achieved in the clinic. This study should aid in designing adequate transducer mounts and calibration procedures, and in specification of B-mode image quality and segmentation algorithms for limited angle transmission tomography relying on ray tracing algorithms.
Collapse
Affiliation(s)
- Rungroj Jintamethasawat
- Department of Radiology, University of Michigan, Ann Arbor, MI 48109, USA; Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, USA.
| | - Won-Mean Lee
- Department of Radiology, University of Michigan, Ann Arbor, MI 48109, USA; GE Healthcare, 447 Indio Way, Sunnyvale, CA 94085, USA
| | - Paul L Carson
- Department of Radiology, University of Michigan, Ann Arbor, MI 48109, USA; Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, USA
| | - Fong Ming Hooi
- Department of Radiology, University of Michigan, Ann Arbor, MI 48109, USA; Siemens Medical Solutions USA, Inc., 22010 South East 51st Street, Issaquah, WA 98029-7002, USA
| | - J Brian Fowlkes
- Department of Radiology, University of Michigan, Ann Arbor, MI 48109, USA; Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, USA
| | - Mitchell M Goodsitt
- Department of Radiology, University of Michigan, Ann Arbor, MI 48109, USA; Department of Nuclear Engineering and Radiological Sciences, University of Michigan, Ann Arbor, MI 48109, USA
| | - Richard Sampson
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI 48109, USA
| | - Thomas F Wenisch
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI 48109, USA
| | - Siyuan Wei
- School of Electrical, Computer and Energy Engineering, Arizona State University, Tempe, AZ 85287, USA
| | - Jian Zhou
- School of Electrical, Computer and Energy Engineering, Arizona State University, Tempe, AZ 85287, USA
| | - Chaitali Chakrabarti
- School of Electrical, Computer and Energy Engineering, Arizona State University, Tempe, AZ 85287, USA
| | - Oliver D Kripfgans
- Department of Radiology, University of Michigan, Ann Arbor, MI 48109, USA; Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, USA
| |
Collapse
|
8
|
Larson ED, Lee WM, Roubidoux MA, Goodsitt MM, Lashbrook C, Davis CE, Kripfgans OD, Carson PL. Preliminary Clinical Experience with a Combined Automated Breast Ultrasound and Digital Breast Tomosynthesis System. ULTRASOUND IN MEDICINE & BIOLOGY 2018; 44:734-742. [PMID: 29311005 PMCID: PMC5801205 DOI: 10.1016/j.ultrasmedbio.2017.12.003] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/09/2017] [Revised: 11/29/2017] [Accepted: 12/03/2017] [Indexed: 06/02/2023]
Abstract
We analyzed the performance of a mammographically configured, automated breast ultrasound (McABUS) scanner combined with a digital breast tomosynthesis (DBT) system. The GE Invenia ultrasound system was modified for integration with GE DBT systems. Ultrasound and DBT imaging were performed in the same mammographic compression. Our small preliminary study included 13 cases, six of whom had contained invasive cancers. From analysis of these cases, current limitations and corresponding potential improvements of the system were determined. A registration analysis was performed to compare the ease of McABUS to DBT registration for this system with that of two systems designed previously. It was observed that in comparison to data from an earlier study, the McABUS-to-DBT registration alignment errors for both this system and a previously built combined system were smaller than those for a previously built standalone McABUS system.
Collapse
Affiliation(s)
- Eric D Larson
- Department of Radiology, University of Michigan, Ann Arbor, Michigan, USA.
| | - Won-Mean Lee
- Department of Radiology, University of Michigan, Ann Arbor, Michigan, USA
| | | | | | - Chris Lashbrook
- Department of Radiology, University of Michigan, Ann Arbor, Michigan, USA
| | | | - Oliver D Kripfgans
- Department of Radiology, University of Michigan, Ann Arbor, Michigan, USA
| | - Paul L Carson
- Department of Radiology, University of Michigan, Ann Arbor, Michigan, USA
| |
Collapse
|
9
|
Jintamethasawat R, Zhang X, Carson PL, Roubidoux MA, Kripfgans OD. Acoustic beam anomalies in automated breast imaging. J Med Imaging (Bellingham) 2017; 4:045001. [DOI: 10.1117/1.jmi.4.4.045001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2017] [Accepted: 09/14/2017] [Indexed: 11/14/2022] Open
Affiliation(s)
| | - Xiaohui Zhang
- Beihang University, School of Biological Science and Medical Engineering, Beijing
| | - Paul L. Carson
- University of Michigan, Department of Radiology, Ann Arbor, Michigan
| | | | | |
Collapse
|
10
|
O'Connor MK, Morrow MM, Tran T, Hruska CB, Conners AL, Hunt KN. Technical Note: Development of a combined molecular breast imaging/ultrasound system for diagnostic evaluation of MBI-detected lesions. Med Phys 2017; 44:451-459. [PMID: 28133745 DOI: 10.1002/mp.12043] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2016] [Revised: 10/31/2016] [Accepted: 11/15/2016] [Indexed: 11/10/2022] Open
Abstract
PURPOSE The purpose of this study was to perform a pilot evaluation of an integrated molecular breast imaging/ultrasound (MBI/US) system designed to enable, in real-time, the registration of US to MBI and diagnostic evaluation of breast lesions detected on MBI. METHODS The MBI/US system was constructed by modifying an existing dual-head cadmium zinc telluride (CZT)-based MBI gamma camera. The upper MBI detector head was replaced with a mesh panel, which allowed an ultrasound probe to access the breast. An optical tracking system was used to monitor the location of the ultrasound transducer, referenced to the MBI detector. The lesion depth at which ultrasound was targeted was estimated from analysis of previously acquired dual-head MBI datasets. A software tool was developed to project the US field of view onto the current MBI image. Correlation of lesion location between both modalities with real-time MBI/US scanning was confirmed in a breast phantom model and assessed in 12 patients with a breast lesion detected on MBI. RESULTS Combined MBI/US scanning allowed for registration of lesions detected on US and MBI as validated in phantom experiments. In patient studies, successful registration was achieved in 8 of 12 (67%) patients, with complete registration achieved in seven and partial registration achieved in one patient. In 4 of 12 (37%) patients, lesion registration was not achieved, partially attributed to uncertainty in lesion depth estimates from MBI. CONCLUSION The MBI/US system enabled successful registration of US to MBI in over half of patients studied in this pilot evaluation. Future studies are needed to determine if real-time, registered US imaging of MBI-detected lesions may obviate the need to proceed to more expensive procedures such as contrast-enhanced breast MRI for diagnostic workup or biopsy of MBI findings.
Collapse
Affiliation(s)
| | | | - Thuy Tran
- Department of Radiology, Mayo Clinic, Rochester, MN, USA
| | | | - Amy L Conners
- Department of Radiology, Mayo Clinic, Rochester, MN, USA
| | - Katie N Hunt
- Department of Radiology, Mayo Clinic, Rochester, MN, USA
| |
Collapse
|