1
|
Han M, Shim H, Baek J. Utilization of an attentive map to preserve anatomical features for training convolutional neural-network-based low-dose CT denoiser. Med Phys 2023; 50:2787-2804. [PMID: 36734478 DOI: 10.1002/mp.16263] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Revised: 12/04/2022] [Accepted: 01/17/2023] [Indexed: 02/04/2023] Open
Abstract
BACKGROUND The purpose of a convolutional neural network (CNN)-based denoiser is to increase the diagnostic accuracy of low-dose computed tomography (LDCT) imaging. To increase diagnostic accuracy, there is a need for a method that reflects the features related to diagnosis during the denoising process. PURPOSE To provide a training strategy for LDCT denoisers that relies more on diagnostic task-related features to improve diagnostic accuracy. METHODS An attentive map derived from a lesion classifier (i.e., determining lesion-present or not) is created to represent the extent to which each pixel influences the decision by the lesion classifier. This is used as a weight to emphasize important parts of the image. The proposed training method consists of two steps. In the first one, the initial parameters of the CNN denoiser are trained using LDCT and normal-dose CT image pairs via supervised learning. In the second one, the learned parameters are readjusted using the attentive map to restore the fine details of the image. RESULTS Structural details and the contrast are better preserved in images generated by using the denoiser trained via the proposed method than in those generated by conventional denoisers. The proposed denoiser also yields higher lesion detectability and localization accuracy than conventional denoisers. CONCLUSIONS A denoiser trained using the proposed method preserves the small structures and the contrast in the denoised images better than without it. Specifically, using the attentive map improves the lesion detectability and localization accuracy of the denoiser.
Collapse
Affiliation(s)
- Minah Han
- Graduate School of Artificial Intelligence, Yonsei University, Seoul, South Korea.,Bareunex Imaging, Inc., Seoul, South Korea
| | - Hyunjung Shim
- Graduate School of AI, Korea Advanced Institute of Science and Technology, Daejeon, South Korea
| | - Jongduk Baek
- Graduate School of Artificial Intelligence, Yonsei University, Seoul, South Korea.,Bareunex Imaging, Inc., Seoul, South Korea
| |
Collapse
|
2
|
Jha AK, Myers KJ, Obuchowski NA, Liu Z, Rahman MA, Saboury B, Rahmim A, Siegel BA. Objective Task-Based Evaluation of Artificial Intelligence-Based Medical Imaging Methods:: Framework, Strategies, and Role of the Physician. PET Clin 2021; 16:493-511. [PMID: 34537127 DOI: 10.1016/j.cpet.2021.06.013] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
Artificial intelligence-based methods are showing promise in medical imaging applications. There is substantial interest in clinical translation of these methods, requiring that they be evaluated rigorously. We lay out a framework for objective task-based evaluation of artificial intelligence methods. We provide a list of available tools to conduct this evaluation. We outline the important role of physicians in conducting these evaluation studies. The examples in this article are proposed in the context of PET scans with a focus on evaluating neural network-based methods. However, the framework is also applicable to evaluate other medical imaging modalities and other types of artificial intelligence methods.
Collapse
Affiliation(s)
- Abhinav K Jha
- Department of Biomedical Engineering, Mallinckrodt Institute of Radioly, Alvin J. Siteman Cancer Center, Washington University in St. Louis, 510 S Kingshighway Boulevard, St Louis, MO 63110, USA.
| | - Kyle J Myers
- Division of Imaging, Diagnostics, and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, Food and Drug Administration (FDA), Silver Spring, MD, USA
| | | | - Ziping Liu
- Department of Biomedical Engineering, Washington University in St. Louis, 1 Brookings Drive, St Louis, MO 63130, USA
| | - Md Ashequr Rahman
- Department of Biomedical Engineering, Washington University in St. Louis, 1 Brookings Drive, St Louis, MO 63130, USA
| | - Babak Saboury
- Department of Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, 9000 Rockville Pike, Bethesda, MD 20892, USA
| | - Arman Rahmim
- Department of Radiology, Department of Physics, University of British Columbia, BC Cancer, BC Cancer Research Institute, 675 West 10th Avenue, Office 6-112, Vancouver, British Columbia V5Z 1L3, Canada
| | - Barry A Siegel
- Division of Nuclear Medicine, Mallinckrodt Institute of Radiology, Alvin J. Siteman Cancer Center, Washington University School of Medicine, 510 S Kingshighway Boulevard #956, St Louis, MO 63110, USA
| |
Collapse
|
3
|
Lévêque L, Outtas M, Liu H, Zhang L. Comparative study of the methodologies used for subjective medical image quality assessment. Phys Med Biol 2021; 66. [PMID: 34225264 DOI: 10.1088/1361-6560/ac1157] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2021] [Accepted: 07/05/2021] [Indexed: 11/12/2022]
Abstract
Healthcare professionals have been increasingly viewing medical images and videos in their routine clinical practice, and this in a wide variety of environments. Both the perception and interpretation of medical visual information, across all branches of practice or medical specialties (e.g. diagnostic, therapeutic, or surgical medicine), career stages, and practice settings (e.g. emergency care), appear to be critical for patient care. However, medical images and videos are not self-explanatory and, therefore, need to be interpreted by humans, i.e. medical experts. In addition, various types of degradations and artifacts may appear during image acquisition or processing, and consequently affect medical imaging data. Such distortions tend to impact viewers' quality of experience, as well as their clinical practice. It is accordingly essential to better understand how medical experts perceive the quality of visual content. Thankfully, progress has been made in the recent literature towards such understanding. In this article, we present an up-to-date state-of the-art of relatively recent (i.e. not older than ten years old) existing studies on the subjective quality assessment of medical images and videos, as well as research works using task-based approaches. Furthermore, we discuss the merits and drawbacks of the methodologies used, and we provide recommendations about experimental designs and statistical processes to evaluate the perception of medical images and videos for future studies, which could then be used to optimise the visual experience of image readers in real clinical practice. Finally, we tackle the issue of the lack of available annotated medical image and video quality databases, which appear to be indispensable for the development of new dedicated objective metrics.
Collapse
Affiliation(s)
- Lucie Lévêque
- Nantes Laboratory of Digital Sciences (LS2N), University of Nantes, Nantes, France
| | - Meriem Outtas
- Department of Industrial Computer Science and Electronics, National Institute of Applied Sciences, Rennes, France
| | - Hantao Liu
- School of Computer Science and Informatics, Cardiff University, Cardiff, United Kingdom
| | - Lu Zhang
- Department of Industrial Computer Science and Electronics, National Institute of Applied Sciences, Rennes, France
| |
Collapse
|
4
|
Liu F, Hernandez-Cabronero M, Sanchez V, Marcellin MW, Bilgin A. The Current Role of Image Compression Standards in Medical Imaging. INFORMATION 2017; 8:131. [PMID: 34671488 PMCID: PMC8525863 DOI: 10.3390/info8040131] [Citation(s) in RCA: 29] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
With increasing utilization of medical imaging in clinical practice and the growing dimensions of data volumes generated by various medical imaging modalities, the distribution, storage, and management of digital medical image data sets requires data compression. Over the past few decades, several image compression standards have been proposed by international standardization organizations. This paper discusses the current status of these image compression standards in medical imaging applications together with some of the legal and regulatory issues surrounding the use of compression in medical settings.
Collapse
Affiliation(s)
- Feng Liu
- College of Electronic Information and Optical Engineering, Nankai University, Haihe Education Park, 38 Tongyan Road, Jinnan District, Tianjin 300353, P. R. China
| | - Miguel Hernandez-Cabronero
- Department of Electrical and Computer Engineering, The University of Arizona; 1230 E. Speedway Blvd, Tucson, AZ, 85721, U.S.A
| | - Victor Sanchez
- Department of Computer Science, University of Warwick, Coventry, CV4 7AL, United Kingdom
| | - Michael W. Marcellin
- Department of Electrical and Computer Engineering, The University of Arizona; 1230 E. Speedway Blvd, Tucson, AZ, 85721, U.S.A
| | - Ali Bilgin
- Department of Electrical and Computer Engineering, The University of Arizona; 1230 E. Speedway Blvd, Tucson, AZ, 85721, U.S.A
- Department of Biomedical Engineering, The University of Arizona; 1127 E. James E. Rogers Way, Tucson, AZ, 85721, U.S.A
- Department of Medical Imaging, The University of Arizona; 1501 N. Campbell Ave., Tucson, AZ, 85724, U.S.A
| |
Collapse
|
5
|
Wunderlich A, Goossens B, Abbey CK. Optimal Joint Detection and Estimation That Maximizes ROC-Type Curves. IEEE TRANSACTIONS ON MEDICAL IMAGING 2016; 35:2164-73. [PMID: 27093544 PMCID: PMC5555688 DOI: 10.1109/tmi.2016.2553001] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/07/2023]
Abstract
Combined detection-estimation tasks are frequently encountered in medical imaging. Optimal methods for joint detection and estimation are of interest because they provide upper bounds on observer performance, and can potentially be utilized for imaging system optimization, evaluation of observer efficiency, and development of image formation algorithms. We present a unified Bayesian framework for decision rules that maximize receiver operating characteristic (ROC)-type summary curves, including ROC, localization ROC (LROC), estimation ROC (EROC), free-response ROC (FROC), alternative free-response ROC (AFROC), and exponentially-transformed FROC (EFROC) curves, succinctly summarizing previous results. The approach relies on an interpretation of ROC-type summary curves as plots of an expected utility versus an expected disutility (or penalty) for signal-present decisions. We propose a general utility structure that is flexible enough to encompass many ROC variants and yet sufficiently constrained to allow derivation of a linear expected utility equation that is similar to that for simple binary detection. We illustrate our theory with an example comparing decision strategies for joint detection-estimation of a known signal with unknown amplitude. In addition, building on insights from our utility framework, we propose new ROC-type summary curves and associated optimal decision rules for joint detection-estimation tasks with an unknown, potentially-multiple, number of signals in each observation.
Collapse
|
6
|
|
7
|
Frouin F, Cazuguel G. French Ph. D. prizes for Biomedical Engineering: Insights into the 2013 edition. Ing Rech Biomed 2014. [DOI: 10.1016/j.irbm.2014.08.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
8
|
Zhang L, Goossens B, Cavaro-Ménard C, Le Callet P, Ge D. Channelized model observer for the detection and estimation of signals with unknown amplitude, orientation, and size. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2013; 30:2422-2432. [PMID: 24322945 DOI: 10.1364/josaa.30.002422] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
As a task-based approach for medical image quality assessment, model observers (MOs) have been proposed as surrogates for human observers. While most MOs treat only signal-known-exactly tasks, there are few studies on signal-known-statistically (SKS) MOs, which are clinically more relevant. In this paper, we present a new SKS MO named channelized joint detection and estimation observer (CJO), capable of detecting and estimating signals with unknown amplitude, orientation, and size. We evaluate its estimation and detection performance using both synthesized (correlated Gaussian) backgrounds and real clinical (magnetic resonance) backgrounds. The results suggest that the CJO has good performance in the SKS detection-estimation task.
Collapse
|
9
|
Ramani S, Weller DS, Nielsen JF, Fessler JA. Non-cartesian MRI reconstruction with automatic regularization Via Monte-Carlo SURE. IEEE TRANSACTIONS ON MEDICAL IMAGING 2013; 32:1411-1422. [PMID: 23591478 PMCID: PMC3735835 DOI: 10.1109/tmi.2013.2257829] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
Magnetic resonance image (MRI) reconstruction from undersampled k-space data requires regularization to reduce noise and aliasing artifacts. Proper application of regularization however requires appropriate selection of associated regularization parameters. In this work, we develop a data-driven regularization parameter adjustment scheme that minimizes an estimate [based on the principle of Stein's unbiased risk estimate (SURE)] of a suitable weighted squared-error measure in k-space. To compute this SURE-type estimate, we propose a Monte-Carlo scheme that extends our previous approach to inverse problems (e.g., MRI reconstruction) involving complex-valued images. Our approach depends only on the output of a given reconstruction algorithm and does not require knowledge of its internal workings, so it is capable of tackling a wide variety of reconstruction algorithms and nonquadratic regularizers including total variation and those based on the l1-norm. Experiments with simulated and real MR data indicate that the proposed approach is capable of providing near mean squared-error optimal regularization parameters for single-coil undersampled non-Cartesian MRI reconstruction.
Collapse
Affiliation(s)
- Sathish Ramani
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI, U.S.A
| | - Daniel S. Weller
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI, U.S.A
| | | | - Jeffrey A. Fessler
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI, U.S.A
| |
Collapse
|