1
|
Ueda Y, Ogawa D, Ishida T. Patient Re-Identification Based on Deep Metric Learning in Trunk Computed Tomography Images Acquired from Devices from Different Vendors. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:1124-1136. [PMID: 38366292 PMCID: PMC11169436 DOI: 10.1007/s10278-024-01017-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Revised: 12/05/2023] [Accepted: 12/27/2023] [Indexed: 02/18/2024]
Abstract
During radiologic interpretation, radiologists read patient identifiers from the metadata of medical images to recognize the patient being examined. However, it is challenging for radiologists to identify "incorrect" metadata and patient identification errors. We propose a method that uses a patient re-identification technique to link correct metadata to an image set of computed tomography images of a trunk with lost or wrongly assigned metadata. This method is based on a feature vector matching technique that uses a deep feature extractor to adapt to the cross-vendor domain contained in the scout computed tomography image dataset. To identify "incorrect" metadata, we calculated the highest similarity score between a follow-up image and a stored baseline image linked to the correct metadata. The re-identification performance tests whether the image with the highest similarity score belongs to the same patient, i.e., whether the metadata attached to the image are correct. The similarity scores between the follow-up and baseline images for the same "correct" patients were generally greater than those for "incorrect" patients. The proposed feature extractor was sufficiently robust to extract individual distinguishable features without additional training, even for unknown scout computed tomography images. Furthermore, the proposed augmentation technique further improved the re-identification performance of the subset for different vendors by incorporating changes in width magnification due to changes in patient table height during each examination. We believe that metadata checking using the proposed method would help detect the metadata with an "incorrect" patient identifier assigned due to unavoidable errors such as human error.
Collapse
Affiliation(s)
- Yasuyuki Ueda
- Division of Health Sciences, Graduate School of Medicine, Osaka University, 1-7 Yamadaoka, Suita, Osaka, 565-0871, Japan.
| | - Daiki Ogawa
- School of Allied Health Sciences, Faculty of Medicine, Osaka University, 1-7 Yamadaoka, Suita, Osaka, 565-0871, Japan
| | - Takayuki Ishida
- Division of Health Sciences, Graduate School of Medicine, Osaka University, 1-7 Yamadaoka, Suita, Osaka, 565-0871, Japan
| |
Collapse
|
2
|
Ueda Y, Morishita J. Patient Identification Based on Deep Metric Learning for Preventing Human Errors in Follow-up X-Ray Examinations. J Digit Imaging 2023; 36:1941-1953. [PMID: 37308675 PMCID: PMC10501972 DOI: 10.1007/s10278-023-00850-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Revised: 05/08/2023] [Accepted: 05/10/2023] [Indexed: 06/14/2023] Open
Abstract
Biological fingerprints extracted from clinical images can be used for patient identity verification to determine misfiled clinical images in picture archiving and communication systems. However, such methods have not been incorporated into clinical use, and their performance can degrade with variability in the clinical images. Deep learning can be used to improve the performance of these methods. A novel method is proposed to automatically identify individuals among examined patients using posteroanterior (PA) and anteroposterior (AP) chest X-ray images. The proposed method uses deep metric learning based on a deep convolutional neural network (DCNN) to overcome the extreme classification requirements for patient validation and identification. It was trained on the NIH chest X-ray dataset (ChestX-ray8) in three steps: preprocessing, DCNN feature extraction with an EfficientNetV2-S backbone, and classification with deep metric learning. The proposed method was evaluated using two public datasets and two clinical chest X-ray image datasets containing data from patients undergoing screening and hospital care. A 1280-dimensional feature extractor pretrained for 300 epochs performed the best with an area under the receiver operating characteristic curve of 0.9894, an equal error rate of 0.0269, and a top-1 accuracy of 0.839 on the PadChest dataset containing both PA and AP view positions. The findings of this study provide considerable insights into the development of automated patient identification to reduce the possibility of medical malpractice due to human errors.
Collapse
Affiliation(s)
- Yasuyuki Ueda
- Department of Medical Physics and Engineering, Area of Medical Imaging Technology and Science, Graduate School of Medicine, Division of Health Sciences, Osaka University, Osaka, Japan.
| | - Junji Morishita
- Department of Health Sciences, Faculty of Medical Sciences, Kyushu University, Fukuoka, Japan
| |
Collapse
|
3
|
Ueda Y, Morishita J, Kudomi S. Biological fingerprint for patient verification using trunk scout views at various scan ranges in computed tomography. Radiol Phys Technol 2022; 15:398-408. [PMID: 36155890 DOI: 10.1007/s12194-022-00682-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2022] [Revised: 09/21/2022] [Accepted: 09/22/2022] [Indexed: 10/14/2022]
Abstract
Immediate verification of whether a patient being examined is correct is desirable, even if the scan ranges change during different examinations for the same patient. This study proposes an advanced biological fingerprint technique for the rapid and reliable verification of various scan ranges in computed tomography (CT) scans of the torso of the same patient. The method comprises the following steps: geometric correction of different scans, local feature extraction, mismatch elimination, and similarity evaluation. The geometric magnification correction was aligned at the scanner table height in the first two steps, and the local maxima were calculated as the local features. In the third step, local features from the follow-up scout image are matched to those in the corresponding baseline scout image via template matching and outlier elimination via a robust estimator. We evaluated the correspondence rate based on the inlier ratio between corresponding scout images. The ratio of inliers between the baseline and follow-up scout images was assessed as the similarity score. The clinical dataset, including chest, abdomen-pelvis, and chest-abdomen-pelvis scans, included 600 patients (372 men, 68 ± 12 years) who underwent two routine torso CT examinations. The highest area under the receiver operating characteristic curve (AUC) was 0.996, which was sufficient for patient verification. Moreover, the verification results were comparable to the conventional method, which uses scout images in the same scan range. Patient identity verification was achieved before the main scan, even in follow-up torso CT, under different scan ranges.
Collapse
Affiliation(s)
- Yasuyuki Ueda
- Department of Medical Physics and Engineering, Area of Medical Imaging Technology and Science, Division of Health Sciences, Graduate School of Medicine, Osaka University, 1-7 Yamadaoka, Suita, Osaka, 565-0871, Japan.
| | - Junji Morishita
- Department of Health Sciences, Faculty of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-Ku, Fukuoka, Fukuoka, 812-8582, Japan
| | - Shohei Kudomi
- Department of Radiological Technology, Yamaguchi University Hospital, 1-1-1 Minamikogushi, Ube, Yamaguchi, 755-8505, Japan
| |
Collapse
|
4
|
Morishita J, Ueda Y. [Recent Review Article in Radiological Physics and Technology]. Nihon Hoshasen Gijutsu Gakkai Zasshi 2021; 77:876-878. [PMID: 34421077 DOI: 10.6009/jjrt.2021_jsrt_77.8.876] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
5
|
Abstract
Biometric registration may improve services associated with HIV research. A cross-sectional, observational survey was used to evaluate biometric fingerprint scanning for identification (ID) verification in the setting of an HIV prevention study. Survey outcomes were dichotomized (discouraged or not discouraged) by biometric scanning and statistical analyses were used to determine if participation decreased by greater than 10% overall and after stratifying by demographic variables and risk behaviors. 206 participants were recruited from a community-based HIV and sexual health research screening program. Participants completed a quantitative survey to assess their perceptions of biometric scanning for ID verification. The majority of participants (n = 160; 77.7%) indicated no deterrence from testing due to biometric scanning, yet a significant number (n = 45; 23.3%, P < .001) reported at least partial deterrence. Research using biometric scanning for ID verification may significantly limit access to HIV prevention services and may risk reducing meaningful participation among marginalized populations.
Collapse
Affiliation(s)
- Matthew P Abrams
- College of Medicine, University of Central Florida, Orlando, FL, USA.
| | | | - Susan J Little
- Division of Infectious Diseases and Global Public Health, University of California, San Diego, CA, USA.
| |
Collapse
|
6
|
Morishita J, Ueda Y. New solutions for automated image recognition and identification: challenges to radiologic technology and forensic pathology. Radiol Phys Technol 2021; 14:123-133. [PMID: 33710498 DOI: 10.1007/s12194-021-00611-9] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2021] [Revised: 02/26/2021] [Accepted: 02/28/2021] [Indexed: 11/30/2022]
Abstract
This paper outlines the history of biometrics for personal identification, the current status of the initial biological fingerprint techniques for digital chest radiography, and patient verification during medical imaging, such as computed tomography and magnetic resonance imaging. Automated image recognition and identification developed for clinical images without metadata could also be applied to the identification of victims in mass disasters or other unidentified individuals. The development of methods that are adaptive to a wide range of recent imaging modalities in the fields of radiologic technology, patient safety, forensic pathology, and forensic odontology is still in its early stages. However, its importance in practice will continue to increase in the future.
Collapse
Affiliation(s)
- Junji Morishita
- Department of Health Sciences, Faculty of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-ku, Fukuoka, Fukuoka, 812-8582, Japan.
| | - Yasuyuki Ueda
- Department of Medical Physics and Engineering, Area of Medical Imaging Technology and Science, Division of Health Sciences, Graduate School of Medicine, Osaka University, 1-7 Yamadaoka, Suita, Osaka, 565-0871, Japan.
| |
Collapse
|
7
|
Ueda Y, Morishita J, Hongyo T. Biological fingerprint using scout computed tomographic images for positive patient identification. Med Phys 2019; 46:4600-4609. [PMID: 31442297 DOI: 10.1002/mp.13779] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2019] [Revised: 08/16/2019] [Accepted: 08/16/2019] [Indexed: 11/12/2022] Open
Abstract
PURPOSE Management of patient identification is an important issue that should be addressed to ensure patient safety while using modern healthcare systems. Patient identification errors can be mainly attributed to human errors or system problems. An error-tolerant system, such as a biometric system, should be able to prevent or mitigate potential misidentification occurrences. Herein, we propose the use of scout computed tomography (CT) images for biometric patient identity verification and present the quantitative accuracy outcomes of using this technique in a clinical setting. METHODS Scout CT images acquired from routine examinations of the chest, abdomen, and pelvis were used as biological fingerprints. We evaluated the resemblance of the follow-up with the baseline image by comparing the estimates of the image characteristics using local feature extraction and matching algorithms. The verification performance was evaluated according to the receiver operating characteristic (ROC) curves, area under the ROC curves (AUC), and equal error rates (EER). The closed-set identification performance was evaluated according to the cumulative match characteristic curves and rank-one identification rates (R1). RESULTS A total of 619 (383 males, 236 females, age range 21-92 years) patients who underwent baseline and follow-up chest-abdomen-pelvis CT scans on the same CT system were analyzed for verification and closed-set identification. The highest performances of AUC, EER, and R1 were 0.998, 1.22%, and 99.7%, respectively, in the considered evaluation range. Furthermore, to determine whether the performance decreased in the presence of metal artifacts, the patients were classified into two groups, namely scout images with (255 patients) and without (364 patients) metal artifacts, and the significance test was performed for two ROC curves using the unpaired Delong's test. No significant differences were found between the ROC performances in the presence and absence of metal artifacts when using a sufficient number of local features. Our proposed technique demonstrated that the performance was comparable to that of conventional biometrics methods when using chest, abdomen, and pelvis scout CT images. Thus, this method has the potential to discover inadequate patient information using the available chest, abdomen, and pelvis scout CT image; moreover, it can be applied widely to routine adult CT scans where no significant body structure effects due to illness or aging are present. CONCLUSIONS Our proposed method can obtain accurate patient information available at the point-of-care and help healthcare providers verify whether a patient's identity is matched accurately. We believe the method to be a key solution for patient misidentification problems.
Collapse
Affiliation(s)
- Yasuyuki Ueda
- Division of Health Sciences, Graduate School of Medicine, Osaka University, 1-7 Yamadaoka, Suita, Osaka, 565-0871, Japan
| | - Junji Morishita
- Department of Health Sciences, Faculty of Medical Sciences, Kyushu University, 3-1-1, Maidashi, Higashi-ku, Fukuoka, 812-8582, Japan
| | - Tadashi Hongyo
- Division of Health Sciences, Graduate School of Medicine, Osaka University, 1-7 Yamadaoka, Suita, Osaka, 565-0871, Japan
| |
Collapse
|
8
|
Kawazoe Y, Morishita J, Matsunobu Y, Okumura M, Shin S, Usumoto Y, Ikeda N. A simple method for semi-automatic readjustment for positioning in post-mortem head computed tomography imaging. ACTA ACUST UNITED AC 2019. [DOI: 10.1016/j.jofri.2019.01.004] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
9
|
Shimizu Y, Morishita J. Development of a method of automated extraction of biological fingerprints from chest radiographs as preprocessing of patient recognition and identification. Radiol Phys Technol 2017; 10:376-381. [DOI: 10.1007/s12194-017-0400-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2016] [Revised: 04/17/2017] [Accepted: 04/23/2017] [Indexed: 10/19/2022]
|
10
|
Bigler ED. Systems Biology, Neuroimaging, Neuropsychology, Neuroconnectivity and Traumatic Brain Injury. Front Syst Neurosci 2016; 10:55. [PMID: 27555810 PMCID: PMC4977319 DOI: 10.3389/fnsys.2016.00055] [Citation(s) in RCA: 36] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2016] [Accepted: 06/08/2016] [Indexed: 01/03/2023] Open
Abstract
The patient who sustains a traumatic brain injury (TBI) typically undergoes neuroimaging studies, usually in the form of computed tomography (CT) and magnetic resonance imaging (MRI). In most cases the neuroimaging findings are clinically assessed with descriptive statements that provide qualitative information about the presence/absence of visually identifiable abnormalities; though little if any of the potential information in a scan is analyzed in any quantitative manner, except in research settings. Fortunately, major advances have been made, especially during the last decade, in regards to image quantification techniques, especially those that involve automated image analysis methods. This review argues that a systems biology approach to understanding quantitative neuroimaging findings in TBI provides an appropriate framework for better utilizing the information derived from quantitative neuroimaging and its relation with neuropsychological outcome. Different image analysis methods are reviewed in an attempt to integrate quantitative neuroimaging methods with neuropsychological outcome measures and to illustrate how different neuroimaging techniques tap different aspects of TBI-related neuropathology. Likewise, how different neuropathologies may relate to neuropsychological outcome is explored by examining how damage influences brain connectivity and neural networks. Emphasis is placed on the dynamic changes that occur following TBI and how best to capture those pathologies via different neuroimaging methods. However, traditional clinical neuropsychological techniques are not well suited for interpretation based on contemporary and advanced neuroimaging methods and network analyses. Significant improvements need to be made in the cognitive and behavioral assessment of the brain injured individual to better interface with advances in neuroimaging-based network analyses. By viewing both neuroimaging and neuropsychological processes within a systems biology perspective could represent a significant advancement for the field.
Collapse
Affiliation(s)
- Erin D. Bigler
- Department of Psychology, Neuroscience Center, Brigham Young UniversityProvo, UT, USA
| |
Collapse
|