1
|
Horkaew P, Chansangrat J, Keeratibharat N, Le DC. Recent advances in computerized imaging and its vital roles in liver disease diagnosis, preoperative planning, and interventional liver surgery: A review. World J Gastrointest Surg 2023; 15:2382-2397. [PMID: 38111769 PMCID: PMC10725533 DOI: 10.4240/wjgs.v15.i11.2382] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Revised: 08/30/2023] [Accepted: 09/27/2023] [Indexed: 11/26/2023] Open
Abstract
The earliest and most accurate detection of the pathological manifestations of hepatic diseases ensures effective treatments and thus positive prognostic outcomes. In clinical settings, screening and determining the extent of a pathology are prominent factors in preparing remedial agents and administering appropriate therapeutic procedures. Moreover, in a patient undergoing liver resection, a realistic preoperative simulation of the subject-specific anatomy and physiology also plays a vital part in conducting initial assessments, making surgical decisions during the procedure, and anticipating postoperative results. Conventionally, various medical imaging modalities, e.g., computed tomography, magnetic resonance imaging, and positron emission tomography, have been employed to assist in these tasks. In fact, several standardized procedures, such as lesion detection and liver segmentation, are also incorporated into prominent commercial software packages. Thus far, most integrated software as a medical device typically involves tedious interactions from the physician, such as manual delineation and empirical adjustments, as per a given patient. With the rapid progress in digital health approaches, especially medical image analysis, a wide range of computer algorithms have been proposed to facilitate those procedures. They include pattern recognition of a liver, its periphery, and lesion, as well as pre- and postoperative simulations. Prior to clinical adoption, however, software must conform to regulatory requirements set by the governing agency, for instance, valid clinical association and analytical and clinical validation. Therefore, this paper provides a detailed account and discussion of the state-of-the-art methods for liver image analyses, visualization, and simulation in the literature. Emphasis is placed upon their concepts, algorithmic classifications, merits, limitations, clinical considerations, and future research trends.
Collapse
Affiliation(s)
- Paramate Horkaew
- School of Computer Engineering, Suranaree University of Technology, Nakhon Ratchasima 30000, Thailand
| | - Jirapa Chansangrat
- School of Radiology, Institute of Medicine, Suranaree University of Technology, Nakhon Ratchasima 30000, Thailand
| | - Nattawut Keeratibharat
- School of Surgery, Institute of Medicine, Suranaree University of Technology, Nakhon Ratchasima 30000, Thailand
| | - Doan Cong Le
- Faculty of Information Technology, An Giang University, Vietnam National University (Ho Chi Minh City), An Giang 90000, Vietnam
| |
Collapse
|
2
|
Xu X, Chen Y, Wu J, Lu J, Ye Y, Huang Y, Dou X, Li K, Wang G, Zhang S, Gong W. A novel one-to-multiple unsupervised domain adaptation framework for abdominal organ segmentation. Med Image Anal 2023; 88:102873. [PMID: 37421932 DOI: 10.1016/j.media.2023.102873] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Revised: 03/24/2023] [Accepted: 06/12/2023] [Indexed: 07/10/2023]
Abstract
Abdominal multi-organ segmentation in multi-sequence magnetic resonance images (MRI) is of great significance in many clinical scenarios, e.g., MRI-oriented pre-operative treatment planning. Labeling multiple organs on a single MR sequence is a time-consuming and labor-intensive task, let alone manual labeling on multiple MR sequences. Training a model by one sequence and generalizing it to other domains is one way to reduce the burden of manual annotation, but the existence of domain gap often leads to poor generalization performance of such methods. Image translation-based unsupervised domain adaptation (UDA) is a common way to address this domain gap issue. However, existing methods focus less on keeping anatomical consistency and are limited by one-to-one domain adaptation, leading to low efficiency for adapting a model to multiple target domains. This work proposes a unified framework called OMUDA for one-to-multiple unsupervised domain-adaptive segmentation, where disentanglement between content and style is used to efficiently translate a source domain image into multiple target domains. Moreover, generator refactoring and style constraint are conducted in OMUDA for better maintaining cross-modality structural consistency and reducing domain aliasing. The average Dice Similarity Coefficients (DSCs) of OMUDA for multiple sequences and organs on the in-house test set, the AMOS22 dataset and the CHAOS dataset are 85.51%, 82.66% and 91.38%, respectively, which are slightly lower than those of CycleGAN(85.66% and 83.40%) in the first two data sets and slightly higher than CycleGAN(91.36%) in the last dataset. But compared with CycleGAN, OMUDA reduces floating-point calculations by about 87 percent in the training phase and about 30 percent in the inference stage respectively. The quantitative results in both segmentation performance and training efficiency demonstrate the usability of OMUDA in some practical scenes, such as the initial phase of product development.
Collapse
Affiliation(s)
- Xiaowei Xu
- SenseTime Research, Shanghai, China; School of Mechanical and Electrical Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Yinan Chen
- SenseTime Research, Shanghai, China; School of Mechanical and Electrical Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China; West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, Sichuan, China.
| | - Jianghao Wu
- School of Mechanical and Electrical Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Jiangshan Lu
- School of Mechanical and Electrical Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | | | | | - Xin Dou
- SenseBrain Technology, Princeton, NJ 08540, USA
| | - Kang Li
- Shanghai Artificial Intelligence Laboratory, Shanghai, China; West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, Sichuan, China; Med-X Center for Informatics, Sichuan University, Chengdu, Sichuan, China
| | - Guotai Wang
- School of Mechanical and Electrical Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China; Shanghai Artificial Intelligence Laboratory, Shanghai, China
| | - Shaoting Zhang
- SenseTime Research, Shanghai, China; School of Mechanical and Electrical Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China; Shanghai Artificial Intelligence Laboratory, Shanghai, China
| | - Wei Gong
- Department of General Surgery, Xinhua Hospital, Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200092, China; Shanghai Key Laboratory of Biliary Tract Disease Research, Shanghai, 200092, China
| |
Collapse
|
3
|
Bilic P, Christ P, Li HB, Vorontsov E, Ben-Cohen A, Kaissis G, Szeskin A, Jacobs C, Mamani GEH, Chartrand G, Lohöfer F, Holch JW, Sommer W, Hofmann F, Hostettler A, Lev-Cohain N, Drozdzal M, Amitai MM, Vivanti R, Sosna J, Ezhov I, Sekuboyina A, Navarro F, Kofler F, Paetzold JC, Shit S, Hu X, Lipková J, Rempfler M, Piraud M, Kirschke J, Wiestler B, Zhang Z, Hülsemeyer C, Beetz M, Ettlinger F, Antonelli M, Bae W, Bellver M, Bi L, Chen H, Chlebus G, Dam EB, Dou Q, Fu CW, Georgescu B, Giró-I-Nieto X, Gruen F, Han X, Heng PA, Hesser J, Moltz JH, Igel C, Isensee F, Jäger P, Jia F, Kaluva KC, Khened M, Kim I, Kim JH, Kim S, Kohl S, Konopczynski T, Kori A, Krishnamurthi G, Li F, Li H, Li J, Li X, Lowengrub J, Ma J, Maier-Hein K, Maninis KK, Meine H, Merhof D, Pai A, Perslev M, Petersen J, Pont-Tuset J, Qi J, Qi X, Rippel O, Roth K, Sarasua I, Schenk A, Shen Z, Torres J, Wachinger C, Wang C, Weninger L, Wu J, Xu D, Yang X, Yu SCH, Yuan Y, Yue M, Zhang L, Cardoso J, Bakas S, Braren R, Heinemann V, Pal C, Tang A, Kadoury S, Soler L, van Ginneken B, Greenspan H, Joskowicz L, Menze B. The Liver Tumor Segmentation Benchmark (LiTS). Med Image Anal 2023; 84:102680. [PMID: 36481607 PMCID: PMC10631490 DOI: 10.1016/j.media.2022.102680] [Citation(s) in RCA: 83] [Impact Index Per Article: 83.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2021] [Revised: 09/27/2022] [Accepted: 10/29/2022] [Indexed: 11/18/2022]
Abstract
In this work, we report the set-up and results of the Liver Tumor Segmentation Benchmark (LiTS), which was organized in conjunction with the IEEE International Symposium on Biomedical Imaging (ISBI) 2017 and the International Conferences on Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2017 and 2018. The image dataset is diverse and contains primary and secondary tumors with varied sizes and appearances with various lesion-to-background levels (hyper-/hypo-dense), created in collaboration with seven hospitals and research institutions. Seventy-five submitted liver and liver tumor segmentation algorithms were trained on a set of 131 computed tomography (CT) volumes and were tested on 70 unseen test images acquired from different patients. We found that not a single algorithm performed best for both liver and liver tumors in the three events. The best liver segmentation algorithm achieved a Dice score of 0.963, whereas, for tumor segmentation, the best algorithms achieved Dices scores of 0.674 (ISBI 2017), 0.702 (MICCAI 2017), and 0.739 (MICCAI 2018). Retrospectively, we performed additional analysis on liver tumor detection and revealed that not all top-performing segmentation algorithms worked well for tumor detection. The best liver tumor detection method achieved a lesion-wise recall of 0.458 (ISBI 2017), 0.515 (MICCAI 2017), and 0.554 (MICCAI 2018), indicating the need for further research. LiTS remains an active benchmark and resource for research, e.g., contributing the liver-related segmentation tasks in http://medicaldecathlon.com/. In addition, both data and online evaluation are accessible via https://competitions.codalab.org/competitions/17094.
Collapse
Affiliation(s)
- Patrick Bilic
- Department of Informatics, Technical University of Munich, Germany
| | - Patrick Christ
- Department of Informatics, Technical University of Munich, Germany
| | - Hongwei Bran Li
- Department of Informatics, Technical University of Munich, Germany; Department of Quantitative Biomedicine, University of Zurich, Switzerland.
| | | | - Avi Ben-Cohen
- Department of Biomedical Engineering, Tel-Aviv University, Israel
| | - Georgios Kaissis
- Institute for AI in Medicine, Technical University of Munich, Germany; Institute for diagnostic and interventional radiology, Klinikum rechts der Isar, Technical University of Munich, Germany; Department of Computing, Imperial College London, London, United Kingdom
| | - Adi Szeskin
- School of Computer Science and Engineering, the Hebrew University of Jerusalem, Israel
| | - Colin Jacobs
- Department of Medical Imaging, Radboud University Medical Center, Nijmegen, The Netherlands
| | | | - Gabriel Chartrand
- The University of Montréal Hospital Research Centre (CRCHUM) Montréal, Québec, Canada
| | - Fabian Lohöfer
- Institute for diagnostic and interventional radiology, Klinikum rechts der Isar, Technical University of Munich, Germany
| | - Julian Walter Holch
- Department of Medicine III, University Hospital, LMU Munich, Munich, Germany; Comprehensive Cancer Center Munich, Munich, Germany; Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Wieland Sommer
- Department of Radiology, University Hospital, LMU Munich, Germany
| | - Felix Hofmann
- Department of General, Visceral and Transplantation Surgery, University Hospital, LMU Munich, Germany; Department of Radiology, University Hospital, LMU Munich, Germany
| | - Alexandre Hostettler
- Department of Surgical Data Science, Institut de Recherche contre les Cancers de l'Appareil Digestif (IRCAD), France
| | - Naama Lev-Cohain
- Department of Radiology, Hadassah University Medical Center, Jerusalem, Israel
| | | | | | | | - Jacob Sosna
- Department of Radiology, Hadassah University Medical Center, Jerusalem, Israel
| | - Ivan Ezhov
- Department of Informatics, Technical University of Munich, Germany
| | - Anjany Sekuboyina
- Department of Informatics, Technical University of Munich, Germany; Department of Quantitative Biomedicine, University of Zurich, Switzerland
| | - Fernando Navarro
- Department of Informatics, Technical University of Munich, Germany; Department of Radiation Oncology and Radiotherapy, Klinikum rechts der Isar, Technical University of Munich, Germany; TranslaTUM - Central Institute for Translational Cancer Research, Technical University of Munich, Germany
| | - Florian Kofler
- Department of Informatics, Technical University of Munich, Germany; Institute for diagnostic and interventional neuroradiology, Klinikum rechts der Isar,Technical University of Munich, Germany; Helmholtz AI, Helmholtz Zentrum München, Neuherberg, Germany; TranslaTUM - Central Institute for Translational Cancer Research, Technical University of Munich, Germany
| | - Johannes C Paetzold
- Department of Computing, Imperial College London, London, United Kingdom; Institute for Tissue Engineering and Regenerative Medicine, Helmholtz Zentrum München, Neuherberg, Germany
| | - Suprosanna Shit
- Department of Informatics, Technical University of Munich, Germany
| | - Xiaobin Hu
- Department of Informatics, Technical University of Munich, Germany
| | - Jana Lipková
- Brigham and Women's Hospital, Harvard Medical School, USA
| | - Markus Rempfler
- Department of Informatics, Technical University of Munich, Germany
| | - Marie Piraud
- Department of Informatics, Technical University of Munich, Germany; Helmholtz AI, Helmholtz Zentrum München, Neuherberg, Germany
| | - Jan Kirschke
- Institute for diagnostic and interventional neuroradiology, Klinikum rechts der Isar,Technical University of Munich, Germany
| | - Benedikt Wiestler
- Institute for diagnostic and interventional neuroradiology, Klinikum rechts der Isar,Technical University of Munich, Germany
| | - Zhiheng Zhang
- Department of Hepatobiliary Surgery, the Affiliated Drum Tower Hospital of Nanjing University Medical School, China
| | | | - Marcel Beetz
- Department of Informatics, Technical University of Munich, Germany
| | | | - Michela Antonelli
- School of Biomedical Engineering & Imaging Sciences, King's College London, London, UK
| | | | | | - Lei Bi
- School of Computer Science, the University of Sydney, Australia
| | - Hao Chen
- Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, China
| | - Grzegorz Chlebus
- Fraunhofer MEVIS, Bremen, Germany; Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Erik B Dam
- Department of Computer Science, University of Copenhagen, Denmark
| | - Qi Dou
- Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China
| | - Chi-Wing Fu
- Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China
| | | | - Xavier Giró-I-Nieto
- Signal Theory and Communications Department, Universitat Politecnica de Catalunya, Catalonia, Spain
| | - Felix Gruen
- Institute of Control Engineering, Technische Universität Braunschweig, Germany
| | - Xu Han
- Department of computer science, UNC Chapel Hill, USA
| | - Pheng-Ann Heng
- Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China
| | - Jürgen Hesser
- Mannheim Institute for Intelligent Systems in Medicine, department of Medicine Mannheim, Heidelberg University, Germany; Interdisciplinary Center for Scientific Computing (IWR), Heidelberg University, Germany; Central Institute for Computer Engineering (ZITI), Heidelberg University, Germany
| | | | - Christian Igel
- Department of Computer Science, University of Copenhagen, Denmark
| | - Fabian Isensee
- Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany; Helmholtz Imaging, Germany
| | - Paul Jäger
- Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany; Helmholtz Imaging, Germany
| | - Fucang Jia
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, China
| | - Krishna Chaitanya Kaluva
- Medical Imaging and Reconstruction Lab, Department of Engineering Design, Indian Institute of Technology Madras, India
| | - Mahendra Khened
- Medical Imaging and Reconstruction Lab, Department of Engineering Design, Indian Institute of Technology Madras, India
| | | | - Jae-Hun Kim
- Department of Radiology, Samsung Medical Center, Sungkyunkwan University School of Medicine, South Korea
| | | | - Simon Kohl
- Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Tomasz Konopczynski
- Interdisciplinary Center for Scientific Computing (IWR), Heidelberg University, Germany
| | - Avinash Kori
- Medical Imaging and Reconstruction Lab, Department of Engineering Design, Indian Institute of Technology Madras, India
| | - Ganapathy Krishnamurthi
- Medical Imaging and Reconstruction Lab, Department of Engineering Design, Indian Institute of Technology Madras, India
| | - Fan Li
- Sensetime, Shanghai, China
| | - Hongchao Li
- Department of Computer Science, Guangdong University of Foreign Studies, China
| | - Junbo Li
- Philips Research China, Philips China Innovation Campus, Shanghai, China
| | - Xiaomeng Li
- Department of Electrical and Electronic Engineering, The University of Hong Kong, China
| | - John Lowengrub
- Departments of Mathematics, Biomedical Engineering, University of California, Irvine, USA; Center for Complex Biological Systems, University of California, Irvine, USA; Chao Family Comprehensive Cancer Center, University of California, Irvine, USA
| | - Jun Ma
- Department of Mathematics, Nanjing University of Science and Technology, China
| | - Klaus Maier-Hein
- Pattern Analysis and Learning Group, Department of Radiation Oncology, Heidelberg University Hospital, Heidelberg, Germany; Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany; Helmholtz Imaging, Germany
| | | | - Hans Meine
- Fraunhofer MEVIS, Bremen, Germany; Medical Image Computing Group, FB3, University of Bremen, Germany
| | - Dorit Merhof
- Institute of Imaging & Computer Vision, RWTH Aachen University, Germany
| | - Akshay Pai
- Department of Computer Science, University of Copenhagen, Denmark
| | - Mathias Perslev
- Department of Computer Science, University of Copenhagen, Denmark
| | - Jens Petersen
- Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Jordi Pont-Tuset
- Eidgenössische Technische Hochschule Zurich (ETHZ), Zurich, Switzerland
| | - Jin Qi
- School of Information and Communication Engineering, University of Electronic Science and Technology of China, China
| | - Xiaojuan Qi
- Department of Electrical and Electronic Engineering, The University of Hong Kong, China
| | - Oliver Rippel
- Institute of Imaging & Computer Vision, RWTH Aachen University, Germany
| | | | - Ignacio Sarasua
- Institute for diagnostic and interventional radiology, Klinikum rechts der Isar, Technical University of Munich, Germany; Department of Child and Adolescent Psychiatry, Ludwig-Maximilians-Universität, Munich, Germany
| | - Andrea Schenk
- Fraunhofer MEVIS, Bremen, Germany; Institute for Diagnostic and Interventional Radiology, Hannover Medical School, Hannover, Germany
| | - Zengming Shen
- Beckman Institute, University of Illinois at Urbana-Champaign, USA; Siemens Healthineers, USA
| | - Jordi Torres
- Barcelona Supercomputing Center, Barcelona, Spain; Universitat Politecnica de Catalunya, Catalonia, Spain
| | - Christian Wachinger
- Department of Informatics, Technical University of Munich, Germany; Institute for diagnostic and interventional radiology, Klinikum rechts der Isar, Technical University of Munich, Germany; Department of Child and Adolescent Psychiatry, Ludwig-Maximilians-Universität, Munich, Germany
| | - Chunliang Wang
- Department of Biomedical Engineering and Health Systems, KTH Royal Institute of Technology, Sweden
| | - Leon Weninger
- Institute of Imaging & Computer Vision, RWTH Aachen University, Germany
| | - Jianrong Wu
- Tencent Healthcare (Shenzhen) Co., Ltd, China
| | | | - Xiaoping Yang
- Department of Mathematics, Nanjing University, China
| | - Simon Chun-Ho Yu
- Department of Imaging and Interventional Radiology, Chinese University of Hong Kong, Hong Kong, China
| | - Yading Yuan
- Department of Radiation Oncology, Icahn School of Medicine at Mount Sinai, NY, USA
| | - Miao Yue
- CGG Services (Singapore) Pte. Ltd., Singapore
| | - Liping Zhang
- Department of Imaging and Interventional Radiology, Chinese University of Hong Kong, Hong Kong, China
| | - Jorge Cardoso
- School of Biomedical Engineering & Imaging Sciences, King's College London, London, UK
| | - Spyridon Bakas
- Center for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania, PA, USA; Department of Radiology, Perelman School of Medicine, University of Pennsylvania, USA; Department of Pathology and Laboratory Medicine, Perelman School of Medicine, University of Pennsylvania, PA, USA
| | - Rickmer Braren
- German Cancer Consortium (DKTK), Germany; Institute for diagnostic and interventional radiology, Klinikum rechts der Isar, Technical University of Munich, Germany; Comprehensive Cancer Center Munich, Munich, Germany
| | - Volker Heinemann
- Department of Hematology/Oncology & Comprehensive Cancer Center Munich, LMU Klinikum Munich, Germany
| | | | - An Tang
- Department of Radiology, Radiation Oncology and Nuclear Medicine, University of Montréal, Canada
| | | | - Luc Soler
- Department of Surgical Data Science, Institut de Recherche contre les Cancers de l'Appareil Digestif (IRCAD), France
| | - Bram van Ginneken
- Department of Medical Imaging, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Hayit Greenspan
- Department of Biomedical Engineering, Tel-Aviv University, Israel
| | - Leo Joskowicz
- School of Computer Science and Engineering, the Hebrew University of Jerusalem, Israel
| | - Bjoern Menze
- Department of Informatics, Technical University of Munich, Germany; Department of Quantitative Biomedicine, University of Zurich, Switzerland
| |
Collapse
|
4
|
Deng C, Adu J, Xie S, Li Z, Meng Q, Zhang Q, Yin L, Peng B. Automatic segmentation of ultrasound images of carotid atherosclerotic plaque based on Dense-UNet. Technol Health Care 2023; 31:165-179. [PMID: 35964217 DOI: 10.3233/thc-220152] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
BACKGROUND Carotid atherosclerosis plaque rupture is an important cause of myocardial infarction and stroke. The effective segmentation of ultrasound images of carotid atherosclerotic plaques aids clinicians to accurately assess plaque stability. At present, this procedure relies mainly on the experience of the medical practitioner to manually segment the ultrasound image of the carotid atherosclerotic plaque. This method is also time-consuming. OBJECTIVE This study intends to establish an automatic intelligent segmentation method of ultrasound images of carotid plaque. METHODS The present study combined the U-Net and DenseNet networks, to automatically segment the ultrasound images of carotid atherosclerotic plaques. The same test set was selected and segmented using the traditional U-Net network and the ResUNet network. The prediction results of the three network models were compared using Dice (Dice similarity coefficient), and VOE (volumetric overlap error) coefficients. RESULTS Compared with the existing U-Net network and ResUNet network, the Dense-UNet network exhibited an optimal effect on the automated segmentation of the ultrasound images. CONCLUSION The Dense-UNet network could realize the automatic segmentation of atherosclerotic plaque ultrasound images, and it could assist medical practitioners in plaque evaluation.
Collapse
Affiliation(s)
- Chengliang Deng
- School of Software Engineering, Chengdu University of Information Technology, Chengdu, Sichuan, China
| | - Jianhua Adu
- School of Information Engineering, Kunming University, Kunming, Yunnan, China
| | - Shenghua Xie
- Ultrasound in Cardiac Electrophysiology and Biomechanics Key Laboratory of Sichuan Province, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China.,Department of Cardiovascular Ultrasound and Noninvasive Cardiology, Sichuan Academy of Medical Sciences and Sichuan Provincial People's Hospital, Chengdu, Sichuan, China
| | - Zhaohuan Li
- Ultrasound in Cardiac Electrophysiology and Biomechanics Key Laboratory of Sichuan Province, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China.,Department of Cardiovascular Ultrasound and Noninvasive Cardiology, Sichuan Academy of Medical Sciences and Sichuan Provincial People's Hospital, Chengdu, Sichuan, China
| | - Qingguo Meng
- Ultrasound in Cardiac Electrophysiology and Biomechanics Key Laboratory of Sichuan Province, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China.,Department of Cardiovascular Ultrasound and Noninvasive Cardiology, Sichuan Academy of Medical Sciences and Sichuan Provincial People's Hospital, Chengdu, Sichuan, China
| | - Qingfeng Zhang
- Ultrasound in Cardiac Electrophysiology and Biomechanics Key Laboratory of Sichuan Province, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China.,Department of Cardiovascular Ultrasound and Noninvasive Cardiology, Sichuan Academy of Medical Sciences and Sichuan Provincial People's Hospital, Chengdu, Sichuan, China
| | - Lixue Yin
- Ultrasound in Cardiac Electrophysiology and Biomechanics Key Laboratory of Sichuan Province, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China.,Department of Cardiovascular Ultrasound and Noninvasive Cardiology, Sichuan Academy of Medical Sciences and Sichuan Provincial People's Hospital, Chengdu, Sichuan, China
| | - Bo Peng
- Ultrasound in Cardiac Electrophysiology and Biomechanics Key Laboratory of Sichuan Province, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China.,Department of Cardiovascular Ultrasound and Noninvasive Cardiology, Sichuan Academy of Medical Sciences and Sichuan Provincial People's Hospital, Chengdu, Sichuan, China.,School of Computer Science, Southwest Petroleum University, Chengdu, Sichuan, China
| |
Collapse
|
5
|
Yang D, Li Y, Yu J. Multi-task thyroid tumor segmentation based on the joint loss function. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104249] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
6
|
Czipczer V, Manno-Kovacs A. Adaptable volumetric liver segmentation model for CT images using region-based features and convolutional neural network. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.07.024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
|
7
|
Ansari MY, Abdalla A, Ansari MY, Ansari MI, Malluhi B, Mohanty S, Mishra S, Singh SS, Abinahed J, Al-Ansari A, Balakrishnan S, Dakua SP. Practical utility of liver segmentation methods in clinical surgeries and interventions. BMC Med Imaging 2022; 22:97. [PMID: 35610600 PMCID: PMC9128093 DOI: 10.1186/s12880-022-00825-2] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2022] [Accepted: 05/09/2022] [Indexed: 12/15/2022] Open
Abstract
Clinical imaging (e.g., magnetic resonance imaging and computed tomography) is a crucial adjunct for clinicians, aiding in the diagnosis of diseases and planning of appropriate interventions. This is especially true in malignant conditions such as hepatocellular carcinoma (HCC), where image segmentation (such as accurate delineation of liver and tumor) is the preliminary step taken by the clinicians to optimize diagnosis, staging, and treatment planning and intervention (e.g., transplantation, surgical resection, radiotherapy, PVE, embolization, etc). Thus, segmentation methods could potentially impact the diagnosis and treatment outcomes. This paper comprehensively reviews the literature (during the year 2012–2021) for relevant segmentation methods and proposes a broad categorization based on their clinical utility (i.e., surgical and radiological interventions) in HCC. The categorization is based on the parameters such as precision, accuracy, and automation.
Collapse
|
8
|
Amin J, Anjum MA, Sharif M, Kadry S, Nadeem A, Ahmad SF. Liver Tumor Localization Based on YOLOv3 and 3D-Semantic Segmentation Using Deep Neural Networks. Diagnostics (Basel) 2022; 12:diagnostics12040823. [PMID: 35453870 PMCID: PMC9025116 DOI: 10.3390/diagnostics12040823] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Revised: 03/18/2022] [Accepted: 03/22/2022] [Indexed: 12/17/2022] Open
Abstract
Worldwide, more than 1.5 million deaths are occur due to liver cancer every year. The use of computed tomography (CT) for early detection of liver cancer could save millions of lives per year. There is also an urgent need for a computerized method to interpret, detect and analyze CT scans reliably, easily, and correctly. However, precise segmentation of minute tumors is a difficult task because of variation in the shape, intensity, size, low contrast of the tumor, and the adjacent tissues of the liver. To address these concerns, a model comprised of three parts: synthetic image generation, localization, and segmentation, is proposed. An optimized generative adversarial network (GAN) is utilized for generation of synthetic images. The generated images are localized by using the improved localization model, in which deep features are extracted from pre-trained Resnet-50 models and fed into a YOLOv3 detector as an input. The proposed modified model localizes and classifies the minute liver tumor with 0.99 mean average precision (mAp). The third part is segmentation, in which pre-trained Inceptionresnetv2 employed as a base-Network of Deeplabv3 and subsequently is trained on fine-tuned parameters with annotated ground masks. The experiments reflect that the proposed approach has achieved greater than 95% accuracy in the testing phase and it is proven that, in comparison to the recently published work in this domain, this research has localized and segmented the liver and minute liver tumor with more accuracy.
Collapse
Affiliation(s)
- Javaria Amin
- Department of Computer Science, University of Wah, Wah Cantt 47040, Pakistan;
| | | | - Muhammad Sharif
- Department of Computer Science, Comsats University Islamabad, Wah Campus, Wah Cantt 47040, Pakistan;
| | - Seifedine Kadry
- Department of Applied Data Science, Noroff University College, 4609 Kristiansand, Norway
- Correspondence:
| | - Ahmed Nadeem
- Department of Pharmacology & Toxicology, College of Pharmacy, King Saud University, P.O. Box 2455, Riyadh 11451, Saudi Arabia; (A.N.); (S.F.A.)
| | - Sheikh F. Ahmad
- Department of Pharmacology & Toxicology, College of Pharmacy, King Saud University, P.O. Box 2455, Riyadh 11451, Saudi Arabia; (A.N.); (S.F.A.)
| |
Collapse
|
9
|
Wang X, Zhang Z, Wu K, Yin X, Guo H. Gabor Dictionary of Sparse Image Patches Selected in Prior Boundaries for 3D Liver Segmentation in CT Images. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:5552864. [PMID: 34925736 PMCID: PMC8677387 DOI: 10.1155/2021/5552864] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/21/2021] [Revised: 06/26/2021] [Accepted: 10/04/2021] [Indexed: 11/17/2022]
Abstract
The gray contrast between the liver and other soft tissues is low, and the boundary is not obvious. As a result, it is still a challenging task to accurately segment the liver from CT images. In recent years, methods of machine learning have become a research hotspot in the field of medical image segmentation because they can effectively use the "gold standard" personalized features of the liver from different data. However, machine learning usually requires a large number of data samples to train the model and improve the accuracy of medical image segmentation. This paper proposed a method for liver segmentation based on the Gabor dictionary of sparse image blocks with prior boundaries. This method reduced the number of samples by selecting the test sample set within the initial boundary area of the liver. The Gabor feature was extracted and the query dictionary was created, and the sparse coefficient was calculated to obtain the boundary information of the liver. By optimizing the reconstruction error and filling holes, a smooth liver boundary was obtained. The proposed method was tested on the MICCAI 2007 dataset and ISBI2017 dataset, and five measures were used to evaluate the results. The proposed method was compared with methods for liver segmentation proposed in recent years. The experimental results show that this method can improve the accuracy of liver segmentation and effectively repair the discontinuity and local overlap of segmentation results.
Collapse
Affiliation(s)
- Xuehu Wang
- College of Electronic and Information Engineering, Hebei University, Baoding 071002, China
- Research Center of Machine Vision Engineering and Technology of Hebei Province, Baoding 071002, China
- Key Laboratory of Digital Medical Engineering of Hebei Province, Baoding 071002, China
| | - Zhiling Zhang
- College of Electronic and Information Engineering, Hebei University, Baoding 071002, China
- Research Center of Machine Vision Engineering and Technology of Hebei Province, Baoding 071002, China
- Key Laboratory of Digital Medical Engineering of Hebei Province, Baoding 071002, China
| | - Kunlun Wu
- Hebei Research Institute of Construction and Geotechnical Investigation Co.,Ltd., Shijiazhuang, Hebei, China
| | - Xiaoping Yin
- Affiliated Hospital of Hebei University, Baoding 071000, China
| | - Haifeng Guo
- College of Electronic and Information Engineering, Hebei University, Baoding 071002, China
- Research Center of Machine Vision Engineering and Technology of Hebei Province, Baoding 071002, China
- Key Laboratory of Digital Medical Engineering of Hebei Province, Baoding 071002, China
| |
Collapse
|
10
|
Seo H, Yu L, Ren H, Li X, Shen L, Xing L. Deep Neural Network With Consistency Regularization of Multi-Output Channels for Improved Tumor Detection and Delineation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:3369-3378. [PMID: 34048339 PMCID: PMC8692166 DOI: 10.1109/tmi.2021.3084748] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/25/2023]
Abstract
Deep learning is becoming an indispensable tool for imaging applications, such as image segmentation, classification, and detection. In this work, we reformulate a standard deep learning problem into a new neural network architecture with multi-output channels, which reflects different facets of the objective, and apply the deep neural network to improve the performance of image segmentation. By adding one or more interrelated auxiliary-output channels, we impose an effective consistency regularization for the main task of pixelated classification (i.e., image segmentation). Specifically, multi-output-channel consistency regularization is realized by residual learning via additive paths that connect main-output channel and auxiliary-output channels in the network. The method is evaluated on the detection and delineation of lung and liver tumors with public data. The results clearly show that multi-output-channel consistency implemented by residual learning improves the standard deep neural network. The proposed framework is quite broad and should find widespread applications in various deep learning problems.
Collapse
|
11
|
See KB, Arpin DJ, Vaillancourt DE, Fang R, Coombes SA. Unraveling somatotopic organization in the human brain using machine learning and adaptive supervoxel-based parcellations. Neuroimage 2021; 245:118710. [PMID: 34780917 PMCID: PMC9008369 DOI: 10.1016/j.neuroimage.2021.118710] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2021] [Revised: 10/29/2021] [Accepted: 11/03/2021] [Indexed: 12/03/2022] Open
Abstract
In addition to the well-established somatotopy in the pre- and post-central gyrus, there is now strong evidence that somatotopic organization is evident across other regions in the sensorimotor network. This raises several experimental questions: To what extent is activity in the sensorimotor network effector-dependent and effector-independent? How important is the sensorimotor cortex when predicting the motor effector? Is there redundancy in the distributed somatotopically organized network such that removing one region has little impact on classification accuracy? To answer these questions, we developed a novel experimental approach. fMRI data were collected while human subjects performed a precisely controlled force generation task separately with their hand, foot, and mouth. We used a simple linear iterative clustering (SLIC) algorithm to segment whole-brain beta coefficient maps to build an adaptive brain parcellation and then classified effectors using extreme gradient boosting (XGBoost) based on parcellations at various spatial resolutions. This allowed us to understand how data-driven adaptive brain parcellation granularity altered classification accuracy. Results revealed effector-dependent activity in regions of the post-central gyrus, precentral gyrus, and paracentral lobule. SMA, regions of the inferior and superior parietal lobule, and cerebellum each contained effector-dependent and effector-independent representations. Machine learning analyses showed that increasing the spatial resolution of the data-driven model increased classification accuracy, which reached 94% with 1755 supervoxels. Our SLIC-based supervoxel parcellation outperformed classification analyses using established brain templates and random simulations. Occlusion experiments further demonstrated redundancy across the sensorimotor network when classifying effectors. Our observations extend our understanding of effector-dependent and effector-independent organization within the human brain and provide new insight into the functional neuroanatomy required to predict the motor effector used in a motor control task.
Collapse
Affiliation(s)
- Kyle B See
- J. Crayton Pruitt Family Department of Biomedical Engineering, Smart Medical Informatics Learning and Evaluation Lab, College of Engineering, University of Florida, PO Box 116131, Gainesville, FL, United States
| | - David J Arpin
- Laboratory for Rehabilitation Neuroscience, Department of Applied Physiology and Kinesiology, University of Florida, PO Box 118206, Gainesville, FL, United States
| | - David E Vaillancourt
- J. Crayton Pruitt Family Department of Biomedical Engineering, Smart Medical Informatics Learning and Evaluation Lab, College of Engineering, University of Florida, PO Box 116131, Gainesville, FL, United States; Laboratory for Rehabilitation Neuroscience, Department of Applied Physiology and Kinesiology, University of Florida, PO Box 118206, Gainesville, FL, United States
| | - Ruogu Fang
- J. Crayton Pruitt Family Department of Biomedical Engineering, Smart Medical Informatics Learning and Evaluation Lab, College of Engineering, University of Florida, PO Box 116131, Gainesville, FL, United States; Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, United States; Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL, United States.
| | - Stephen A Coombes
- J. Crayton Pruitt Family Department of Biomedical Engineering, Smart Medical Informatics Learning and Evaluation Lab, College of Engineering, University of Florida, PO Box 116131, Gainesville, FL, United States; Laboratory for Rehabilitation Neuroscience, Department of Applied Physiology and Kinesiology, University of Florida, PO Box 118206, Gainesville, FL, United States.
| |
Collapse
|
12
|
Zhou L, Deng X, Li W, Zheng S, Lei B. A contour-aware feature-merged network for liver segmentation based on shape prior knowledge. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2021.04.079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
13
|
Luan S, Xue X, Ding Y, Wei W, Zhu B. Adaptive Attention Convolutional Neural Network for Liver Tumor Segmentation. Front Oncol 2021; 11:680807. [PMID: 34434891 PMCID: PMC8381250 DOI: 10.3389/fonc.2021.680807] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2021] [Accepted: 07/12/2021] [Indexed: 12/29/2022] Open
Abstract
Purpose Accurate segmentation of liver and liver tumors is critical for radiotherapy. Liver tumor segmentation, however, remains a difficult and relevant problem in the field of medical image processing because of the various factors like complex and variable location, size, and shape of liver tumors, low contrast between tumors and normal tissues, and blurred or difficult-to-define lesion boundaries. In this paper, we proposed a neural network (S-Net) that can incorporate attention mechanisms to end-to-end segmentation of liver tumors from CT images. Methods First, this study adopted a classical coding-decoding structure to realize end-to-end segmentation. Next, we introduced an attention mechanism between the contraction path and the expansion path so that the network could encode a longer range of semantic information in the local features and find the corresponding relationship between different channels. Then, we introduced long-hop connections between the layers of the contraction path and the expansion path, so that the semantic information extracted in both paths could be fused. Finally, the application of closed operation was used to dissipate the narrow interruptions and long, thin divide. This eliminated small cavities and produced a noise reduction effect. Results In this paper, we used the MICCAI 2017 liver tumor segmentation (LiTS) challenge dataset, 3DIRCADb dataset and doctors' manual contours of Hubei Cancer Hospital dataset to test the network architecture. We calculated the Dice Global (DG) score, Dice per Case (DC) score, volumetric overlap error (VOE), average symmetric surface distance (ASSD), and root mean square error (RMSE) to evaluate the accuracy of the architecture for liver tumor segmentation. The segmentation DG for tumor was found to be 0.7555, DC was 0.613, VOE was 0.413, ASSD was 1.186 and RMSE was 1.804. For a small tumor, DG was 0.3246 and DC was 0.3082. For a large tumor, DG was 0.7819 and DC was 0.7632. Conclusion S-Net obtained more semantic information with the introduction of an attention mechanism and long jump connection. Experimental results showed that this method effectively improved the effect of tumor recognition in CT images and could be applied to assist doctors in clinical treatment.
Collapse
Affiliation(s)
- Shunyao Luan
- Department of Optoelectronic Engineering, Huazhong University of Science and Technology, Wuhan, China
| | - Xudong Xue
- Oncology Radiotherapy Department, Hubei Cancer Hospital, Wuhan, China
| | - Yi Ding
- Oncology Radiotherapy Department, Hubei Cancer Hospital, Wuhan, China
| | - Wei Wei
- Oncology Radiotherapy Department, Hubei Cancer Hospital, Wuhan, China
| | - Benpeng Zhu
- Department of Optoelectronic Engineering, Huazhong University of Science and Technology, Wuhan, China
| |
Collapse
|
14
|
Computed Tomography Image Segmentation Algorithm to Detect the Curative Effect of Radial Shock Wave Therapy for Knee Osteoarthritis. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:7098924. [PMID: 34394896 PMCID: PMC8363439 DOI: 10.1155/2021/7098924] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Accepted: 07/28/2021] [Indexed: 11/30/2022]
Abstract
The aim of this study was to investigate the values of computed tomography (CT) imaging technology based on image segmentation algorithm (ISA). It was applied in the radial shock wave therapy (RSWT) to treat knee osteoarthritis (KOA), so its curative effect and rehabilitation effect on nerve function were mainly analyzed in this study. 84 patients with KOA were selected and grouped into an ultrasonic treatment group (group A) and a RSW group (group B). All the patients received the ISA-based CT examination and high-quality nursing intervention. There were comparisons on the effects of pain improvement, knee joint function, and nerve function rehabilitation of patients in groups A and B. Results showed that visual analogue scale (VAS) scores before and after treatment were markedly different among all patients, and the pain degree of patients in group B was lower than the degree of group A (P < 0.05). The knee joint function of group B after treatment was greatly better than group A (P < 0.05). Scandinavian stroke scale (SSS) scores of nerve function rehabilitation after nursing in patients from group B were sharply lower than the scores of group A (P < 0.05). Results indicated that ISA-based CT images could be applied in analysis of curative effect on KOA, and there was more obvious effect of RSWT in the treatment of KOA.
Collapse
|
15
|
Liu QF, Kang BS, Liu HY, Li HA, Chen R, Liu GX. Efficient Medical Image Adaption via Axis-Aligned Mesh Deformation. JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS 2021. [DOI: 10.1166/jmihi.2021.3547] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Content-aware medical image adaptation can make medical images be well presented on different display devices. The existing adaption algorithms mainly consider the visual effect of salient regions, such as specific organ areas of the patient body, but either ignore the quality of unimportant
areas or execute more slowly. In order to enhance the effect of adaption and accelerate the speed of adaptation, we propose an efficient medical image adaptation method via axis-aligned mesh deformation. With this method, importance map is firstly produced by combing the weighted edge map
and saliency map. Then, integer programming is used to initialize and deform the axis-aligned mesh based on importance map. Finally, image adaptation is operated rapidly by bi-linear interpolation. With the proposed method, the real-time image adaptation can be realized, and not only the visual
effect of the significant areas but also the contour integrity and continuity of the non significant areas can be maintained. Experiments on open data-sets show that the proposed method has high efficiency, better effect and strong stability, and is suitable for real-time image adaptation.
Collapse
Affiliation(s)
- Qing-Fang Liu
- School of Information Science and Technology, Northwest University, Xi’an 710127, China
| | - Bao-Sheng Kang
- School of Information Science and Technology, Northwest University, Xi’an 710127, China
| | - Hai-Yun Liu
- Network Center, Shijiazhuang Posts and Telecommunications Technical College, Shijiazhuang 050021, China
| | - Hong-An Li
- College of Computer Science and Technology, Xi’an University of Science and Technology, Xi’an 710054, China
| | - Rui Chen
- Software Engineering College, Zhengzhou University of Light Industry, Zhengzhou 450002, China
| | - Gui-Xian Liu
- Sifang College, Shijiazhuang Tiedao University, Shijiazhuang 050043, China
| |
Collapse
|
16
|
Symmetric Reconstruction of Functional Liver Segments and Cross-Individual Correspondence of Hepatectomy. Diagnostics (Basel) 2021; 11:diagnostics11050852. [PMID: 34068516 PMCID: PMC8151903 DOI: 10.3390/diagnostics11050852] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2021] [Revised: 05/03/2021] [Accepted: 05/08/2021] [Indexed: 02/02/2023] Open
Abstract
Accurate localization and analyses of functional liver segments are crucial in devising various surgical procedures, including hepatectomy. To this end, they require the extraction of a liver from computed tomography, and then the identification of resection correspondence between individuals. The first part is usually impeded by inherent deficiencies, as present in medical images, and vast anatomical variations across subjects. While the model-based approach is found viable to tackle both issues, it is often undermined by an inadequate number of labeled samples, to capture all plausible variations. To address segmentation problems by balancing between accuracy, resource consumption, and data availability, this paper presents an efficient method for liver segmentation based on a graph-cut algorithm. One of its main novelties is the incorporation of a feature preserving a metric for boundary separation. Intuitive anatomical constraints are imposed to ensure valid extraction. The second part involves the symmetric conformal parameterization of the extracted liver surface onto a genus-0 domain. Provided with a few landmarks specified on two livers, we demonstrated that, by using a modified Beltrami differential, not only could they be non-rigidly registered, but also the hepatectomy on one liver could be envisioned on another. The merits of the proposed scheme were elucidated by both visual and numerical assessments on a standard MICCAI SLIVER07 dataset.
Collapse
|
17
|
Semi-automatic liver segmentation based on probabilistic models and anatomical constraints. Sci Rep 2021; 11:6106. [PMID: 33731736 PMCID: PMC7969941 DOI: 10.1038/s41598-021-85436-7] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2020] [Accepted: 03/01/2021] [Indexed: 12/12/2022] Open
Abstract
Segmenting a liver and its peripherals from abdominal computed tomography is a crucial step toward computer aided diagnosis and therapeutic intervention. Despite the recent advances in computing methods, faithfully segmenting the liver has remained a challenging task, due to indefinite boundary, intensity inhomogeneity, and anatomical variations across subjects. In this paper, a semi-automatic segmentation method based on multivariable normal distribution of liver tissues and graph-cut sub-division is presented. Although it is not fully automated, the method minimally involves human interactions. Specifically, it consists of three main stages. Firstly, a subject specific probabilistic model was built from an interior patch, surrounding a seed point specified by the user. Secondly, an iterative assignment of pixel labels was applied to gradually update the probabilistic map of the tissues based on spatio-contextual information. Finally, the graph-cut model was optimized to extract the 3D liver from the image. During post-processing, overly segmented nodal regions due to fuzzy tissue separation were removed, maintaining its correct anatomy by using robust bottleneck detection with adjacent contour constraint. The proposed system was implemented and validated on the MICCAI SLIVER07 dataset. The experimental results were benchmarked against the state-of-the-art methods, based on major clinically relevant metrics. Both visual and numerical assessments reported herein indicated that the proposed system could improve the accuracy and reliability of asymptomatic liver segmentation.
Collapse
|
18
|
Jin Q, Meng Z, Sun C, Cui H, Su R. RA-UNet: A Hybrid Deep Attention-Aware Network to Extract Liver and Tumor in CT Scans. Front Bioeng Biotechnol 2020; 8:605132. [PMID: 33425871 PMCID: PMC7785874 DOI: 10.3389/fbioe.2020.605132] [Citation(s) in RCA: 98] [Impact Index Per Article: 24.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2020] [Accepted: 12/01/2020] [Indexed: 02/01/2023] Open
Abstract
Automatic extraction of liver and tumor from CT volumes is a challenging task due to their heterogeneous and diffusive shapes. Recently, 2D deep convolutional neural networks have become popular in medical image segmentation tasks because of the utilization of large labeled datasets to learn hierarchical features. However, few studies investigate 3D networks for liver tumor segmentation. In this paper, we propose a 3D hybrid residual attention-aware segmentation method, i.e., RA-UNet, to precisely extract the liver region and segment tumors from the liver. The proposed network has a basic architecture as U-Net which extracts contextual information combining low-level feature maps with high-level ones. Attention residual modules are integrated so that the attention-aware features change adaptively. This is the first work that an attention residual mechanism is used to segment tumors from 3D medical volumetric images. We evaluated our framework on the public MICCAI 2017 Liver Tumor Segmentation dataset and tested the generalization on the 3DIRCADb dataset. The experiments show that our architecture obtains competitive results.
Collapse
Affiliation(s)
- Qiangguo Jin
- School of Computer Software, College of Intelligence and Computing, Tianjin University, Tianjin, China
- CSIRO Data61, Sydney, NSW, Australia
| | - Zhaopeng Meng
- School of Computer Software, College of Intelligence and Computing, Tianjin University, Tianjin, China
- Tianjin University of Traditional Chinese Medicine, Tianjin, China
| | | | - Hui Cui
- Department of Computer Science and Information Technology, La Trobe University, Melbourne, VIC, Australia
| | - Ran Su
- School of Computer Software, College of Intelligence and Computing, Tianjin University, Tianjin, China
| |
Collapse
|
19
|
Liu T, Liu J, Ma Y, He J, Han J, Ding X, Chen CT. Spatial feature fusion convolutional network for liver and liver tumor segmentation from CT images. Med Phys 2020; 48:264-272. [PMID: 33159809 DOI: 10.1002/mp.14585] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2020] [Revised: 08/05/2020] [Accepted: 10/15/2020] [Indexed: 12/30/2022] Open
Abstract
PURPOSE The accurate segmentation of liver and liver tumors from CT images can assist radiologists in decision-making and treatment planning. The contours of liver and liver tumors are currently obtained by manual labeling, which is time-consuming and subjective. Computer-aided segmentation methods have been widely used in the segmentation of liver and liver tumors. However, due to the diversity of shape, volume, and image intensity, the segmentation is still a difficult task. In this study, we present a Spatial Feature Fusion Convolutional Network (SFF-Net) to automatically segment liver and liver tumors from CT images. METHODS First, we extract side-outputs at each convolutional block in SFF-Net to make full use of multiscale features. Second, skip-connections are added in the down-sampling phase, therefore, the spatial information can be efficiently transferred to later layers. Third, we present feature fusion blocks (FFBs) to merge spatial features and high-level semantic features from early layers and later layers, respectively. Finally, a fully connected 3D conditional random fields (CRFs) is applied to refine the liver and liver tumor segmentation results. RESULTS We test our method on the MICCAI 2017 Liver Tumor Segmentation (LiTS) challenge dataset. The Dice Global (DG) score, Dice per case (DC) score, Volume Overlap Error (VOE), Average Symmetric Surface Distance (ASSD), and tumor precision score are calculated to evaluate the liver and liver tumor segmentation accuracies. For the liver segmentation, DG is 0.955; DC is 0.937; VOE is 0.106; and ASSD is 3.678. For the tumor segmentation, DG is 0.746; DC is 0.592; VOE is 0.416; ASSD is 1.585 and the tumor precision score is 0.369. CONCLUSIONS The SFF-Net learns more spatial information by adding skip-connections and feature fusion blocks. The experiments validate that our method can accurately segment liver and liver tumors from CT images.
Collapse
Affiliation(s)
- Tianyu Liu
- Department of Electronic Engineering, Lanzhou University of Finance and Economics, Lanzhou, 730020, China
| | - Junchi Liu
- Department of Electrical and Computer Engineering, Illinois Institute of Technology, Chicago, 60616, USA
| | - Yan Ma
- Department of Electronic Engineering, Lanzhou University of Finance and Economics, Lanzhou, 730020, China
| | - Jiangping He
- Department of Electronic Engineering, Lanzhou University of Finance and Economics, Lanzhou, 730020, China
| | - Jincang Han
- Department of Electronic Engineering, Lanzhou University of Finance and Economics, Lanzhou, 730020, China
| | - Xiaoyang Ding
- Department of Electronic Engineering, Lanzhou University of Finance and Economics, Lanzhou, 730020, China
| | - Chin-Tu Chen
- Department of Radiology, The University of Chicago, Chicago, 60637, USA
| |
Collapse
|
20
|
Bui V, Hsu LY, Shanbhag SM, Tran L, Bandettini WP, Chang LC, Chen MY. Improving multi-atlas cardiac structure segmentation of computed tomography angiography: A performance evaluation based on a heterogeneous dataset. Comput Biol Med 2020; 125:104019. [PMID: 33038614 PMCID: PMC7655721 DOI: 10.1016/j.compbiomed.2020.104019] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2020] [Revised: 09/22/2020] [Accepted: 09/23/2020] [Indexed: 11/21/2022]
Abstract
Multi-atlas based segmentation is an effective technique that transforms a representative set of atlas images and labels into a target image for structural segmentation. However, a significant limitation of this approach relates to the fact that the atlas and the target images need to be similar in volume orientation, coverage, or acquisition protocols in order to prevent image misregistration and avoid segmentation fault. In this study, we aim to evaluate the impact of using a heterogeneous Computed Tomography Angiography (CTA) dataset on the performance of a multi-atlas cardiac structure segmentation framework. We propose a generalized technique based upon using the Simple Linear Iterative Clustering (SLIC) supervoxel method to detect a bounding box region enclosing the heart before subsequent cardiac structure segmentation. This technique facilitates our framework to process CTA datasets acquired from distinct imaging protocols and to improve its segmentation accuracy and speed. In a four-way cross comparison based on 60 CTA studies from our institution and 60 CTA datasets from the Multi-Modality Whole Heart Segmentation MICCAI challenge, we show that the proposed framework performs well in segmenting seven different cardiac structures based upon interchangeable atlas and target datasets acquired from different imaging settings. For the overall results, our automated segmentation framework attains a median Dice, mean distance, and Hausdorff distance of 0.88, 1.5 mm, and 9.69 mm over the entire datasets. The average processing time was 1.55 min for both datasets. Furthermore, this study shows that it is feasible to exploit heterogenous datasets from different imaging protocols and institutions for accurate multi-atlas cardiac structure segmentation.
Collapse
Affiliation(s)
- Vy Bui
- National Heart, Lung, And Blood Institute, National Institutes of Health, Bethesda, MD, 20892, USA; Department of Electrical Engineering and Computer Science, Catholic University of America, Washington, DC, 20064, USA
| | - Li-Yueh Hsu
- National Heart, Lung, And Blood Institute, National Institutes of Health, Bethesda, MD, 20892, USA; Department of Radiology and Imaging Sciences, National Institutes of Health, Bethesda, MD, 20892, USA.
| | - Sujata M Shanbhag
- National Heart, Lung, And Blood Institute, National Institutes of Health, Bethesda, MD, 20892, USA
| | - Loc Tran
- Department of Electrical Engineering and Computer Science, Catholic University of America, Washington, DC, 20064, USA
| | - W Patricia Bandettini
- National Heart, Lung, And Blood Institute, National Institutes of Health, Bethesda, MD, 20892, USA
| | - Lin-Ching Chang
- Department of Electrical Engineering and Computer Science, Catholic University of America, Washington, DC, 20064, USA
| | - Marcus Y Chen
- National Heart, Lung, And Blood Institute, National Institutes of Health, Bethesda, MD, 20892, USA
| |
Collapse
|
21
|
Actor JA, Fuentes DT, Rivière B. Identification of Kernels in a Convolutional Neural Network: Connections Between Level Set Equation and Deep Learning for Image Segmentation. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2020; 11313. [PMID: 32377028 DOI: 10.1117/12.2548871] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
Medical image segmentation remains a difficult, time-consuming task; currently, liver segmentation from abdominal CT scans is often done by hand, requiring too much time to construct patient-specific treatment models for hepatocellular carcinoma. Image segmentation techniques, such as level set methods and convolutional neural networks (CNN), rely on a series of convolutions and nonlinearities to construct image features: neural networks that use strictly mean-zero finite difference stencils as convolution kernels can be treated as upwind discretizations of differential equations. If this relationship can be made explicit, one gains the ability to analyze CNN using the language of numerical analysis, thereby providing a well-established framework for proving properties such as stability and approximation accuracy. We test this relationship by constructing a level set network, a type of CNN whose architecture describes the expansion of level sets; forward-propagation through a level set network is equivalent to solving the level set equation; the level set network achieves comparable segmentation accuracy to solving the level set equation, while not obtaining the accuracy of a common CNN architecture. We therefore analyze which convolution filters are present in a standard CNN, to see whether finite difference stencils are learned during training; we observe certain patterns that form at certain layers in the network, where the learned CNN kernels depart from known convolution kernels used to solve the level set equation.
Collapse
Affiliation(s)
| | - David T Fuentes
- University of Texas MD Anderson Cancer Center, Houston, TX USA
| | | |
Collapse
|
22
|
Seo H, Huang C, Bassenne M, Xiao R, Xing L. Modified U-Net (mU-Net) With Incorporation of Object-Dependent High Level Features for Improved Liver and Liver-Tumor Segmentation in CT Images. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:1316-1325. [PMID: 31634827 PMCID: PMC8095064 DOI: 10.1109/tmi.2019.2948320] [Citation(s) in RCA: 153] [Impact Index Per Article: 38.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/18/2023]
Abstract
Segmentation of livers and liver tumors is one of the most important steps in radiation therapy of hepatocellular carcinoma. The segmentation task is often done manually, making it tedious, labor intensive, and subject to intra-/inter- operator variations. While various algorithms for delineating organ-at-risks (OARs) and tumor targets have been proposed, automatic segmentation of livers and liver tumors remains intractable due to their low tissue contrast with respect to the surrounding organs and their deformable shape in CT images. The U-Net has gained increasing popularity recently for image analysis tasks and has shown promising results. Conventional U-Net architectures, however, suffer from three major drawbacks. First, skip connections allow for the duplicated transfer of low resolution information in feature maps to improve efficiency in learning, but this often leads to blurring of extracted image features. Secondly, high level features extracted by the network often do not contain enough high resolution edge information of the input, leading to greater uncertainty where high resolution edge dominantly affects the network's decisions such as liver and liver-tumor segmentation. Thirdly, it is generally difficult to optimize the number of pooling operations in order to extract high level global features, since the number of pooling operations used depends on the object size. To cope with these problems, we added a residual path with deconvolution and activation operations to the skip connection of the U-Net to avoid duplication of low resolution information of features. In the case of small object inputs, features in the skip connection are not incorporated with features in the residual path. Furthermore, the proposed architecture has additional convolution layers in the skip connection in order to extract high level global features of small object inputs as well as high level features of high resolution edge information of large object inputs. Efficacy of the modified U-Net (mU-Net) was demonstrated using the public dataset of Liver tumor segmentation (LiTS) challenge 2017. For liver-tumor segmentation, Dice similarity coefficient (DSC) of 89.72 %, volume of error (VOE) of 21.93 %, and relative volume difference (RVD) of - 0.49 % were obtained. For liver segmentation, DSC of 98.51 %, VOE of 3.07 %, and RVD of 0.26 % were calculated. For the public 3D Image Reconstruction for Comparison of Algorithm Database (3Dircadb), DSCs were 96.01 % for the liver and 68.14 % for liver-tumor segmentations, respectively. The proposed mU-Net outperformed existing state-of-art networks.
Collapse
|
23
|
Machine-Learning Based Hybrid-Feature Analysis for Liver Cancer Classification Using Fused (MR and CT) Images. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10093134] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
The purpose of this research is to demonstrate the ability of machine-learning (ML) methods for liver cancer classification using a fused dataset of two-dimensional (2D) computed tomography (CT) scans and magnetic resonance imaging (MRI). Datasets of benign (hepatocellular adenoma, hemangioma, cyst) and malignant (hepatocellular carcinoma, hepatoblastoma, metastasis) liver cancer were acquired at Bahawal Victoria Hospital (BVH), Bahawalpur, Pakistan. The final dataset was generated by fusion of 1200 (100 × 6 × 2) MR and CT-scan images, 200 (100 MRI and 100 CT-scan) images size 512 × 512 for each class of cancer. The acquired dataset was preprocessed by employing the Gabor filters to reduce the noise and taking an automated region of interest (ROIs) using an Otsu thresholding-based segmentation approach. The preprocessed dataset was used to acquire 254 hybrid-feature data for each ROI, which is the combination of the histogram, wavelet, co-occurrence, and run-length features, while 10 optimized hybrid features were selected by employing (probability of error plus average correlation) feature selection technique. For classification, we deployed this optimized hybrid-feature dataset to four ML classifiers: multilayer perceptron (MLP), support vector machine (SVM), random forest (RF), and J48, using a ten fold cross-validation method. MLP showed an overall accuracy of (95.78% on MRI and 97.44% on CT). Unfortunately, the obtained results were not promising, and there were some limitations due to the different modalities of the dataset. Thereafter, a fusion of MRI and CT-scan datasets generated the fused optimized hybrid-feature dataset. The MLP has shown a promising accuracy of 99% among all the deployed classifiers.
Collapse
|
24
|
Singh S, Melnik R. Thermal ablation of biological tissues in disease treatment: A review of computational models and future directions. Electromagn Biol Med 2020; 39:49-88. [PMID: 32233691 DOI: 10.1080/15368378.2020.1741383] [Citation(s) in RCA: 42] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
Percutaneous thermal ablation has proven to be an effective modality for treating both benign and malignant tumours in various tissues. Among these modalities, radiofrequency ablation (RFA) is the most promising and widely adopted approach that has been extensively studied in the past decades. Microwave ablation (MWA) is a newly emerging modality that is gaining rapid momentum due to its capability of inducing rapid heating and attaining larger ablation volumes, and its lesser susceptibility to the heat sink effects as compared to RFA. Although the goal of both these therapies is to attain cell death in the target tissue by virtue of heating above 50°C, their underlying mechanism of action and principles greatly differs. Computational modelling is a powerful tool for studying the effect of electromagnetic interactions within the biological tissues and predicting the treatment outcomes during thermal ablative therapies. Such a priori estimation can assist the clinical practitioners during treatment planning with the goal of attaining successful tumour destruction and preservation of the surrounding healthy tissue and critical structures. This review provides current state-of-the-art developments and associated challenges in the computational modelling of thermal ablative techniques, viz., RFA and MWA, as well as touch upon several promising avenues in the modelling of laser ablation, nanoparticles assisted magnetic hyperthermia and non-invasive RFA. The application of RFA in pain relief has been extensively reviewed from modelling point of view. Additionally, future directions have also been provided to improve these models for their successful translation and integration into the hospital work flow.
Collapse
Affiliation(s)
- Sundeep Singh
- MS2Discovery Interdisciplinary Research Institute, Wilfrid Laurier University, Waterloo, Ontario, Canada
| | - Roderick Melnik
- MS2Discovery Interdisciplinary Research Institute, Wilfrid Laurier University, Waterloo, Ontario, Canada.,BCAM - Basque Center for Applied Mathematics, Bilbao, Spain
| |
Collapse
|
25
|
Koçak B, Durmaz EŞ, Ateş E, Kılıçkesmez Ö. Radiomics with artificial intelligence: a practical guide for beginners. ACTA ACUST UNITED AC 2020; 25:485-495. [PMID: 31650960 DOI: 10.5152/dir.2019.19321] [Citation(s) in RCA: 180] [Impact Index Per Article: 45.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Radiomics is a relatively new word for the field of radiology, meaning the extraction of a high number of quantitative features from medical images. Artificial intelligence (AI) is broadly a set of advanced computational algorithms that basically learn the patterns in the data provided to make predictions on unseen data sets. Radiomics can be coupled with AI because of its better capability of handling a massive amount of data compared with the traditional statistical methods. Together, the primary purpose of these fields is to extract and analyze as much and meaningful hidden quantitative data as possible to be used in decision support. Nowadays, both radiomics and AI have been getting attention for their remarkable success in various radiological tasks, which has been met with anxiety by most of the radiologists due to the fear of replacement by intelligent machines. Considering ever-developing advances in computational power and availability of large data sets, the marriage of humans and machines in future clinical practice seems inevitable. Therefore, regardless of their feelings, the radiologists should be familiar with these concepts. Our goal in this paper was three-fold: first, to familiarize radiologists with the radiomics and AI; second, to encourage the radiologists to get involved in these ever-developing fields; and, third, to provide a set of recommendations for good practice in design and assessment of future works.
Collapse
Affiliation(s)
- Burak Koçak
- Department of Radiology İstanbul Training and Research Hospital, İstanbul, Turkey
| | - Emine Şebnem Durmaz
- Department of Radiology, Büyükçekmece Mimar Sinan State Hospital, İstanbul, Turkey
| | - Ece Ateş
- Department of Radiology İstanbul Training and Research Hospital, İstanbul, Turkey
| | - Özgür Kılıçkesmez
- Department of Radiology İstanbul Training and Research Hospital, İstanbul, Turkey
| |
Collapse
|
26
|
Liu X, Guo S, Yang B, Ma S, Zhang H, Li J, Sun C, Jin L, Li X, Yang Q, Fu Y. Automatic Organ Segmentation for CT Scans Based on Super-Pixel and Convolutional Neural Networks. J Digit Imaging 2019; 31:748-760. [PMID: 29679242 DOI: 10.1007/s10278-018-0052-4] [Citation(s) in RCA: 31] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
Abstract
Accurate segmentation of specific organ from computed tomography (CT) scans is a basic and crucial task for accurate diagnosis and treatment. To avoid time-consuming manual optimization and to help physicians distinguish diseases, an automatic organ segmentation framework is presented. The framework utilized convolution neural networks (CNN) to classify pixels. To reduce the redundant inputs, the simple linear iterative clustering (SLIC) of super-pixels and the support vector machine (SVM) classifier are introduced. To establish the perfect boundary of organs in one-pixel-level, the pixels need to be classified step-by-step. First, the SLIC is used to cut an image into grids and extract respective digital signatures. Next, the signature is classified by the SVM, and the rough edges are acquired. Finally, a precise boundary is obtained by the CNN, which is based on patches around each pixel-point. The framework is applied to abdominal CT scans of livers and high-resolution computed tomography (HRCT) scans of lungs. The experimental CT scans are derived from two public datasets (Sliver 07 and a Chinese local dataset). Experimental results show that the proposed method can precisely and efficiently detect the organs. This method consumes 38 s/slice for liver segmentation. The Dice coefficient of the liver segmentation results reaches to 97.43%. For lung segmentation, the Dice coefficient is 97.93%. This finding demonstrates that the proposed framework is a favorable method for lung segmentation of HRCT scans.
Collapse
Affiliation(s)
- Xiaoming Liu
- College of Electronic Science & Engineering, Jilin University, D451 Room of Tangaoqing Building, No. 2699 of Qianjin Street, Changchun, Jilin, China
| | - Shuxu Guo
- College of Electronic Science & Engineering, Jilin University, D451 Room of Tangaoqing Building, No. 2699 of Qianjin Street, Changchun, Jilin, China
| | - Bingtao Yang
- College of Communication Engineering, Jilin University, Changchun, 130012, China
| | - Shuzhi Ma
- LUSTER LightTech Group, Beijing, China
| | - Huimao Zhang
- Department of Radiology, The First Hospital of Jilin University, Changchun, China
| | - Jing Li
- Department of Radiology, The First Hospital of Jilin University, Changchun, China
| | - Changjian Sun
- College of Electronic Science & Engineering, Jilin University, D451 Room of Tangaoqing Building, No. 2699 of Qianjin Street, Changchun, Jilin, China
| | - Lanyi Jin
- College of Electronic Science & Engineering, Jilin University, D451 Room of Tangaoqing Building, No. 2699 of Qianjin Street, Changchun, Jilin, China
| | - Xueyan Li
- College of Electronic Science & Engineering, Jilin University, D451 Room of Tangaoqing Building, No. 2699 of Qianjin Street, Changchun, Jilin, China.
| | - Qi Yang
- Department of Radiology, The First Hospital of Jilin University, Changchun, China
| | - Yu Fu
- Department of Radiology, The First Hospital of Jilin University, Changchun, China
| |
Collapse
|
27
|
Nayak A, Baidya Kayal E, Arya M, Culli J, Krishan S, Agarwal S, Mehndiratta A. Computer-aided diagnosis of cirrhosis and hepatocellular carcinoma using multi-phase abdomen CT. Int J Comput Assist Radiol Surg 2019; 14:1341-1352. [PMID: 31062266 DOI: 10.1007/s11548-019-01991-5] [Citation(s) in RCA: 35] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2019] [Accepted: 04/25/2019] [Indexed: 12/15/2022]
Abstract
PURPOSE High mortality rate due to liver cirrhosis has been reported over the globe in the previous years. Early detection of cirrhosis may help in controlling the disease progression toward hepatocellular carcinoma (HCC). The lack of trained CT radiologists and increased patient population delays the diagnosis and further management. This study proposes a computer-aided diagnosis system for detecting cirrhosis and HCC in a very efficient and less time-consuming approach. METHODS Contrast-enhanced CT dataset of 40 patients (n = 40; M:F = 5:3; age = 25-55 years) with three groups of subjects: healthy (n = 14), cirrhosis (n = 12) and cirrhosis with HCC (n = 14), were retrospectively analyzed in this study. A novel method for the automatic 3D segmentation of liver using modified region-growing segmentation technique was developed and compared with the state-of-the-art deep learning-based technique. Further, histogram parameters were calculated from segmented CT liver volume for classification between healthy and diseased (cirrhosis and HCC) liver using logistic regression. Multi-phase analysis of CT images was performed to extract 24 temporal features for detecting cirrhosis and HCC liver using support vector machine (SVM). RESULTS The proposed method produced improved 3D segmentation with Dice coefficient 90% for healthy liver, 86% for cirrhosis and 81% for HCC subjects compared to the deep learning algorithm (healthy: 82%; cirrhosis: 78%; HCC: 70%). Standard deviation and kurtosis were found to be statistically different (p < 0.05) among healthy and diseased liver, and using logistic regression, classification accuracy obtained was 92.5%. For detecting cirrhosis and HCC liver, SVM with RBF kernel obtained highest slice-wise and patient-wise prediction accuracy of 86.9% (precision = 0.93, recall = 0.7) and 80% (precision = 0.86, recall = 0.75), respectively, than that of linear kernel (slice-wise: accuracy = 85.4%, precision = 0.92, recall = 0.67; patient-wise: accuracy = 73.33%, precision = 0.75, recall = 0.75). CONCLUSIONS The proposed computer-aided diagnosis system for detecting cirrhosis and hepatocellular carcinoma (HCC) showed promising results and can be used as effective screening tool in medical image analysis.
Collapse
Affiliation(s)
- Akash Nayak
- Department of Electrical Engineering, Indian Institute of Technology Delhi, New Delhi, India.,IBM Research, Bangalore, India
| | - Esha Baidya Kayal
- Centre for Biomedical Engineering, Indian Institute of Technology Delhi, Hauz Khas, New Delhi, India
| | - Manish Arya
- Centre for Biomedical Engineering, Indian Institute of Technology Delhi, Hauz Khas, New Delhi, India
| | - Jayanth Culli
- Department of Electrical Engineering, Indian Institute of Technology Delhi, New Delhi, India
| | - Sonal Krishan
- Department of Radiology, Medanta The Medicity, Gurgaon, India
| | - Sumeet Agarwal
- Department of Electrical Engineering, Indian Institute of Technology Delhi, New Delhi, India
| | - Amit Mehndiratta
- Centre for Biomedical Engineering, Indian Institute of Technology Delhi, Hauz Khas, New Delhi, India. .,Department of Biomedical Engineering, All India Institute of Medical Sciences, New Delhi, India.
| |
Collapse
|
28
|
Jafargholi Rangraz E, Coudyzer W, Maleux G, Baete K, Deroose CM, Nuyts J. Multi-modal image analysis for semi-automatic segmentation of the total liver and liver arterial perfusion territories for radioembolization. EJNMMI Res 2019; 9:19. [PMID: 30788640 PMCID: PMC6382918 DOI: 10.1186/s13550-019-0485-x] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2018] [Accepted: 01/29/2019] [Indexed: 12/15/2022] Open
Abstract
Purpose We have developed a multi-modal imaging approach for SIRT, combining 99mTc-MAA SPECT/CT and/or 90Y PET, 18F-FDG PET/CT, and contrast-enhanced CBCT for voxel-based dosimetry, as a tool for treatment planning and verification. For radiation dose prediction calculations, a segmentation of the total liver volume and of the liver perfusion territories is required. Method In this paper, we proposed a procedure for multi-modal image analysis to assist SIRT treatment planning. The pre-treatment 18F-FDG PET/CT, 99mTc-MAA SPECT/CT, and contrast-enhanced CBCT images were registered to a common space using an initial rigid, followed by a deformable registration. The registration was scored by an expert using Likert scores. The total liver was segmented semi-automatically based on the PET/CT and SPECT/CT images, and the liver perfusion territories were determined based on the CBCT images. The segmentations of the liver and liver lobes were compared to the manual segmentations by an expert on a CT image. Result Our methodology showed that multi-modal image analysis can be used for determination of the liver and perfusion territories using CBCT in SIRT using all pre-treatment studies. The results for image registration showed acceptable alignment with limited impact on dosimetry. The image registration performs well according to the expert reviewer (scored as perfect or with little misalignment in 94% of the cases). The semi-automatic liver segmentation agreed well with manual liver segmentation (dice coefficient of 0.92 and an average Hausdorff distance of 3.04 mm). The results showed disagreement between lobe segmentation using CBCT images compared to lobe segmentation based on CT images (average Hausdorff distance of 14.18 mm), with a high impact on the dosimetry (differences up to 9 Gy for right and 21 Gy for the left liver lobe). Conclusion This methodology can be used for pre-treatment dosimetry and for SIRT planning including the determination of the activity that should be administered to achieve the therapeutical goal. The inclusion of perfusion CBCT enables perfusion-based definition of the liver lobes, which was shown to be markedly different from the anatomical definition in some of the patients.
Collapse
Affiliation(s)
| | - Walter Coudyzer
- Radiology Section, Department of imaging and pathology, UZ Leuven, Leuven, Belgium
| | - Geert Maleux
- Radiology Section, Department of imaging and pathology, UZ & KU Leuven, Leuven, Belgium
| | - Kristof Baete
- Nuclear Medicine, Department of imaging and pathology, UZ & KU Leuven, Leuven, Belgium
| | - Christophe M Deroose
- Nuclear Medicine, Department of imaging and pathology, UZ & KU Leuven, Leuven, Belgium
| | - Johan Nuyts
- Nuclear Medicine, Department of imaging and pathology, UZ & KU Leuven, Leuven, Belgium
| |
Collapse
|
29
|
Abstract
OBJECTIVE Radiologic texture is the variation in image intensities within an image and is an important part of radiomics. The objective of this article is to discuss some parameters that affect the performance of texture metrics and propose recommendations that can guide both the design and evaluation of future radiomics studies. CONCLUSION A variety of texture-extraction techniques are used to assess clinical imaging data. Currently, no consensus exists regarding workflow, including acquisition, extraction, or reporting of variable settings leading to poor reproducibility.
Collapse
|
30
|
An Improved Fuzzy Connectedness Method for Automatic Three-Dimensional Liver Vessel Segmentation in CT Images. JOURNAL OF HEALTHCARE ENGINEERING 2018; 2018:2376317. [PMID: 30510670 PMCID: PMC6231381 DOI: 10.1155/2018/2376317] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/17/2018] [Revised: 09/22/2018] [Accepted: 10/04/2018] [Indexed: 01/04/2023]
Abstract
In this paper, an improved fuzzy connectedness (FC) method was proposed for automatic three-dimensional (3D) liver vessel segmentation in computed tomography (CT) images. The vessel-enhanced image (i.e., vesselness image) was incorporated into the fuzzy affinity function of FC, rather than the intensity image used by traditional FC. An improved vesselness filter was proposed by incorporating adaptive sigmoid filtering and a background-suppressing item. The fuzzy scene of FC was automatically initialized by using the Otsu segmentation algorithm and one single seed generated adaptively, while traditional FC required multiple seeds. The improved FC method was evaluated on 40 cases of clinical CT volumetric images from the 3Dircadb (n=20) and Sliver07 (n=20) datasets. Experimental results showed that the proposed liver vessel segmentation strategy could achieve better segmentation performance than traditional FC, region growing, and threshold level set. Average accuracy, sensitivity, specificity, and Dice coefficient of the improved FC method were, respectively, (96.4 ± 1.1)%, (73.7 ± 7.6)%, (97.4 ± 1.3)%, and (67.3 ± 5.7)% for the 3Dircadb dataset and (96.8 ± 0.6)%, (89.1 ± 6.8)%, (97.6 ± 1.1)%, and (71.4 ± 7.6)% for the Sliver07 dataset. It was concluded that the improved FC may be used as a new method for automatic 3D segmentation of liver vessel from CT images.
Collapse
|
31
|
Qin W, Wu J, Han F, Yuan Y, Zhao W, Ibragimov B, Gu J, Xing L. Superpixel-based and boundary-sensitive convolutional neural network for automated liver segmentation. Phys Med Biol 2018; 63:095017. [PMID: 29633960 PMCID: PMC5983385 DOI: 10.1088/1361-6560/aabd19] [Citation(s) in RCA: 40] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
Segmentation of liver in abdominal computed tomography (CT) is an important step for radiation therapy planning of hepatocellular carcinoma. Practically, a fully automatic segmentation of liver remains challenging because of low soft tissue contrast between liver and its surrounding organs, and its highly deformable shape. The purpose of this work is to develop a novel superpixel-based and boundary sensitive convolutional neural network (SBBS-CNN) pipeline for automated liver segmentation. The entire CT images were first partitioned into superpixel regions, where nearby pixels with similar CT number were aggregated. Secondly, we converted the conventional binary segmentation into a multinomial classification by labeling the superpixels into three classes: interior liver, liver boundary, and non-liver background. By doing this, the boundary region of the liver was explicitly identified and highlighted for the subsequent classification. Thirdly, we computed an entropy-based saliency map for each CT volume, and leveraged this map to guide the sampling of image patches over the superpixels. In this way, more patches were extracted from informative regions (e.g. the liver boundary with irregular changes) and fewer patches were extracted from homogeneous regions. Finally, deep CNN pipeline was built and trained to predict the probability map of the liver boundary. We tested the proposed algorithm in a cohort of 100 patients. With 10-fold cross validation, the SBBS-CNN achieved mean Dice similarity coefficients of 97.31 ± 0.36% and average symmetric surface distance of 1.77 ± 0.49 mm. Moreover, it showed superior performance in comparison with state-of-art methods, including U-Net, pixel-based CNN, active contour, level-sets and graph-cut algorithms. SBBS-CNN provides an accurate and effective tool for automated liver segmentation. It is also envisioned that the proposed framework is directly applicable in other medical image segmentation scenarios.
Collapse
Affiliation(s)
- Wenjian Qin
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China. Medical Physics Division in the Department of Radiation Oncology, Stanford University, Palo Alto, CA 94305, United States of America. University of Chinese Academy of Sciences, Beijing 100049, People's Republic of China
| | | | | | | | | | | | | | | |
Collapse
|
32
|
Huang Q, Ding H, Wang X, Wang G. Fully automatic liver segmentation in CT images using modified graph cuts and feature detection. Comput Biol Med 2018. [DOI: 10.1016/j.compbiomed.2018.02.012] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
|
33
|
Siri SK, Latte MV. Combined endeavor of Neutrosophic Set and Chan-Vese model to extract accurate liver image from CT scan. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2017; 151:101-109. [PMID: 28946992 DOI: 10.1016/j.cmpb.2017.08.020] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/19/2017] [Revised: 06/29/2017] [Accepted: 08/22/2017] [Indexed: 06/07/2023]
Abstract
Many different diseases can occur in the liver, including infections such as hepatitis, cirrhosis, cancer and over effect of medication or toxins. The foremost stage for computer-aided diagnosis of liver is the identification of liver region. Liver segmentation algorithms extract liver image from scan images which helps in virtual surgery simulation, speedup the diagnosis, accurate investigation and surgery planning. The existing liver segmentation algorithms try to extort exact liver image from abdominal Computed Tomography (CT) scan images. It is an open problem because of ambiguous boundaries, large variation in intensity distribution, variability of liver geometry from patient to patient and presence of noise. A novel approach is proposed to meet challenges in extracting the exact liver image from abdominal CT scan images. The proposed approach consists of three phases: (1) Pre-processing (2) CT scan image transformation to Neutrosophic Set (NS) and (3) Post-processing. In pre-processing, the noise is removed by median filter. The "new structure" is designed to transform a CT scan image into neutrosophic domain which is expressed using three membership subset: True subset (T), False subset (F) and Indeterminacy subset (I). This transform approximately extracts the liver image structure. In post processing phase, morphological operation is performed on indeterminacy subset (I) and apply Chan-Vese (C-V) model with detection of initial contour within liver without user intervention. This resulted in liver boundary identification with high accuracy. Experiments show that, the proposed method is effective, robust and comparable with existing algorithm for liver segmentation of CT scan images.
Collapse
Affiliation(s)
- Sangeeta K Siri
- Department of Electronics & Communication Engineering, Sapthagiri College of Engineering, Bengaluru, karnataka 560057, India.
| | | |
Collapse
|
34
|
3D Liver Tumor Segmentation in CT Images Using Improved Fuzzy C-Means and Graph Cuts. BIOMED RESEARCH INTERNATIONAL 2017; 2017:5207685. [PMID: 29090220 PMCID: PMC5635475 DOI: 10.1155/2017/5207685] [Citation(s) in RCA: 39] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/14/2016] [Accepted: 06/18/2017] [Indexed: 02/08/2023]
Abstract
Three-dimensional (3D) liver tumor segmentation from Computed Tomography (CT) images is a prerequisite for computer-aided diagnosis, treatment planning, and monitoring of liver cancer. Despite many years of research, 3D liver tumor segmentation remains a challenging task. In this paper, an efficient semiautomatic method was proposed for liver tumor segmentation in CT volumes based on improved fuzzy C-means (FCM) and graph cuts. With a single seed point, the tumor volume of interest (VOI) was extracted using confidence connected region growing algorithm to reduce computational cost. Then, initial foreground/background regions were labeled automatically, and a kernelized FCM with spatial information was incorporated in graph cuts segmentation to increase segmentation accuracy. The proposed method was evaluated on the public clinical dataset (3Dircadb), which included 15 CT volumes consisting of various sizes of liver tumors. We achieved an average volumetric overlap error (VOE) of 29.04% and Dice similarity coefficient (DICE) of 0.83, with an average processing time of 45 s per tumor. The experimental results showed that the proposed method was accurate for 3D liver tumor segmentation with a reduction of processing time.
Collapse
|
35
|
Esfandiarkhani M, Foruzan AH. A generalized active shape model for segmentation of liver in low-contrast CT volumes. Comput Biol Med 2017; 82:59-70. [DOI: 10.1016/j.compbiomed.2017.01.009] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2016] [Revised: 12/24/2016] [Accepted: 01/17/2017] [Indexed: 10/20/2022]
|
36
|
Norajitra T, Maier-Hein KH. 3D Statistical Shape Models Incorporating Landmark-Wise Random Regression Forests for Omni-Directional Landmark Detection. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:155-168. [PMID: 27541630 DOI: 10.1109/tmi.2016.2600502] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
3D Statistical Shape Models (3D-SSM) are widely used for medical image segmentation. However, during segmentation, they typically perform a very limited unidirectional search for suitable landmark positions in the image, relying on weak learners or use-case specific appearance models that solely take local image information into account. As a consequence, segmentation errors arise, and results in general depend on the accuracy of a previous model initialization. Furthermore, these methods become subject to a tedious and use-case dependent parameter tuning in order to obtain optimized results. To overcome these limitations, we propose an extension of 3D-SSM by landmark-wise random regression forests that perform an enhanced omni-directional search for landmark positions, thereby taking rich non-local image information into account. In addition, we provide a long distance model fitting based on a multi-scale approach, that allows an accurate and reproducible segmentation even from distant image positions, thus enabling an application without model initialization. Finally, translation of the proposed method to different organs is straightforward and requires no adaptation of the training process. In segmentation experiments on 45 clinical CT volumes, the proposed omni-directional search significantly increased accuracy and displayed great precision regardless of model initialization. Furthermore, for liver, spleen and kidney segmentation in a competitive multi-organ labeling challenge on publicly available data, the proposed method achieved similar or better results than the state of the art. Finally, liver segmentation results were obtained that successfully compete with specialized state-of-the-art methods from the well-known liver segmentation challenge SLIVER.
Collapse
|
37
|
Liao M, Zhao YQ, Wang W, Zeng YZ, Yang Q, Shih FY, Zou BJ. Efficient liver segmentation in CT images based on graph cuts and bottleneck detection. Phys Med 2016; 32:1383-1396. [PMID: 27771278 DOI: 10.1016/j.ejmp.2016.10.002] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/27/2016] [Revised: 10/05/2016] [Accepted: 10/05/2016] [Indexed: 12/20/2022] Open
Abstract
Liver segmentation from abdominal computed tomography (CT) volumes is extremely important for computer-aided liver disease diagnosis and surgical planning of liver transplantation. Due to ambiguous edges, tissue adhesion, and variation in liver intensity and shape across patients, accurate liver segmentation is a challenging task. In this paper, we present an efficient semi-automatic method using intensity, local context, and spatial correlation of adjacent slices for the segmentation of healthy liver regions in CT volumes. An intensity model is combined with a principal component analysis (PCA) based appearance model to exclude complex background and highlight liver region. They are then integrated with location information from neighboring slices into graph cuts to segment the liver in each slice automatically. Finally, a boundary refinement method based on bottleneck detection is used to increase the segmentation accuracy. Our method does not require heavy training process or statistical model construction, and is capable of dealing with complicated shape and intensity variations. We apply the proposed method on XHCSU14 and SLIVER07 databases, and evaluate it by MICCAI criteria and Dice similarity coefficient. Experimental results show our method outperforms several existing methods on liver segmentation.
Collapse
Affiliation(s)
- Miao Liao
- School of Computer Science and Engineering, Hunan University of Science and Technology, Xiangtan 411201, China; School of Information Science and Engineering, Central South University, Changsha 410083, China
| | - Yu-Qian Zhao
- School of Information Science and Engineering, Central South University, Changsha 410083, China.
| | - Wei Wang
- The Third Xiangya Hospital, Central South University, Changsha 410083, China.
| | - Ye-Zhan Zeng
- School of Information Science and Engineering, Central South University, Changsha 410083, China
| | - Qing Yang
- School of Information Science and Engineering, Central South University, Changsha 410083, China
| | - Frank Y Shih
- College of Computing Sciences, New Jersey Institute of Technology, Newark, NJ 07102, USA
| | - Bei-Ji Zou
- School of Information Science and Engineering, Central South University, Changsha 410083, China
| |
Collapse
|