1
|
Hu G, Wang B, Hu B, Chen D, Hu L, Li C, An Y, Hu G, Jia G. From WSI-level to patch-level: Structure prior-guided binuclear cell fine-grained detection. Med Image Anal 2023; 89:102931. [PMID: 37586290 DOI: 10.1016/j.media.2023.102931] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Revised: 07/02/2023] [Accepted: 08/08/2023] [Indexed: 08/18/2023]
Abstract
Accurate and quick binuclear cell (BC) detection plays a significant role in predicting the risk of leukemia and other malignant tumors. However, manual counting of BCs using microscope images is time consuming and subjective. Moreover, traditional image processing approaches perform poorly due to the limitations in staining quality and the diversity of morphological features in binuclear cell (BC) microscopy whole-slide images (WSIs). To overcome this challenge, we propose a multi-task method inspired by the structure prior of BCs based on deep learning, which cascades to implement BC coarse detection at the WSI level and fine-grained classification at the patch level. The coarse detection network is a multitask detection framework based on circular bounding boxes for cell detection and central key points for nucleus detection. Circle representation reduces the degrees of freedom, mitigates the effect of surrounding impurities compared to usual rectangular boxes and can be rotation invariant in WSIs. Detecting key points in the nucleus can assist in network perception and be used for unsupervised color layer segmentation in later fine-grained classification. The fine classification network consists of a background region suppression module based on color layer mask supervision and a key region selection module based on a transformer due to its global modeling capability. Additionally, an unsupervised and unpaired cytoplasm generator network is first proposed to expand the long-tailed distribution dataset. Finally, experiments are performed on BC multicenter datasets. The proposed BC fine detection method outperforms other benchmarks in almost all evaluation criteria, providing clarification and support for tasks such as cancer screenings.
Collapse
Affiliation(s)
- Geng Hu
- School of Engineering Medicine, Beihang University, Beijing 100191, China; School of Biological Science, Beihang University and Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education, Beijing 100191, China
| | - Baomin Wang
- School of Engineering Medicine, Beihang University, Beijing 100191, China; School of Biological Science, Beihang University and Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education, Beijing 100191, China
| | - Boxian Hu
- School of Engineering Medicine, Beihang University, Beijing 100191, China; School of Biological Science, Beihang University and Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education, Beijing 100191, China
| | - Dan Chen
- School of Engineering Medicine, Beihang University, Beijing 100191, China; School of Biological Science, Beihang University and Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education, Beijing 100191, China
| | - Lihua Hu
- Department of Cardiology, Peking University First Hospital, Beijing 100034, China.
| | - Cheng Li
- School of Engineering Medicine, Beihang University and Key Laboratory of Big Data-Based Precision Medicine (Beihang University), Ministry of Industry and Information Technology, Beijing 100191, China
| | - Yu An
- School of Engineering Medicine, Beihang University and Key Laboratory of Big Data-Based Precision Medicine (Beihang University), Ministry of Industry and Information Technology, Beijing 100191, China
| | - Guiping Hu
- School of Engineering Medicine, Beihang University and Key Laboratory of Big Data-Based Precision Medicine (Beihang University), Ministry of Industry and Information Technology, Beijing 100191, China.
| | - Guang Jia
- Department of Occupational and Environmental Health Sciences, School of Public Health, Peking University, Beijing 100191, China
| |
Collapse
|
2
|
Su HH, Lu CP. Development of a Deep Learning-Based Epiglottis Obstruction Ratio Calculation System. SENSORS (BASEL, SWITZERLAND) 2023; 23:7669. [PMID: 37765726 PMCID: PMC10535372 DOI: 10.3390/s23187669] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 08/31/2023] [Accepted: 09/01/2023] [Indexed: 09/29/2023]
Abstract
Surgeons determine the treatment method for patients with epiglottis obstruction based on its severity, often by estimating the obstruction severity (using three obstruction degrees) from the examination of drug-induced sleep endoscopy images. However, the use of obstruction degrees is inadequate and fails to correspond to changes in respiratory airflow. Current artificial intelligence image technologies can effectively address this issue. To enhance the accuracy of epiglottis obstruction assessment and replace obstruction degrees with obstruction ratios, this study developed a computer vision system with a deep learning-based method for calculating epiglottis obstruction ratios. The system employs a convolutional neural network, the YOLOv4 model, for epiglottis cartilage localization, a color quantization method to transform pixels into regions, and a region puzzle algorithm to calculate the range of a patient's epiglottis airway. This information is then utilized to compute the obstruction ratio of the patient's epiglottis site. Additionally, this system integrates web-based and PC-based programming technologies to realize its functionalities. Through experimental validation, this system was found to autonomously calculate obstruction ratios with a precision of 0.1% (ranging from 0% to 100%). It presents epiglottis obstruction levels as continuous data, providing crucial diagnostic insight for surgeons to assess the severity of epiglottis obstruction in patients.
Collapse
Affiliation(s)
- Hsing-Hao Su
- Department of Otorhinolaryngology-Head and Neck Surgery, Kaohsiung Veterans General Hospital, Kaohsiung 81362, Taiwan;
- Department of Physical Therapy, Shu-Zen Junior College of Medicine and Management, Kaohsiung 82144, Taiwan
- Department of Pharmacy and Master Program, College of Pharmacy & Health Care, Tajen University, Pingtung 90741, Taiwan
| | - Chuan-Pin Lu
- Department of Information and Communication Engineering, Chaoyang University of Technology, Taichung 41349, Taiwan
| |
Collapse
|
3
|
Panchbhai A, Savash Ishanzadeh MC, Sidali A, Solaiman N, Pankanti S, Kanagaraj R, Murphy JJ, Surendranath K. A deep learning workflow for quantification of micronuclei in DNA damage studies in cultured cancer cell lines: A proof of principle investigation. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 232:107447. [PMID: 36889248 DOI: 10.1016/j.cmpb.2023.107447] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/15/2022] [Revised: 02/23/2023] [Accepted: 02/24/2023] [Indexed: 06/18/2023]
Abstract
The cytokinesis block micronucleus assay is widely used for measuring/scoring/counting micronuclei, a marker of genome instability in cultured and primary cells. Though a gold standard method, this is a laborious and time-consuming process with person-to-person variation observed in quantification of micronuclei. We report in this study the utilisation of a new deep learning workflow for detection of micronuclei in DAPI stained nuclear images. The proposed deep learning framework achieved an average precision of >90% in detection of micronuclei. This proof of principle investigation in a DNA damage studies laboratory supports the idea of deploying AI powered tools in a cost-effective manner for repetitive and laborious tasks with relevant computational expertise. These systems will also help improving the quality of data and wellbeing of researchers.
Collapse
Affiliation(s)
- Anand Panchbhai
- Logy.AI, Machine Learning Research Division, Indian Institute of Technology Bhilai, Raipur India.
| | | | - Ahmed Sidali
- Genome engineering laboratory, University of Westminster, London W1W 6UW, United Kingdom
| | - Nadeen Solaiman
- Genome engineering laboratory, University of Westminster, London W1W 6UW, United Kingdom
| | - Smarana Pankanti
- Logy.AI, Machine Learning Research Division, Indian Institute of Technology Bhilai, Raipur India
| | - Radhakrishnan Kanagaraj
- Genome engineering laboratory, University of Westminster, London W1W 6UW, United Kingdom; School of Life Sciences, University of Bedfordshire, Park Square, Luton LU1 3JU, United Kingdom
| | - John J Murphy
- Genome engineering laboratory, University of Westminster, London W1W 6UW, United Kingdom
| | - Kalpana Surendranath
- Genome engineering laboratory, University of Westminster, London W1W 6UW, United Kingdom.
| |
Collapse
|
4
|
Wei W, Tao H, Chen W, Wu X. Automatic recognition of micronucleus by combining attention mechanism and AlexNet. BMC Med Inform Decis Mak 2022; 22:138. [PMID: 35585543 PMCID: PMC9116712 DOI: 10.1186/s12911-022-01875-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2022] [Accepted: 05/05/2022] [Indexed: 11/19/2022] Open
Abstract
Background Micronucleus (MN) is an abnormal fragment in a human cell caused by disorders in the mechanism regulating chromosome segregation. It can be used as a biomarker for genotoxicity, tumor risk, and tumor malignancy. The in vitro micronucleus assay is a commonly used method to detect micronucleus. However, it is time-consuming and the visual scoring can be inconsistent. Methods To alleviate this issue, we proposed a computer-aided diagnosis method combining convolutional neural networks and visual attention for micronucleus recognition. The backbone of our model is AlexNet without any dense layers and it is pretrained on the ImageNet dataset. Two attention modules are applied to extract cell image features and generate attention maps highlighting the region of interest to improve the interpretability of the network. Given the problems in the data set, we leverage data augmentation and focal loss to alleviate the impact. Results Experiments show that the proposed network yields better performance with fewer parameters. The AP value, F1 value and AUC value reach 0.932, 0.811 and 0.995, respectively. Conclusion In conclusion, the proposed network can effectively recognize micronucleus, and it can play an auxiliary role in clinical diagnosis by doctors.
Collapse
Affiliation(s)
- Weiyi Wei
- College of Computer Science and Engineering, Northwest Normal University, Lanzhou, China
| | - Hong Tao
- College of Computer Science and Engineering, Northwest Normal University, Lanzhou, China.
| | - Wenxia Chen
- College of Computer Science and Engineering, Northwest Normal University, Lanzhou, China
| | - Xiaoqin Wu
- Radiology Department, Gansu Provincial Center For Disease Control And Prevention, Lanzhou, China
| |
Collapse
|
5
|
Yi PS, Hu CJ, Li CH, Yu F. Clinical value of artificial intelligence in hepatocellular carcinoma: Current status and prospect. Artif Intell Gastroenterol 2021; 2:42-55. [DOI: 10.35712/aig.v2.i2.42] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/06/2021] [Revised: 02/25/2021] [Accepted: 03/16/2021] [Indexed: 02/06/2023] Open
Abstract
Hepatocellular carcinoma (HCC) is the most commonly diagnosed type of liver cancer and the fourth leading cause of cancer-related mortality worldwide. The early identification of HCC and effective treatments for it have been challenging. Due to the sufficient compensatory ability of early patients and its nonspecific symptoms, HCC is more likely to escape diagnosis in the incipient stage, during which patients can achieve a more satisfying overall survival if they undergo resection or liver transplantation. Patients at advanced stages can profit from radical therapies in a limited way. In order to improve the unfavorable prognosis of HCC, diagnostic ability and treatment efficiency must be improved. The past decade has seen rapid advancements in artificial intelligence, underlying its unique usefulness in almost every field, including that of medicine. Herein, we sought and reviewed studies that put emphasis on artificial intelligence and HCC.
Collapse
Affiliation(s)
- Peng-Sheng Yi
- Department of Hepato-Biliary-Pancreas II, Affiliated Hospital of North Sichuan Medical College, Nanchong 637000, Sichuan Province, China
| | - Chen-Jun Hu
- Department of Hepato-Biliary-Pancreas II, Affiliated Hospital of North Sichuan Medical College, Nanchong 637000, Sichuan Province, China
| | - Chen-Hui Li
- Department of Obstetrics and Gynecology, Nanchong Traditional Chinese Medicine Hospital, Nanchong 637000, Sichuan Province, China
| | - Fei Yu
- Department of Radiology, Yingshan County People’s Hospital, Nanchong 610041, Sichuan Province, China
| |
Collapse
|
6
|
Cheng DC, Chi JH, Yang SN, Liu SH. Organ Contouring for Lung Cancer Patients with a Seed Generation Scheme and Random Walks. SENSORS (BASEL, SWITZERLAND) 2020; 20:E4823. [PMID: 32858982 PMCID: PMC7506591 DOI: 10.3390/s20174823] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/25/2020] [Revised: 08/20/2020] [Accepted: 08/24/2020] [Indexed: 12/25/2022]
Abstract
In this study, we proposed a semi-automated and interactive scheme for organ contouring in radiotherapy planning for patients with non-small cell lung cancers. Several organs were contoured, including the lungs, airway, heart, spinal cord, body, and gross tumor volume (GTV). We proposed some schemes to automatically generate and vanish the seeds of the random walks (RW) algorithm. We considered 25 lung cancer patients, whose computed tomography (CT) images were obtained from the China Medical University Hospital (CMUH) in Taichung, Taiwan. The manual contours made by clinical oncologists were taken as the gold standard for comparison to evaluate the performance of our proposed method. The Dice coefficient between two contours of the same organ was computed to evaluate the similarity. The average Dice coefficients for the lungs, airway, heart, spinal cord, and body and GTV segmentation were 0.92, 0.84, 0.83, 0.73, 0.85 and 0.66, respectively. The computation time was between 2 to 4 min for a whole CT sequence segmentation. The results showed that our method has the potential to assist oncologists in the process of radiotherapy treatment in the CMUH, and hopefully in other hospitals as well, by saving a tremendous amount of time in contouring.
Collapse
Affiliation(s)
- Da-Chuan Cheng
- Department of Biomedical Imaging and Radiological Science, China Medical University, Taichung City 40402, Taiwan;
| | - Jen-Hong Chi
- Department of Diagnostic Radiology, Singapore General Hospital, Singapore 169608, Singapore;
| | - Shih-Neng Yang
- Department of Biomedical Imaging and Radiological Science, China Medical University, Taichung City 40402, Taiwan;
- Department of Radiation Oncology, China Medical University Hospital, Taichung City 40447, Taiwan
| | - Shing-Hong Liu
- Department of Computer Science and Information Engineering Chaoyang University of Technology, Taichung City 41349, Taiwan
| |
Collapse
|