1
|
Huang S, Deng G, Kang Y, Li J, Li J, Lyu M. Exploring deep learning strategies for intervertebral disc herniation detection on veterinary MRI. Sci Rep 2024; 14:16705. [PMID: 39030338 PMCID: PMC11271534 DOI: 10.1038/s41598-024-67749-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2024] [Accepted: 07/15/2024] [Indexed: 07/21/2024] Open
Abstract
Intervertebral Disc Herniation (IVDH) is a common spinal disease in dogs, significantly impacting their health, mobility, and overall well-being. This study initiates an effort to automate the detection and localization of IVDH lesions in veterinary MRI scans, utilizing advanced artificial intelligence (AI) methods. A comprehensive canine IVDH dataset, comprising T2-weighted sagittal MRI images from 213 pet dogs of various breeds, ages, and sizes, was compiled and utilized to train and test the IVDH detection models. The experimental results showed that traditional two-stage detection models reliably outperformed one-stage models, including the recent You Only Look Once X (YOLOX) detector. In terms of methodology, this study introduced a novel spinal localization module, successfully integrated into different object detection models to enhance IVDH detection, achieving an average precision (AP) of up to 75.32%. Additionally, transfer learning was explored to adapt the IVDH detection model for a smaller feline dataset. Overall, this study provides insights into advancing AI for veterinary care, identifying challenges and exploring potential strategies for future development in veterinary radiology.
Collapse
Affiliation(s)
| | | | - Yan Kang
- Shenzhen Technology University, Shenzhen, China
| | - Jianzhong Li
- Shenzhen GoldenStone Medical Technology Co., Ltd., Shenzhen, China
| | - Jingyu Li
- Shenzhen Technology University, Shenzhen, China.
| | - Mengye Lyu
- Shenzhen Technology University, Shenzhen, China.
| |
Collapse
|
2
|
Cheng CT, Ooyang CH, Kang SC, Liao CH. Applications of Deep Learning in Trauma Radiology: A Narrative Review. Biomed J 2024:100743. [PMID: 38679199 DOI: 10.1016/j.bj.2024.100743] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 03/26/2024] [Accepted: 04/24/2024] [Indexed: 05/01/2024] Open
Abstract
Diagnostic imaging is essential in modern trauma care for initial evaluation and identifying injuries requiring intervention. Deep learning (DL) has become mainstream in medical image analysis and has shown promising efficacy for classification, segmentation, and lesion detection. This narrative review provides the fundamental concepts for developing DL algorithms in trauma imaging and presents an overview of current progress in each modality. DL has been applied to detect free fluid on Focused Assessment with Sonography for Trauma (FAST), traumatic findings on chest and pelvic X-rays, and computed tomography (CT) scans, identify intracranial hemorrhage on head CT, detect vertebral fractures, and identify injuries to organs like the spleen, liver, and lungs on abdominal and chest CT. Future directions involve expanding dataset size and diversity through federated learning, enhancing model explainability and transparency to build clinician trust, and integrating multimodal data to provide more meaningful insights into traumatic injuries. Though some commercial artificial intelligence products are Food and Drug Administration-approved for clinical use in the trauma field, adoption remains limited, highlighting the need for multi-disciplinary teams to engineer practical, real-world solutions. Overall, DL shows immense potential to improve the efficiency and accuracy of trauma imaging, but thoughtful development and validation are critical to ensure these technologies positively impact patient care.
Collapse
Affiliation(s)
- Chi-Tung Cheng
- Department of Trauma and Emergency Surgery, Chang Gung Memorial Hospital, Linkou, Chang Gung University, Taoyuan Taiwan
| | - Chun-Hsiang Ooyang
- Department of Trauma and Emergency Surgery, Chang Gung Memorial Hospital, Linkou, Chang Gung University, Taoyuan Taiwan
| | - Shih-Ching Kang
- Department of Trauma and Emergency Surgery, Chang Gung Memorial Hospital, Linkou, Chang Gung University, Taoyuan Taiwan.
| | - Chien-Hung Liao
- Department of Trauma and Emergency Surgery, Chang Gung Memorial Hospital, Linkou, Chang Gung University, Taoyuan Taiwan
| |
Collapse
|
3
|
Manjila S, Alsalama AA, Medani K, Patel S, Prabhune A, Ramachandran SN, Mani S. Is foramen magnum decompression for acquired Chiari I malformation like putting a finger in the dyke? - A simplistic overview of artificial intelligence in assessing critical upstream and downstream etiologies. JOURNAL OF CRANIOVERTEBRAL JUNCTION AND SPINE 2024; 15:153-165. [PMID: 38957754 PMCID: PMC11216646 DOI: 10.4103/jcvjs.jcvjs_160_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2023] [Accepted: 01/09/2024] [Indexed: 07/04/2024] Open
Abstract
Background Missed diagnosis of evolving or coexisting idiopathic (IIH) and spontaneous intracranial hypotension (SIH) is often the reason for persistent or worsening symptoms after foramen magnum decompression for Chiari malformation (CM) I. We explore the role of artificial intelligence (AI)/convolutional neural networks (CNN) in Chiari I malformation in a combinatorial role for the first time in literature, exploring both upstream and downstream magnetic resonance findings as initial screening profilers in CM-1. We have also put together a review of all existing subtypes of CM and discuss the role of upright (gravity-aided) magnetic resonance imaging (MRI) in evaluating equivocal tonsillar descent on a lying-down MRI. We have formulated a workflow algorithm MaChiP 1.0 (Manjila Chiari Protocol 1.0) using upstream and downstream profilers, that cause de novo or worsening Chiari I malformation, which we plan to implement using AI. Materials and Methods The PRISMA guidelines were used for "CM and machine learning and CNN" on PubMed database articles, and four articles specific to the topic were encountered. The radiologic criteria for IIH and SIH were applied from neurosurgical literature, and they were applied between primary and secondary (acquired) Chiari I malformations. An upstream etiology such as IIH or SIH and an isolated downstream etiology in the spine were characterized using the existing body of literature. We propose the utility of using four selected criteria for IIH and SIH each, over MRI T2 images of the brain and spine, predominantly sagittal sequences in upstream etiology in the brain and multiplanar MRI in spinal lesions. Results Using MaChiP 1.0 (patent/ copyright pending) concepts, we have proposed the upstream and downstream profilers implicated in progressive Chiari I malformation. The upstream profilers included findings of brain sagging, slope of the third ventricular floor, pontomesencephalic angle, mamillopontine distance, lateral ventricular angle, internal cerebral vein-vein of Galen angle, and displacement of iter, clivus length, tonsillar descent, etc., suggestive of SIH. The IIH features noted in upstream pathologies were posterior flattening of globe of the eye, partial empty sella, optic nerve sheath distortion, and optic nerve tortuosity in MRI. The downstream etiologies involved spinal cerebrospinal fluid (CSF) leak from dural tear, meningeal diverticula, CSF-venous fistulae, etc. Conclusion AI would help offer predictive analysis along the spectrum of upstream and downstream etiologies, ensuring safety and efficacy in treating secondary (acquired) Chiari I malformation, especially with coexisting IIH and SIH. The MaChiP 1.0 algorithm can help document worsening of a previously diagnosed CM-1 and find the exact etiology of a secondary CM-I. However, the role of posterior fossa morphometry and cine-flow MRI data for intracranial CSF flow dynamics, along with advanced spinal CSF studies using dynamic myelo-CT scanning in the formation of secondary CM-I is still being evaluated.
Collapse
Affiliation(s)
- Sunil Manjila
- Department of Neurosurgery, Insight Institute of Neurosurgery and Neuroscience, Flint, MI, USA
| | | | - Khalid Medani
- Department of Occupational Medicine, Kaiser Permanente, Los Angeles, CA
| | - Shlok Patel
- Department of Orthopedic Surgery, BJ Medical College, Ahmedabad, Gujarat, India
| | - Anagha Prabhune
- Department of Neurosurgery, Sahyadri Medical Center, Pune, Maharashtra, India
| | | | - Sudhan Mani
- Department of Neurosurgery, Insight Institute of Neurosurgery and Neuroscience, Flint, MI, USA
| |
Collapse
|
4
|
Payne DL, Xu X, Faraji F, John K, Pradas KF, Bernard VV, Bangiyev L, Prasanna P. Automated Detection of Cervical Spinal Stenosis and Cord Compression via Vision Transformer and Rules-Based Classification. AJNR Am J Neuroradiol 2024; 45:ajnr.A8141. [PMID: 38360785 PMCID: PMC11288556 DOI: 10.3174/ajnr.a8141] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Accepted: 12/15/2023] [Indexed: 02/17/2024]
Abstract
BACKGROUND AND PURPOSE Cervical spinal cord compression, defined as spinal cord deformity and severe narrowing of the spinal canal in the cervical region, can lead to severe clinical consequences, including intractable pain, sensory disturbance, paralysis, and even death, and may require emergent intervention to prevent negative outcomes. Despite the critical nature of cord compression, no automated tool is available to alert clinical radiologists to the presence of such findings. This study aims to demonstrate the ability of a vision transformer (ViT) model for the accurate detection of cervical cord compression. MATERIALS AND METHODS A clinically diverse cohort of 142 cervical spine MRIs was identified, 34% of which were normal or had mild stenosis, 31% with moderate stenosis, and 35% with cord compression. Utilizing gradient-echo images, slices were labeled as no cord compression/mild stenosis, moderate stenosis, or severe stenosis/cord compression. Segmentation of the spinal canal was performed and confirmed by neuroradiology faculty. A pretrained ViT model was fine-tuned to predict section-level severity by using a train:validation:test split of 60:20:20. Each examination was assigned an overall severity based on the highest level of section severity, with an examination labeled as positive for cord compression if ≥1 section was predicted in the severe category. Additionally, 2 convolutional neural network (CNN) models (ResNet50, DenseNet121) were tested in the same manner. RESULTS The ViT model outperformed both CNN models at the section level, achieving section-level accuracy of 82%, compared with 72% and 78% for ResNet and DenseNet121, respectively. ViT patient-level classification achieved accuracy of 93%, sensitivity of 0.90, positive predictive value of 0.90, specificity of 0.95, and negative predictive value of 0.95. Receiver operating characteristic area under the curve was greater for ViT than either CNN. CONCLUSIONS This classification approach using a ViT model and rules-based classification accurately detects the presence of cervical spinal cord compression at the patient level. In this study, the ViT model outperformed both conventional CNN approaches at the section and patient levels. If implemented into the clinical setting, such a tool may streamline neuroradiology workflow, improving efficiency and consistency.
Collapse
Affiliation(s)
- David L Payne
- From the Department of Radiology (D.L.P., F.F., K.J., K.F.P., V.V.B., L.B.), Stony Brook University Hospital, Stony Brook, New York
- Department of Biomedical Informatics (D.L.P., X.X., F.F., K.J., P.P.), Stony Brook University, Stony Brook, New York
| | - Xuan Xu
- Department of Biomedical Informatics (D.L.P., X.X., F.F., K.J., P.P.), Stony Brook University, Stony Brook, New York
| | - Farshid Faraji
- From the Department of Radiology (D.L.P., F.F., K.J., K.F.P., V.V.B., L.B.), Stony Brook University Hospital, Stony Brook, New York
- Department of Biomedical Informatics (D.L.P., X.X., F.F., K.J., P.P.), Stony Brook University, Stony Brook, New York
| | - Kevin John
- From the Department of Radiology (D.L.P., F.F., K.J., K.F.P., V.V.B., L.B.), Stony Brook University Hospital, Stony Brook, New York
- Department of Biomedical Informatics (D.L.P., X.X., F.F., K.J., P.P.), Stony Brook University, Stony Brook, New York
| | - Katherine Ferra Pradas
- From the Department of Radiology (D.L.P., F.F., K.J., K.F.P., V.V.B., L.B.), Stony Brook University Hospital, Stony Brook, New York
| | - Vahni Vishala Bernard
- From the Department of Radiology (D.L.P., F.F., K.J., K.F.P., V.V.B., L.B.), Stony Brook University Hospital, Stony Brook, New York
| | - Lev Bangiyev
- From the Department of Radiology (D.L.P., F.F., K.J., K.F.P., V.V.B., L.B.), Stony Brook University Hospital, Stony Brook, New York
| | - Prateek Prasanna
- Department of Biomedical Informatics (D.L.P., X.X., F.F., K.J., P.P.), Stony Brook University, Stony Brook, New York
| |
Collapse
|
5
|
Liu B, Li J, Yang X, Chen F, Zhang Y, Li H. Diagnosis of primary clear cell carcinoma of the liver based on Faster region-based convolutional neural network. Chin Med J (Engl) 2023; 136:2706-2711. [PMID: 37882066 PMCID: PMC10684187 DOI: 10.1097/cm9.0000000000002853] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2022] [Indexed: 10/27/2023] Open
Abstract
BACKGROUND Distinguishing between primary clear cell carcinoma of the liver (PCCCL) and common hepatocellular carcinoma (CHCC) through traditional inspection methods before the operation is difficult. This study aimed to establish a Faster region-based convolutional neural network (RCNN) model for the accurate differential diagnosis of PCCCL and CHCC. METHODS In this study, we collected the data of 62 patients with PCCCL and 1079 patients with CHCC in Beijing YouAn Hospital from June 2012 to May 2020. A total of 109 patients with CHCC and 42 patients with PCCCL were randomly divided into the training validation set and the test set in a ratio of 4:1.The Faster RCNN was used for deep learning of patients' data in the training validation set, and established a convolutional neural network model to distinguish PCCCL and CHCC. The accuracy, average precision, and the recall of the model for diagnosing PCCCL and CHCC were used to evaluate the detection performance of the Faster RCNN algorithm. RESULTS A total of 4392 images of 121 patients (1032 images of 33 patients with PCCCL and 3360 images of 88 patients with CHCC) were uesd in test set for deep learning and establishing the model, and 1072 images of 30 patients (320 images of nine patients with PCCCL and 752 images of 21 patients with CHCC) were used to test the model. The accuracy of the model for accurately diagnosing PCCCL and CHCC was 0.962 (95% confidence interval [CI]: 0.931-0.992). The average precision of the model for diagnosing PCCCL was 0.908 (95% CI: 0.823-0.993) and that for diagnosing CHCC was 0.907 (95% CI: 0.823-0.993). The recall of the model for diagnosing PCCCL was 0.951 (95% CI: 0.916-0.985) and that for diagnosing CHCC was 0.960 (95% CI: 0.854-0.962). The time to make a diagnosis using the model took an average of 4 s for each patient. CONCLUSION The Faster RCNN model can accurately distinguish PCCCL and CHCC. This model could be important for clinicians to make appropriate treatment plans for patients with PCCCL or CHCC.
Collapse
Affiliation(s)
- Bin Liu
- Department of Radiology, Beijing YouAn Hospital Capital Medical University, Beijing 100069, China
- Department of Radiology, Civil Aviation General Hospital, Beijing 100123, China
| | - Jianfei Li
- Extenics Specialized Committee, Chinese Association of Artificial Intelligence, Beijing 100876, China
| | - Xue Yang
- Department of Radiology, Beijing YouAn Hospital Capital Medical University, Beijing 100069, China
| | - Feng Chen
- Department of Radiology, Beijing YouAn Hospital Capital Medical University, Beijing 100069, China
| | - Yanyan Zhang
- Department of Radiology, Beijing YouAn Hospital Capital Medical University, Beijing 100069, China
| | - Hongjun Li
- Department of Radiology, Beijing YouAn Hospital Capital Medical University, Beijing 100069, China
| |
Collapse
|
6
|
Yi W, Zhao J, Tang W, Yin H, Yu L, Wang Y, Tian W. Deep learning-based high-accuracy detection for lumbar and cervical degenerative disease on T2-weighted MR images. EUROPEAN SPINE JOURNAL : OFFICIAL PUBLICATION OF THE EUROPEAN SPINE SOCIETY, THE EUROPEAN SPINAL DEFORMITY SOCIETY, AND THE EUROPEAN SECTION OF THE CERVICAL SPINE RESEARCH SOCIETY 2023; 32:3807-3814. [PMID: 36943484 DOI: 10.1007/s00586-023-07641-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Revised: 01/31/2023] [Accepted: 03/05/2023] [Indexed: 03/23/2023]
Abstract
PURPOSE To develop and validate a deep learning (DL) model for detecting lumbar degenerative disease in both sagittal and axial views of T2-weighted MRI and evaluate its generalized performance in detecting cervical degenerative disease. METHODS T2-weighted MRI scans of 804 patients with symptoms of lumbar degenerative disease were retrospectively collected from three hospitals. The training dataset (n = 456) and internal validation dataset (n = 134) were randomly selected from the center I. Two external validation datasets comprising 100 and 114 patients were from center II and center III, respectively. A DL model based on 3D ResNet18 and transformer architecture was proposed to detect lumbar degenerative disease. In addition, a cervical MR image dataset comprising 200 patients from an independent hospital was used to evaluate the generalized performance of the DL model. The diagnostic performance was assessed by the free-response receiver operating characteristic (fROC) curve and precision-recall (PR) curve. Precision, recall, and F1-score were used to measure the DL model. RESULTS A total of 2497 three-dimension retrogression annotations were labeled for training (n = 1157) and multicenter validation (n = 1340). The DL model showed excellent detection efficiency in the internal validation dataset, with F1-score achieving 0.971 and 0.903 on the sagittal and axial MR images, respectively. Good performance was also observed in the external validation dataset I (F1-score, 0.768 on sagittal MR images and 0.837 on axial MR images) and external validation dataset II (F1-score, 0.787 on sagittal MR images and 0.770 on axial MR images). Furthermore, the robustness of the DL model was demonstrated via transfer learning and generalized performance evaluation on the external cervical dataset, with the F1-score yielding 0.931 and 0.919 on the sagittal and axial MR images, respectively. CONCLUSION The proposed DL model can automatically detect lumbar and cervical degenerative disease on T2-weighted MR images with good performance, robustness, and feasibility in clinical practice.
Collapse
Affiliation(s)
- Wei Yi
- Department of Spine Surgery, Beijing Jishuitan Hospital, Beijing, 100035, China.
| | - Jingwei Zhao
- Beijing Jishuitan Hospital, Research Unit of Intelligent Orthopedics, Chinese Academy of Medical Sciences, Beijing, China.
| | - Wen Tang
- Institute of Advanced Research, Infervision Medical Technology Co., Ltd, Beijing, Beijing, China
| | - Hongkun Yin
- Institute of Advanced Research, Infervision Medical Technology Co., Ltd, Beijing, Beijing, China
| | - Lifeng Yu
- The Second Hospital of Zhangjiakou City, Zhangjiakou, Hebei Province, China
| | - Yaohui Wang
- Department of Trauma, Beijing Water Conservancy Hospital, Beijing, 10036, China
| | - Wei Tian
- Beijing Jishuitan Hospital, Research Unit of Intelligent Orthopedics, Chinese Academy of Medical Sciences, Beijing, China
| |
Collapse
|
7
|
Zhong B, Yi J, Jin Z. AC-Faster R-CNN: an improved detection architecture with high precision and sensitivity for abnormality in spine x-ray images. Phys Med Biol 2023; 68:195021. [PMID: 37678268 DOI: 10.1088/1361-6560/acf7a8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Accepted: 09/07/2023] [Indexed: 09/09/2023]
Abstract
Objective.In clinical medicine, localization and identification of disease on spinal radiographs are difficult and require a high level of expertise in the radiological discipline and extensive clinical experience. The model based on deep learning acquires certain disease recognition abilities through continuous training, thereby assisting clinical physicians in disease diagnosis. This study aims to develop an object detection network that accurately locates and classifies the abnormal parts in spinal x-ray photographs.Approach.This study proposes a deep learning-based automated multi-disease detection architecture called Abnormality Capture-Faster Region-based Convolutional Neural Network (AC-Faster R-CNN), which develops the feature fusion structure Deformable Convolution Feature Pyramid Network and the abnormality capture structure Abnormality Capture Head. Through the combination of dilated and deformable convolutions, the model better captures the multi-scale information of lesions. To further improve the detection performance, the contrast enhancement algorithm Contrast Limited Adaptive Histogram Equalization is used for image preprocessing.Main results.The proposed model is extensively evaluated on a testing set containing 1007 spine x-ray images and the experimental results show that the AC-Faster R-CNN architecture outperforms the baseline model and other advanced detection architectures. The mean Average Precision at Intersection over Union of 50% are 39.8%, the Precision and Sensitivity at the optimal cutoff point of Precision-Recall curve are 48.6% and 46.3%, respectively, reaching the current state-of-the-art detection level.Significance.AC-Faster R-CNN exhibits high precision and sensitivity in abnormality detection tasks of spinal x-ray images, and effectively locates and identifies abnormal areas. Additionally, this study would provide reference and comparison for the further development of medical automatic detection.
Collapse
Affiliation(s)
- Bolin Zhong
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha 410004, People's Republic of China
| | - Jizheng Yi
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha 410004, People's Republic of China
- Yuelushan Laboratory Carbon Sinks Forests Variety Innovation Center, Changsha 410000, People's Republic of China
| | - Ze Jin
- Suzuki lab, Information and Artificial Intelligence Research International Hub Group, Tokyo 226-8503, Japan
- Laboratory for Future Interdisciplinary Research of Science and Technology, Institute of Innovative Research, Tokyo Institute of Technology, Tokyo 226-8503, Japan
| |
Collapse
|
8
|
Xu Z, Zhang X, Zhang H, Liu Y, Zhan Y, Lukasiewicz T. EFPN: Effective medical image detection using feature pyramid fusion enhancement. Comput Biol Med 2023; 163:107149. [PMID: 37348265 DOI: 10.1016/j.compbiomed.2023.107149] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Revised: 05/15/2023] [Accepted: 06/07/2023] [Indexed: 06/24/2023]
Abstract
Feature pyramid networks (FPNs) are widely used in the existing deep detection models to help them utilize multi-scale features. However, there exist two multi-scale feature fusion problems for the FPN-based deep detection models in medical image detection tasks: insufficient multi-scale feature fusion and the same importance for multi-scale features. Therefore, in this work, we propose a new enhanced backbone model, EFPNs, to overcome these problems and help the existing FPN-based detection models to achieve much better medical image detection performances. We first introduce an additional top-down pyramid to help the detection networks fuse deeper multi-scale information; then, a scale enhancement module is developed to use different sizes of kernels to generate more diverse multi-scale features. Finally, we propose a feature fusion attention module to estimate and assign different importance weights to features with different depths and scales. Extensive experiments are conducted on two public lesion detection datasets for different medical image modalities (X-ray and MRI). On the mAP and mR evaluation metrics, EFPN-based Faster R-CNNs improved 1.55% and 4.3% on the PenD (X-ray) dataset, and 2.74% and 3.1% on the BraTs (MRI) dataset, respectively. EFPN-based Faster R-CNNs achieve much better performances than the state-of-the-art baselines in medical image detection tasks. The proposed three improvements are all essential and effective for EFPNs to achieve superior performances; and besides Faster R-CNNs, EFPNs can be easily applied to other deep models to significantly enhance their performances in medical image detection tasks.
Collapse
Affiliation(s)
- Zhenghua Xu
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin, China.
| | - Xudong Zhang
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin, China
| | - Hexiang Zhang
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin, China.
| | - Yunxin Liu
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin, China
| | - Yuefu Zhan
- Department of Radiology, Hainan Women and Children's Medical Center, Haikou, China.
| | - Thomas Lukasiewicz
- Institute of Logic and Computation, TU Wien, Vienna, Austria; Department of Computer Science, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
9
|
Kaphle A, Jayarathna S, Moktan H, Aliru M, Raghuram S, Krishnan S, Cho SH. Deep Learning-Based TEM Image Analysis for Fully Automated Detection of Gold Nanoparticles Internalized Within Tumor Cell. MICROSCOPY AND MICROANALYSIS : THE OFFICIAL JOURNAL OF MICROSCOPY SOCIETY OF AMERICA, MICROBEAM ANALYSIS SOCIETY, MICROSCOPICAL SOCIETY OF CANADA 2023; 29:1474-1487. [PMID: 37488822 PMCID: PMC10433944 DOI: 10.1093/micmic/ozad066] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Revised: 04/28/2023] [Accepted: 05/22/2023] [Indexed: 07/26/2023]
Abstract
Transmission electron microscopy (TEM) imaging can be used for detection/localization of gold nanoparticles (GNPs) within tumor cells. However, quantitative analysis of GNP-containing cellular TEM images typically relies on conventional/thresholding-based methods, which are manual, time-consuming, and prone to human errors. In this study, therefore, deep learning (DL)-based methods were developed for fully automated detection of GNPs from cellular TEM images. Several models of "you only look once (YOLO)" v5 were implemented, with a few adjustments to enhance the model's performance by applying the transfer learning approach, adjusting the size of the input image, and choosing the best optimization algorithm. Seventy-eight original (12,040 augmented) TEM images of GNP-laden tumor cells were used for model implementation and validation. A maximum F1 score (harmonic mean of the precision and recall) of 0.982 was achieved by the best-trained models, while mean average precision was 0.989 and 0.843 at 0.50 and 0.50-0.95 intersection over union threshold, respectively. These results suggested the developed DL-based approach was capable of precisely estimating the number/position of internalized GNPs from cellular TEM images. A novel DL-based TEM image analysis tool from this study will benefit research/development efforts on GNP-based cancer therapeutics, for example, by enabling the modeling of GNP-laden tumor cells using nanometer-resolution TEM images.
Collapse
Affiliation(s)
- Amrit Kaphle
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Sandun Jayarathna
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Hem Moktan
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Maureen Aliru
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Subhiksha Raghuram
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Sunil Krishnan
- Vivian L. Smith Department of Neurosurgery, The University of Texas Health Science Center, Houston, TX 77030, USA
| | - Sang Hyun Cho
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| |
Collapse
|
10
|
Yan P, Li S, Zhou Z, Liu Q, Wu J, Ren Q, Chen Q, Chen Z, Chen Z, Chen S, Scholp A, Jiang JJ, Kang J, Ge P. Automated detection of glottic laryngeal carcinoma in laryngoscopic images from a multicentre database using a convolutional neural network. Clin Otolaryngol 2023; 48:436-441. [PMID: 36624555 DOI: 10.1111/coa.14029] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2021] [Revised: 11/22/2022] [Accepted: 12/31/2022] [Indexed: 01/11/2023]
Abstract
OBJECTIVE Little is known about the efficacy of using artificial intelligence (AI) to identify laryngeal carcinoma from images of vocal lesions taken in different hospitals with multiple laryngoscope systems. This multicentre study aimed to establish an AI system and provide a reliable auxiliary tool to screen for laryngeal carcinoma. STUDY DESIGN Multicentre case-control study. SETTING Six tertiary care centres. PARTICIPANTS Laryngoscopy images were collected from 2179 patients with vocal fold lesions. OUTCOME MEASURES An automatic detection system of laryngeal carcinoma was established and used to distinguish malignant and benign vocal lesions in 2179 laryngoscopy images acquired from 6 hospitals with 5 types of laryngoscopy systems. Pathological examination was the gold standard for identifying malignant and benign vocal lesions. RESULTS Out of 89 cases in the malignant group, the classifier was able to correctly identify laryngeal carcinoma in 66 patients (74.16%, sensitivity). Out of 640 cases in the benign group, the classifier was able to accurately assess the laryngeal lesion in 503 cases (78.59%, specificity). Furthermore, the region-based convolutional neural network (R-CNN) classifier achieved an overall accuracy of 78.05%, with a 95.63% negative predictive value and a 32.51% positive predictive value for the testing data set. CONCLUSION This automatic diagnostic system has the potential to assist clinical laryngeal carcinoma diagnosis which may improve and standardise the diagnostic capacity of laryngologists using different laryngoscopes.
Collapse
Affiliation(s)
- Peikai Yan
- Department of Otolaryngology & Head Neck Surgery, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China.,School of Medicine, South China University of Technology, Guangzhou, China
| | - Shaohua Li
- Department of Otorhinolaryngology Head and Neck Surgery, Zhongshan Hospital of Traditional Chinese Medicine, Affiliated to Guangzhou University of Chinese Medicine, Guangdong, Zhongshan, Guangdong, China
| | - Zhou Zhou
- Department of Otolaryngology, Shenzhen People's Hospital (The Second Clinical Medical College, Jinan University; The First Affiliated Hospital, Southern University of Science and Technology), Shenzhen, China
| | - Qian Liu
- Department of Otolaryngology, Shenzhen People's Hospital (The Second Clinical Medical College, Jinan University; The First Affiliated Hospital, Southern University of Science and Technology), Shenzhen, China
| | - Jiahui Wu
- Department of Otolaryngology & Head Neck Surgery, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
| | - Qingyi Ren
- Department of Otolaryngology & Head Neck Surgery, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
| | - Qiuhuan Chen
- Department of Otolaryngology, Zhaoqing Gaoyao People's Hospital, Zhaoqing, China
| | - Zhipeng Chen
- Department of Otolaryngology, The Second People's Hospital of Longgang District, Shenzhen, China
| | - Ze Chen
- Department of Otolaryngology, Gaozhou People's Hospital, Gaozhou, China
| | - Shaohua Chen
- Department of Otolaryngology & Head Neck Surgery, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
| | - Austin Scholp
- Department of Biomedical Engineering, University of Iowa, Iowa City, Iowa, USA.,Division of Otolaryngology-Head and Neck Surgery, Department of Surgery, School of Medicine and Public Health (A.S.), University of Wisconsin-Madison, Madison, Wisconsin, USA
| | - Jack J Jiang
- Division of Otolaryngology-Head and Neck Surgery, Department of Surgery, School of Medicine and Public Health (A.S.), University of Wisconsin-Madison, Madison, Wisconsin, USA
| | - Jing Kang
- Department of Otolaryngology & Head Neck Surgery, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China.,School of Medicine, South China University of Technology, Guangzhou, China
| | - Pingjiang Ge
- School of Medicine, South China University of Technology, Guangzhou, China
| |
Collapse
|
11
|
Cao Y, Ma H, Fan Y, Liu Y, Zhang H, Cao C, Yu H. A deep learning-based method for cervical transformation zone classification in colposcopy images. Technol Health Care 2023; 31:527-538. [PMID: 36093645 DOI: 10.3233/thc-220141] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND Colposcopy is one of the common methods of cervical cancer screening. The type of cervical transformation zone is considered one of the important factors for grading colposcopic findings and choosing treatment. OBJECTIVE This study aims to develop a deep learning-based method for automatic classification of cervical transformation zone from colposcopy images. METHODS We proposed a multiscale feature fusion classification network to classify cervical transformation zone, which can extract features from images and fuse them at multiple scales. Cervical regions were first detected from original colposcopy images and then fed into our multiscale feature fusion classification network. RESULTS The results on the test dataset showed that, compared with the state-of-the-art image classification models, the proposed classification network had the highest classification accuracy, reaching 88.49%, and the sensitivity to type 1, type 2 and type 3 were 90.12%, 85.95% and 89.45%, respectively, higher than the comparison methods. CONCLUSIONS The proposed method can automatically classify cervical transformation zone in colposcopy images, and can be used as an auxiliary tool in cervical cancer screening.
Collapse
Affiliation(s)
- Yuzhen Cao
- School of Precision Instrument and Opto-Electronics Engineering, Tianjin University, Tianjin, China
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Huizhan Ma
- School of Precision Instrument and Opto-Electronics Engineering, Tianjin University, Tianjin, China
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Yinuo Fan
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Yuzhen Liu
- Department of Obstetrics and Gynecology, Affiliated Hospital of Weifang Medical University, Weifang, Shandong, China
| | - Haifeng Zhang
- Department of Obstetrics and Gynecology, Affiliated Hospital of Weifang Medical University, Weifang, Shandong, China
| | - Chengcheng Cao
- Department of Obstetrics and Gynecology, Affiliated Hospital of Weifang Medical University, Weifang, Shandong, China
| | - Hui Yu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- School of Precision Instrument and Opto-Electronics Engineering, Tianjin University, Tianjin, China
| |
Collapse
|
12
|
Liu X, Zhou K, Yao J, Wang M, Zhang Y. Contrastive uncertainty based biomarkers detection in retinal optical coherence tomography images. Phys Med Biol 2022; 67. [PMID: 36384040 DOI: 10.1088/1361-6560/aca376] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Accepted: 11/16/2022] [Indexed: 11/18/2022]
Abstract
Objective.Retinal biomarker in optical coherence tomography (OCT) images plays a key guiding role in the follow-up diagnosis and clinical treatment of eye diseases. Although there have been many deep learning methods to automatically process retinal biomarker, the detection of retinal biomarkers is still a great challenge due to the similar characteristics to normal tissue, large changes in size and shape and fuzzy boundary of different types of biomarkers. To overcome these challenges, a novel contrastive uncertainty network (CUNet) is proposed for retinal biomarkers detection in OCT images.Approach.In CUNet, proposal contrastive learning is designed to enhance the feature representation of retinal biomarkers, aiming at boosting the discrimination ability of network between different types of retinal biomarkers. Furthermore, we proposed bounding box uncertainty and combined it with the traditional bounding box regression, thereby improving the sensitivity of the network to the fuzzy boundaries of retinal biomarkers, and to obtain a better localization result.Main results.Comprehensive experiments are conducted to evaluate the performance of the proposed CUNet. The experimental results on two datasets show that our proposed method achieves good detection performance compared with other detection methods.Significance.We propose a method for retinal biomarker detection trained by bounding box labels. The proposal contrastive learning and bounding box uncertainty are used to improve the detection of retinal biomarkers. The method is designed to help reduce the amount of work doctors have to do to detect retinal diseases.
Collapse
Affiliation(s)
- Xiaoming Liu
- School of Computer Science and Technology, Wuhan University of Science and Technology, Wuhan, 430065, People's Republic of China.,Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System, Wuhan, 430065, People's Republic of China
| | - Kejie Zhou
- School of Computer Science and Technology, Wuhan University of Science and Technology, Wuhan, 430065, People's Republic of China.,Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System, Wuhan, 430065, People's Republic of China
| | - Junping Yao
- Department of Ophthalmology, Tianyou Hospital Affiliated to Wuhan University of Science and Technology, Wuhan, People's Republic of China
| | - Man Wang
- Wuhan Aier Eye Hospital of Wuhan University, Wuhan, People's Republic of China
| | - Ying Zhang
- Wuhan Aier Eye Hospital of Wuhan University, Wuhan, People's Republic of China
| |
Collapse
|
13
|
Jang WS, Kim S, Yun PS, Jang HS, Seong YW, Yang HS, Chang JS. Accurate detection for dental implant and peri-implant tissue by transfer learning of faster R-CNN: a diagnostic accuracy study. BMC Oral Health 2022; 22:591. [PMID: 36494645 PMCID: PMC9737962 DOI: 10.1186/s12903-022-02539-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Accepted: 10/26/2022] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND The diagnosis of dental implants and the periapical tissues using periapical radiographs is crucial. Recently, artificial intelligence has shown a rapid advancement in the field of radiographic imaging. PURPOSE This study attempted to detect dental implants and peri-implant tissues by using a deep learning method known as object detection on the implant image of periapical radiographs. METHODS After implant treatment, the periapical images were collected and data were processed by labeling the dental implant and peri-implant tissue together in the images. Next, 300 images of the periapical radiographs were split into 80:20 ratio (i.e. 80% of the data were used for training the model while 20% were used for testing the model). These were evaluated using an object detection model known as Faster R-CNN, which simultaneously performs classification and localization. This model was evaluated on the classification performance using metrics, including precision, recall, and F1 score. Additionally, in order to assess the localization performance, an evaluation through intersection over union (IoU) was utilized, and, Average Precision (AP) was used to assess both the classification and localization performance. RESULTS Considering the classification performance, precision = 0.977, recall = 0.992, and F1 score = 0.984 were derived. The indicator of localization was derived as mean IoU = 0.907. On the other hand, considering the indicators of both classification and localization performance, AP showed an object detection level of AP@0.5 = 0.996 and AP@0.75 = 0.967. CONCLUSION Thus, the implementation of Faster R-CNN model for object detection on 300 periapical radiographic images including dental implants, resulted in high-quality object detection for dental implants and peri-implant tissues.
Collapse
Affiliation(s)
- Woo Sung Jang
- grid.15444.300000 0004 0470 5454Department of Artificial Intelligence, College of Engineering, Yonsei University, Seoul, Korea
| | - Sunjai Kim
- grid.15444.300000 0004 0470 5454Department of Prosthodontics, Gangnam Severance Dental Hospital, College of Dentistry, Yonsei University, 211 Eonju-ro, Gangnam-gu, 06273 Seoul, Korea
| | - Pill Sang Yun
- grid.15444.300000 0004 0470 5454Department of Prosthodontics, Gangnam Severance Dental Hospital, College of Dentistry, Yonsei University, 211 Eonju-ro, Gangnam-gu, 06273 Seoul, Korea
| | - Han Sol Jang
- grid.15444.300000 0004 0470 5454Department of Prosthodontics, Gangnam Severance Dental Hospital, College of Dentistry, Yonsei University, 211 Eonju-ro, Gangnam-gu, 06273 Seoul, Korea
| | - You Won Seong
- grid.26999.3d0000 0001 2151 536XGraduate School of Public Policy, The University of Tokyo, Tokyo, Japan
| | - Hee Soo Yang
- grid.15444.300000 0004 0470 5454Department of Mechanical Engineering, College of Engineering, Yonsei University, Seoul, Korea
| | - Jae-Seung Chang
- grid.15444.300000 0004 0470 5454Department of Prosthodontics, Gangnam Severance Dental Hospital, College of Dentistry, Yonsei University, 211 Eonju-ro, Gangnam-gu, 06273 Seoul, Korea
| |
Collapse
|
14
|
Tian SZ, Yin P, Jing K, Yang Y, Xu Y, Huang G, Ning D, Fullwood MJ, Zheng M. MCI-frcnn: A deep learning method for topological micro-domain boundary detection. Front Cell Dev Biol 2022; 10:1050769. [DOI: 10.3389/fcell.2022.1050769] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Accepted: 11/07/2022] [Indexed: 12/05/2022] Open
Abstract
Chromatin structural domains, or topologically associated domains (TADs), are a general organizing principle in chromatin biology. RNA polymerase II (RNAPII) mediates multiple chromatin interactive loops, tethering together as RNAPII-associated chromatin interaction domains (RAIDs) to offer a framework for gene regulation. RAID and TAD alterations have been found to be associated with diseases. They can be further dissected as micro-domains (micro-TADs and micro-RAIDs) by clustering single-molecule chromatin-interactive complexes from next-generation three-dimensional (3D) genome techniques, such as ChIA-Drop. Currently, there are few tools available for micro-domain boundary identification. In this work, we developed the MCI-frcnn deep learning method to train a Faster Region-based Convolutional Neural Network (Faster R-CNN) for micro-domain boundary detection. At the training phase in MCI-frcnn, 50 images of RAIDs from Drosophila RNAPII ChIA-Drop data, containing 261 micro-RAIDs with ground truth boundaries, were trained for 7 days. Using this well-trained MCI-frcnn, we detected micro-RAID boundaries for the input new images, with a fast speed (5.26 fps), high recognition accuracy (AUROC = 0.85, mAP = 0.69), and high boundary region quantification (genomic IoU = 76%). We further applied MCI-frcnn to detect human micro-TADs boundaries using human GM12878 SPRITE data and obtained a high region quantification score (mean gIoU = 85%). In all, the MCI-frcnn deep learning method which we developed in this work is a general tool for micro-domain boundary detection.
Collapse
|
15
|
Baur D, Kroboth K, Heyde CE, Voelker A. Convolutional Neural Networks in Spinal Magnetic Resonance Imaging: A Systematic Review. World Neurosurg 2022; 166:60-70. [PMID: 35863650 DOI: 10.1016/j.wneu.2022.07.041] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2022] [Revised: 07/08/2022] [Accepted: 07/09/2022] [Indexed: 12/15/2022]
Abstract
OBJECTIVE Convolutional neural networks (CNNs) are being increasingly used in the medical field, especially for image recognition in high-resolution, large-volume data sets. The study represents the current state of research on the application of CNNs in image segmentation and pathology detection in spine magnetic resonance imaging. METHODS For this systematic literature review, the authors performed a systematic initial search of the PubMed/Medline and Web of Science (Core collection) databases for eligible investigations. The authors limited the search to observational studies. Outcome parameters were analyzed according to the inclusion criteria and assigned to 3 groups: 1) segmentation of anatomical structures, 2) segmentation and evaluation of pathologic structures, and 3) specific implementation of CNNs. RESULTS Twenty-four retrospectively designed articles met the inclusion criteria. Publication dates ranged from 2017 to 2021. In total, 14,065 patients with 113,110 analyzed images were included. Most authors trained their network with a training-to-testing ratio of 80/20, while all but 2 articles used 5- to 10-fold cross-validation. Nine articles compared their performance results with other neural networks and algorithms, and all 24 articles described outcomes as positive. CONCLUSIONS State-of-the-art CNNs can detect and segment-specific anatomical landmarks and pathologies across a wide range, comparable to the skills of radiologists and experienced clinicians. With rapidly evolving network architectures and growing medical image databases, the future is likely to show growth in the development and refinement of these capable networks. However, the aid of automated segmentation and classification by neural networks cannot and should not be expected to replace clinical experts.
Collapse
Affiliation(s)
- David Baur
- Department of Orthopedics, Trauma and Plastic Surgery, University Hospital Leipzig, Leipzig, Germany
| | - Katharina Kroboth
- Department of Orthopedics, Trauma and Plastic Surgery, University Hospital Leipzig, Leipzig, Germany
| | - Christoph-Eckhard Heyde
- Department of Orthopedics, Trauma and Plastic Surgery, University Hospital Leipzig, Leipzig, Germany
| | - Anna Voelker
- Department of Orthopedics, Trauma and Plastic Surgery, University Hospital Leipzig, Leipzig, Germany.
| |
Collapse
|
16
|
Qu B, Cao J, Qian C, Wu J, Lin J, Wang L, Ou-Yang L, Chen Y, Yan L, Hong Q, Zheng G, Qu X. Current development and prospects of deep learning in spine image analysis: a literature review. Quant Imaging Med Surg 2022; 12:3454-3479. [PMID: 35655825 PMCID: PMC9131328 DOI: 10.21037/qims-21-939] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Accepted: 03/04/2022] [Indexed: 10/07/2023]
Abstract
BACKGROUND AND OBJECTIVE As the spine is pivotal in the support and protection of human bodies, much attention is given to the understanding of spinal diseases. Quick, accurate, and automatic analysis of a spine image greatly enhances the efficiency with which spine conditions can be diagnosed. Deep learning (DL) is a representative artificial intelligence technology that has made encouraging progress in the last 6 years. However, it is still difficult for clinicians and technicians to fully understand this rapidly evolving field due to the diversity of applications, network structures, and evaluation criteria. This study aimed to provide clinicians and technicians with a comprehensive understanding of the development and prospects of DL spine image analysis by reviewing published literature. METHODS A systematic literature search was conducted in the PubMed and Web of Science databases using the keywords "deep learning" and "spine". Date ranges used to conduct the search were from 1 January, 2015 to 20 March, 2021. A total of 79 English articles were reviewed. KEY CONTENT AND FINDINGS The DL technology has been applied extensively to the segmentation, detection, diagnosis, and quantitative evaluation of spine images. It uses static or dynamic image information, as well as local or non-local information. The high accuracy of analysis is comparable to that achieved manually by doctors. However, further exploration is needed in terms of data sharing, functional information, and network interpretability. CONCLUSIONS The DL technique is a powerful method for spine image analysis. We believe that, with the joint efforts of researchers and clinicians, intelligent, interpretable, and reliable DL spine analysis methods will be widely applied in clinical practice in the future.
Collapse
Affiliation(s)
- Biao Qu
- Department of Instrumental and Electrical Engineering, Xiamen University, Xiamen, China
| | - Jianpeng Cao
- Department of Electronic Science, Biomedical Intelligent Cloud R&D Center, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China
| | - Chen Qian
- Department of Electronic Science, Biomedical Intelligent Cloud R&D Center, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China
| | - Jinyu Wu
- Department of Electronic Science, Biomedical Intelligent Cloud R&D Center, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China
| | - Jianzhong Lin
- Department of Radiology, Zhongshan Hospital of Xiamen University, Xiamen, China
| | - Liansheng Wang
- Department of Computer Science, School of Informatics, Xiamen University, Xiamen, China
| | - Lin Ou-Yang
- Department of Medical Imaging of Southeast Hospital, Medical College of Xiamen University, Zhangzhou, China
| | - Yongfa Chen
- Department of Pediatric Orthopedic Surgery, The First Affiliated Hospital of Xiamen University, Xiamen, China
| | - Liyue Yan
- Department of Information & Computational Mathematics, Xiamen University, Xiamen, China
| | - Qing Hong
- Biomedical Intelligent Cloud R&D Center, China Mobile Group, Xiamen, China
| | - Gaofeng Zheng
- Department of Instrumental and Electrical Engineering, Xiamen University, Xiamen, China
| | - Xiaobo Qu
- Department of Electronic Science, Biomedical Intelligent Cloud R&D Center, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China
| |
Collapse
|
17
|
He Y, Tan J, Han X. High-Resolution Computer Tomography Image Features of Lungs for Patients with Type 2 Diabetes under the Faster-Region Recurrent Convolutional Neural Network Algorithm. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:4147365. [PMID: 35509859 PMCID: PMC9061003 DOI: 10.1155/2022/4147365] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/22/2021] [Revised: 01/11/2022] [Accepted: 03/30/2022] [Indexed: 12/17/2022]
Abstract
The objective of this study was to adopt the high-resolution computed tomography (HRCT) technology based on the faster-region recurrent convolutional neural network (Faster-RCNN) algorithm to evaluate the lung infection in patients with type 2 diabetes, so as to analyze the application value of imaging features in the assessment of pulmonary disease in type 2 diabetes. In this study, 176 patients with type 2 diabetes were selected as the research objects, and they were divided into different groups based on gender, course of disease, age, glycosylated hemoglobin level (HbA1c), 2 h C peptide (2 h C-P) after meal, fasting C peptide (FC-P), and complications. The research objects were performed with HRCT scan, and the Faster-RCNN algorithm model was built to obtain the imaging features. The relationships between HRCT imaging features and 2 h C-P, FC-P, HbA1c, gender, course of disease, age, and complications were analyzed comprehensively. The results showed that there were no significant differences in HRCT scores between male and female patients, patients of various ages, and patients with different HbA1c contents (P > 0.05). As the course of disease and complications increased, HRCT scores of patients increased obviously (P < 0.05). The HRCT score decreased dramatically with the increase in the contents of 2 h C-P and FC-P after the meal (P < 0.05). In addition, the results of the Spearman rank correlation analysis showed that the course of disease and complications were positively correlated with the HRCT scores, while the 2 h C-P and FC-P levels after meal were negatively correlated with the HRCT scores. The receiver operating curve (ROC) showed that the accuracy, specificity, and sensitivity of HRCT imaging based on Faster-RCNN algorithm were 90.12%, 90.43%, and 83.64%, respectively, in diagnosing lung infection of patients with type 2 diabetes. In summary, the HRCT imaging features based on the Faster-RCNN algorithm can provide effective reference information for the diagnosis and condition assessment of lung infection in patients with type 2 diabetes.
Collapse
Affiliation(s)
- Yumei He
- Department of General Medicine, Affiliated Hospital of Yan'an University, Yan'an, 716000 Shaanxi, China
| | - Juan Tan
- Department of Traditional Chinese Medicine, Affiliated Hospital of Yan'an University, Yan'an, 716000 Shaanxi, China
| | - Xiuping Han
- Department of General Medicine, Affiliated Hospital of Yan'an University, Yan'an, 716000 Shaanxi, China
| |
Collapse
|
18
|
Runx1 Messenger RNA Delivered by Polyplex Nanomicelles Alleviate Spinal Disc Hydration Loss in a Rat Disc Degeneration Model. Int J Mol Sci 2022; 23:ijms23010565. [PMID: 35008997 PMCID: PMC8745749 DOI: 10.3390/ijms23010565] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Revised: 12/18/2021] [Accepted: 01/03/2022] [Indexed: 02/04/2023] Open
Abstract
Vertebral disc degenerative disease (DDD) affects millions of people worldwide and is a critical factor leading to low back and neck pain and consequent disability. Currently, no strategy has addressed curing DDD from fundamental aspects, because the pathological mechanism leading to DDD is still controversial. One possible mechanism points to the homeostatic status of extracellular matrix (ECM) anabolism, and catabolism in the disc may play a vital role in the disease’s progression. If the damaged disc receives an abundant amount of cartilage, anabolic factors may stimulate the residual cells in the damaged disc to secrete the ECM and mitigate the degeneration process. To examine this hypothesis, a cartilage anabolic factor, Runx1, was expressed by mRNA through a sophisticated polyamine-based PEG-polyplex nanomicelle delivery system in the damaged disc in a rat model. The mRNA medicine and polyamine carrier have favorable safety characteristics and biocompatibility for regenerative medicine. The endocytosis of mRNA-loaded polyplex nanomicelles in vitro, mRNA delivery efficacy, hydration content, disc shrinkage, and ECM in the disc in vivo were also examined. The data revealed that the mRNA-loaded polyplex nanomicelle was promptly engulfed by cellular late endosome, then spread into the cytosol homogeneously at a rate of less than 20 min post-administration of the mRNA medicine. The mRNA expression persisted for at least 6-days post-injection in vivo. Furthermore, the Runx1 mRNA delivered by polyplex nanomicelles increased hydration content by ≈43% in the punctured disc at 4-weeks post-injection (wpi) compared with naked Runx1 mRNA administration. Meanwhile, the disc space and ECM production were also significantly ameliorated in the polyplex nanomicelle group. This study demonstrated that anabolic factor administration by polyplex nanomicelle-protected mRNA medicine, such as Runx1, plays a key role in alleviating the progress of DDD, which is an imbalance scenario of disc metabolism. This platform could be further developed as a promising strategy applied to regenerative medicine.
Collapse
|
19
|
Deep Learning-Based CT Imaging in Diagnosing Myeloma and Its Prognosis Evaluation. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:5436793. [PMID: 34552707 PMCID: PMC8452442 DOI: 10.1155/2021/5436793] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/13/2021] [Revised: 08/20/2021] [Accepted: 08/23/2021] [Indexed: 11/30/2022]
Abstract
Imaging examination plays an important role in the early diagnosis of myeloma. The study focused on the segmentation effects of deep learning-based models on CT images for myeloma, and the influence of different chemotherapy treatments on the prognosis of patients. Specifically, 186 patients with suspected myeloma were the research subjects. The U-Net model was adjusted to segment the CT images, and then, the Faster region convolutional neural network (RCNN) model was used to label the lesions. Patients were divided into bortezomib group (group 1, n = 128) and non-bortezomib group (group 2, n = 58). The biochemical indexes, blood routine indexes, and skeletal muscle of the two groups were compared before and after chemotherapy. The results showed that the improved U-Net model demonstrated good segmentation results, the Faster RCNN model can realize the labeling of the lesion area in the CT image, and the classification accuracy rate was as high as 99%. Compared with group 1, group 2 showed enlarged psoas major and erector spinae muscle after treatment and decreased bone marrow plasma cells content, blood M protein, urine 24 h light chain, pBNP, ß-2 microglobulin (β2MG), ALP, and white blood cell (WBC) levels (P < 0.05). In conclusion, deep learning is suggested in the segmentation and classification of CT images for myeloma, which can lift the detection accuracy. Two different chemotherapy regimens both improve the prognosis of patients, but the effects of non-bortezomib chemotherapy are better.
Collapse
|