1
|
Ma Z, Chen Z, Zheng X, Wang T, You Y, Zou S, Wang Y. A Biological Immunity-Based Neuro Prototype for Few-Shot Anomaly Detection with Character Embedding. CYBORG AND BIONIC SYSTEMS 2024; 5:0086. [PMID: 38234315 PMCID: PMC10793867 DOI: 10.34133/cbsystems.0086] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2023] [Accepted: 12/11/2023] [Indexed: 01/19/2024] Open
Abstract
Anomaly detection has wide applications to help people recognize false, intrusion, flaw, equipment failure, etc. In most practical scenarios, the amount of the annotated data and the trusted labels is low, resulting in poor performance of the detection. In this paper, we focus on the anomaly detection for the text type data and propose a detection network based on biological immunity for few-shot detection, by imitating the working mechanism of the immune system of biological organisms. This network enabling the protected system to distinguish the aggressive behavior of "nonself" from the legitimate behavior of "self" by embedding characters. First, it constructs episodic task sets and extracts data representations at the character level. Then, in the pretraining phase, Word2Vec is used to embed the representations. In the meta-learning phase, a dynamic prototype containing encoder, routing, and relation is designed to identify the data traffic. Compare to the mean-based prototype, the proposed prototype applies a dynamic routing algorithm that assigns different weights to samples in the support set through multiple iterations to obtain a prototype that combines the distribution of samples. The proposed method is validated on 2 real traffic datasets. The experimental results indicate that (a) the proposed anomaly detection prototype outperforms state-of-the-art few-shot techniques with 1.3% to 4.48% accuracy and 0.18% to 4.55% recall; (b) under the premise of ensuring the accuracy and recall, the number of training samples is reduced to 5 or 10; (c) ablation experiments are designed for each module, and the results show that more accurate prototypes can be obtained by using the dynamic routing algorithm.
Collapse
Affiliation(s)
- Zhongjing Ma
- School of Automation,
Beijing Institute of Technology, Beijing 100081, China
| | - Zhan Chen
- School of Automation,
Beijing Institute of Technology, Beijing 100081, China
| | - Xiaochen Zheng
- ETH AI Center, Andreasstrasse 5, 8092 Zürich, Switzerland
| | - Tianyu Wang
- School of Automation,
Beijing Institute of Technology, Beijing 100081, China
| | - Yuyang You
- School of Automation,
Beijing Institute of Technology, Beijing 100081, China
| | - Suli Zou
- School of Automation,
Beijing Institute of Technology, Beijing 100081, China
| | - Yu Wang
- State Key Lab of Multimodal Artificial Intelligence Systems, Institute of Automation,
Chinese Academy of Sciences, Beijing 100095, China
| |
Collapse
|
2
|
Zhang J, Zou H. Insights into artificial intelligence in myopia management: from a data perspective. Graefes Arch Clin Exp Ophthalmol 2024; 262:3-17. [PMID: 37231280 PMCID: PMC10212230 DOI: 10.1007/s00417-023-06101-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2022] [Revised: 03/23/2023] [Accepted: 05/06/2023] [Indexed: 05/27/2023] Open
Abstract
Given the high incidence and prevalence of myopia, the current healthcare system is struggling to handle the task of myopia management, which is worsened by home quarantine during the ongoing COVID-19 pandemic. The utilization of artificial intelligence (AI) in ophthalmology is thriving, yet not enough in myopia. AI can serve as a solution for the myopia pandemic, with application potential in early identification, risk stratification, progression prediction, and timely intervention. The datasets used for developing AI models are the foundation and determine the upper limit of performance. Data generated from clinical practice in managing myopia can be categorized into clinical data and imaging data, and different AI methods can be used for analysis. In this review, we comprehensively review the current application status of AI in myopia with an emphasis on data modalities used for developing AI models. We propose that establishing large public datasets with high quality, enhancing the model's capability of handling multimodal input, and exploring novel data modalities could be of great significance for the further application of AI for myopia.
Collapse
Affiliation(s)
- Juzhao Zhang
- Department of Ophthalmology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Haidong Zou
- Department of Ophthalmology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
- Shanghai Eye Diseases Prevention & Treatment Center, Shanghai Eye Hospital, Shanghai, China.
- National Clinical Research Center for Eye Diseases, Shanghai, China.
- Shanghai Engineering Center for Precise Diagnosis and Treatment of Eye Diseases, Shanghai, China.
| |
Collapse
|
3
|
Jia J, Wei Z, Cao X. EMDL-ac4C: identifying N4-acetylcytidine based on ensemble two-branch residual connection DenseNet and attention. Front Genet 2023; 14:1232038. [PMID: 37519885 PMCID: PMC10372626 DOI: 10.3389/fgene.2023.1232038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Accepted: 06/29/2023] [Indexed: 08/01/2023] Open
Abstract
Introduction: N4-acetylcytidine (ac4C) is a critical acetylation modification that has an essential function in protein translation and is associated with a number of human diseases. Methods: The process of identifying ac4C sites by biological experiments is too cumbersome and costly. And the performance of several existing computational models needs to be improved. Therefore, we propose a new deep learning tool EMDL-ac4C to predict ac4C sites, which uses a simple one-hot encoding for a unbalanced dataset using a downsampled ensemble deep learning network to extract important features to identify ac4C sites. The base learner of this ensemble model consists of a modified DenseNet and Squeeze-and-Excitation Networks. In addition, we innovatively add a convolutional residual structure in parallel with the dense block to achieve the effect of two-layer feature extraction. Results: The average accuracy (Acc), mathews correlation coefficient (MCC), and area under the curve Area under curve of EMDL-ac4C on ten independent testing sets are 80.84%, 61.77%, and 87.94%, respectively. Discussion: Multiple experimental comparisons indicate that EMDL-ac4C outperforms existing predictors and it greatly improved the predictive performance of the ac4C sites. At the same time, EMDL-ac4C could provide a valuable reference for the next part of the study. The source code and experimental data are available at: https://github.com/13133989982/EMDLac4C.
Collapse
Affiliation(s)
- Jianhua Jia
- *Correspondence: Jianhua Jia, ; Zhangying Wei,
| | | | | |
Collapse
|
4
|
Zhang J, Zou H. Artificial intelligence technology for myopia challenges: A review. Front Cell Dev Biol 2023; 11:1124005. [PMID: 36733459 PMCID: PMC9887165 DOI: 10.3389/fcell.2023.1124005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2022] [Accepted: 01/10/2023] [Indexed: 01/19/2023] Open
Abstract
Myopia is a significant global health concern and affects human visual function, resulting in blurred vision at a distance. There are still many unsolved challenges in this field that require the help of new technologies. Currently, artificial intelligence (AI) technology is dominating medical image and data analysis and has been introduced to address challenges in the clinical practice of many ocular diseases. AI research in myopia is still in its early stages. Understanding the strengths and limitations of each AI method in specific tasks of myopia could be of great value and might help us to choose appropriate approaches for different tasks. This article reviews and elaborates on the technical details of AI methods applied for myopia risk prediction, screening and diagnosis, pathogenesis, and treatment.
Collapse
Affiliation(s)
- Juzhao Zhang
- Department of Ophthalmology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Haidong Zou
- Department of Ophthalmology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China,Shanghai Eye Diseases Prevention and Treatment Center, Shanghai Eye Hospital, Shanghai, China,National Clinical Research Center for Eye Diseases, Shanghai, China,Shanghai Engineering Center for Precise Diagnosis and Treatment of Eye Diseases, Shanghai, China,*Correspondence: Haidong Zou,
| |
Collapse
|
5
|
Zou H, Shi S, Yang X, Ma J, Fan Q, Chen X, Wang Y, Zhang M, Song J, Jiang Y, Li L, He X, Jhanji V, Wang S, Song M, Wang Y. Identification of ocular refraction based on deep learning algorithm as a novel retinoscopy method. Biomed Eng Online 2022; 21:87. [PMID: 36528597 PMCID: PMC9758840 DOI: 10.1186/s12938-022-01057-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2022] [Accepted: 12/05/2022] [Indexed: 12/23/2022] Open
Abstract
BACKGROUND The evaluation of refraction is indispensable in ophthalmic clinics, generally requiring a refractor or retinoscopy under cycloplegia. Retinal fundus photographs (RFPs) supply a wealth of information related to the human eye and might provide a promising approach that is more convenient and objective. Here, we aimed to develop and validate a fusion model-based deep learning system (FMDLS) to identify ocular refraction via RFPs and compare with the cycloplegic refraction. In this population-based comparative study, we retrospectively collected 11,973 RFPs from May 1, 2020 to November 20, 2021. The performance of the regression models for sphere and cylinder was evaluated using mean absolute error (MAE). The accuracy, sensitivity, specificity, area under the receiver operating characteristic curve, and F1-score were used to evaluate the classification model of the cylinder axis. RESULTS Overall, 7873 RFPs were retained for analysis. For sphere and cylinder, the MAE values between the FMDLS and cycloplegic refraction were 0.50 D and 0.31 D, representing an increase of 29.41% and 26.67%, respectively, when compared with the single models. The correlation coefficients (r) were 0.949 and 0.807, respectively. For axis analysis, the accuracy, specificity, sensitivity, and area under the curve value of the classification model were 0.89, 0.941, 0.882, and 0.814, respectively, and the F1-score was 0.88. CONCLUSIONS The FMDLS successfully identified the ocular refraction in sphere, cylinder, and axis, and showed good agreement with the cycloplegic refraction. The RFPs can provide not only comprehensive fundus information but also the refractive state of the eye, highlighting their potential clinical value.
Collapse
Affiliation(s)
- Haohan Zou
- grid.265021.20000 0000 9792 1228Clinical College of Ophthalmology, Tianjin Medical University, Tianjin, China ,grid.216938.70000 0000 9878 7032Tianjin Key Lab of Ophthalmology and Visual Science, Tianjin Eye Institute, Tianjin Eye Hospital, Nankai University Affiliated Eye Hospital, 4 Gansu Road, He-Ping District, Tianjin, 300020 China
| | - Shenda Shi
- grid.31880.320000 0000 8780 1230School of Computer Science, School of National Pilot Software Engineering, Beijing University of Posts and Telecommunications, 10 Xitucheng Road, Hai-Dian District, Beijing, 100876 China ,HuaHui Jian AI Tech Ltd., Tianjin, China
| | - Xiaoyan Yang
- grid.216938.70000 0000 9878 7032Tianjin Key Lab of Ophthalmology and Visual Science, Tianjin Eye Institute, Tianjin Eye Hospital, Nankai University Affiliated Eye Hospital, 4 Gansu Road, He-Ping District, Tianjin, 300020 China ,grid.412729.b0000 0004 1798 646XTianjin Eye Hospital Optometric Center, Tianjin, China
| | - Jiaonan Ma
- grid.216938.70000 0000 9878 7032Tianjin Key Lab of Ophthalmology and Visual Science, Tianjin Eye Institute, Tianjin Eye Hospital, Nankai University Affiliated Eye Hospital, 4 Gansu Road, He-Ping District, Tianjin, 300020 China
| | - Qian Fan
- grid.216938.70000 0000 9878 7032Tianjin Key Lab of Ophthalmology and Visual Science, Tianjin Eye Institute, Tianjin Eye Hospital, Nankai University Affiliated Eye Hospital, 4 Gansu Road, He-Ping District, Tianjin, 300020 China
| | - Xuan Chen
- grid.265021.20000 0000 9792 1228Clinical College of Ophthalmology, Tianjin Medical University, Tianjin, China ,grid.216938.70000 0000 9878 7032Tianjin Key Lab of Ophthalmology and Visual Science, Tianjin Eye Institute, Tianjin Eye Hospital, Nankai University Affiliated Eye Hospital, 4 Gansu Road, He-Ping District, Tianjin, 300020 China
| | - Yibing Wang
- grid.265021.20000 0000 9792 1228Clinical College of Ophthalmology, Tianjin Medical University, Tianjin, China ,grid.216938.70000 0000 9878 7032Tianjin Key Lab of Ophthalmology and Visual Science, Tianjin Eye Institute, Tianjin Eye Hospital, Nankai University Affiliated Eye Hospital, 4 Gansu Road, He-Ping District, Tianjin, 300020 China
| | - Mingdong Zhang
- grid.265021.20000 0000 9792 1228Clinical College of Ophthalmology, Tianjin Medical University, Tianjin, China ,grid.216938.70000 0000 9878 7032Tianjin Key Lab of Ophthalmology and Visual Science, Tianjin Eye Institute, Tianjin Eye Hospital, Nankai University Affiliated Eye Hospital, 4 Gansu Road, He-Ping District, Tianjin, 300020 China
| | - Jiaxin Song
- grid.265021.20000 0000 9792 1228Clinical College of Ophthalmology, Tianjin Medical University, Tianjin, China ,grid.216938.70000 0000 9878 7032Tianjin Key Lab of Ophthalmology and Visual Science, Tianjin Eye Institute, Tianjin Eye Hospital, Nankai University Affiliated Eye Hospital, 4 Gansu Road, He-Ping District, Tianjin, 300020 China
| | - Yanglin Jiang
- grid.216938.70000 0000 9878 7032Tianjin Key Lab of Ophthalmology and Visual Science, Tianjin Eye Institute, Tianjin Eye Hospital, Nankai University Affiliated Eye Hospital, 4 Gansu Road, He-Ping District, Tianjin, 300020 China ,grid.412729.b0000 0004 1798 646XTianjin Eye Hospital Optometric Center, Tianjin, China
| | - Lihua Li
- grid.412729.b0000 0004 1798 646XTianjin Eye Hospital Optometric Center, Tianjin, China
| | - Xin He
- HuaHui Jian AI Tech Ltd., Tianjin, China
| | - Vishal Jhanji
- grid.21925.3d0000 0004 1936 9000UPMC Eye Center, University of Pittsburgh School of Medicine, Pittsburgh, PA USA
| | - Shengjin Wang
- HuaHui Jian AI Tech Ltd., Tianjin, China ,grid.12527.330000 0001 0662 3178Department of Electronic Engineering, Tsinghua University, Beijing, China
| | - Meina Song
- grid.31880.320000 0000 8780 1230School of Computer Science, School of National Pilot Software Engineering, Beijing University of Posts and Telecommunications, 10 Xitucheng Road, Hai-Dian District, Beijing, 100876 China ,HuaHui Jian AI Tech Ltd., Tianjin, China
| | - Yan Wang
- grid.265021.20000 0000 9792 1228Clinical College of Ophthalmology, Tianjin Medical University, Tianjin, China ,grid.216938.70000 0000 9878 7032Tianjin Key Lab of Ophthalmology and Visual Science, Tianjin Eye Institute, Tianjin Eye Hospital, Nankai University Affiliated Eye Hospital, 4 Gansu Road, He-Ping District, Tianjin, 300020 China ,grid.216938.70000 0000 9878 7032Nankai University Eye Institute, Nankai University, Tianjin, China
| |
Collapse
|
6
|
Bhambra N, Antaki F, Malt FE, Xu A, Duval R. Deep learning for ultra-widefield imaging: a scoping review. Graefes Arch Clin Exp Ophthalmol 2022; 260:3737-3778. [PMID: 35857087 DOI: 10.1007/s00417-022-05741-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Revised: 05/16/2022] [Accepted: 06/22/2022] [Indexed: 11/04/2022] Open
Abstract
PURPOSE This article is a scoping review of published and peer-reviewed articles using deep-learning (DL) applied to ultra-widefield (UWF) imaging. This study provides an overview of the published uses of DL and UWF imaging for the detection of ophthalmic and systemic diseases, generative image synthesis, quality assessment of images, and segmentation and localization of ophthalmic image features. METHODS A literature search was performed up to August 31st, 2021 using PubMed, Embase, Cochrane Library, and Google Scholar. The inclusion criteria were as follows: (1) deep learning, (2) ultra-widefield imaging. The exclusion criteria were as follows: (1) articles published in any language other than English, (2) articles not peer-reviewed (usually preprints), (3) no full-text availability, (4) articles using machine learning algorithms other than deep learning. No study design was excluded from consideration. RESULTS A total of 36 studies were included. Twenty-three studies discussed ophthalmic disease detection and classification, 5 discussed segmentation and localization of ultra-widefield images (UWFIs), 3 discussed generative image synthesis, 3 discussed ophthalmic image quality assessment, and 2 discussed detecting systemic diseases via UWF imaging. CONCLUSION The application of DL to UWF imaging has demonstrated significant effectiveness in the diagnosis and detection of ophthalmic diseases including diabetic retinopathy, retinal detachment, and glaucoma. DL has also been applied in the generation of synthetic ophthalmic images. This scoping review highlights and discusses the current uses of DL with UWF imaging, and the future of DL applications in this field.
Collapse
Affiliation(s)
- Nishaant Bhambra
- Faculty of Medicine, McGill University, Montréal, Québec, Canada
| | - Fares Antaki
- Department of Ophthalmology, Université de Montréal, Montréal, Québec, Canada.,Centre Universitaire d'Ophtalmologie (CUO), Hôpital Maisonneuve-Rosemont, CIUSSS de L'Est-de-L'Île-de-Montréal, 5415 Assumption Blvd, Montréal, Québec, H1T 2M4, Canada
| | - Farida El Malt
- Faculty of Medicine, McGill University, Montréal, Québec, Canada
| | - AnQi Xu
- Faculty of Medicine, Université de Montréal, Montréal, Québec, Canada
| | - Renaud Duval
- Department of Ophthalmology, Université de Montréal, Montréal, Québec, Canada. .,Centre Universitaire d'Ophtalmologie (CUO), Hôpital Maisonneuve-Rosemont, CIUSSS de L'Est-de-L'Île-de-Montréal, 5415 Assumption Blvd, Montréal, Québec, H1T 2M4, Canada.
| |
Collapse
|
7
|
Lu HC, Chen HY, Huang CJ, Chu PH, Wu LS, Tsai CY. Predicting Axial Length From Choroidal Thickness on Optical Coherence Tomography Images With Machine Learning Based Algorithms. Front Med (Lausanne) 2022; 9:850284. [PMID: 35836947 PMCID: PMC9273745 DOI: 10.3389/fmed.2022.850284] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2022] [Accepted: 05/25/2022] [Indexed: 02/03/2023] Open
Abstract
PurposeWe formulated and tested ensemble learning models to classify axial length (AXL) from choroidal thickness (CT) as indicated on fovea-centered, 2D single optical coherence tomography (OCT) images.DesignRetrospective cross-sectional study.ParticipantsWe analyzed 710 OCT images from 355 eyes of 188 patients. Each eye had 2 OCT images.MethodsThe CT was estimated from 3 points of each image. We used five machine-learning base algorithms to construct the classifiers. This study trained and validated the models to classify the AXLs eyes based on binary (AXL < or > 26 mm) and multiclass (AXL < 22 mm, between 22 and 26 mm, and > 26 mm) classifications.ResultsNo features were redundant or duplicated after an analysis using Pearson’s correlation coefficient, LASSO-Pattern search algorithm, and variance inflation factors. Among the positions, CT at the nasal side had the highest correlation with AXL followed by the central area. In binary classification, our classifiers obtained high accuracy, as indicated by accuracy, recall, positive predictive value (PPV), negative predictive value (NPV), F1 score, and area under ROC curve (AUC) values of 94.37, 100, 90.91, 100, 86.67, and 95.61%, respectively. In multiclass classification, our classifiers were also highly accurate, as indicated by accuracy, weighted recall, weighted PPV, weighted NPV, weighted F1 score, and macro AUC of 88.73, 88.73, 91.21, 85.83, 87.42, and 93.42%, respectively.ConclusionsOur binary and multiclass classifiers classify AXL well from CT, as indicated on OCT images. We demonstrated the effectiveness of the proposed classifiers and provided an assistance tool for physicians.
Collapse
Affiliation(s)
- Hao-Chun Lu
- Graduate Institute of Business and Management, Chang Gung University, Taoyuan, Taiwan
- Division of Cardiology, Department of Internal Medicine, Chang Gung Memorial Hospital, Taoyuan, Taiwan
| | - Hsin-Yi Chen
- Department of Ophthalmology, Fu Jen Catholic University Hospital, New Taipei City, Taiwan
- School of Medicine, College of Medicine, Fu Jen Catholic University, New Taipei City, Taiwan
| | - Chien-Jung Huang
- Department of Ophthalmology, Fu Jen Catholic University Hospital, New Taipei City, Taiwan
| | - Pao-Hsien Chu
- Division of Cardiology, Department of Internal Medicine, Chang Gung Memorial Hospital, Chang Gung University College of Medicine, Taipei, Taiwan
| | - Lung-Sheng Wu
- Division of Cardiology, Department of Internal Medicine, Chang Gung Memorial Hospital, Chang Gung University College of Medicine, Taipei, Taiwan
| | - Chia-Ying Tsai
- Department of Ophthalmology, Fu Jen Catholic University Hospital, New Taipei City, Taiwan
- School of Medicine, College of Medicine, Fu Jen Catholic University, New Taipei City, Taiwan
- *Correspondence: Chia-Ying Tsai,
| |
Collapse
|
8
|
Dense Convolutional Network and Its Application in Medical Image Analysis. BIOMED RESEARCH INTERNATIONAL 2022; 2022:2384830. [PMID: 35509707 PMCID: PMC9060995 DOI: 10.1155/2022/2384830] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Accepted: 03/23/2022] [Indexed: 12/28/2022]
Abstract
Dense convolutional network (DenseNet) is a hot topic in deep learning research in recent years, which has good applications in medical image analysis. In this paper, DenseNet is summarized from the following aspects. First, the basic principle of DenseNet is introduced; second, the development of DenseNet is summarized and analyzed from five aspects: broaden DenseNet structure, lightweight DenseNet structure, dense unit, dense connection mode, and attention mechanism; finally, the application research of DenseNet in the field of medical image analysis is summarized from three aspects: pattern recognition, image segmentation, and object detection. The network structures of DenseNet are systematically summarized in this paper, which has certain positive significance for the research and development of DenseNet.
Collapse
|
9
|
Yang D, Li M, Li W, Wang Y, Niu L, Shen Y, Zhang X, Fu B, Zhou X. Prediction of Refractive Error Based on Ultrawide Field Images With Deep Learning Models in Myopia Patients. Front Med (Lausanne) 2022; 9:834281. [PMID: 35433763 PMCID: PMC9007166 DOI: 10.3389/fmed.2022.834281] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Accepted: 03/04/2022] [Indexed: 11/21/2022] Open
Abstract
Summary Ultrawide field fundus images could be applied in deep learning models to predict the refractive error of myopic patients. The predicted error was related to the older age and greater spherical power. Purpose To explore the possibility of predicting the refractive error of myopic patients by applying deep learning models trained with ultrawide field (UWF) images. Methods UWF fundus images were collected from left eyes of 987 myopia patients of Eye and ENT Hospital, Fudan University between November 2015 and January 2019. The fundus images were all captured with Optomap Daytona, a 200° UWF imaging device. Three deep learning models (ResNet-50, Inception-v3, Inception-ResNet-v2) were trained with the UWF images for predicting refractive error. 133 UWF fundus images were also collected after January 2021 as an the external validation data set. The predicted refractive error was compared with the “true value” measured by subjective refraction. Mean absolute error (MAE), mean absolute percentage error (MAPE) and coefficient (R2) value were calculated in the test set. The Spearman rank correlation test was applied for univariate analysis and multivariate linear regression analysis on variables affecting MAE. The weighted heat map was generated by averaging the predicted weight of each pixel. Results ResNet-50, Inception-v3 and Inception-ResNet-v2 models were trained with the UWF images for refractive error prediction with R2 of 0.9562, 0.9555, 0.9563 and MAE of 1.72(95%CI: 1.62–1.82), 1.75(95%CI: 1.65–1.86) and 1.76(95%CI: 1.66–1.86), respectively. 29.95%, 31.47% and 29.44% of the test set were within the predictive error of 0.75D in the three models. 64.97%, 64.97%, and 64.47% was within 2.00D predictive error. The predicted MAE was related to older age (P < 0.01) and greater spherical power(P < 0.01). The optic papilla and macular region had significant predictive power in the weighted heat map. Conclusions It was feasible to predict refractive error in myopic patients with deep learning models trained by UWF images with the accuracy to be improved.
Collapse
Affiliation(s)
- Danjuan Yang
- Eye Institute and Department of Ophthalmology, Eye & ENT Hospital, Fudan University, Shanghai, China
- NHC Key Laboratory of Myopia, Fudan University, Shanghai, China
- Key Laboratory of Myopia, Chinese Academy of Medical Sciences, Shanghai, China
- Shanghai Research Center of Ophthalmology and Optometry, Shanghai, China
- Shanghai Engineering Research Center of Laser and Autostereoscopic 3D for Vision Care, Shanghai, China
| | - Meiyan Li
- Eye Institute and Department of Ophthalmology, Eye & ENT Hospital, Fudan University, Shanghai, China
- NHC Key Laboratory of Myopia, Fudan University, Shanghai, China
- Key Laboratory of Myopia, Chinese Academy of Medical Sciences, Shanghai, China
- Shanghai Research Center of Ophthalmology and Optometry, Shanghai, China
- Shanghai Engineering Research Center of Laser and Autostereoscopic 3D for Vision Care, Shanghai, China
| | - Weizhen Li
- School of Data Science, Fudan University, Shanghai, China
| | - Yunzhe Wang
- Shanghai Medical College, Fudan University, Shanghai, China
| | - Lingling Niu
- Eye Institute and Department of Ophthalmology, Eye & ENT Hospital, Fudan University, Shanghai, China
- NHC Key Laboratory of Myopia, Fudan University, Shanghai, China
- Key Laboratory of Myopia, Chinese Academy of Medical Sciences, Shanghai, China
- Shanghai Research Center of Ophthalmology and Optometry, Shanghai, China
- Shanghai Engineering Research Center of Laser and Autostereoscopic 3D for Vision Care, Shanghai, China
| | - Yang Shen
- Eye Institute and Department of Ophthalmology, Eye & ENT Hospital, Fudan University, Shanghai, China
- NHC Key Laboratory of Myopia, Fudan University, Shanghai, China
- Key Laboratory of Myopia, Chinese Academy of Medical Sciences, Shanghai, China
- Shanghai Research Center of Ophthalmology and Optometry, Shanghai, China
- Shanghai Engineering Research Center of Laser and Autostereoscopic 3D for Vision Care, Shanghai, China
| | - Xiaoyu Zhang
- Eye Institute and Department of Ophthalmology, Eye & ENT Hospital, Fudan University, Shanghai, China
- NHC Key Laboratory of Myopia, Fudan University, Shanghai, China
- Key Laboratory of Myopia, Chinese Academy of Medical Sciences, Shanghai, China
- Shanghai Research Center of Ophthalmology and Optometry, Shanghai, China
- Shanghai Engineering Research Center of Laser and Autostereoscopic 3D for Vision Care, Shanghai, China
| | - Bo Fu
- School of Data Science, Fudan University, Shanghai, China
- Bo Fu
| | - Xingtao Zhou
- Eye Institute and Department of Ophthalmology, Eye & ENT Hospital, Fudan University, Shanghai, China
- NHC Key Laboratory of Myopia, Fudan University, Shanghai, China
- Key Laboratory of Myopia, Chinese Academy of Medical Sciences, Shanghai, China
- Shanghai Research Center of Ophthalmology and Optometry, Shanghai, China
- Shanghai Engineering Research Center of Laser and Autostereoscopic 3D for Vision Care, Shanghai, China
- *Correspondence: Xingtao Zhou
| |
Collapse
|