1
|
Ye X, He S, Zhong X, Yu J, Yang S, Shen Y, Chen Y, Wang Y, Huang X, Shen L. OIMHS: An Optical Coherence Tomography Image Dataset Based on Macular Hole Manual Segmentation. Sci Data 2023; 10:769. [PMID: 37932307 PMCID: PMC10628143 DOI: 10.1038/s41597-023-02675-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Accepted: 10/24/2023] [Indexed: 11/08/2023] Open
Abstract
Macular holes, one of the most common macular diseases, require timely treatment. The morphological changes on optical coherence tomography (OCT) images provided an opportunity for direct observation of the disease, and accurate segmentation was needed to identify and quantify the lesions. Developments of such algorithms had been obstructed by a lack of high-quality datasets (the OCT images and the corresponding gold standard macular hole segmentation labels), especially for supervised learning-based segmentation algorithms. In such context, we established a large OCT image macular hole segmentation (OIMHS) dataset with 3859 B-scan images of 119 patients, and each image provided four segmentation labels: retina, macular hole, intraretinal cysts, and choroid. This dataset offered an excellent opportunity for investigating the accuracy and reliability of different segmentation algorithms for macular holes and a new research insight into the further development of clinical research for macular diseases, which included the retina, lesions, and choroid in quantitative analyses.
Collapse
Affiliation(s)
- Xin Ye
- Center for Rehabilitation Medicine, Department of Ophthalmology, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, Zhejiang, China
| | - Shucheng He
- Center for Rehabilitation Medicine, Department of Ophthalmology, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, Zhejiang, China
| | - Xiaxing Zhong
- Wenzhou Medical University, Wenzhou, Zhejiang, China
| | - Jiafeng Yu
- Center for Rehabilitation Medicine, Department of Ophthalmology, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, Zhejiang, China
| | | | - Yingjiao Shen
- Center for Rehabilitation Medicine, Department of Ophthalmology, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, Zhejiang, China
| | - Yiqi Chen
- Center for Rehabilitation Medicine, Department of Ophthalmology, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, Zhejiang, China
| | - Yaqi Wang
- College of Media Engineering, Communication University of Zhejiang, Hangzhou, China
| | - Xingru Huang
- School of Electronic Engineering and Computer Science, Queen Mary University of London, London, UK.
| | - Lijun Shen
- Center for Rehabilitation Medicine, Department of Ophthalmology, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, Zhejiang, China.
| |
Collapse
|
2
|
Sampath Kumar A, Schlosser T, Langner H, Ritter M, Kowerko D. Improving OCT Image Segmentation of Retinal Layers by Utilizing a Machine Learning Based Multistage System of Stacked Multiscale Encoders and Decoders. Bioengineering (Basel) 2023; 10:1177. [PMID: 37892907 PMCID: PMC10603937 DOI: 10.3390/bioengineering10101177] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Revised: 10/02/2023] [Accepted: 10/05/2023] [Indexed: 10/29/2023] Open
Abstract
Optical coherence tomography (OCT)-based retinal imagery is often utilized to determine influential factors in patient progression and treatment, for which the retinal layers of the human eye are investigated to assess a patient's health status and eyesight. In this contribution, we propose a machine learning (ML)-based multistage system of stacked multiscale encoders and decoders for the image segmentation of OCT imagery of the retinal layers to enable the following evaluation regarding the physiological and pathological states. Our proposed system's results highlight its benefits compared to currently investigated approaches by combining commonly deployed methods from deep learning (DL) while utilizing deep neural networks (DNN). We conclude that by stacking multiple multiscale encoders and decoders, improved scores for the image segmentation task can be achieved. Our retinal-layer-based segmentation results in a final segmentation performance of up to 82.25±0.74% for the Sørensen-Dice coefficient, outperforming the current best single-stage model by 1.55% with a score of 80.70±0.20%, given the evaluated peripapillary OCT data set. Additionally, we provide results on the data sets Duke SD-OCT, Heidelberg, and UMN to illustrate our model's performance on especially noisy data sets.
Collapse
Affiliation(s)
- Arunodhayan Sampath Kumar
- Junior Professorship of Media Computing, Chemnitz University of Technology, 09107 Chemnitz, Germany; (A.S.K.); (T.S.)
| | - Tobias Schlosser
- Junior Professorship of Media Computing, Chemnitz University of Technology, 09107 Chemnitz, Germany; (A.S.K.); (T.S.)
| | - Holger Langner
- Professorship of Media Informatics, University of Applied Sciences Mittweida, 09648 Mittweida, Germany; (H.L.); (M.R.)
| | - Marc Ritter
- Professorship of Media Informatics, University of Applied Sciences Mittweida, 09648 Mittweida, Germany; (H.L.); (M.R.)
| | - Danny Kowerko
- Junior Professorship of Media Computing, Chemnitz University of Technology, 09107 Chemnitz, Germany; (A.S.K.); (T.S.)
| |
Collapse
|
3
|
Wei X, Li H, Zhu T, Li W, Li Y, Sui R. Deep Learning with Automatic Data Augmentation for Segmenting Schisis Cavities in the Optical Coherence Tomography Images of X-Linked Juvenile Retinoschisis Patients. Diagnostics (Basel) 2023; 13:3035. [PMID: 37835778 PMCID: PMC10572414 DOI: 10.3390/diagnostics13193035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2023] [Revised: 09/09/2023] [Accepted: 09/15/2023] [Indexed: 10/15/2023] Open
Abstract
X-linked juvenile retinoschisis (XLRS) is an inherited disorder characterized by retinal schisis cavities, which can be observed in optical coherence tomography (OCT) images. Monitoring disease progression necessitates the accurate segmentation and quantification of these cavities; yet, current manual methods are time consuming and result in subjective interpretations, highlighting the need for automated and precise solutions. We employed five state-of-the-art deep learning models-U-Net, U-Net++, Attention U-Net, Residual U-Net, and TransUNet-for the task, leveraging a dataset of 1500 OCT images from 30 patients. To enhance the models' performance, we utilized data augmentation strategies that were optimized via deep reinforcement learning. The deep learning models achieved a human-equivalent accuracy level in the segmentation of schisis cavities, with U-Net++ surpassing others by attaining an accuracy of 0.9927 and a Dice coefficient of 0.8568. By utilizing reinforcement-learning-based automatic data augmentation, deep learning segmentation models demonstrate a robust and precise method for the automated segmentation of schisis cavities in OCT images. These findings are a promising step toward enhancing clinical evaluation and treatment planning for XLRS.
Collapse
Affiliation(s)
| | | | | | | | | | - Ruifang Sui
- Department of Ophthalmology, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, No. 1, Shuai Fu Yuan, Beijing 100730, China; (X.W.); (H.L.); (T.Z.); (W.L.); (Y.L.)
| |
Collapse
|
4
|
Nawash B, Ong J, Driban M, Hwang J, Chen J, Selvam A, Mohan S, Chhablani J. Prognostic Optical Coherence Tomography Biomarkers in Neovascular Age-Related Macular Degeneration. J Clin Med 2023; 12:jcm12093049. [PMID: 37176491 PMCID: PMC10179658 DOI: 10.3390/jcm12093049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Revised: 04/13/2023] [Accepted: 04/19/2023] [Indexed: 05/15/2023] Open
Abstract
Optical coherence tomography has revolutionized the diagnosis and management of neovascular age-related macular degeneration. OCT-derived biomarkers have the potential to further guide therapeutic advancements with anti-vascular endothelial growth factor; however, the clinical convergence between these two tools remains suboptimal. Therefore, the aim of this review of literature was to examine the current data on OCT biomarkers and their prognostic value. Thirteen biomarkers were analyzed, and retinal fluid had the strongest-reported impact on clinical outcomes, including visual acuity, clinic visits, and anti-VEGF treatment regimens. In particular, intra-retinal fluid was shown to be associated with poor visual outcomes. Consistencies in the literature with regard to these OCT prognostic biomarkers can lead to patient-specific clinical decision making, such as early-initiated treatment and proactive monitoring. An integrated analysis of all OCT components in combination with new efforts toward automated analysis with artificial intelligence has the potential to further improve the role of OCT in nAMD therapy.
Collapse
Affiliation(s)
- Baraa Nawash
- Department of Ophthalmology, University of Pittsburgh School of Medicine, Pittsburgh, PA 15213, USA
| | - Joshua Ong
- Michigan Medicine, University of Michigan, Ann Arbor, MI 48104, USA
| | - Matthew Driban
- Department of Ophthalmology, University of Pittsburgh School of Medicine, Pittsburgh, PA 15213, USA
| | - Jonathan Hwang
- Department of Ophthalmology, University of Pittsburgh School of Medicine, Pittsburgh, PA 15213, USA
| | - Jeffrey Chen
- Department of Ophthalmology, University of Pittsburgh School of Medicine, Pittsburgh, PA 15213, USA
| | - Amrish Selvam
- Department of Ophthalmology, University of Pittsburgh School of Medicine, Pittsburgh, PA 15213, USA
| | - Sashwanthi Mohan
- Ophthalmology, Medcare Hospital LLC, Dubai P.O. Box 215565, United Arab Emirates
- Education and Research, Rajan Eye Care Hospital Pvt Ltd., Chennai 600042, India
| | - Jay Chhablani
- Department of Ophthalmology, University of Pittsburgh School of Medicine, Pittsburgh, PA 15213, USA
| |
Collapse
|
5
|
Wei X, Sui R. A Review of Machine Learning Algorithms for Retinal Cyst Segmentation on Optical Coherence Tomography. SENSORS (BASEL, SWITZERLAND) 2023; 23:3144. [PMID: 36991857 PMCID: PMC10054815 DOI: 10.3390/s23063144] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/11/2023] [Revised: 03/02/2023] [Accepted: 03/07/2023] [Indexed: 06/19/2023]
Abstract
Optical coherence tomography (OCT) is an emerging imaging technique for diagnosing ophthalmic diseases and the visual analysis of retinal structure changes, such as exudates, cysts, and fluid. In recent years, researchers have increasingly focused on applying machine learning algorithms, including classical machine learning and deep learning methods, to automate retinal cysts/fluid segmentation. These automated techniques can provide ophthalmologists with valuable tools for improved interpretation and quantification of retinal features, leading to more accurate diagnosis and informed treatment decisions for retinal diseases. This review summarized the state-of-the-art algorithms for the three essential steps of cyst/fluid segmentation: image denoising, layer segmentation, and cyst/fluid segmentation, while emphasizing the significance of machine learning techniques. Additionally, we provided a summary of the publicly available OCT datasets for cyst/fluid segmentation. Furthermore, the challenges, opportunities, and future directions of artificial intelligence (AI) in OCT cyst segmentation are discussed. This review is intended to summarize the key parameters for the development of a cyst/fluid segmentation system and the design of novel segmentation algorithms and has the potential to serve as a valuable resource for imaging researchers in the development of assessment systems related to ocular diseases exhibiting cyst/fluid in OCT imaging.
Collapse
|
6
|
Vidal P, de Moura J, Novo J, Ortega M. Multivendor fully automatic uncertainty management approaches for the intuitive representation of DME fluid accumulations in OCT images. Med Biol Eng Comput 2023; 61:1209-1224. [PMID: 36690902 PMCID: PMC10083163 DOI: 10.1007/s11517-022-02765-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Accepted: 12/27/2022] [Indexed: 01/25/2023]
Abstract
Diabetes represents one of the main causes of blindness in developed countries, caused by fluid accumulations in the retinal layers. The clinical literature defines the different types of diabetic macular edema (DME) as cystoid macular edema (CME), diffuse retinal thickening (DRT), and serous retinal detachment (SRD), each with its own clinical relevance. These fluid accumulations do not present defined borders that facilitate segmentational approaches (specially the DRT type, usually not taken into account by the state of the art for this reason) so a diffuse paradigm is used for its detection and visualization. In this paper, we propose three novel approaches for the representation and characterization of these types of DME. A baseline proposal, using a convolutional neural network as backbone, another based on transfer learning from a general domain, and a third approach exploiting information of regions without a defined label. Overall, our baseline proposal obtained an AUC of 0.9583 ± 0.0093, the approach pretrained with a general-domain dataset an AUC of 0.9603 ± 0.0087, and the approach pretrained in the domain taking advantage of uncertainty, an AUC of 0.9619 ± 0.0073.
Collapse
Affiliation(s)
- Plácido Vidal
- Centro de investigación CITIC, Universidade da Coruña, Campus de Elviña, s/n, A Coruña, 15071, Galicia, Spain.,Grupo VARPA, Instituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña, Xubias de Arriba, 84, A Coruña, 15006, Galicia, Spain
| | - Joaquim de Moura
- Centro de investigación CITIC, Universidade da Coruña, Campus de Elviña, s/n, A Coruña, 15071, Galicia, Spain. .,Grupo VARPA, Instituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña, Xubias de Arriba, 84, A Coruña, 15006, Galicia, Spain.
| | - Jorge Novo
- Centro de investigación CITIC, Universidade da Coruña, Campus de Elviña, s/n, A Coruña, 15071, Galicia, Spain.,Grupo VARPA, Instituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña, Xubias de Arriba, 84, A Coruña, 15006, Galicia, Spain
| | - Marcos Ortega
- Centro de investigación CITIC, Universidade da Coruña, Campus de Elviña, s/n, A Coruña, 15071, Galicia, Spain.,Grupo VARPA, Instituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña, Xubias de Arriba, 84, A Coruña, 15006, Galicia, Spain
| |
Collapse
|
7
|
Mousavi N, Monemian M, Ghaderi Daneshmand P, Mirmohammadsadeghi M, Zekri M, Rabbani H. Cyst identification in retinal optical coherence tomography images using hidden Markov model. Sci Rep 2023; 13:12. [PMID: 36593300 PMCID: PMC9807649 DOI: 10.1038/s41598-022-27243-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2022] [Accepted: 12/28/2022] [Indexed: 01/03/2023] Open
Abstract
Optical Coherence Tomography (OCT) is a useful imaging modality facilitating the capturing process from retinal layers. In the salient diseases of retina, cysts are formed in retinal layers. Therefore, the identification of cysts in the retinal layers is of great importance. In this paper, a new method is proposed for the rapid detection of cystic OCT B-scans. In the proposed method, a Hidden Markov Model (HMM) is used for mathematically modelling the existence of cyst. In fact, the existence of cyst in the image can be considered as a hidden state. Since the existence of cyst in an OCT B-scan depends on the existence of cyst in the previous B-scans, HMM is an appropriate tool for modelling this process. In the first phase, a number of features are extracted which are Harris, KAZE, HOG, SURF, FAST, Min-Eigen and feature extracted by deep AlexNet. It is shown that the feature with the best discriminating power is the feature extracted by AlexNet. The features extracted in the first phase are used as observation vectors to estimate the HMM parameters. The evaluation results show the improved performance of HMM in terms of accuracy.
Collapse
Affiliation(s)
- Niloofarsadat Mousavi
- grid.411751.70000 0000 9908 3264Department of Electrical and Computer Engineering, Isfahan University of Technology, Isfahan, Iran
| | - Maryam Monemian
- grid.411036.10000 0001 1498 685XMedical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Parisa Ghaderi Daneshmand
- grid.411036.10000 0001 1498 685XMedical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | | | - Maryam Zekri
- grid.411751.70000 0000 9908 3264Department of Electrical and Computer Engineering, Isfahan University of Technology, Isfahan, Iran
| | - Hossein Rabbani
- grid.411036.10000 0001 1498 685XMedical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| |
Collapse
|
8
|
Rashno E, Akbari A, Nasersharif B. Uncertainty handling in convolutional neural networks. Neural Comput Appl 2022; 34:16753-16769. [PMID: 35756151 PMCID: PMC9206226 DOI: 10.1007/s00521-022-07313-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2019] [Accepted: 04/18/2022] [Indexed: 11/26/2022]
Abstract
The performance of convolutional neural networks is degraded by noisy data, especially in the test phase. To address this challenge, a new convolutional neural network structure with data indeterminacy handling in the neutrosophic (NS) domain, named as Neutrosophic Convolutional Neural Networks, is proposed for image classification. For this task, images are firstly mapped from the pixel domain to three sets true (T), indeterminacy (I) and false (F) in NS domain by the proposed method. Then, NCNN with two parallel paths, one with the input of T and another with I, is constructed followed by an appropriate combination of paths to generate the final output. Here, two paths are trained simultaneously, and neural network weights are updated using back propagation algorithm. The effectiveness of NCNN to handle noisy data is analyzed mathematically in terms of the weights update rule. Proposed two paths NS idea is applied to two basic models: CNN and VGG-Net to construct NCNN and NVGG-Net, respectively. The proposed method has been evaluated on MNIST, CIFAR-10 and CIFAR-100 datasets contaminated with 20 levels of Gaussian noise. Results show that two-path NCNN outperforms CNN by 5.11% and 2.21% in 5 pairs (training, test) with different levels of noise on MNIST and CIFAR-10 datasets, respectively. Finally, NVGG-Net increases the accuracy by 3.09% and 2.57% compared to VGG-Net on CIFAR-10 and CIFAR-100 datasets, respectively.
Collapse
Affiliation(s)
- Elyas Rashno
- Department of Computer Engineering, Iran University of Science and Technology, Narmak, Tehran, 1684613114 Iran
| | - Ahmad Akbari
- Department of Computer Engineering, Iran University of Science and Technology, Narmak, Tehran, 1684613114 Iran
| | - Babak Nasersharif
- Department of Computer Engineering, K.N. Toosi University of Technology, Tehran, Iran
| |
Collapse
|
9
|
Recent Advanced Deep Learning Architectures for Retinal Fluid Segmentation on Optical Coherence Tomography Images. SENSORS 2022; 22:s22083055. [PMID: 35459040 PMCID: PMC9029682 DOI: 10.3390/s22083055] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/10/2022] [Revised: 04/10/2022] [Accepted: 04/13/2022] [Indexed: 11/16/2022]
Abstract
With non-invasive and high-resolution properties, optical coherence tomography (OCT) has been widely used as a retinal imaging modality for the effective diagnosis of ophthalmic diseases. The retinal fluid is often segmented by medical experts as a pivotal biomarker to assist in the clinical diagnosis of age-related macular diseases, diabetic macular edema, and retinal vein occlusion. In recent years, the advanced machine learning methods, such as deep learning paradigms, have attracted more and more attention from academia in the retinal fluid segmentation applications. The automatic retinal fluid segmentation based on deep learning can improve the semantic segmentation accuracy and efficiency of macular change analysis, which has potential clinical implications for ophthalmic pathology detection. This article summarizes several different deep learning paradigms reported in the up-to-date literature for the retinal fluid segmentation in OCT images. The deep learning architectures include the backbone of convolutional neural network (CNN), fully convolutional network (FCN), U-shape network (U-Net), and the other hybrid computational methods. The article also provides a survey on the prevailing OCT image datasets used in recent retinal segmentation investigations. The future perspectives and some potential retinal segmentation directions are discussed in the concluding context.
Collapse
|
10
|
Directional analysis of intensity changes for determining the existence of cyst in optical coherence tomography images. Sci Rep 2022; 12:2105. [PMID: 35136133 PMCID: PMC8825816 DOI: 10.1038/s41598-022-06099-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2021] [Accepted: 01/24/2022] [Indexed: 11/23/2022] Open
Abstract
Diabetic retinopathy (DR) is an important cause of blindness in people with the long history of diabetes. DR is caused due to the damage to blood vessels in the retina. One of the most important manifestations of DR is the formation of fluid-filled regions between retinal layers. The evaluation of stage and transcribed drugs can be possible through the analysis of retinal Optical Coherence Tomography (OCT) images. Therefore, the detection of cysts in OCT images and the is of considerable importance. In this paper, a fast method is proposed to determine the status of OCT images as cystic or non-cystic. The method consists of three phases which are pre-processing, boundary pixel determination and post-processing. After applying a noise reduction method in the pre-processing step, the method finds the pixels which are the boundary pixels of cysts. This process is performed by finding the significant intensity changes in the vertical direction and considering rectangular patches around the candidate pixels. The patches are verified whether or not they contain enough pixels making considerable diagonal intensity changes. Then, a shadow omission method is proposed in the post-processing phase to extract the shadow regions which can be mistakenly considered as cystic areas. Then, the pixels extracted in the previous phase that are near the shadow regions are removed to prevent the production of false positive cases. The performance of the proposed method is evaluated in terms of sensitivity and specificity on real datasets. The experimental results show that the proposed method produces outstanding results from both accuracy and speed points of view.
Collapse
|
11
|
Rahmati M, Rashno A. Automated image segmentation method to analyse skeletal muscle cross section in exercise-induced regenerating myofibers. Sci Rep 2021; 11:21327. [PMID: 34716401 PMCID: PMC8556272 DOI: 10.1038/s41598-021-00886-3] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2021] [Accepted: 10/14/2021] [Indexed: 02/07/2023] Open
Abstract
Skeletal muscle is an adaptive tissue with the ability to regenerate in response to exercise training. Cross-sectional area (CSA) quantification, as a main parameter to assess muscle regeneration capability, is highly tedious and time-consuming, necessitating an accurate and automated approach to analysis. Although several excellent programs are available to automate analysis of muscle histology, they fail to efficiently and accurately measure CSA in regenerating myofibers in response to exercise training. Here, we have developed a novel fully-automated image segmentation method based on neutrosophic set algorithms to analyse whole skeletal muscle cross sections in exercise-induced regenerating myofibers, referred as MyoView, designed to obtain accurate fiber size and distribution measurements. MyoView provides relatively efficient, accurate, and reliable measurements for CSA quantification and detecting different myofibers, myonuclei and satellite cells in response to the post-exercise regenerating process. We showed that MyoView is comparable with manual quantification. We also showed that MyoView is more accurate and efficient to measure CSA in post-exercise regenerating myofibers as compared with Open-CSAM, MuscleJ, SMASH and MyoVision. Furthermore, we demonstrated that to obtain an accurate CSA quantification of exercise-induced regenerating myofibers, whole muscle cross-section analysis is an essential part, especially for the measurement of different fiber-types. We present MyoView as a new tool to quantify CSA, myonuclei and satellite cells in skeletal muscle from any experimental condition including exercise-induced regenerating myofibers.
Collapse
Affiliation(s)
- Masoud Rahmati
- Department of Exercise Physiology, Faculty of Literature and Human Sciences, Lorestan University, Khoramabad, Iran.
| | - Abdolreza Rashno
- Department of Computer Engineering, Lorestan University, Khorramabad, Iran
| |
Collapse
|
12
|
Terry L, Trikha S, Bhatia KK, Graham MS, Wood A. Evaluation of Automated Multiclass Fluid Segmentation in Optical Coherence Tomography Images Using the Pegasus Fluid Segmentation Algorithms. Transl Vis Sci Technol 2021; 10:27. [PMID: 34008019 PMCID: PMC9354552 DOI: 10.1167/tvst.10.1.27] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Purpose To evaluate the performance of the Pegasus-OCT (Visulytix Ltd) multiclass automated fluid segmentation algorithms on independent spectral domain optical coherence tomography data sets. Methods The Pegasus automated fluid segmentation algorithms were applied to three data sets with edematous pathology, comprising 750, 600, and 110 b-scans, respectively. Intraretinal fluid (IRF), sub-retinal fluid (SRF), and pigment epithelial detachment (PED) were automatically segmented by Pegasus-OCT for each b-scan where ground truth from data set owners was available. Detection performance was assessed by calculating sensitivities and specificities, while Dice coefficients were used to assess agreement between the segmentation methods. Results For two data sets, IRF detection yielded promising sensitivities (0.98 and 0.94, respectively) and specificities (1.00 and 0.98) but less consistent agreement with the ground truth (dice coefficients 0.81 and 0.59); likewise, SRF detection showed high sensitivity (0.86 and 0.98) and specificity (0.83 and 0.89) but less consistent agreement (0.59 and 0.78). PED detection on the first data set showed moderate agreement (0.66) with high sensitivity (0.97) and specificity (0.98). IRF detection in a third data set yielded less favorable agreement (0.46-0.57) and sensitivity (0.59-0.68), attributed to image quality and ground truth grader discordance. Conclusions The Pegasus automated fluid segmentation algorithms were able to detect IRF, SRF, and PED in SD-OCT b-scans acquired across multiple independent data sets. Dice coefficients and sensitivity and specificity values indicate the potential for application to automated detection and monitoring of retinal diseases such as age-related macular degeneration and diabetic macular edema. Translational Relevance The potential of Pegasus-OCT for automated fluid quantification and differentiation of IRF, SRF, and PED in OCT images has application to both clinical practice and research.
Collapse
Affiliation(s)
- Louise Terry
- School of Optometry and Vision Sciences, Cardiff University, Cardiff, UK
| | - Sameer Trikha
- King's College Hospital NHS Foundation Trust, London, UK
| | | | - Mark S Graham
- School of Biomedical Engineering & Imaging Sciences, King's College London, London, UK
| | - Ashley Wood
- School of Optometry and Vision Sciences, Cardiff University, Cardiff, UK
| |
Collapse
|
13
|
Luo S, Liang W, Zhao G. Linguistic neutrosophic power Muirhead mean operators for safety evaluation of mines. PLoS One 2019; 14:e0224090. [PMID: 31648224 PMCID: PMC6813029 DOI: 10.1371/journal.pone.0224090] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2019] [Accepted: 10/04/2019] [Indexed: 11/18/2022] Open
Abstract
Safety is the fundamental guarantee for the sustainable development of mining enterprises. As the safety evaluation of mines is a complex system engineering project, consistent and inconsistent, even hesitant evaluation information may be contained simultaneously. Linguistic neutrosophic numbers (LNNs), as the extensions of linguistic terms, are effective means to entirely and qualitatively convey such evaluation information with three independent linguistic membership functions. The aim of our work is to investigate several mean operators so that the safety evaluation issues of mines are addressed under linguistic neutrosophic environment. During the safety evaluation process of mines, many influence factors should be considered, and some of them may interact with each other. To this end, the Muirhead mean (MM) operators are adopted as they are powerful tools to deal with such situation. On the other hand, to diminish the impacts of irrational data provided by evaluators, the power average (PA) operators are under consideration. Thus, with the combination of MM and PA, the power MM operators and weighted power MM operators are proposed to aggregate linguistic neutrosophic information. Meanwhile, some key points and special cases are studied. The advantages of these operators are that not only the interrelations among any number of inputs can be reflected, but also the effects of unreasonable information can be reduced. Thereafter, a new linguistic neutrosophic ranking technique based on these operators is developed to evaluate the mine safety. Moreover, in-depth discussions are made to show the robust and flexible abilities of our method. Results manifest that the proposed method is successful in dealing with mine safety evaluation issues within linguistic neutrosophic circumstances.
Collapse
Affiliation(s)
- Suizhi Luo
- College of Systems Engineering, National University of Defense Technology, Changsha, Hunan, China
| | - Weizhang Liang
- School of Resources and Safety Engineering, Central South University, Changsha, Hunan, China
- * E-mail:
| | - Guoyan Zhao
- School of Resources and Safety Engineering, Central South University, Changsha, Hunan, China
| |
Collapse
|
14
|
Rashno A, Koozekanani DD, Parhi KK. OCT Fluid Segmentation using Graph Shortest Path and Convolutional Neural Network .. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2019; 2018:3426-3429. [PMID: 30441124 DOI: 10.1109/embc.2018.8512998] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Diagnosis and monitoring of retina diseases related to pathologies such as accumulated fluid can be performed using optical coherence tomography (OCT). OCT acquires a series of 2D slices (Bscans). This work presents a fully-automated method based on graph shortest path algorithms and convolutional neural network (CNN) to segment and detect three types of fluid including sub-retinal fluid (SRF), intra-retinal fluid (IRF) and pigment epithelium detachment (PED) in OCT Bscans of subjects with age-related macular degeneration (AMD) and retinal vein occlusion (RVO) or diabetic retinopathy. The proposed method achieves an average dice coefficient of 76.44%, 92.25% and 82.14% in Cirrus, Spectralis and Topcon datasets, respectively. The effectiveness of the proposed methods was also demonstrated in segmenting fluid in OCT images from the 2017 Retouch challenge.
Collapse
|
15
|
Bogunovic H, Venhuizen F, Klimscha S, Apostolopoulos S, Bab-Hadiashar A, Bagci U, Beg MF, Bekalo L, Chen Q, Ciller C, Gopinath K, Gostar AK, Jeon K, Ji Z, Kang SH, Koozekanani DD, Lu D, Morley D, Parhi KK, Park HS, Rashno A, Sarunic M, Shaikh S, Sivaswamy J, Tennakoon R, Yadav S, De Zanet S, Waldstein SM, Gerendas BS, Klaver C, Sanchez CI, Schmidt-Erfurth U. RETOUCH: The Retinal OCT Fluid Detection and Segmentation Benchmark and Challenge. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:1858-1874. [PMID: 30835214 DOI: 10.1109/tmi.2019.2901398] [Citation(s) in RCA: 75] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
Retinal swelling due to the accumulation of fluid is associated with the most vision-threatening retinal diseases. Optical coherence tomography (OCT) is the current standard of care in assessing the presence and quantity of retinal fluid and image-guided treatment management. Deep learning methods have made their impact across medical imaging, and many retinal OCT analysis methods have been proposed. However, it is currently not clear how successful they are in interpreting the retinal fluid on OCT, which is due to the lack of standardized benchmarks. To address this, we organized a challenge RETOUCH in conjunction with MICCAI 2017, with eight teams participating. The challenge consisted of two tasks: fluid detection and fluid segmentation. It featured for the first time: all three retinal fluid types, with annotated images provided by two clinical centers, which were acquired with the three most common OCT device vendors from patients with two different retinal diseases. The analysis revealed that in the detection task, the performance on the automated fluid detection was within the inter-grader variability. However, in the segmentation task, fusing the automated methods produced segmentations that were superior to all individual methods, indicating the need for further improvements in the segmentation performance.
Collapse
|
16
|
Lu D, Heisler M, Lee S, Ding GW, Navajas E, Sarunic MV, Beg MF. Deep-learning based multiclass retinal fluid segmentation and detection in optical coherence tomography images using a fully convolutional neural network. Med Image Anal 2019; 54:100-110. [DOI: 10.1016/j.media.2019.02.011] [Citation(s) in RCA: 65] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2018] [Revised: 02/15/2019] [Accepted: 02/15/2019] [Indexed: 11/28/2022]
|
17
|
Vidal PL, de Moura J, Novo J, Penedo MG, Ortega M. Intraretinal fluid identification via enhanced maps using optical coherence tomography images. BIOMEDICAL OPTICS EXPRESS 2018; 9:4730-4754. [PMID: 30319899 PMCID: PMC6179401 DOI: 10.1364/boe.9.004730] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/14/2018] [Revised: 07/16/2018] [Accepted: 08/12/2018] [Indexed: 05/28/2023]
Abstract
Nowadays, among the main causes of blindness in developed countries are age-related macular degeneration (AMD) and the diabetic macular edema (DME). Both diseases present, as a common symptom, the appearance of cystoid fluid regions inside the retinal layers. Optical coherence tomography (OCT) image modality was one of the main medical imaging techniques for the early diagnosis and monitoring of AMD and DME via this intraretinal fluid detection and characterization. We present a novel methodology to identify these fluid accumulations by means of generating binary maps (offering a direct representation of these areas) and heat maps (containing the region confidence). To achieve this, a set of 312 intensity and texture-based features were studied. The most relevant features were selected using the sequential forward selection (SFS) strategy and tested with three archetypal classifiers: LDC, SVM and Parzen window. Finally, the most proficient classifier is used to create the proposed maps. All of the tested classifiers returned satisfactory results, the best classifier achieving a mean test accuracy higher than 94% in all of the experiments. The suitability of the maps was evaluated in a context of a screening issue with three different datasets obtained with two different devices, testing the capabilities of the system to work independently of the used OCT device. The experiments with the map creation were performed using 323 OCT images. Using only the binary maps, more than 91.33% of the images were correctly classified. With only the heat maps, the proposed methodology correctly separated 93.50% of the images.
Collapse
Affiliation(s)
- Plácido L. Vidal
- Department of Computer Science, University of A Coruña, 15071 A Coruña,
Spain
- CITIC-Research Center of Information and Communication Technologies, University of A Coruña, 15071 A Coruña,
Spain
| | - Joaquim de Moura
- Department of Computer Science, University of A Coruña, 15071 A Coruña,
Spain
- CITIC-Research Center of Information and Communication Technologies, University of A Coruña, 15071 A Coruña,
Spain
| | - Jorge Novo
- Department of Computer Science, University of A Coruña, 15071 A Coruña,
Spain
- CITIC-Research Center of Information and Communication Technologies, University of A Coruña, 15071 A Coruña,
Spain
| | - Manuel G. Penedo
- Department of Computer Science, University of A Coruña, 15071 A Coruña,
Spain
- CITIC-Research Center of Information and Communication Technologies, University of A Coruña, 15071 A Coruña,
Spain
| | - Marcos Ortega
- Department of Computer Science, University of A Coruña, 15071 A Coruña,
Spain
- CITIC-Research Center of Information and Communication Technologies, University of A Coruña, 15071 A Coruña,
Spain
| |
Collapse
|
18
|
Venhuizen FG, van Ginneken B, Liefers B, van Asten F, Schreur V, Fauser S, Hoyng C, Theelen T, Sánchez CI. Deep learning approach for the detection and quantification of intraretinal cystoid fluid in multivendor optical coherence tomography. BIOMEDICAL OPTICS EXPRESS 2018; 9:1545-1569. [PMID: 29675301 PMCID: PMC5905905 DOI: 10.1364/boe.9.001545] [Citation(s) in RCA: 78] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/15/2017] [Revised: 01/13/2018] [Accepted: 01/31/2018] [Indexed: 05/18/2023]
Abstract
We developed a deep learning algorithm for the automatic segmentation and quantification of intraretinal cystoid fluid (IRC) in spectral domain optical coherence tomography (SD-OCT) volumes independent of the device used for acquisition. A cascade of neural networks was introduced to include prior information on the retinal anatomy, boosting performance significantly. The proposed algorithm approached human performance reaching an overall Dice coefficient of 0.754 ± 0.136 and an intraclass correlation coefficient of 0.936, for the task of IRC segmentation and quantification, respectively. The proposed method allows for fast quantitative IRC volume measurements that can be used to improve patient care, reduce costs, and allow fast and reliable analysis in large population studies.
Collapse
Affiliation(s)
- Freerk G. Venhuizen
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen,
the Netherlands
- Department of Ophthalmology, Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Center, Nijmegen,
the Netherlands
| | - Bram van Ginneken
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen,
the Netherlands
| | - Bart Liefers
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen,
the Netherlands
- Department of Ophthalmology, Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Center, Nijmegen,
the Netherlands
| | - Freekje van Asten
- Department of Ophthalmology, Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Center, Nijmegen,
the Netherlands
| | - Vivian Schreur
- Department of Ophthalmology, Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Center, Nijmegen,
the Netherlands
| | - Sascha Fauser
- Roche Pharma Research and Early Development, F. Hoffmann-La Roche Ltd, Basel,
Switzerland
- Cologne University Eye Clinic, Cologne,
Germany
| | - Carel Hoyng
- Department of Ophthalmology, Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Center, Nijmegen,
the Netherlands
| | - Thomas Theelen
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen,
the Netherlands
- Department of Ophthalmology, Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Center, Nijmegen,
the Netherlands
| | - Clara I. Sánchez
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen,
the Netherlands
- Department of Ophthalmology, Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Center, Nijmegen,
the Netherlands
| |
Collapse
|