1
|
Zhang G, Chen W, Wang Z, Wang F, Liu R, Feng J. Automated diagnosis of pancreatic mucinous and serous cystic neoplasms with modality-fusion deep neural network using multi-modality MRIs. Front Oncol 2023; 13:1181270. [PMID: 37795452 PMCID: PMC10546304 DOI: 10.3389/fonc.2023.1181270] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2023] [Accepted: 08/29/2023] [Indexed: 10/06/2023] Open
Abstract
Background Pancreatic cystic neoplasms are increasingly diagnosed with the development of medical imaging technology and people's self-care awareness. However, two of their sub-types, serous cystic neoplasms (SCN) and mucinous cystic neoplasms (MCN), are often misclassified from each other. Because SCN is primarily benign and MCN has a high rate of malignant transformation. Distinguishing SCN and MCN is challenging and essential. Purpose MRIs have many different modalities, complete with SCN and MCN diagnosis information. With the help of an artificial intelligence-based algorithm, we aimed to propose a multi-modal hybrid deep learning network that can efficiently diagnose SCN and MCN using multi-modality MRIs. Methods A cross-modal feature fusion structure was innovatively designed, combining features of seven modalities to realize the classification of SCN and MCN. 69 Patients with multi-modalities of MRIs were included, and experiments showed performances of every modality. Results The proposed method with the optimized settings outperformed all other techniques and human radiologists with high accuracy of 75.07% and an AUC of 82.77%. Besides, the proposed disentanglement method outperformed other fusion methods, and delayed contrast-enhanced T1-weighted MRIs proved most valuable in diagnosing SCN and MCN. Conclusions Through the use of a contemporary artificial intelligence algorithm, physicians can attain high performance in the complex challenge of diagnosing SCN and MCN, surpassing human radiologists to a significant degree.
Collapse
Affiliation(s)
- Gong Zhang
- Faculty of Hepato-Biliary-Pancreatic Surgery, the First Medical Center of Chinese People’s Liberation Army (PLA) General Hospital, Beijing, China
| | - Weixiang Chen
- Department of Automation, Tsinghua University, Beijing, China
| | - Zizheng Wang
- Senior Department of Hepatology, Fifth Medical Center of the PLA General Hospital, Beijing, China
| | - Fei Wang
- Faculty of Hepato-Biliary-Pancreatic Surgery, the First Medical Center of Chinese People’s Liberation Army (PLA) General Hospital, Beijing, China
| | - Rong Liu
- Faculty of Hepato-Biliary-Pancreatic Surgery, the First Medical Center of Chinese People’s Liberation Army (PLA) General Hospital, Beijing, China
| | - Jianjiang Feng
- Department of Automation, Tsinghua University, Beijing, China
| |
Collapse
|
2
|
Wu L, Zhang Z, Yang X, Xu L, Chen S, Zhang Y, Zhang J. Centroid Optimization of DNN Classification in DOA Estimation for UAV. Sensors (Basel) 2023; 23:2513. [PMID: 36904717 PMCID: PMC10007322 DOI: 10.3390/s23052513] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/09/2023] [Revised: 02/16/2023] [Accepted: 02/21/2023] [Indexed: 06/18/2023]
Abstract
Classifications based on deep learning have been widely applied in the estimation of the direction of arrival (DOA) of signal. Due to the limited number of classes, the classification of DOA cannot satisfy the required prediction accuracy of signals from random azimuth in real applications. This paper presents a Centroid Optimization of deep neural network classification (CO-DNNC) to improve the estimation accuracy of DOA. CO-DNNC includes signal preprocessing, classification network, and Centroid Optimization. The DNN classification network adopts a convolutional neural network, including convolutional layers and fully connected layers. The Centroid Optimization takes the classified labels as the coordinates and calculates the azimuth of received signal according to the probabilities of the Softmax output. The experimental results show that CO-DNNC is capable of acquiring precise and accurate estimation of DOA, especially in the cases of low SNRs. In addition, CO-DNNC requires lower numbers of classes under the same condition of prediction accuracy and SNR, which reduces the complexity of the DNN network and saves training and processing time.
Collapse
Affiliation(s)
- Long Wu
- School of Computer Science and Technology, Zhejiang Sci-Tech University, Hangzhou 310018, China
| | - Zidan Zhang
- School of Information Science and Technology, Zhejiang Sci-Tech University, Hangzhou 310018, China
| | - Xu Yang
- School of Computer Science and Technology, Zhejiang Sci-Tech University, Hangzhou 310018, China
| | - Lu Xu
- School of Information Science and Technology, Zhejiang Sci-Tech University, Hangzhou 310018, China
| | - Shuyu Chen
- Keyi College of Zhejiang Sci-Tech University, Shaoxing 312369, China
| | - Yong Zhang
- Institute of Optical Target Simulation and Test Technology, Harbin Institute of Technology, Harbin 150001, China
| | - Jianlong Zhang
- Institute of Optical Target Simulation and Test Technology, Harbin Institute of Technology, Harbin 150001, China
| |
Collapse
|
3
|
Cui J, Ma L, Shi Y, Zhang J, Liang Y, Zhang J, Wang H, Yao Q, Lin H, Li M, Yao J, Zhang M, Chen J, Li M, Guo Y. Impact Ionization Coefficient Prediction of a Lateral Power Device Using Deep Neural Network. Micromachines (Basel) 2023; 14:522. [PMID: 36984929 PMCID: PMC10055979 DOI: 10.3390/mi14030522] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/06/2023] [Revised: 02/07/2023] [Accepted: 02/21/2023] [Indexed: 06/18/2023]
Abstract
Nowadays, the impact ionization coefficient in the avalanche breakdown theory is obtained using 1-D PN junctions or SBDs, and is considered to be a constant determined by the material itself only. In this paper, the impact ionization coefficient of silicon in a 2D lateral power device is found to be no longer a constant, but instead a function of the 2D coupling effects. The impact ionization coefficient of silicon that considers the 2D depletion effects in real-world devices is proposed and extracted in this paper. The extracted impact ionization coefficient indicates that the conventional empirical impact ionization in the Fulop equation is not suitable for the analysis of 2D lateral power devices. The veracity of the proposed impact ionization coefficient is validated by the simulations obtained from TCAD tools. Considering the complexity of direct modeling, a new prediction method using deep neural networks is proposed. The prediction method demonstrates 97.67% accuracy for breakdown location prediction and less than 6% average error for the impact ionization coefficient prediction compared with the TCAD simulation.
Collapse
Affiliation(s)
- Jingyu Cui
- The College of Integrated Circuit Science and Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| | - Linglin Ma
- The College of Integrated Circuit Science and Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| | - Yuxian Shi
- The College of Integrated Circuit Science and Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| | - Jinan Zhang
- The College of Integrated Circuit Science and Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| | - Yuxiang Liang
- The College of Integrated Circuit Science and Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| | - Jun Zhang
- The College of Integrated Circuit Science and Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
- National and Local Joint Engineering Laboratory for RF Integration and Micro-Packaging Technologies, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| | - Haidong Wang
- The College of Integrated Circuit Science and Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
- National and Local Joint Engineering Laboratory for RF Integration and Micro-Packaging Technologies, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| | - Qing Yao
- The College of Integrated Circuit Science and Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
- National and Local Joint Engineering Laboratory for RF Integration and Micro-Packaging Technologies, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| | - Haonan Lin
- The College of Integrated Circuit Science and Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
- National and Local Joint Engineering Laboratory for RF Integration and Micro-Packaging Technologies, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| | - Mengyang Li
- The College of Integrated Circuit Science and Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
- National and Local Joint Engineering Laboratory for RF Integration and Micro-Packaging Technologies, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| | - Jiafei Yao
- The College of Integrated Circuit Science and Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
- National and Local Joint Engineering Laboratory for RF Integration and Micro-Packaging Technologies, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| | - Maolin Zhang
- The College of Integrated Circuit Science and Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
- National and Local Joint Engineering Laboratory for RF Integration and Micro-Packaging Technologies, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| | - Jing Chen
- The College of Integrated Circuit Science and Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
- National and Local Joint Engineering Laboratory for RF Integration and Micro-Packaging Technologies, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| | - Man Li
- The College of Integrated Circuit Science and Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
- National and Local Joint Engineering Laboratory for RF Integration and Micro-Packaging Technologies, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| | - Yufeng Guo
- The College of Integrated Circuit Science and Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
- National and Local Joint Engineering Laboratory for RF Integration and Micro-Packaging Technologies, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| |
Collapse
|
4
|
Warren SL, Moustafa AA. Functional magnetic resonance imaging, deep learning, and Alzheimer's disease: A systematic review. J Neuroimaging 2023; 33:5-18. [PMID: 36257926 PMCID: PMC10092597 DOI: 10.1111/jon.13063] [Citation(s) in RCA: 16] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2022] [Revised: 09/30/2022] [Accepted: 09/30/2022] [Indexed: 02/01/2023] Open
Abstract
Alzheimer's disease (AD) is currently diagnosed using a mixture of psychological tests and clinical observations. However, these diagnoses are not perfect, and additional diagnostic tools (e.g., MRI) can help improve our understanding of AD as well as our ability to detect the disease. Accordingly, a large amount of research has been invested into innovative diagnostic methods for AD. Functional MRI (fMRI) is a form of neuroimaging technology that has been used to diagnose AD; however, fMRI is incredibly noisy, complex, and thus lacks clinical use. Nonetheless, recent innovations in deep learning technology could enable the simplified and streamlined analysis of fMRI. Deep learning is a form of artificial intelligence that uses computer algorithms based on human neural networks to solve complex problems. For example, in fMRI research, deep learning models can automatically denoise images and classify AD by detecting patterns in participants' brain scans. In this systematic review, we investigate how fMRI (specifically resting-state fMRI) and deep learning methods are used to diagnose AD. In turn, we outline the common deep neural network, preprocessing, and classification methods used in the literature. We also discuss the accuracy, strengths, limitations, and future direction of fMRI deep learning methods. In turn, we aim to summarize the current field for new researchers, suggest specific areas for future research, and highlight the potential of fMRI to aid AD diagnoses.
Collapse
Affiliation(s)
- Samuel L Warren
- School of Psychology, Faculty of Society and Design, Bond University, Gold Coast, Queensland, Australia
| | - Ahmed A Moustafa
- School of Psychology, Faculty of Society and Design, Bond University, Gold Coast, Queensland, Australia.,Department of Human Anatomy and Physiology, Faculty of Health Sciences, University of Johannesburg, Johannesburg, South Africa
| |
Collapse
|
5
|
Baghdadi NA, Alsayed SK, Malki GA, Balaha HM, Farghaly Abdelaliem SM. An Analysis of Burnout among Female Nurse Educators in Saudi Arabia Using K-Means Clustering. Eur J Investig Health Psychol Educ 2022; 13:33-53. [PMID: 36661753 DOI: 10.3390/ejihpe13010003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Revised: 12/12/2022] [Accepted: 12/14/2022] [Indexed: 01/03/2023] Open
Abstract
Nurse educators are often burnt out and suffer from depression due to their demanding job settings. Biochemical markers of burnout can provide insights into the physiological changes that lead to burnout and may help us prevent burnout symptoms. Research was conducted using a descriptive cross-sectional survey design and a multi-stage sampling method. The ministry of education website provides a list of Saudi Arabian nursing education programs that offer bachelor of science in nursing programs (BSN). The study consisted of 299 qualified participants. Malsach Burnout Inventory (MBI) was used to measure burnout as the dependent variable. The MBI is a 22-item scale that measures depersonalization, accomplishment, and emotional exhaustion during work. Bootstrapping with 5000 replicas was used to address potential non-normality. During this framework, four deep neural networks are created. They all have the same number of layers but differ in the number of neurons they have in the hidden layers. The number of female nurse educators experiencing burnout is moderate (mean = 1.92 ± 0.63). Burnout is also moderately observed in terms of emotional exhaustion (mean = 2.13 ± 0.63), depersonalization (mean = 2.12 ± 0.50), and personal achievement scores (mean = 12 2.38 ± 1.13). It has been shown that stacking the clusters at the end of a column increases their accuracy, which can be considered an important feature when classifying.
Collapse
|
6
|
Ji Y, Li R, Tian Y, Chen G, Yan A. Classification models and SAR analysis on thromboxane A 2 synthase inhibitors by machine learning methods. SAR QSAR Environ Res 2022; 33:429-462. [PMID: 35678125 DOI: 10.1080/1062936x.2022.2078880] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Accepted: 05/11/2022] [Indexed: 06/15/2023]
Abstract
Thromboxane A2 synthase (TXS) is a promising drug target for cardiovascular diseases and cancer. In this work, we conducted a structure-activity relationship (SAR) study on 526 TXS inhibitors for bioactivity prediction. Three types of descriptors (MACCS fingerprints, ECFP4 fingerprints, and MOE descriptors) were utilized to characterize inhibitors, 24 classification models were developed by support vector machine (SVM), random forest (RF), extreme gradient boosting (XGBoost), and deep neural networks (DNN). Then we reduced the number of fingerprints according to the contribution of descriptors to the models, and constructed 16 extra models on simplified fingerprints. In general, Model_4D built by DNN algorithm and 67 bits MACCS fingerprints performs best. The prediction accuracy of the model on the test set is 0.969, and Matthews correlation coefficient (MCC) is 0.936. The distance between compound and model (dSTD-PRO) was used to characterize the application domain of the model. In the test set of Model_4D, dSTD-PRO of 91.5% compounds is lower than the corresponding training set threshold (threshold0.90 = 0.1055), and the accuracy of these compounds is 0.983. In addition, the important descriptors were summarized and further analyzed. It showed that aromatic nitrogenous heterocyclic groups were beneficial to improve the bioactivity of TXS inhibitors.
Collapse
Affiliation(s)
- Y Ji
- State Key Laboratory of Chemical Resource Engineering, Department of Pharmaceutical Engineering, Beijing University of Chemical Technology, Beijing, P. R. China
| | - R Li
- State Key Laboratory of Chemical Resource Engineering, Department of Pharmaceutical Engineering, Beijing University of Chemical Technology, Beijing, P. R. China
| | - Y Tian
- State Key Laboratory of Chemical Resource Engineering, Department of Pharmaceutical Engineering, Beijing University of Chemical Technology, Beijing, P. R. China
| | - G Chen
- College of Life Science and Technology, Beijing University of Chemical Technology, Beijing, China
| | - A Yan
- State Key Laboratory of Chemical Resource Engineering, Department of Pharmaceutical Engineering, Beijing University of Chemical Technology, Beijing, P. R. China
| |
Collapse
|
7
|
Gromada K, Siemiątkowska B, Stecz W, Płochocki K, Woźniak K. Real-Time Object Detection and Classification by UAV Equipped With SAR. Sensors (Basel) 2022; 22:s22052068. [PMID: 35271213 PMCID: PMC8915099 DOI: 10.3390/s22052068] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/27/2021] [Revised: 03/03/2022] [Accepted: 03/04/2022] [Indexed: 11/20/2022]
Abstract
The article presents real-time object detection and classification methods by unmanned aerial vehicles (UAVs) equipped with a synthetic aperture radar (SAR). Two algorithms have been extensively tested: classic image analysis and convolutional neural networks (YOLOv5). The research resulted in a new method that combines YOLOv5 with post-processing using classic image analysis. It is shown that the new system improves both the classification accuracy and the location of the identified object. The algorithms were implemented and tested on a mobile platform installed on a military-class UAV as the primary unit for online image analysis. The usage of objective low-computational complexity detection algorithms on SAR scans can reduce the size of the scans sent to the ground control station.
Collapse
Affiliation(s)
- Krzysztof Gromada
- Institute of Automatic Control and Robotics, Warsaw University of Technology, 02-525 Warsaw, Poland; (B.S.); (K.P.); (K.W.)
- Correspondence:
| | - Barbara Siemiątkowska
- Institute of Automatic Control and Robotics, Warsaw University of Technology, 02-525 Warsaw, Poland; (B.S.); (K.P.); (K.W.)
| | - Wojciech Stecz
- Faculty of Cybernetics, Military University of Technology, 00-908 Warsaw, Poland;
| | - Krystian Płochocki
- Institute of Automatic Control and Robotics, Warsaw University of Technology, 02-525 Warsaw, Poland; (B.S.); (K.P.); (K.W.)
| | - Karol Woźniak
- Institute of Automatic Control and Robotics, Warsaw University of Technology, 02-525 Warsaw, Poland; (B.S.); (K.P.); (K.W.)
| |
Collapse
|
8
|
Usmankhujaev S, Ibrokhimov B, Baydadaev S, Kwon J. Time Series Classification with InceptionFCN. Sensors (Basel) 2021; 22:157. [PMID: 35009700 PMCID: PMC8749786 DOI: 10.3390/s22010157] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/15/2021] [Revised: 12/20/2021] [Accepted: 12/22/2021] [Indexed: 06/14/2023]
Abstract
Deep neural networks (DNN) have proven to be efficient in computer vision and data classification with an increasing number of successful applications. Time series classification (TSC) has been one of the challenging problems in data mining in the last decade, and significant research has been proposed with various solutions, including algorithm-based approaches as well as machine and deep learning approaches. This paper focuses on combining the two well-known deep learning techniques, namely the Inception module and the Fully Convolutional Network. The proposed method proved to be more efficient than the previous state-of-the-art InceptionTime method. We tested our model on the univariate TSC benchmark (the UCR/UEA archive), which includes 85 time-series datasets, and proved that our network outperforms the InceptionTime in terms of the training time and overall accuracy on the UCR archive.
Collapse
|
9
|
Abstract
Deep neural networks, inspired by information processing in the brain, can achieve human-like performance for various tasks. However, research efforts to use these networks as models of the brain have primarily focused on modeling healthy brain function so far. In this work, we propose a paradigm for modeling neural diseases in silico with deep learning and demonstrate its use in modeling posterior cortical atrophy (PCA), an atypical form of Alzheimer’s disease affecting the visual cortex. We simulated PCA in deep convolutional neural networks (DCNNs) trained for visual object recognition by randomly injuring connections between artificial neurons. Results showed that injured networks progressively lost their object recognition capability. Simulated PCA impacted learned representations hierarchically, as networks lost object-level representations before category-level representations. Incorporating this paradigm in computational neuroscience will be essential for developing in silico models of the brain and neurological diseases. The paradigm can be expanded to incorporate elements of neural plasticity and to other cognitive domains such as motor control, auditory cognition, language processing, and decision making.
Collapse
Affiliation(s)
- Anup Tuladhar
- Department of Radiology, University of Calgary, Calgary, AB, Canada.,Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada
| | - Jasmine A Moore
- Department of Radiology, University of Calgary, Calgary, AB, Canada.,Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada.,Biomedical Engineering Program, University of Calgary, Calgary, AB, Canada
| | - Zahinoor Ismail
- Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada.,Department of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada.,Department of Community Health Sciences, University of Calgary, Calgary, AB, Canada.,Department of Psychiatry, University of Calgary, Calgary, AB, Canada.,O'Brien Institute for Public Health, University of Calgary, Calgary, AB, Canada
| | - Nils D Forkert
- Department of Radiology, University of Calgary, Calgary, AB, Canada.,Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada.,Department of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada.,Alberta Children's Hospital Research Institute, University of Calgary, Calgary, AB, Canada
| |
Collapse
|
10
|
Cohen-Karlik E, Awida Z, Bergman A, Eshed S, Nestor O, Kadashev M, Yosef SB, Saed H, Mansour Y, Globerson A, Neumann D, Gabet Y. Quantification of Osteoclasts in Culture, Powered by Machine Learning. Front Cell Dev Biol 2021; 9:674710. [PMID: 34113621 PMCID: PMC8186397 DOI: 10.3389/fcell.2021.674710] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Accepted: 04/26/2021] [Indexed: 12/02/2022] Open
Abstract
In vitro osteoclastogenesis is a central assay in bone biology to study the effect of genetic and pharmacologic cues on the differentiation of bone resorbing osteoclasts. To date, identification of TRAP+ multinucleated cells and measurements of osteoclast number and surface rely on a manual tracing requiring specially trained lab personnel. This task is tedious, time-consuming, and prone to operator bias. Here, we propose to replace this laborious manual task with a completely automatic process using algorithms developed for computer vision. To this end, we manually annotated full cultures by contouring each cell, and trained a machine learning algorithm to detect and classify cells into preosteoclast (TRAP+ cells with 1-2 nuclei), osteoclast type I (cells with more than 3 nuclei and less than 15 nuclei), and osteoclast type II (cells with more than 15 nuclei). The training usually requires thousands of annotated samples and we developed an approach to minimize this requirement. Our novel strategy was to train the algorithm by working at "patch-level" instead of on the full culture, thus amplifying by >20-fold the number of patches to train on. To assess the accuracy of our algorithm, we asked whether our model measures osteoclast number and area at least as well as any two trained human annotators. The results indicated that for osteoclast type I cells, our new model achieves a Pearson correlation (r) of 0.916 to 0.951 with human annotators in the estimation of osteoclast number, and 0.773 to 0.879 for estimating the osteoclast area. Because the correlation between 3 different trained annotators ranged between 0.948 and 0.958 for the cell count and between 0.915 and 0.936 for the area, we can conclude that our trained model is in good agreement with trained lab personnel, with a correlation that is similar to inter-annotator correlation. Automation of osteoclast culture quantification is a useful labor-saving and unbiased technique, and we suggest that a similar machine-learning approach may prove beneficial for other morphometrical analyses.
Collapse
Affiliation(s)
- Edo Cohen-Karlik
- Blavatnik School of Computer Science, Tel Aviv University, Tel Aviv, Israel
| | - Zamzam Awida
- Department of Cell and Developmental Biology, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Ayelet Bergman
- Blavatnik School of Computer Science, Tel Aviv University, Tel Aviv, Israel
| | - Shahar Eshed
- Blavatnik School of Computer Science, Tel Aviv University, Tel Aviv, Israel
| | - Omer Nestor
- Blavatnik School of Computer Science, Tel Aviv University, Tel Aviv, Israel
| | - Michelle Kadashev
- Department of Cell and Developmental Biology, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Sapir Ben Yosef
- Department of Cell and Developmental Biology, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Hussam Saed
- Department of Cell and Developmental Biology, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Yishay Mansour
- Blavatnik School of Computer Science, Tel Aviv University, Tel Aviv, Israel
| | - Amir Globerson
- Blavatnik School of Computer Science, Tel Aviv University, Tel Aviv, Israel
| | - Drorit Neumann
- Department of Cell and Developmental Biology, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Yankel Gabet
- Department of Anatomy and Anthropology, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| |
Collapse
|
11
|
Vougas K, Almpanis S, Gorgoulis V. Deep learning: shaping the medicine of tomorrow. Mol Cell Oncol 2020; 7:1723462. [PMID: 32391419 DOI: 10.1080/23723556.2020.1723462] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2020] [Revised: 01/23/2020] [Accepted: 01/24/2020] [Indexed: 10/25/2022]
Abstract
Predicting response to therapy is a major challenge in medicine. Machine learning algorithms are promising tools for assisting this aim. Amongst them, Deep Neural Networks are emerging as the most capable of interrogating across multiple data types. Their further development will lead to sophisticated knowledge extraction, shaping the medicine of tomorrow.
Collapse
Affiliation(s)
- Konstantinos Vougas
- Molecular Carcinogenesis Group, Department of Histology and Embryology, School of Medicine, National and Kapodistrian University of Athens, Athens, Greece.,Biomedical Research Foundation of the Academy of Athens, Athens, Greece
| | - Spyridon Almpanis
- Molecular Carcinogenesis Group, Department of Histology and Embryology, School of Medicine, National and Kapodistrian University of Athens, Athens, Greece
| | - Vassilis Gorgoulis
- Molecular Carcinogenesis Group, Department of Histology and Embryology, School of Medicine, National and Kapodistrian University of Athens, Athens, Greece.,Biomedical Research Foundation of the Academy of Athens, Athens, Greece.,Division of Cancer Sciences, Faculty of Biology, Medicine and Health, Manchester Academic Health Science Centre, Manchester Cancer Research Centre, NIHR Manchester Biomedical Research Centre, University of Manchester, Manchester, UK.,Centre for New Biotechnologies and Precision Medicine, Medical School, National and Kapodistrian University of Athens, Athens, Greece
| |
Collapse
|