1
|
Wang Y, Li G, Zhang X, Wang Y, Zhang Z, Li J, Ma J, Wang L. Optimal Training Positive Sample Size Determination for Deep Learning with a Validation on CBCT Image Caries Recognition. Diagnostics (Basel) 2024; 14:2080. [PMID: 39335759 PMCID: PMC11431354 DOI: 10.3390/diagnostics14182080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2024] [Revised: 09/08/2024] [Accepted: 09/15/2024] [Indexed: 09/30/2024] Open
Abstract
Objectives: During deep learning model training, it is essential to consider the balance among the effects of sample size, actual resources, and time constraints. Single-arm objective performance criteria (OPC) was proposed to determine the optimal positive sample size for training deep learning models in caries recognition. Methods: An expected sensitivity (PT) of 0.6 and a clinically acceptable sensitivity (P0) of 0.5 were applied to the single-arm OPC calculation formula, yielding an optimal training set comprising 263 carious teeth. U-Net, YOLOv5n, and CariesDetectNet were trained and validated using clinically self-collected cone-beam computed tomography (CBCT) images that included varying quantities of carious teeth. To assess performance, an additional dataset was utilized to evaluate the accuracy of caries detection by both the models and two dental radiologists. Results: When the number of carious teeth reached approximately 250, the models reached the optimal performance levels. U-Net demonstrated superior performance, achieving accuracy, sensitivity, specificity, F1-Score, and Dice similarity coefficients of 0.9929, 0.9307, 0.9989, 0.9590, and 0.9435, respectively. The three models exhibited greater accuracy in caries recognition compared to dental radiologists. Conclusions: This study demonstrated that the positive sample size of CBCT images containing caries was predictable and could be calculated using single-arm OPC.
Collapse
Affiliation(s)
- Yanlin Wang
- National Center for Stomatology & National Clinical Research Center for Oral Diseases & National Engineering Research Center of Oral Biomaterials and Digital Medical Device & Beijing Key Laboratory of Digital Stomatology & NHC Key Laboratory of Digital Stomatology, Department of Oral and Maxillofacial Radiology, Peking University School and Hospital of Stomatology, Beijing 100080, China; (Y.W.); (X.Z.)
| | - Gang Li
- National Center for Stomatology & National Clinical Research Center for Oral Diseases & National Engineering Research Center of Oral Biomaterials and Digital Medical Device & Beijing Key Laboratory of Digital Stomatology & NHC Key Laboratory of Digital Stomatology, Department of Oral and Maxillofacial Radiology, Peking University School and Hospital of Stomatology, Beijing 100080, China; (Y.W.); (X.Z.)
| | - Xinyue Zhang
- National Center for Stomatology & National Clinical Research Center for Oral Diseases & National Engineering Research Center of Oral Biomaterials and Digital Medical Device & Beijing Key Laboratory of Digital Stomatology & NHC Key Laboratory of Digital Stomatology, Department of Oral and Maxillofacial Radiology, Peking University School and Hospital of Stomatology, Beijing 100080, China; (Y.W.); (X.Z.)
| | - Yue Wang
- School of Electronic and Information Engineering, Beijing Jiaotong University, Beijing 100044, China; (Y.W.); (Z.Z.); (J.L.)
| | - Zhenhao Zhang
- School of Electronic and Information Engineering, Beijing Jiaotong University, Beijing 100044, China; (Y.W.); (Z.Z.); (J.L.)
| | - Jupeng Li
- School of Electronic and Information Engineering, Beijing Jiaotong University, Beijing 100044, China; (Y.W.); (Z.Z.); (J.L.)
| | - Junqi Ma
- YOFO Medical Technology Co., Ltd., Hefei 230093, China; (J.M.); (L.W.)
| | - Linghang Wang
- YOFO Medical Technology Co., Ltd., Hefei 230093, China; (J.M.); (L.W.)
| |
Collapse
|
2
|
Soheili F, Delfan N, Masoudifar N, Ebrahimni S, Moshiri B, Glogauer M, Ghafar-Zadeh E. Toward Digital Periodontal Health: Recent Advances and Future Perspectives. Bioengineering (Basel) 2024; 11:937. [PMID: 39329678 PMCID: PMC11428937 DOI: 10.3390/bioengineering11090937] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2024] [Revised: 08/24/2024] [Accepted: 09/12/2024] [Indexed: 09/28/2024] Open
Abstract
Periodontal diseases, ranging from gingivitis to periodontitis, are prevalent oral diseases affecting over 50% of the global population. These diseases arise from infections and inflammation of the gums and supporting bones, significantly impacting oral health. The established link between periodontal diseases and systemic diseases, such as cardiovascular diseases, underscores their importance as a public health concern. Consequently, the early detection and prevention of periodontal diseases have become critical objectives in healthcare, particularly through the integration of advanced artificial intelligence (AI) technologies. This paper aims to bridge the gap between clinical practices and cutting-edge technologies by providing a comprehensive review of current research. We examine the identification of causative factors, disease progression, and the role of AI in enhancing early detection and treatment. Our goal is to underscore the importance of early intervention in improving patient outcomes and to stimulate further interest among researchers, bioengineers, and AI specialists in the ongoing exploration of AI applications in periodontal disease diagnosis.
Collapse
Affiliation(s)
- Fatemeh Soheili
- Biologically Inspired Sensors and Actuators Laboratory (BIOSA), Lassonde School of Engineering, York University, 4700 Keele Street, Toronto, ON M3J 1P3, Canada
- Department of Biology, York University, 4700 Keele Street, Toronto, ON M3J 1P3, Canada
| | - Niloufar Delfan
- Biologically Inspired Sensors and Actuators Laboratory (BIOSA), Lassonde School of Engineering, York University, 4700 Keele Street, Toronto, ON M3J 1P3, Canada
- School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran P9FQ+M8X, Kargar, Iran
| | - Negin Masoudifar
- Department of Internal Medicine, University Health Network, Toronto, ON M5G 2C4, Canada
| | - Shahin Ebrahimni
- Biologically Inspired Sensors and Actuators Laboratory (BIOSA), Lassonde School of Engineering, York University, 4700 Keele Street, Toronto, ON M3J 1P3, Canada
| | - Behzad Moshiri
- School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran P9FQ+M8X, Kargar, Iran
- Department of Electrical and Computer Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada
| | - Michael Glogauer
- Faculty of Dentistry, University of Toronto, Toronto, ON M5G 1G6, Canada
| | - Ebrahim Ghafar-Zadeh
- Biologically Inspired Sensors and Actuators Laboratory (BIOSA), Lassonde School of Engineering, York University, 4700 Keele Street, Toronto, ON M3J 1P3, Canada
- Department of Biology, York University, 4700 Keele Street, Toronto, ON M3J 1P3, Canada
- Department of Electrical Engineering and Computer Science, York University, 4700 Keele Street, Toronto, ON M3J 1P3, Canada
| |
Collapse
|
3
|
Jundaeng J, Chamchong R, Nithikathkul C. Periodontitis diagnosis: A review of current and future trends in artificial intelligence. Technol Health Care 2024:THC241169. [PMID: 39302402 DOI: 10.3233/thc-241169] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/22/2024]
Abstract
BACKGROUND Artificial intelligence (AI) acts as the state-of-the-art in periodontitis diagnosis in dentistry. Current diagnostic challenges include errors due to a lack of experienced dentists, limited time for radiograph analysis, and mandatory reporting, impacting care quality, cost, and efficiency. OBJECTIVE This review aims to evaluate the current and future trends in AI for diagnosing periodontitis. METHODS A thorough literature review was conducted following PRISMA guidelines. We searched databases including PubMed, Scopus, Wiley Online Library, and ScienceDirect for studies published between January 2018 and December 2023. Keywords used in the search included "artificial intelligence," "panoramic radiograph," "periodontitis," "periodontal disease," and "diagnosis." RESULTS The review included 12 studies from an initial 211 records. These studies used advanced models, particularly convolutional neural networks (CNNs), demonstrating accuracy rates for periodontal bone loss detection ranging from 0.76 to 0.98. Methodologies included deep learning hybrid methods, automated identification systems, and machine learning classifiers, enhancing diagnostic precision and efficiency. CONCLUSIONS Integrating AI innovations in periodontitis diagnosis enhances diagnostic accuracy and efficiency, providing a robust alternative to conventional methods. These technologies offer quicker, less labor-intensive, and more precise alternatives to classical approaches. Future research should focus on improving AI model reliability and generalizability to ensure widespread clinical adoption.
Collapse
Affiliation(s)
- Jarupat Jundaeng
- Health Science Program, Faculty of Medicine, Mahasarakham University, Mahasarakham, Thailand
- Tropical Health Innovation Research Unit, Faculty of Medicine, Mahasarakham University, Mahasarakham, Thailand
- Dental Department, Fang Hospital, Chiangmai, Thailand
| | - Rapeeporn Chamchong
- Department of Computer Science, Faculty of Informatics, Mahasarakham University, Mahasarakham, Thailand
| | - Choosak Nithikathkul
- Health Science Program, Faculty of Medicine, Mahasarakham University, Mahasarakham, Thailand
- Tropical Health Innovation Research Unit, Faculty of Medicine, Mahasarakham University, Mahasarakham, Thailand
| |
Collapse
|
4
|
N BC, Koopmans LVE, Valentijn EA, Kleijn GV, de Jong JTA, Napolitano N, Li R, Tortora C, Busillo V, Dong Y. Automation of finding strong gravitational lenses in the Kilo Degree Survey with U - DenseLens (DenseLens + Segmentation). MONTHLY NOTICES OF THE ROYAL ASTRONOMICAL SOCIETY 2024; 533:1426-1441. [PMID: 39176180 PMCID: PMC11338276 DOI: 10.1093/mnras/stae1882] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/22/2024] [Revised: 07/31/2024] [Accepted: 07/31/2024] [Indexed: 08/24/2024]
Abstract
In the context of upcoming large-scale surveys like Euclid, the necessity for the automation of strong lens detection is essential. While existing machine learning pipelines heavily rely on the classification probability (P), this study intends to address the importance of integrating additional metrics, such as Information Content (IC) and the number of pixels above the segmentation threshold ([Formula: see text]), to alleviate the false positive rate in unbalanced data-sets. In this work, we introduce a segmentation algorithm (U-Net) as a supplementary step in the established strong gravitational lens identification pipeline (Denselens), which primarily utilizes [Formula: see text] and [Formula: see text] parameters for the detection and ranking. The results demonstrate that the inclusion of segmentation enables significant reduction of false positives by approximately 25 per cent in the final sample extracted from DenseLens, without compromising the identification of strong lenses. The main objective of this study is to automate the strong lens detection process by integrating these three metrics. To achieve this, a decision tree-based selection process is introduced, applied to the Kilo Degree Survey (KiDS) data. This process involves rank-ordering based on classification scores ([Formula: see text]), filtering based on Information Content ([Formula: see text]), and segmentation score ([Formula: see text]). Additionally, the study presents 14 newly discovered strong lensing candidates identified by the U-Denselens network using the KiDS DR4 data.
Collapse
Affiliation(s)
- Bharath Chowdhary N
- Kapteyn Astronomical Institute, University of Groningen, PO Box 800, NL-9700 AV Groningen, the Netherlands
| | - Léon V E Koopmans
- Kapteyn Astronomical Institute, University of Groningen, PO Box 800, NL-9700 AV Groningen, the Netherlands
| | - Edwin A Valentijn
- Kapteyn Astronomical Institute, University of Groningen, PO Box 800, NL-9700 AV Groningen, the Netherlands
| | - Gijs Verdoes Kleijn
- Kapteyn Astronomical Institute, University of Groningen, PO Box 800, NL-9700 AV Groningen, the Netherlands
| | - Jelte T A de Jong
- Kapteyn Astronomical Institute, University of Groningen, PO Box 800, NL-9700 AV Groningen, the Netherlands
| | - Nicola Napolitano
- Department of Physics “E. Pancini”, University of Naples, Federico II, Via Cintia, 21, 80126 Naples, Italy
- School of Physics and Astronomy, Sun Yat-sen University, Zhuhai Campus, 2 Daxue Road, Xiangzhou District, Zhuhai 519082, China
- CSST Science Center for Guangdong-Hong Kong-Macau Great Bay Area, Zhuhai 519082, China
| | - Rui Li
- School of Astronomy and Space Science, University of Chinese Academy of Sciences, Beijing 100049, China
- National Astronomical Observatories, Chinese Academy of Sciences, 20A Datun Road, Chaoyang District, Beijing 100012, China
| | - Crescenzo Tortora
- INAF – Osservatorio Astronomico di Capodimonte, Via Moiariello 16, I-80131 Napoli, Italy
| | - Valerio Busillo
- INAF – Osservatorio Astronomico di Capodimonte, Via Moiariello 16, I-80131 Napoli, Italy
| | - Yue Dong
- Xi’an Jiaotong-Liverpool University, Wuzhong District, Suzhou 215000, China
| |
Collapse
|
5
|
Kim HS, Kim GT. Current advances in artificial intelligence in radiographic interpretation and reporting. J Periodontal Implant Sci 2024; 54:207-208. [PMID: 39228090 PMCID: PMC11377896 DOI: 10.5051/jpis.245404edi01] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2024] [Accepted: 08/15/2024] [Indexed: 09/05/2024] Open
Affiliation(s)
- Hak-Sun Kim
- Department of Oral and Maxillofacial Radiology, Kyung Hee University Dental Hospital, Seoul, Korea
| | - Gyu-Tae Kim
- Department of Oral and Maxillofacial Radiology, College of Dentistry, Kyung Hee University, Seoul, Korea.
| |
Collapse
|
6
|
Faadiya AN, Widyaningrum R, Arindra PK, Diba SF. The diagnostic performance of impacted third molars in the mandible: A review of deep learning on panoramic radiographs. Saudi Dent J 2024; 36:404-412. [PMID: 38525176 PMCID: PMC10960107 DOI: 10.1016/j.sdentj.2023.11.025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2023] [Revised: 11/21/2023] [Accepted: 11/23/2023] [Indexed: 03/26/2024] Open
Abstract
Background Mandibular third molar is prone to impaction, resulting in its inability to erupt into the oral cavity. The radiographic examination is required to support the odontectomy of impacted teeth. The use of computer-aided diagnosis based on deep learning is emerging in the field of medical and dentistry with the advancement of artificial intelligence (AI) technology. This review describes the performance and prospects of deep learning for the detection, classification, and evaluation of third molar-mandibular canal relationships on panoramic radiographs. Methods This work was conducted using three databases: PubMed, Google Scholar, and Science Direct. Following the literature selection, 49 articles were reviewed, with the 12 main articles discussed in this review. Results Several models of deep learning are currently used for segmentation and classification of third molar impaction with or without the combination of other techniques. Deep learning has demonstrated significant diagnostic performance in identifying mandibular impacted third molars (ITM) on panoramic radiographs, with an accuracy range of 78.91% to 90.23%. Meanwhile, the accuracy of deep learning in determining the relationship between ITM and the mandibular canal (MC) ranges from 72.32% to 99%. Conclusion Deep learning-based AI with high performance for the detection, classification, and evaluation of the relationship of ITM to the MC using panoramic radiographs has been developed over the past decade. However, deep learning must be improved using large datasets, and the evaluation of diagnostic performance for deep learning models should be aligned with medical diagnostic test protocols. Future studies involving collaboration among oral radiologists, clinicians, and computer scientists are required to identify appropriate AI development models that are accurate, efficient, and applicable to clinical services.
Collapse
Affiliation(s)
- Amalia Nur Faadiya
- Dental Medicine Study Program, Faculty of Dentistry, Universitas Gadjah Mada, Yogyakarta, Indonesia
| | - Rini Widyaningrum
- Department of Dentomaxillofacial Radiology, Faculty of Dentistry, Universitas Gadjah Mada, Yogyakarta, Indonesia
| | - Pingky Krisna Arindra
- Department of Oral and Maxillofacial Surgery, Faculty of Dentistry, Universitas Gadjah Mada, Yogyakarta, Indonesia
| | - Silviana Farrah Diba
- Department of Dentomaxillofacial Radiology, Faculty of Dentistry, Universitas Gadjah Mada, Yogyakarta, Indonesia
| |
Collapse
|
7
|
Umer F, Adnan S, Lal A. Research and application of artificial intelligence in dentistry from lower-middle income countries - a scoping review. BMC Oral Health 2024; 24:220. [PMID: 38347508 PMCID: PMC10860267 DOI: 10.1186/s12903-024-03970-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2023] [Accepted: 02/02/2024] [Indexed: 02/15/2024] Open
Abstract
Artificial intelligence (AI) has been integrated into dentistry for improvement of current dental practice. While many studies have explored the utilization of AI in various fields, the potential of AI in dentistry, particularly in low-middle income countries (LMICs) remains understudied. This scoping review aimed to study the existing literature on the applications of artificial intelligence in dentistry in low-middle income countries. A comprehensive search strategy was applied utilizing three major databases: PubMed, Scopus, and EBSCO Dentistry & Oral Sciences Source. The search strategy included keywords related to AI, Dentistry, and LMICs. The initial search yielded a total of 1587, out of which 25 articles were included in this review. Our findings demonstrated that limited studies have been carried out in LMICs in terms of AI and dentistry. Most of the studies were related to Orthodontics. In addition gaps in literature were noted such as cost utility and patient experience were not mentioned in the included studies.
Collapse
Affiliation(s)
- Fahad Umer
- Department of Surgery, Section of Dentistry, The Aga Khan University, Karachi, Pakistan
| | - Samira Adnan
- Department of Operative Dentistry, Sindh Institute of Oral Health Sciences, Jinnah Sindh Medical University, Karachi, Pakistan
| | - Abhishek Lal
- Department of Medicine, Section of Gastroenterology, The Aga Khan University, Karachi, Pakistan.
| |
Collapse
|
8
|
Guler Ayyildiz B, Karakis R, Terzioglu B, Ozdemir D. Comparison of deep learning methods for the radiographic detection of patients with different periodontitis stages. Dentomaxillofac Radiol 2024; 53:32-42. [PMID: 38214940 PMCID: PMC11003609 DOI: 10.1093/dmfr/twad003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Revised: 10/20/2023] [Accepted: 11/06/2023] [Indexed: 01/13/2024] Open
Abstract
OBJECTIVES The objective of this study is to assess the accuracy of computer-assisted periodontal classification bone loss staging using deep learning (DL) methods on panoramic radiographs and to compare the performance of various models and layers. METHODS Panoramic radiographs were diagnosed and classified into 3 groups, namely "healthy," "Stage1/2," and "Stage3/4," and stored in separate folders. The feature extraction stage involved transferring and retraining the feature extraction layers and weights from 3 models, namely ResNet50, DenseNet121, and InceptionV3, which were proposed for classifying the ImageNet dataset, to 3 DL models designed for classifying periodontal bone loss. The features obtained from global average pooling (GAP), global max pooling (GMP), or flatten layers (FL) of convolutional neural network (CNN) models were used as input to the 8 different machine learning (ML) models. In addition, the features obtained from the GAP, GMP, or FL of the DL models were reduced using the minimum redundancy maximum relevance (mRMR) method and then classified again with 8 ML models. RESULTS A total of 2533 panoramic radiographs, including 721 in the healthy group, 842 in the Stage1/2 group, and 970 in the Stage3/4 group, were included in the dataset. The average performance values of DenseNet121 + GAP-based and DenseNet121 + GAP + mRMR-based ML techniques on 10 subdatasets and ML models developed using 2 feature selection techniques outperformed CNN models. CONCLUSIONS The new DenseNet121 + GAP + mRMR-based support vector machine model developed in this study achieved higher performance in periodontal bone loss classification compared to other models in the literature by detecting effective features from raw images without the need for manual selection.
Collapse
Affiliation(s)
- Berceste Guler Ayyildiz
- Faculty of Dentistry, Department of Periodontology, Kutahya Health Sciences University, Kutahya, 43100, Turkey
| | - Rukiye Karakis
- Faculty of Technology, Department of Software Engineering, Sivas Cumhuriyet University, Sivas, 58140, Turkey
| | - Busra Terzioglu
- Faculty of Dentistry, Department of Periodontology, Kutahya Health Sciences University, Kutahya, 43100, Turkey
- Tavsanlõ Vocational School, Oral Health Department, Kutahya Health Sciences University, Kütahya, 43410, Turkey
| | - Durmus Ozdemir
- Faculty of Engineering, Department of Computer Engineering, Kutahya Dumlupinar University, Kutahya, 43020, Turkey
| |
Collapse
|
9
|
Li X, Zhao D, Xie J, Wen H, Liu C, Li Y, Li W, Wang S. Deep learning for classifying the stages of periodontitis on dental images: a systematic review and meta-analysis. BMC Oral Health 2023; 23:1017. [PMID: 38114946 PMCID: PMC10729340 DOI: 10.1186/s12903-023-03751-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Accepted: 12/08/2023] [Indexed: 12/21/2023] Open
Abstract
BACKGROUND The development of deep learning (DL) algorithms for use in dentistry is an emerging trend. Periodontitis is one of the most prevalent oral diseases, which has a notable impact on the life quality of patients. Therefore, it is crucial to classify periodontitis accurately and efficiently. This systematic review aimed to identify the application of DL for the classification of periodontitis and assess the accuracy of this approach. METHODS A literature search up to November 2023 was implemented through EMBASE, PubMed, Web of Science, Scopus, and Google Scholar databases. Inclusion and exclusion criteria were used to screen eligible studies, and the quality of the studies was evaluated by the Grading of Recommendations Assessment, Development and Evaluation (GRADE) methodology with the QUADAS-2 (Quality Assessment of Diagnostic Accuracy Studies) tool. Random-effects inverse-variance model was used to perform the meta-analysis of a diagnostic test, with which pooled sensitivity, specificity, positive likelihood ratio (LR), negative LR, and diagnostic odds ratio (DOR) were calculated, and a summary receiver operating characteristic (SROC) plot was constructed. RESULTS Thirteen studies were included in the meta-analysis. After excluding an outlier, the pooled sensitivity, specificity, positive LR, negative LR and DOR were 0.88 (95%CI 0.82-0.92), 0.82 (95%CI 0.72-0.89), 4.9 (95%CI 3.2-7.5), 0.15 (95%CI 0.10-0.22) and 33 (95%CI 19-59), respectively. The area under the SROC was 0.92 (95%CI 0.89-0.94). CONCLUSIONS The accuracy of DL-based classification of periodontitis is high, and this approach could be employed in the future to reduce the workload of dental professionals and enhance the consistency of classification.
Collapse
Affiliation(s)
- Xin Li
- School of Public Health, National Institute for Data Science in Health and Medicine, Capital Medical University, Beijing, China
| | - Dan Zhao
- Department of Implant Dentistry, Beijing Stomatological Hospital, Capital Medical University, Beijing, China
| | - Jinxuan Xie
- School of Public Health, National Institute for Data Science in Health and Medicine, Capital Medical University, Beijing, China
| | - Hao Wen
- City University of Hong Kong, Hong Kong SAR, China
| | - Chunhua Liu
- City University of Hong Kong, Hong Kong SAR, China
| | - Yajie Li
- School of Public Health, National Institute for Data Science in Health and Medicine, Capital Medical University, Beijing, China
| | - Wenbin Li
- Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Songlin Wang
- Salivary Gland Disease Center and Beijing Key Laboratory of Tooth Regeneration and Function Reconstruction, Beijing Laboratory of Oral Health and Beijing Stomatological Hospital, Capital Medical University, Beijing, 100050, China.
| |
Collapse
|
10
|
Dujic H, Meyer O, Hoss P, Wölfle UC, Wülk A, Meusburger T, Meier L, Gruhn V, Hesenius M, Hickel R, Kühnisch J. Automatized Detection of Periodontal Bone Loss on Periapical Radiographs by Vision Transformer Networks. Diagnostics (Basel) 2023; 13:3562. [PMID: 38066803 PMCID: PMC10706472 DOI: 10.3390/diagnostics13233562] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Revised: 11/18/2023] [Accepted: 11/27/2023] [Indexed: 07/25/2024] Open
Abstract
Several artificial intelligence-based models have been presented for the detection of periodontal bone loss (PBL), mostly using convolutional neural networks, which are the state of the art in deep learning. Given the emerging breakthrough of transformer networks in computer vision, we aimed to evaluate various models for automatized PBL detection. An image data set of 21,819 anonymized periapical radiographs from the upper/lower and anterior/posterior regions was assessed by calibrated dentists according to PBL. Five vision transformer networks (ViT-base/ViT-large from Google, BEiT-base/BEiT-large from Microsoft, DeiT-base from Facebook/Meta) were utilized and evaluated. Accuracy (ACC), sensitivity (SE), specificity (SP), positive/negative predictive value (PPV/NPV) and area under the ROC curve (AUC) were statistically determined. The overall diagnostic ACC and AUC values ranged from 83.4 to 85.2% and 0.899 to 0.918 for all evaluated transformer networks, respectively. Differences in diagnostic performance were evident for lower (ACC 94.1-96.7%; AUC 0.944-0.970) and upper anterior (86.7-90.2%; 0.948-0.958) and lower (85.6-87.2%; 0.913-0.937) and upper posterior teeth (78.1-81.0%; 0.851-0.875). In this study, only minor differences among the tested networks were detected for PBL detection. To increase the diagnostic performance and to support the clinical use of such networks, further optimisations with larger and manually annotated image data sets are needed.
Collapse
Affiliation(s)
- Helena Dujic
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.)
| | - Ole Meyer
- Institute for Software Engineering, University of Duisburg-Essen, 45127 Essen, Germany; (O.M.); (V.G.); (M.H.)
| | - Patrick Hoss
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.)
| | - Uta Christine Wölfle
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.)
| | - Annika Wülk
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.)
| | - Theresa Meusburger
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.)
| | - Leon Meier
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.)
| | - Volker Gruhn
- Institute for Software Engineering, University of Duisburg-Essen, 45127 Essen, Germany; (O.M.); (V.G.); (M.H.)
| | - Marc Hesenius
- Institute for Software Engineering, University of Duisburg-Essen, 45127 Essen, Germany; (O.M.); (V.G.); (M.H.)
| | - Reinhard Hickel
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.)
| | - Jan Kühnisch
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.)
| |
Collapse
|
11
|
Hoss P, Meyer O, Wölfle UC, Wülk A, Meusburger T, Meier L, Hickel R, Gruhn V, Hesenius M, Kühnisch J, Dujic H. Detection of Periodontal Bone Loss on Periapical Radiographs-A Diagnostic Study Using Different Convolutional Neural Networks. J Clin Med 2023; 12:7189. [PMID: 38002799 PMCID: PMC10672399 DOI: 10.3390/jcm12227189] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Revised: 11/14/2023] [Accepted: 11/18/2023] [Indexed: 11/26/2023] Open
Abstract
Interest in machine learning models and convolutional neural networks (CNNs) for diagnostic purposes is steadily increasing in dentistry. Here, CNNs can potentially help in the classification of periodontal bone loss (PBL). In this study, the diagnostic performance of five CNNs in detecting PBL on periapical radiographs was analyzed. A set of anonymized periapical radiographs (N = 21,819) was evaluated by a group of trained and calibrated dentists and classified into radiographs without PBL or with mild, moderate, or severe PBL. Five CNNs were trained over five epochs. Statistically, diagnostic performance was analyzed using accuracy (ACC), sensitivity (SE), specificity (SP), and area under the receiver operating curve (AUC). Here, overall ACC ranged from 82.0% to 84.8%, SE 88.8-90.7%, SP 66.2-71.2%, and AUC 0.884-0.913, indicating similar diagnostic performance of the five CNNs. Furthermore, performance differences were evident in the individual sextant groups. Here, the highest values were found for the mandibular anterior teeth (ACC 94.9-96.0%) and the lowest values for the maxillary posterior teeth (78.0-80.7%). It can be concluded that automatic assessment of PBL seems to be possible, but that diagnostic accuracy varies depending on the location in the dentition. Future research is needed to improve performance for all tooth groups.
Collapse
Affiliation(s)
- Patrick Hoss
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.); (H.D.)
| | - Ole Meyer
- Institute for Software Engineering, University of Duisburg-Essen, 45127 Essen, Germany; (O.M.); (V.G.); (M.H.)
| | - Uta Christine Wölfle
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.); (H.D.)
| | - Annika Wülk
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.); (H.D.)
| | - Theresa Meusburger
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.); (H.D.)
| | - Leon Meier
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.); (H.D.)
| | - Reinhard Hickel
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.); (H.D.)
| | - Volker Gruhn
- Institute for Software Engineering, University of Duisburg-Essen, 45127 Essen, Germany; (O.M.); (V.G.); (M.H.)
| | - Marc Hesenius
- Institute for Software Engineering, University of Duisburg-Essen, 45127 Essen, Germany; (O.M.); (V.G.); (M.H.)
| | - Jan Kühnisch
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.); (H.D.)
| | - Helena Dujic
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.); (H.D.)
| |
Collapse
|
12
|
Orhan K, Aktuna Belgin C, Manulis D, Golitsyna M, Bayrak S, Aksoy S, Sanders A, Önder M, Ezhov M, Shamshiev M, Gusarev M, Shlenskii V. Determining the reliability of diagnosis and treatment using artificial intelligence software with panoramic radiographs. Imaging Sci Dent 2023; 53:199-208. [PMID: 37799743 PMCID: PMC10548159 DOI: 10.5624/isd.20230109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Revised: 07/07/2023] [Accepted: 07/10/2023] [Indexed: 10/07/2023] Open
Abstract
Purpose The objective of this study was to evaluate the accuracy and effectiveness of an artificial intelligence (AI) program in identifying dental conditions using panoramic radiographs (PRs), as well as to assess the appropriateness of its treatment recommendations. Material and Methods PRs from 100 patients (representing 4497 teeth) with known clinical examination findings were randomly selected from a university database. Three dentomaxillofacial radiologists and the Diagnocat AI software evaluated these PRs. The evaluations were focused on various dental conditions and treatments, including canal filling, caries, cast post and core, dental calculus, fillings, furcation lesions, implants, lack of interproximal tooth contact, open margins, overhangs, periapical lesions, periodontal bone loss, short fillings, voids in root fillings, overfillings, pontics, root fragments, impacted teeth, artificial crowns, missing teeth, and healthy teeth. Results The AI demonstrated almost perfect agreement (exceeding 0.81) in most of the assessments when compared to the ground truth. The sensitivity was very high (above 0.8) for the evaluation of healthy teeth, artificial crowns, dental calculus, missing teeth, fillings, lack of interproximal contact, periodontal bone loss, and implants. However, the sensitivity was low for the assessment of caries, periapical lesions, pontic voids in the root canal, and overhangs. Conclusion Despite the limitations of this study, the synthesized data suggest that AI-based decision support systems can serve as a valuable tool in detecting dental conditions, when used with PR for clinical dental applications.
Collapse
Affiliation(s)
- Kaan Orhan
- Department of Dentomaxillofacial Radiology, Faculty of Dentistry, Ankara University, Ankara, Turkey
| | - Ceren Aktuna Belgin
- Department of Dentomaxillofacial Radiology, Faculty of Dentistry, Hatay Mustafa Kemal University, Hatay, Turkey
| | | | | | - Seval Bayrak
- Department of Dentomaxillofacial Radiology, Faculty of Dentistry, Abant İzzet Baysal University, Bolu, Turkey
| | - Secil Aksoy
- Department of Dentomaxillofacial Radiology, Faculty of Dentistry, Near East University, Nicosia, Cyprus
| | | | - Merve Önder
- Department of Dentomaxillofacial Radiology, Faculty of Dentistry, Ankara University, Ankara, Turkey
| | | | | | | | | |
Collapse
|