1
|
Hartoonian S, Hosseini M, Yousefi I, Mahdian M, Ghazizadeh Ahsaie M. Applications of artificial intelligence in dentomaxillofacial imaging: a systematic review. Oral Surg Oral Med Oral Pathol Oral Radiol 2024; 138:641-655. [PMID: 38637235 DOI: 10.1016/j.oooo.2023.12.790] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2023] [Revised: 12/02/2023] [Accepted: 12/22/2023] [Indexed: 04/20/2024]
Abstract
BACKGROUND Artificial intelligence (AI) technology has been increasingly developed in oral and maxillofacial imaging. The aim of this systematic review was to assess the applications and performance of the developed algorithms in different dentomaxillofacial imaging modalities. STUDY DESIGN A systematic search of PubMed and Scopus databases was performed. The search strategy was set as a combination of the following keywords: "Artificial Intelligence," "Machine Learning," "Deep Learning," "Neural Networks," "Head and Neck Imaging," and "Maxillofacial Imaging." Full-text screening and data extraction were independently conducted by two independent reviewers; any mismatch was resolved by discussion. The risk of bias was assessed by one reviewer and validated by another. RESULTS The search returned a total of 3,392 articles. After careful evaluation of the titles, abstracts, and full texts, a total number of 194 articles were included. Most studies focused on AI applications for tooth and implant classification and identification, 3-dimensional cephalometric landmark detection, lesion detection (periapical, jaws, and bone), and osteoporosis detection. CONCLUSION Despite the AI models' limitations, they showed promising results. Further studies are needed to explore specific applications and real-world scenarios before confidently integrating these models into dental practice.
Collapse
Affiliation(s)
- Serlie Hartoonian
- School of Dentistry, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Matine Hosseini
- School of Dentistry, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Iman Yousefi
- School of Dentistry, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Mina Mahdian
- Department of Prosthodontics and Digital Technology, Stony Brook University School of Dental Medicine, Stony Brook University, Stony Brook, NY, USA
| | - Mitra Ghazizadeh Ahsaie
- Department of Oral and Maxillofacial Radiology, School of Dentistry, Shahid Beheshti University of Medical Sciences, Tehran, Iran.
| |
Collapse
|
2
|
Xu Z, Peng Y, Zhang M, Wang R, Yang Z. An explainable machine learning estimated biological age based on morphological parameters of the spine. GeroScience 2024:10.1007/s11357-024-01394-8. [PMID: 39446225 DOI: 10.1007/s11357-024-01394-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2024] [Accepted: 10/11/2024] [Indexed: 10/25/2024] Open
Abstract
Accurately estimating biological age is beneficial for measuring aging and predicting risk. It is widely accepted that the prevalence of spine compression increases significantly with age. However, biological age based on vertebral morphological data is rarely reported. In this study, a total of 2,364 participants from the National Health and Nutrition Examination Survey were enrolled, and morphological parameters of the spine were collected from lateral radiographs scanned by dual energy X-ray absorptiometry. The biological age of the spine, called SpineAge, was calculated with the parameters by machine learning models. The SHapley Additive exPlanation was used for better interpreting each parameter's contribution. Besides, an Accelerated Aging Index (AAI) was defined as SpineAge minus chronological age and was used to quantify the accelerating aging degree of the spine. The results indicated that the SpineAge performed better than chronological age did in predicting 2-year and 5-year all-cause mortality. After adjusting all covariates, there was a significant association between AAI and all-cause mortality risk. Specifically, each 1-year increase in AAI was associated with a 25.9% increase in all-cause mortality risk (Hazards ratio, 1.259; 95% CI, 1.087-1.457; P < 0.001). Considering the first quartile of AAI as a reference, the mortality risks for the second, third, and fourth quartiles were 2.389 (95% CI, 1.064-5.364; P = 0.035), 5.911 (95% CI, 2.241-15.590; P < 0.001) and 22.925 (95% CI, 4.744-110.769; P < 0.001) times higher, respectively. Our study developed a novel and highly applicable biological-age predictor for predicting individualized long-term prognosis and facilitating personalized care.
Collapse
Affiliation(s)
- Zi Xu
- Department of Radiology, Guizhou Provincial Peoples Hospital, Guiyang, 550001, People's Republic of China
| | - Yunsong Peng
- Department of Radiology, Guizhou Provincial Peoples Hospital, Guiyang, 550001, People's Republic of China
| | - Mudan Zhang
- Department of Radiology, Guizhou Provincial Peoples Hospital, Guiyang, 550001, People's Republic of China
| | - Rongpin Wang
- Department of Radiology, Guizhou Provincial Peoples Hospital, Guiyang, 550001, People's Republic of China.
| | - Zhenlu Yang
- Department of Radiology, Guizhou Provincial Peoples Hospital, Guiyang, 550001, People's Republic of China.
| |
Collapse
|
3
|
Kanchanapiboon P, Tunksook P, Tunksook P, Ritthipravat P, Boonpratham S, Satravaha Y, Chaweewannakorn C, Peanchitlertkajorn S. Classification of cervical vertebral maturation stages with machine learning models: leveraging datasets with high inter- and intra-observer agreement. Prog Orthod 2024; 25:35. [PMID: 39279025 PMCID: PMC11402886 DOI: 10.1186/s40510-024-00535-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2024] [Accepted: 07/22/2024] [Indexed: 09/18/2024] Open
Abstract
OBJECTIVES This study aimed to assess the accuracy of machine learning (ML) models with feature selection technique in classifying cervical vertebral maturation stages (CVMS). Consensus-based datasets were used for models training and evaluation for their model generalization capabilities on unseen datasets. METHODS Three clinicians independently rated CVMS on 1380 lateral cephalograms, resulting in the creation of five datasets: two consensus-based datasets (Complete Agreement and Majority Voting), and three datasets based on a single rater's evaluations. Additionally, landmarks annotation of the second to fourth cervical vertebrae and patients' information underwent a feature selection process. These datasets were used to train various ML models and identify the top-performing model for each dataset. These models were subsequently tested on their generalization capabilities. RESULTS Features that considered significant in the consensus-based datasets were consistent with a CVMS guideline. The Support Vector Machine model on the Complete Agreement dataset achieved the highest accuracy (77.4%), followed by the Multi-Layer Perceptron model on the Majority Voting dataset (69.6%). Models from individual ratings showed lower accuracies (60.4-67.9%). The consensus-based training models also exhibited lower coefficient of variation (CV), indicating superior generalization capability compared to models from single raters. CONCLUSION ML models trained on consensus-based datasets for CVMS classification exhibited the highest accuracy, with significant features consistent with the original CVMS guidelines. These models also showed robust generalization capabilities, underscoring the importance of dataset quality.
Collapse
Affiliation(s)
- Potjanee Kanchanapiboon
- Division of Nuclear Medicine, Department of Radiology, Faculty of Medicine Siriraj Hospital, Mahidol University, 2 Wang Lang Rd, Siriraj, Bangkok Noi, Bangkok, 10700, Thailand
| | - Pitipat Tunksook
- Department of Orthodontics, Faculty of Dentistry, Mahidol University, 6 Yothi Rd, Thung Phaya Thai, Ratchathewi, Bangkok, 10400, Thailand
| | | | - Panrasee Ritthipravat
- Department of Biomedical Engineering, Faculty of Engineering, Mahidol University, 999 Phutthamonthon 4 Rd, Salaya, Nakhon Pathom, 73170, Thailand
| | - Supatchai Boonpratham
- Department of Orthodontics, Faculty of Dentistry, Mahidol University, 6 Yothi Rd, Thung Phaya Thai, Ratchathewi, Bangkok, 10400, Thailand
| | - Yodhathai Satravaha
- Department of Orthodontics, Faculty of Dentistry, Mahidol University, 6 Yothi Rd, Thung Phaya Thai, Ratchathewi, Bangkok, 10400, Thailand
| | - Chaiyapol Chaweewannakorn
- Department of Orthodontics, Faculty of Dentistry, Mahidol University, 6 Yothi Rd, Thung Phaya Thai, Ratchathewi, Bangkok, 10400, Thailand
| | - Supakit Peanchitlertkajorn
- Department of Orthodontics, Faculty of Dentistry, Mahidol University, 6 Yothi Rd, Thung Phaya Thai, Ratchathewi, Bangkok, 10400, Thailand.
| |
Collapse
|
4
|
Nogueira-Reis F, Cascante-Sequeira D, Farias-Gomes A, de Macedo MMG, Watanabe RN, Santiago AG, Tabchoury CPM, Freitas DQ. Determination of the pubertal growth spurt by artificial intelligence analysis of cervical vertebrae maturation in lateral cephalometric radiographs. Oral Surg Oral Med Oral Pathol Oral Radiol 2024; 138:306-315. [PMID: 38553310 DOI: 10.1016/j.oooo.2024.02.017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2023] [Revised: 02/08/2024] [Accepted: 02/24/2024] [Indexed: 07/16/2024]
Abstract
OBJECTIVE This study aimed to assess the performance of a convolutional neural network (CNN) model in detecting the pubertal growth spurt by analyzing cervical vertebrae maturation (CVM) in lateral cephalometric radiographs (LCRs). STUDY DESIGN In total, 600 LCRs of patients from 6 to 17 years old were selected. Three radiologists independently and blindly classified the maturation stages of the LCRs and defined the difficulty of each classification. Subsequently, the stage and level of difficulty were determined by consensus. LCRs were distributed between training, validation, and test datasets across 4 CNN-based models. The models' responses were compared with the radiologists' reference standard, and the architecture with the highest success rate was selected for evaluation. Models were developed using full and cropped LCRs with original and simplified maturation classifications. RESULTS In the simplified classification, the Inception-v3 CNN yielded an accuracy of 74% and 75%, with recall and precision values of 61% and 62%, for full and cropped LCRs, respectively. It achieved 61% and 62% total success rates with full and cropped LCRs, respectively, reaching 72.7% for easy-to-classify cropped cases. CONCLUSION Overall, the CNN model demonstrated potential for determining the maturation status regarding the pubertal growth spurt through images of the cervical vertebrae. It may be useful as an initial assessment tool or as an aid for optimizing the assessment and treatment decisions of the clinician.
Collapse
Affiliation(s)
- Fernanda Nogueira-Reis
- Department of Oral Diagnosis, Division of Oral Radiology, Piracicaba Dental School, University of Campinas (UNICAMP), Piracicaba, São Paulo, Brazil.
| | - Deivi Cascante-Sequeira
- Department of Oral Diagnosis, Division of Oral Radiology, Piracicaba Dental School, University of Campinas (UNICAMP), Piracicaba, São Paulo, Brazil
| | - Amanda Farias-Gomes
- Department of Oral Diagnosis, Division of Oral Radiology, Piracicaba Dental School, University of Campinas (UNICAMP), Piracicaba, São Paulo, Brazil
| | | | - Renato Naville Watanabe
- Center for Engineering, Modeling and Applied Social Sciences of the Federal University of ABC (UFABC), São Bernardo, São Paulo, Brazil
| | - Anderson Gabriel Santiago
- Center for Engineering, Modeling and Applied Social Sciences of the Federal University of ABC (UFABC), São Bernardo, São Paulo, Brazil
| | - Cínthia Pereira Machado Tabchoury
- Department of Biosciences, Division of Biochemistry, Piracicaba Dental School, University of Campinas (UNICAMP), Piracicaba, São Paulo, Brazil
| | - Deborah Queiroz Freitas
- Department of Oral Diagnosis, Division of Oral Radiology, Piracicaba Dental School, University of Campinas (UNICAMP), Piracicaba, São Paulo, Brazil
| |
Collapse
|
5
|
Rakhshankhah N, Abbaszadeh M, Kazemi A, Rezaei SS, Roozpeykar S, Arabfard M. Deep learning approach to femoral AVN detection in digital radiography: differentiating patients and pre-collapse stages. BMC Musculoskelet Disord 2024; 25:547. [PMID: 39010001 PMCID: PMC11251364 DOI: 10.1186/s12891-024-07669-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/27/2024] [Accepted: 07/08/2024] [Indexed: 07/17/2024] Open
Abstract
OBJECTIVE This study aimed to evaluate a new deep-learning model for diagnosing avascular necrosis of the femoral head (AVNFH) by analyzing pelvic anteroposterior digital radiography. METHODS The study sample included 1167 hips. The radiographs were independently classified into 6 stages by a radiologist using their simultaneous MRIs. After that, the radiographs were given to train and test the deep learning models of the project including SVM and ANFIS layer using the Python programming language and TensorFlow library. In the last step, the test set of hip radiographs was provided to two independent radiologists with different work experiences to compare their diagnosis performance to the deep learning models' performance using the F1 score and Mcnemar test analysis. RESULTS The performance of SVM for AVNFH detection (AUC = 82.88%) was slightly higher than less experienced radiologists (79.68%) and slightly lower than experienced radiologists (88.4%) without reaching significance (p-value > 0.05). Evaluation of the performance of SVM for pre-collapse AVNFH detection with an AUC of 73.58% showed significantly higher performance than less experienced radiologists (AUC = 60.70%, p-value < 0.001). On the other hand, no significant difference is noted between experienced radiologists and SVM for pre-collapse detection. ANFIS algorithm for AVNFH detection with an AUC of 86.60% showed significantly higher performance than less experienced radiologists (AUC = 79.68%, p-value = 0.04). Although reaching less performance compared to experienced radiologists statistically not significant (AUC = 88.40%, p-value = 0.20). CONCLUSIONS Our study has shed light on the remarkable capabilities of SVM and ANFIS as diagnostic tools for AVNFH detection in radiography. Their ability to achieve high accuracy with remarkable efficiency makes them promising candidates for early detection and intervention, ultimately contributing to improved patient outcomes.
Collapse
Affiliation(s)
- Nima Rakhshankhah
- Department of Radiology and Health Research Center, Baqiyatallah University of Medical Sciences, Tehran, Iran
| | - Mahdi Abbaszadeh
- Department of Orthopedic Surgery, Faculty of Medicine, Baqiyatallah University of Medical Sciences, Tehran, Iran
| | - Atefeh Kazemi
- Department of Radiology and Health Research Center, Baqiyatallah University of Medical Sciences, Tehran, Iran
| | - Soroush Soltan Rezaei
- Student Research Committee, Baqiyatallah University of Medical Sciences, Tehran, Iran
| | - Saeid Roozpeykar
- Department of Radiology and Health Research Center, Baqiyatallah University of Medical Sciences, Tehran, Iran.
| | - Masoud Arabfard
- Chemical Injuries Research Center, Systems Biology and Poisonings Institute, Baqiyatallah University of Medical Sciences, Tehran, Iran.
| |
Collapse
|
6
|
Kazimierczak W, Jedliński M, Issa J, Kazimierczak N, Janiszewska-Olszowska J, Dyszkiewicz-Konwińska M, Różyło-Kalinowska I, Serafin Z, Orhan K. Accuracy of Artificial Intelligence for Cervical Vertebral Maturation Assessment-A Systematic Review. J Clin Med 2024; 13:4047. [PMID: 39064087 PMCID: PMC11277636 DOI: 10.3390/jcm13144047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2024] [Revised: 07/03/2024] [Accepted: 07/08/2024] [Indexed: 07/28/2024] Open
Abstract
Background/Objectives: To systematically review and summarize the existing scientific evidence on the diagnostic performance of artificial intelligence (AI) in assessing cervical vertebral maturation (CVM). This review aimed to evaluate the accuracy and reliability of AI algorithms in comparison to those of experienced clinicians. Methods: Comprehensive searches were conducted across multiple databases, including PubMed, Scopus, Web of Science, and Embase, using a combination of Boolean operators and MeSH terms. The inclusion criteria were cross-sectional studies with neural network research, reporting diagnostic accuracy, and involving human subjects. Data extraction and quality assessment were performed independently by two reviewers, with a third reviewer resolving any disagreements. The Quality Assessment of Diagnostic Accuracy Studies (QUADAS)-2 tool was used for bias assessment. Results: Eighteen studies met the inclusion criteria, predominantly employing supervised learning techniques, especially convolutional neural networks (CNNs). The diagnostic accuracy of AI models for CVM assessment varied widely, ranging from 57% to 95%. The factors influencing accuracy included the type of AI model, training data, and study methods. Geographic concentration and variability in the experience of radiograph readers also impacted the results. Conclusions: AI has considerable potential for enhancing the accuracy and reliability of CVM assessments in orthodontics. However, the variability in AI performance and the limited number of high-quality studies suggest the need for further research.
Collapse
Affiliation(s)
- Wojciech Kazimierczak
- Department of Radiology and Diagnostic Imaging, Collegium Medicum, Nicolaus Copernicus University in Torun, Jagiellońska 13-15, 85-067 Bydgoszcz, Poland
- Kazimierczak Private Medical Practice, Dworcowa 13/u6a, 85-009 Bydgoszcz, Poland
| | - Maciej Jedliński
- Department of Interdisciplinary Dentistry, Pomeranian Medical University in Szczecin, 70-111 Szczecin, Poland
| | - Julien Issa
- Chair of Practical Clinical Dentistry, Department of Diagnostics, Poznań University of Medical Sciences, 61-701 Poznań, Poland
| | - Natalia Kazimierczak
- Kazimierczak Private Medical Practice, Dworcowa 13/u6a, 85-009 Bydgoszcz, Poland
| | | | - Marta Dyszkiewicz-Konwińska
- Chair of Practical Clinical Dentistry, Department of Diagnostics, Poznań University of Medical Sciences, 61-701 Poznań, Poland
| | - Ingrid Różyło-Kalinowska
- Department of Dental and Maxillofacial Radiodiagnostics, Medical University of Lublin, 20-093 Lublin, Poland
| | - Zbigniew Serafin
- Department of Radiology and Diagnostic Imaging, Collegium Medicum, Nicolaus Copernicus University in Torun, Jagiellońska 13-15, 85-067 Bydgoszcz, Poland
| | - Kaan Orhan
- Department of Dentomaxillofacial Radiology, Faculty of Dentistry, Ankara University, Ankara 06500, Turkey
- Medical Design Application and Research Center (MEDITAM), Ankara University, Ankara 06500, Turkey
- Department of Oral Diagnostics, Faculty of Dentistry, Semmelweis University, 1088 Budapest, Hungary
| |
Collapse
|
7
|
Shoari SA, Sadrolashrafi SV, Sohrabi A, Afrouzian R, Ebrahimi P, Kouhsoltani M, Soltani MK. Estimating mandibular growth stage based on cervical vertebral maturation in lateral cephalometric radiographs using artificial intelligence. Prog Orthod 2024; 25:28. [PMID: 38910180 PMCID: PMC11194253 DOI: 10.1186/s40510-024-00527-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2024] [Accepted: 05/27/2024] [Indexed: 06/25/2024] Open
Abstract
INTRODUCTION Determining the right time for orthodontic treatment is one of the most important factors affecting the treatment plan and its outcome. The aim of this study is to estimate the mandibular growth stage based on cervical vertebral maturation (CVM) in lateral cephalometric radiographs using artificial intelligence. Unlike previous studies, which use conventional CVM stage naming, our proposed method directly correlates cervical vertebrae with mandibular growth slope. METHODS AND MATERIALS To conduct this study, first, information of people achieved in American Association of Orthodontics Foundation (AAOF) growth centers was assessed and after considering the entry and exit criteria, a total of 200 people, 108 women and 92 men, were included in the study. Then, the length of the mandible in the lateral cephalometric radiographs that were taken serially from the patients was calculated. The corresponding graphs were labeled based on the growth rate of the mandible in 3 stages; before the growth peak of puberty (pre-pubertal), during the growth peak of puberty (pubertal) and after the growth peak of puberty (post-pubertal). A total of 663 images were selected for evaluation using artificial intelligence. These images were evaluated with different deep learning-based artificial intelligence models considering the diagnostic measures of sensitivity, specificity, accuracy, positive predictive value (PPV), and negative predictive value (NPV). We also employed weighted kappa statistics. RESULTS In the diagnosis of pre-pubertal stage, the convolutional neural network (CNN) designed for this study has the higher sensitivity and NPV (0.84, 0.91 respectively) compared to ResNet-18 model. The ResNet-18 model had better performance in other diagnostic measures of the pre-pubertal stage and all measures in the pubertal and post-pubertal stages. The highest overall diagnostic accuracy was also obtained using ResNet-18 model with the amount of 87.5% compared to 81% in designed CNN. CONCLUSION The artificial intelligence model trained in this study can receive images of cervical vertebrae and predict mandibular growth status by classifying it into one of three groups; before the growth spurt (pre-pubertal), during the growth spurt (pubertal), and after the growth spurt (post-pubertal). The highest accuracy is in post-pubertal stage with the designed networks.
Collapse
Affiliation(s)
- Sajjad Alipour Shoari
- Department of Orthodontics, Faculty of Dentistry, Tabriz University of Medical Sciences, Tabriz, Iran
| | | | - Aydin Sohrabi
- Department of Orthodontics, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Reza Afrouzian
- Mianeh Technical and Engineering Faculty, University of Tabriz, Tabriz, 51666-14766, Iran
| | - Pooya Ebrahimi
- Department of Orthodontics, Faculty of Dentistry, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Maryam Kouhsoltani
- Department of Oral and Maxillofacial Pathology, Faculty of Dentistry, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Minou Kouh Soltani
- Mianeh Technical and Engineering Faculty, University of Tabriz, Tabriz, 51666-14766, Iran.
| |
Collapse
|
8
|
Tyndall DA, Price JB, Gaalaas L, Spin-Neto R. Surveying the landscape of diagnostic imaging in dentistry's future: Four emerging technologies with promise. J Am Dent Assoc 2024; 155:364-378. [PMID: 38520421 DOI: 10.1016/j.adaj.2024.01.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Revised: 01/04/2024] [Accepted: 01/07/2024] [Indexed: 03/25/2024]
Abstract
BACKGROUND Advances in digital radiography for both intraoral and panoramic imaging and cone-beam computed tomography have led the way to an increase in diagnostic capabilities for the dental care profession. In this article, the authors provide information on 4 emerging technologies with promise. TYPES OF STUDIES REVIEWED The authors feature the following: artificial intelligence in the form of deep learning using convolutional neural networks, dental magnetic resonance imaging, stationary intraoral tomosynthesis, and second-generation cone-beam computed tomography sources based on carbon nanotube technology and multispectral imaging. The authors review and summarize articles featuring these technologies. RESULTS The history and background of these emerging technologies are previewed along with their development and potential impact on the practice of dental diagnostic imaging. The authors conclude that these emerging technologies have the potential to have a substantial influence on the practice of dentistry as these systems mature. The degree of influence most likely will vary, with artificial intelligence being the most influential of the 4. CONCLUSIONS AND PRACTICAL IMPLICATIONS The readers are informed about these emerging technologies and the potential effects on their practice going forward, giving them information on which to base decisions on adopting 1 or more of these technologies. The 4 technologies reviewed in this article have the potential to improve imaging diagnostics in dentistry thereby leading to better patient care and heightened professional satisfaction.
Collapse
|
9
|
Bajjad AA, Gupta S, Agarwal S, Pawar RA, Kothawade MU, Singh G. Use of artificial intelligence in determination of bone age of the healthy individuals: A scoping review. J World Fed Orthod 2024; 13:95-102. [PMID: 37968159 DOI: 10.1016/j.ejwf.2023.10.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Revised: 09/25/2023] [Accepted: 10/10/2023] [Indexed: 11/17/2023]
Abstract
BACKGROUND Bone age assessment, as an indicator of biological age, is widely used in orthodontics and pediatric endocrinology. Owing to significant subject variations in the manual method of assessment, artificial intelligence (AI), machine learning (ML), and deep learning (DL) play a significant role in this aspect. A scoping review was conducted to search the existing literature on the role of AI, ML, and DL in skeletal age or bone age assessment in healthy individuals. METHODS A literature search was conducted in PubMed, Scopus, and Web of Science from January 2012 to December 2022 using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses-Extension for Scoping Reviews (PRISMA-ScR) and Joanna Briggs Institute guidelines. Grey literature was searched using Google Scholar and OpenGrey. Hand-searching of the articles in all the reputed orthodontic journals and the references of the included articles were also searched for relevant articles for the present scoping review. RESULTS Nineteen articles that fulfilled the inclusion criteria were included. Ten studies used skeletal maturity indicators based on hand and wrist radiographs, two studies used magnetic resonance imaging and seven studies used cervical vertebrae maturity indicators based on lateral cephalograms to assess the skeletal age of the individuals. Most of these studies were published in non-orthodontic medical journals. BoneXpert automated software was the most commonly used software, followed by DL models, and ML models in the studies for assessment of bone age. The automated method was found to be as reliable as the manual method for assessment. CONCLUSIONS This scoping review validated the use of AI, ML, or DL in bone age assessment of individuals. A more uniform distribution of sufficient samples in different stages of maturation, use of three-dimensional inputs such as magnetic resonance imaging, and cone beam computed tomography is required for better training of the models to generalize the outputs for use in the target population.
Collapse
Affiliation(s)
- Adeel Ahmed Bajjad
- Department of Orthodontics, Kothiwal Dental College and Research Centre, Moradabad, India
| | - Seema Gupta
- Department of Orthodontics, Kothiwal Dental College and Research Centre, Moradabad, India.
| | - Soumitra Agarwal
- Department of Orthodontics, Kothiwal Dental College and Research Centre, Moradabad, India
| | - Rakesh A Pawar
- Department of Orthodontics, JMF ACPM Dental College, Dhule, India
| | | | - Gul Singh
- Department of Orthodontics, Kothiwal Dental College and Research Centre, Moradabad, India
| |
Collapse
|
10
|
Dai X, Liu A, Liu J, Zhan M, Liu Y, Ke W, Shi L, Huang X, Chen H, Deng Z, Fan F. Machine Learning Supported the Modified Gustafson's Criteria for Dental Age Estimation in Southwest China. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:611-619. [PMID: 38343227 PMCID: PMC11031552 DOI: 10.1007/s10278-023-00956-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Revised: 10/13/2023] [Accepted: 10/13/2023] [Indexed: 04/20/2024]
Abstract
Adult age estimation is one of the most challenging problems in forensic science and physical anthropology. In this study, we aimed to develop and evaluate machine learning (ML) methods based on the modified Gustafson's criteria for dental age estimation. In this retrospective study, a total of 851 orthopantomograms were collected from patients aged 15 to 40 years old. The secondary dentin formation (SE), periodontal recession (PE), and attrition (AT) of four mandibular premolars were analyzed according to the modified Gustafson's criteria. Ten ML models were generated and compared for age estimation. The partial least squares regressor outperformed other models in males with a mean absolute error (MAE) of 4.151 years. The support vector regressor (MAE = 3.806 years) showed good performance in females. The accuracy of ML models is better than the single-tooth model provided in the previous studies (MAE = 4.747 years in males and MAE = 4.957 years in females). The Shapley additive explanations method was used to reveal the importance of the 12 features in ML models and found that AT and PE are the most influential in age estimation. The findings suggest that the modified Gustafson method can be effectively employed for adult age estimation in the southwest Chinese population. Furthermore, this study highlights the potential of machine learning models to assist experts in achieving accurate and interpretable age estimation.
Collapse
Affiliation(s)
- Xinhua Dai
- West China School of Basic Medical Sciences & Forensic Medicine, Sichuan University, Chengdu, 610041, People's Republic of China
- Department of Laboratory Medicine, West China Hospital, Sichuan University, Chengdu, 610041, People's Republic of China
| | - Anjie Liu
- University of Electronic Science and Technology of China, Chengdu, 611731, People's Republic of China
| | - Junhong Liu
- West China School of Basic Medical Sciences & Forensic Medicine, Sichuan University, Chengdu, 610041, People's Republic of China
| | - Mengjun Zhan
- West China School of Basic Medical Sciences & Forensic Medicine, Sichuan University, Chengdu, 610041, People's Republic of China
| | - Yuanyuan Liu
- Department of Oral Radiology, College of Stomatology, Sichuan University, West China, Chengdu, 610041, People's Republic of China
| | - Wenchi Ke
- College of Computer Science, Sichuan University, Chengdu, 610064, People's Republic of China
| | - Lei Shi
- West China School of Basic Medical Sciences & Forensic Medicine, Sichuan University, Chengdu, 610041, People's Republic of China
| | - Xinyu Huang
- West China School of Basic Medical Sciences & Forensic Medicine, Sichuan University, Chengdu, 610041, People's Republic of China
| | - Hu Chen
- College of Computer Science, Sichuan University, Chengdu, 610064, People's Republic of China
| | - Zhenhua Deng
- West China School of Basic Medical Sciences & Forensic Medicine, Sichuan University, Chengdu, 610041, People's Republic of China
| | - Fei Fan
- West China School of Basic Medical Sciences & Forensic Medicine, Sichuan University, Chengdu, 610041, People's Republic of China.
| |
Collapse
|
11
|
Cao L, He H, Hua F. CURRENT NEURAL NETWORKS DEMONSTRATE POTENTIAL IN AUTOMATED CERVICAL VERTEBRAL MATURATION STAGE CLASSIFICATION BASED ON LATERAL CEPHALOGRAMS. J Evid Based Dent Pract 2024; 24:101928. [PMID: 38448121 DOI: 10.1016/j.jebdp.2023.101928] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/08/2024]
Abstract
ARTICLE TITLE AND BIBLIOGRAPHIC INFORMATION Neural networks for classification of cervical vertebrae maturation: a systematic review. Mathew R, Palatinus S, Padala S, Alshehri A, Awadh W, Bhandi S, Thomas J, Patil S. Angle Orthod. 2022 Nov 1;92(6):796-804. SOURCE OF FUNDING No financial support was reported. TYPE OF STUDY/DESIGN Systematic review.
Collapse
|
12
|
Alhamady AM, Ishaq RAR, Alhammadi MS, Almashraqi AA, Alhashimi N. Evaluation of an objective staging system for assessment of cervical vertebral maturation. BMC Oral Health 2024; 24:97. [PMID: 38233829 PMCID: PMC10792801 DOI: 10.1186/s12903-023-03844-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2023] [Accepted: 12/29/2023] [Indexed: 01/19/2024] Open
Abstract
BACKGROUND The aim of this study was to evaluate an objective method for Cervical Vertebral Maturation (CVM) staging. METHODS An initial sample of 647 Lateral Cephalometric Radiographs (LCR) were staged according to the CVM (Baccetti et al.) by 4 examiners. The final sample (n = 394) included LCR on which the staging of the 4 investigators matched. The objective staging was performed by a single operator. The sample was divided according to the maturational stages into pre-pubertal, pubertal and post-pubertal groups. Measurements were performed on the cervical vertebrae (C2, C3 and C4). The angle between posterior and superior borders for C3 and C4 was the Superior Wall Inclination Angle (SWIA). Concavity Depth (CD) for C2, C3 and C4, and Body Shape (BS) (ratio of width to height of C3 and C4). Measurements of the 3 groups were compared. RESULTS Reliability of subjective staging was high (intra-observer reliability, 0.948; inter-observer reliability, 0.967). Good agreement was observed for the outcomes measured. Intra-observer reliability was good (0.918, 0.885 and 0.722 for CD, BS and SWIA, respectively). The same was for the inter-observer reliability results (0.902, 0.889 and 0.728 for CD, BS and SWIA, respectively). Significant differences were observed for mean values of SWIA and BS and median values of CD within maturational stage. Similar findings were observed when the outcomes were compared at different phases (P < 0.001). CONCLUSIONS A standardized, objective staging system using linear, angular measurements and ratios was applied for the determination of cervical vertebral maturation.
Collapse
Affiliation(s)
- Ahlam M Alhamady
- Master of Science, Orthodontics, Faculty of Dentistry, University of Science and Technology, Sana'a Yemen, Sana'a, Republic of Yemen
| | - Ramy Abdul Rahman Ishaq
- Department of Orthodontics, Pedodontics and Preventive Dentistry Faculty of Dentistry, Sana'a University, P. O. Box 271, Mathbah, Sana'a Yemen, Sana'a, Republic of Yemen.
| | - Maged S Alhammadi
- Orthodontics and Dentofacial Orthopedics, Department of Preventive Dental Sciences, College of Dentistry, Jazan University, Jazan, Saudi Arabia
| | - Abeer A Almashraqi
- Department of Clinical Oral Health Sciences, College of Dental Medicine, QU Health, Qatar University, Doha, Qatar
| | - Najah Alhashimi
- Unit and Divisional Chief Orthodontics at Hamad Medical Corporation and Associate Professor at College of Dental Medicine, Qatar University, Doha, Qatar
| |
Collapse
|
13
|
Kazimierczak N, Kazimierczak W, Serafin Z, Nowicki P, Nożewski J, Janiszewska-Olszowska J. AI in Orthodontics: Revolutionizing Diagnostics and Treatment Planning-A Comprehensive Review. J Clin Med 2024; 13:344. [PMID: 38256478 PMCID: PMC10816993 DOI: 10.3390/jcm13020344] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2023] [Revised: 12/29/2023] [Accepted: 01/05/2024] [Indexed: 01/24/2024] Open
Abstract
The advent of artificial intelligence (AI) in medicine has transformed various medical specialties, including orthodontics. AI has shown promising results in enhancing the accuracy of diagnoses, treatment planning, and predicting treatment outcomes. Its usage in orthodontic practices worldwide has increased with the availability of various AI applications and tools. This review explores the principles of AI, its applications in orthodontics, and its implementation in clinical practice. A comprehensive literature review was conducted, focusing on AI applications in dental diagnostics, cephalometric evaluation, skeletal age determination, temporomandibular joint (TMJ) evaluation, decision making, and patient telemonitoring. Due to study heterogeneity, no meta-analysis was possible. AI has demonstrated high efficacy in all these areas, but variations in performance and the need for manual supervision suggest caution in clinical settings. The complexity and unpredictability of AI algorithms call for cautious implementation and regular manual validation. Continuous AI learning, proper governance, and addressing privacy and ethical concerns are crucial for successful integration into orthodontic practice.
Collapse
Affiliation(s)
- Natalia Kazimierczak
- Kazimierczak Private Medical Practice, Dworcowa 13/u6a, 85-009 Bydgoszcz, Poland
| | - Wojciech Kazimierczak
- Kazimierczak Private Medical Practice, Dworcowa 13/u6a, 85-009 Bydgoszcz, Poland
- Department of Radiology and Diagnostic Imaging, Collegium Medicum, Nicolaus Copernicus University in Torun, Jagiellońska 13-15, 85-067 Bydgoszcz, Poland
| | - Zbigniew Serafin
- Department of Radiology and Diagnostic Imaging, Collegium Medicum, Nicolaus Copernicus University in Torun, Jagiellońska 13-15, 85-067 Bydgoszcz, Poland
| | - Paweł Nowicki
- Kazimierczak Private Medical Practice, Dworcowa 13/u6a, 85-009 Bydgoszcz, Poland
| | - Jakub Nożewski
- Department of Emeregncy Medicine, University Hospital No 2 in Bydgoszcz, Ujejskiego 75, 85-168 Bydgoszcz, Poland
| | | |
Collapse
|
14
|
Dipalma G, Inchingolo AD, Inchingolo AM, Piras F, Carpentiere V, Garofoli G, Azzollini D, Campanelli M, Paduanelli G, Palermo A, Inchingolo F. Artificial Intelligence and Its Clinical Applications in Orthodontics: A Systematic Review. Diagnostics (Basel) 2023; 13:3677. [PMID: 38132261 PMCID: PMC10743240 DOI: 10.3390/diagnostics13243677] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Revised: 12/05/2023] [Accepted: 12/13/2023] [Indexed: 12/23/2023] Open
Abstract
This review aims to analyze different strategies that make use of artificial intelligence to enhance diagnosis, treatment planning, and monitoring in orthodontics. Orthodontics has seen significant technological advancements with the introduction of digital equipment, including cone beam computed tomography, intraoral scanners, and software coupled to these devices. The use of deep learning in software has sped up image processing processes. Deep learning is an artificial intelligence technology that trains computers to analyze data like the human brain does. Deep learning models are capable of recognizing complex patterns in photos, text, audio, and other data to generate accurate information and predictions. MATERIALS AND METHODS Pubmed, Scopus, and Web of Science were used to discover publications from 1 January 2013 to 18 October 2023 that matched our topic. A comparison of various artificial intelligence applications in orthodontics was generated. RESULTS A final number of 33 studies were included in the review for qualitative analysis. CONCLUSIONS These studies demonstrate the effectiveness of AI in enhancing orthodontic diagnosis, treatment planning, and assessment. A lot of articles emphasize the integration of artificial intelligence into orthodontics and its potential to revolutionize treatment monitoring, evaluation, and patient outcomes.
Collapse
Affiliation(s)
- Gianna Dipalma
- Department of Interdisciplinary Medicine, University of Bari “Aldo Moro”, 70124 Bari, Italy; (A.M.I.); (F.P.); (V.C.); (G.G.); (D.A.); (M.C.); (G.P.); (F.I.)
| | - Alessio Danilo Inchingolo
- Department of Interdisciplinary Medicine, University of Bari “Aldo Moro”, 70124 Bari, Italy; (A.M.I.); (F.P.); (V.C.); (G.G.); (D.A.); (M.C.); (G.P.); (F.I.)
| | - Angelo Michele Inchingolo
- Department of Interdisciplinary Medicine, University of Bari “Aldo Moro”, 70124 Bari, Italy; (A.M.I.); (F.P.); (V.C.); (G.G.); (D.A.); (M.C.); (G.P.); (F.I.)
| | - Fabio Piras
- Department of Interdisciplinary Medicine, University of Bari “Aldo Moro”, 70124 Bari, Italy; (A.M.I.); (F.P.); (V.C.); (G.G.); (D.A.); (M.C.); (G.P.); (F.I.)
| | - Vincenzo Carpentiere
- Department of Interdisciplinary Medicine, University of Bari “Aldo Moro”, 70124 Bari, Italy; (A.M.I.); (F.P.); (V.C.); (G.G.); (D.A.); (M.C.); (G.P.); (F.I.)
| | - Grazia Garofoli
- Department of Interdisciplinary Medicine, University of Bari “Aldo Moro”, 70124 Bari, Italy; (A.M.I.); (F.P.); (V.C.); (G.G.); (D.A.); (M.C.); (G.P.); (F.I.)
| | - Daniela Azzollini
- Department of Interdisciplinary Medicine, University of Bari “Aldo Moro”, 70124 Bari, Italy; (A.M.I.); (F.P.); (V.C.); (G.G.); (D.A.); (M.C.); (G.P.); (F.I.)
| | - Merigrazia Campanelli
- Department of Interdisciplinary Medicine, University of Bari “Aldo Moro”, 70124 Bari, Italy; (A.M.I.); (F.P.); (V.C.); (G.G.); (D.A.); (M.C.); (G.P.); (F.I.)
| | - Gregorio Paduanelli
- Department of Interdisciplinary Medicine, University of Bari “Aldo Moro”, 70124 Bari, Italy; (A.M.I.); (F.P.); (V.C.); (G.G.); (D.A.); (M.C.); (G.P.); (F.I.)
| | - Andrea Palermo
- Implant Dentistry College of Medicine and Dentistry Birmingham, University of Birmingham, Birmingham B46BN, UK;
| | - Francesco Inchingolo
- Department of Interdisciplinary Medicine, University of Bari “Aldo Moro”, 70124 Bari, Italy; (A.M.I.); (F.P.); (V.C.); (G.G.); (D.A.); (M.C.); (G.P.); (F.I.)
| |
Collapse
|
15
|
Kapila S, Vora SR, Rengasamy Venugopalan S, Elnagar MH, Akyalcin S. Connecting the dots towards precision orthodontics. Orthod Craniofac Res 2023; 26 Suppl 1:8-19. [PMID: 37968678 DOI: 10.1111/ocr.12725] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/20/2023] [Indexed: 11/17/2023]
Abstract
Precision orthodontics entails the use of personalized clinical, biological, social and environmental knowledge of each patient for deep individualized clinical phenotyping and diagnosis combined with the delivery of care using advanced customized devices, technologies and biologics. From its historical origins as a mechanotherapy and materials driven profession, the most recent advances in orthodontics in the past three decades have been propelled by technological innovations including volumetric and surface 3D imaging and printing, advances in software that facilitate the derivation of diagnostic details, enhanced personalization of treatment plans and fabrication of custom appliances. Still, the use of these diagnostic and therapeutic technologies is largely phenotype driven, focusing mainly on facial/skeletal morphology and tooth positions. Future advances in orthodontics will involve comprehensive understanding of an individual's biology through omics, a field of biology that involves large-scale rapid analyses of DNA, mRNA, proteins and other biological regulators from a cell, tissue or organism. Such understanding will define individual biological attributes that will impact diagnosis, treatment decisions, risk assessment and prognostics of therapy. Equally important are the advances in artificial intelligence (AI) and machine learning, and its applications in orthodontics. AI is already being used to perform validation of approaches for diagnostic purposes such as landmark identification, cephalometric tracings, diagnosis of pathologies and facial phenotyping from radiographs and/or photographs. Other areas for future discoveries and utilization of AI will include clinical decision support, precision orthodontics, payer decisions and risk prediction. The synergies between deep 3D phenotyping and advances in materials, omics and AI will propel the technological and omics era towards achieving the goal of delivering optimized and predictable precision orthodontics.
Collapse
Affiliation(s)
- Sunil Kapila
- Strategic Initiatives and Operations, UCLA School of Dentistry, Los Angeles, California, USA
| | - Siddharth R Vora
- Oral Health Sciences, University of British Columbia, Vancouver, British Columbia, USA
| | | | - Mohammed H Elnagar
- Department of Orthodontics, College of Dentistry, University of Illinois Chicago, Chicago, Illinois, USA
| | - Sercan Akyalcin
- Department of Developmental Biology, Harvard School of Dental Medicine, Boston, Massachusetts, USA
| |
Collapse
|
16
|
Liu J, Zhang C, Shan Z. Application of Artificial Intelligence in Orthodontics: Current State and Future Perspectives. Healthcare (Basel) 2023; 11:2760. [PMID: 37893833 PMCID: PMC10606213 DOI: 10.3390/healthcare11202760] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Revised: 10/11/2023] [Accepted: 10/16/2023] [Indexed: 10/29/2023] Open
Abstract
In recent years, there has been the notable emergency of artificial intelligence (AI) as a transformative force in multiple domains, including orthodontics. This review aims to provide a comprehensive overview of the present state of AI applications in orthodontics, which can be categorized into the following domains: (1) diagnosis, including cephalometric analysis, dental analysis, facial analysis, skeletal-maturation-stage determination and upper-airway obstruction assessment; (2) treatment planning, including decision making for extractions and orthognathic surgery, and treatment outcome prediction; and (3) clinical practice, including practice guidance, remote care, and clinical documentation. We have witnessed a broadening of the application of AI in orthodontics, accompanied by advancements in its performance. Additionally, this review outlines the existing limitations within the field and offers future perspectives.
Collapse
Affiliation(s)
- Junqi Liu
- Division of Paediatric Dentistry and Orthodontics, Faculty of Dentistry, The University of Hong Kong, Hong Kong SAR, China;
| | - Chengfei Zhang
- Division of Restorative Dental Sciences, Faculty of Dentistry, The University of Hong Kong, Hong Kong SAR, China;
| | - Zhiyi Shan
- Division of Paediatric Dentistry and Orthodontics, Faculty of Dentistry, The University of Hong Kong, Hong Kong SAR, China;
| |
Collapse
|
17
|
Akay G, Akcayol MA, Özdem K, Güngör K. Deep convolutional neural network-the evaluation of cervical vertebrae maturation. Oral Radiol 2023; 39:629-638. [PMID: 36894716 DOI: 10.1007/s11282-023-00678-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Accepted: 02/19/2023] [Indexed: 03/11/2023]
Abstract
OBJECTIVES This study aimed to automatically determine the cervical vertebral maturation (CVM) processes on lateral cephalometric radiograph images using a proposed deep learning-based convolutional neural network (CNN) model and to test the success rate of this CNN model in detecting CVM stages using precision, recall, and F1-score. METHODS A total of 588 digital lateral cephalometric radiographs of patients with a chronological age between 8 and 22 years were included in this study. CVM evaluation was carried out by two dentomaxillofacial radiologists. CVM stages in the images were divided into 6 subgroups according to the growth process. A convolutional neural network (CNN) model was developed in this study. Experimental studies for the developed model were carried out in the Jupyter Notebook environment using the Python programming language, the Keras, and TensorFlow libraries. RESULTS As a result of the training that lasted 40 epochs, 58% training and 57% test accuracy were obtained. The model obtained results that were very close to the training on the test data. On the other hand, it was determined that the model showed the highest success in terms of precision and F1-score in the CVM Stage 1 and the highest success in the recall value in the CVM Stage 2. CONCLUSION The experimental results have shown that the developed model achieved moderate success and it reached a classification accuracy of 58.66% in CVM stage classification.
Collapse
Affiliation(s)
- Gülsün Akay
- Department of Dentomaxillofacial Radiology, Gazi University Faculty of Dentistry, Emek, Ankara, Turkey.
| | - M Ali Akcayol
- Department of Computer Engineering, Gazi University Faculty of Engineering, Ankara, Turkey
| | - Kevser Özdem
- Department of Computer Engineering, Gazi University Faculty of Engineering, Ankara, Turkey
| | - Kahraman Güngör
- Department of Dentomaxillofacial Radiology, Gazi University Faculty of Dentistry, Emek, Ankara, Turkey
| |
Collapse
|
18
|
Rana SS, Nath B, Chaudhari PK, Vichare S. Cervical Vertebral Maturation Assessment using various Machine Learning techniques on Lateral cephalogram: A systematic literature review. J Oral Biol Craniofac Res 2023; 13:642-651. [PMID: 37663368 PMCID: PMC10470275 DOI: 10.1016/j.jobcr.2023.08.005] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Revised: 05/12/2023] [Accepted: 08/16/2023] [Indexed: 09/05/2023] Open
Abstract
Importance For the assessment of optimum treatment timing in dentofacial orthopedics, understanding the growth process is of paramount importance. The evaluation of skeletal maturity based on study of the morphology of the cervical vertebrae has been devised to minimize radiation exposure of a patient due to hand wrist radiography. Cervical vertebral maturation assessment (CVMA) predictions have been examined in the state-of-the-art machine learning techniques in the recent past which require more attention and validation by clinicians and practitioners. Objectives This paper aimed to answer the question "How are machine learning techniques being employed in studies concerning cervical vertebral maturation assessment using lateral cephalograms?" Method A systematic search through the available literature was performed for this work based upon the Population, Intervention, Comparison and Outcome (PICO) framework. Data sources study selection data extraction and synthesis The searches were performed in Ovid Medline, Embase, PubMed and Cochrane Central Register of Controlled Trials (CENTRAL) and Cochrane Database of Systematic Reviews (CDSR). A search of the grey literature was also performed in Google Scholar and OpenGrey. We also did a hand-searching in the Angle Orthodontist, Journal of Orthodontics and Craniofacial Research, Progress in Orthodontics, and the American Journal of Orthodontics and Dentofacial Orthopedics. References from the included articles were also searched. Main outcomes and measures results A total of 25 papers which were assessed for full text, and 13 papers were included for the systematic review. The machine learning methods used were scrutinized according to their performance and comparison to human observers/experts. The accuracy of the models ranged between 60 and 90% or above, and satisfactory agreement and correlation with the human observers. Conclusions and relevance Machine learning models can be used for detection and classification of the cervical vertebrae maturation. In this systematic review (SR), the studies were summarized in terms of ML techniques applied, sample data, age range of sample and conventional method for CVMA, which showed that further studies with a uniform distribution of samples equally in stages of maturation and according to the gender is required for better training of the models in order to generalize the outputs for prolific use to target population.
Collapse
Affiliation(s)
- Shailendra Singh Rana
- Department of Dentistry, All India Institute of Medical Sciences, Bhatinda, Punjab, India
| | - Bhola Nath
- Department of Community Medicine, All India Institute of Medical Sciences, Bhatinda, Punjab, India
| | - Prabhat Kumar Chaudhari
- Division of Orthodontics and Dentofacial Deformities, Centre for Dental Education and Research, All India Institute of Medical Sciences, New Delhi, 110029, India
| | - Sharvari Vichare
- Department of Dentistry, All India Institute of Medical Sciences, Bhatinda, Punjab, India
| |
Collapse
|
19
|
Vodanović M, Subašić M, Milošević DP, Galić I, Brkić H. Artificial intelligence in forensic medicine and forensic dentistry. THE JOURNAL OF FORENSIC ODONTO-STOMATOLOGY 2023; 41:30-41. [PMID: 37634174 PMCID: PMC10473456] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 08/29/2023]
Abstract
This review article aims to highlight the current possibilities for applying Artificial Intelligence in modern forensic medicine and forensic dentistry and present the advantages and disadvantages of its use. For this purpose, the relevant academic literature was searched using PubMed, Web of Science and Scopus. The application of Artificial Intelligence in forensic medicine and forensic dentistry is still in its early stages. However, the possibilities are great, and the future will show what is applicable in daily practice. Artificial Intelligence will improve the accuracy and efficiency of work in forensic medicine and forensic dentistry; it can automate some tasks; and enhance the quality of evidence. Disadvantages of the application of Artificial Intelligence may be related to discrimination, transparency, accountability, privacy, security, ethics and others. Artificial Intelligence systems should be used as a support tool, not as a replacement for forensic experts.
Collapse
Affiliation(s)
- M Vodanović
- Department of Dental Anthropology, School of Dental Medicine, University of Zagreb, Croatia
| | - M Subašić
- Faculty of Electrical Engineering and Computing, University of Zagreb, Croatia
| | - D P Milošević
- Faculty of Electrical Engineering and Computing, University of Zagreb, Croatia
| | - I Galić
- School of Medicine, University of Split, Croatia
| | - H Brkić
- Department of Dental Anthropology, School of Dental Medicine, University of Zagreb, Croatia
| |
Collapse
|
20
|
Volovic J, Badirli S, Ahmad S, Leavitt L, Mason T, Bhamidipalli SS, Eckert G, Albright D, Turkkahraman H. A Novel Machine Learning Model for Predicting Orthodontic Treatment Duration. Diagnostics (Basel) 2023; 13:2740. [PMID: 37685278 PMCID: PMC10486486 DOI: 10.3390/diagnostics13172740] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Revised: 08/14/2023] [Accepted: 08/21/2023] [Indexed: 09/10/2023] Open
Abstract
In the field of orthodontics, providing patients with accurate treatment time estimates is of utmost importance. As orthodontic practices continue to evolve and embrace new advancements, incorporating machine learning (ML) methods becomes increasingly valuable in improving orthodontic diagnosis and treatment planning. This study aimed to develop a novel ML model capable of predicting the orthodontic treatment duration based on essential pre-treatment variables. Patients who completed comprehensive orthodontic treatment at the Indiana University School of Dentistry were included in this retrospective study. Fifty-seven pre-treatment variables were collected and used to train and test nine different ML models. The performance of each model was assessed using descriptive statistics, intraclass correlation coefficients, and one-way analysis of variance tests. Random Forest, Lasso, and Elastic Net were found to be the most accurate, with a mean absolute error of 7.27 months in predicting treatment duration. Extraction decision, COVID, intermaxillary relationship, lower incisor position, and additional appliances were identified as important predictors of treatment duration. Overall, this study demonstrates the potential of ML in predicting orthodontic treatment duration using pre-treatment variables.
Collapse
Affiliation(s)
- James Volovic
- Department of Orthodontics and Oral Facial Genetics, Indiana University School of Dentistry, Indianapolis, IN 46202, USA; (J.V.); (S.A.); (D.A.)
| | | | - Sunna Ahmad
- Department of Orthodontics and Oral Facial Genetics, Indiana University School of Dentistry, Indianapolis, IN 46202, USA; (J.V.); (S.A.); (D.A.)
| | - Landon Leavitt
- Department of Orthodontics and Oral Facial Genetics, Indiana University School of Dentistry, Indianapolis, IN 46202, USA; (J.V.); (S.A.); (D.A.)
| | - Taylor Mason
- Department of Orthodontics and Oral Facial Genetics, Indiana University School of Dentistry, Indianapolis, IN 46202, USA; (J.V.); (S.A.); (D.A.)
| | - Surya Sruthi Bhamidipalli
- Department of Biostatistics and Health Data Science, Indiana University School of Medicine, Indianapolis, IN 46202, USA; (S.S.B.); (G.E.)
| | - George Eckert
- Department of Biostatistics and Health Data Science, Indiana University School of Medicine, Indianapolis, IN 46202, USA; (S.S.B.); (G.E.)
| | - David Albright
- Department of Orthodontics and Oral Facial Genetics, Indiana University School of Dentistry, Indianapolis, IN 46202, USA; (J.V.); (S.A.); (D.A.)
| | - Hakan Turkkahraman
- Department of Orthodontics and Oral Facial Genetics, Indiana University School of Dentistry, Indianapolis, IN 46202, USA; (J.V.); (S.A.); (D.A.)
| |
Collapse
|
21
|
Zakhar G, Hazime S, Eckert G, Wong A, Badirli S, Turkkahraman H. Prediction of Pubertal Mandibular Growth in Males with Class II Malocclusion by Utilizing Machine Learning. Diagnostics (Basel) 2023; 13:2713. [PMID: 37627972 PMCID: PMC10453460 DOI: 10.3390/diagnostics13162713] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Revised: 08/11/2023] [Accepted: 08/17/2023] [Indexed: 08/27/2023] Open
Abstract
The goal of this study was to create a novel machine learning (ML) model that can predict the magnitude and direction of pubertal mandibular growth in males with Class II malocclusion. Lateral cephalometric radiographs of 123 males at three time points (T1: 12; T2: 14; T3: 16 years old) were collected from an online database of longitudinal growth studies. Each radiograph was traced, and seven different ML models were trained using 38 data points obtained from 92 subjects. Thirty-one subjects were used as the test group to predict the post-pubertal mandibular length and y-axis, using input data from T1 and T2 combined (2 year prediction), and T1 alone (4 year prediction). Mean absolute errors (MAEs) were used to evaluate the accuracy of each model. For all ML methods tested using the 2 year prediction, the MAEs for post-pubertal mandibular length ranged from 2.11-6.07 mm to 0.85-2.74° for the y-axis. For all ML methods tested with 4 year prediction, the MAEs for post-pubertal mandibular length ranged from 2.32-5.28 mm to 1.25-1.72° for the y-axis. Besides its initial length, the most predictive factors for mandibular length were found to be chronological age, upper and lower face heights, upper and lower incisor positions, and inclinations. For the y-axis, the most predictive factors were found to be y-axis at earlier time points, SN-MP, SN-Pog, SNB, and SNA. Although the potential of ML techniques to accurately forecast future mandibular growth in Class II cases is promising, a requirement for more substantial sample sizes exists to further enhance the precision of these predictions.
Collapse
Affiliation(s)
- Grant Zakhar
- Department of Orthodontics and Oral Facial Genetics, Indiana University School of Dentistry, Indianapolis, IN 46202, USA; (G.Z.); (A.W.)
| | - Samir Hazime
- Indiana University School of Dentistry, Indianapolis, IN 46202, USA;
| | - George Eckert
- Department of Biostatistics and Health Data Science, Indiana University School of Medicine, Indianapolis, IN 46202, USA;
| | - Ariel Wong
- Department of Orthodontics and Oral Facial Genetics, Indiana University School of Dentistry, Indianapolis, IN 46202, USA; (G.Z.); (A.W.)
| | | | - Hakan Turkkahraman
- Department of Orthodontics and Oral Facial Genetics, Indiana University School of Dentistry, Indianapolis, IN 46202, USA; (G.Z.); (A.W.)
| |
Collapse
|
22
|
Li H, Li H, Yuan L, Liu C, Xiao S, Liu Z, Zhou G, Dong T, Ouyang N, Liu L, Ma C, Feng Y, Zheng Y, Xia L, Fang B. The psc-CVM assessment system: A three-stage type system for CVM assessment based on deep learning. BMC Oral Health 2023; 23:557. [PMID: 37573308 PMCID: PMC10422791 DOI: 10.1186/s12903-023-03266-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Accepted: 07/29/2023] [Indexed: 08/14/2023] Open
Abstract
BACKGROUND Many scholars have proven cervical vertebral maturation (CVM) method can predict the growth and development and assist in choosing the best time for treatment. However, assessing CVM is a complex process. The experience and seniority of the clinicians have an enormous impact on judgment. This study aims to establish a fully automated, high-accuracy CVM assessment system called the psc-CVM assessment system, based on deep learning, to provide valuable reference information for the growth period determination. METHODS This study used 10,200 lateral cephalograms as the data set (7111 in train set, 1544 in validation set and 1545 in test set) to train the system. The psc-CVM assessment system is designed as three parts with different roles, each operating in a specific order. 1) Position Network for locating the position of cervical vertebrae; 2) Shape Recognition Network for recognizing and extracting the shapes of cervical vertebrae; and 3) CVM Assessment Network for assessing CVM according to the shapes of cervical vertebrae. Statistical analysis was conducted to detect the performance of the system and the agreement of CVM assessment between the system and the expert panel. Heat maps were analyzed to understand better what the system had learned. The area of the third (C3), fourth (C4) cervical vertebrae and the lower edge of second (C2) cervical vertebrae were activated when the system was assessing the images. RESULTS The system has achieved good performance for CVM assessment with an average AUC (the area under the curve) of 0.94 and total accuracy of 70.42%, as evaluated on the test set. The Cohen's Kappa between the system and the expert panel is 0.645. The weighted Kappa between the system and the expert panel is 0.844. The overall ICC between the psc-CVM assessment system and the expert panel was 0.946. The F1 score rank for the psc-CVM assessment system was: CVS (cervical vertebral maturation stage) 6 > CVS1 > CVS4 > CVS5 > CVS3 > CVS2. CONCLUSIONS The results showed that the psc-CVM assessment system achieved high accuracy in CVM assessment. The system in this study was significantly consistent with expert panels in CVM assessment, indicating that the system can be used as an efficient, accurate, and stable diagnostic aid to provide a clinical aid for determining growth and developmental stages by CVM.
Collapse
Affiliation(s)
- Hairui Li
- Department of Orthodontics, Shanghai Ninth People's Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China
| | - Haizhen Li
- Department of Orthodontics, Shanghai Ninth People's Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China
| | - Lingjun Yuan
- Department of Orthodontics, Shanghai Ninth People's Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China
| | - Chao Liu
- Department of Orthodontics, Shanghai Ninth People's Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China
| | - Shengzhao Xiao
- Department of Orthodontics, Shanghai Ninth People's Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China
| | - Zhen Liu
- Department of Orthodontics, Shanghai Ninth People's Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China
| | - Guoli Zhou
- Department of Orthodontics, Shanghai Ninth People's Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China
| | - Ting Dong
- Department of Orthodontics, Shanghai Ninth People's Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China
| | - Ningjuan Ouyang
- Department of Orthodontics, Shanghai Ninth People's Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China
| | - Lu Liu
- Department of Orthodontics, Shanghai Ninth People's Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China
| | | | - Yang Feng
- Translational Medicine Research Platform of Oral Biomechanics and Artificial Intelligence, Department of Orthodontics, Shanghai Ninth People's Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China
| | - Youyi Zheng
- State Key Lab of CAD&CG, Zhejiang University, Hangzhou, China.
| | - Lunguo Xia
- Department of Orthodontics, Shanghai Ninth People's Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China.
| | - Bing Fang
- Department of Orthodontics, Shanghai Ninth People's Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China.
| |
Collapse
|
23
|
Kiełczykowski M, Kamiński K, Perkowski K, Zadurska M, Czochrowska E. Application of Artificial Intelligence (AI) in a Cephalometric Analysis: A Narrative Review. Diagnostics (Basel) 2023; 13:2640. [PMID: 37627899 PMCID: PMC10453867 DOI: 10.3390/diagnostics13162640] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Revised: 08/04/2023] [Accepted: 08/08/2023] [Indexed: 08/27/2023] Open
Abstract
In recent years, the application of artificial intelligence (AI) has become more and more widespread in medicine and dentistry. It may contribute to improved quality of health care as diagnostic methods are getting more accurate and diagnostic errors are rarer in daily medical practice. The aim of this paper was to present data from the literature on the effectiveness of AI in orthodontic diagnostics based on the analysis of lateral cephalometric radiographs. A review of the literature from 2009 to 2023 has been performed using PubMed, Medline, Scopus and Dentistry & Oral Sciences Source databases. The accuracy of determining cephalometric landmarks using widely available commercial AI-based software and advanced AI algorithms was presented and discussed. Most AI algorithms used for the automated positioning of landmarks on cephalometric radiographs had relatively high accuracy. At the same time, the effectiveness of using AI in cephalometry varies depending on the algorithm or the application type, which has to be accounted for during the interpretation of the results. In conclusion, artificial intelligence is a promising tool that facilitates the identification of cephalometric landmarks in everyday clinical practice, may support orthodontic treatment planning for less experienced clinicians and shorten radiological examination in orthodontics. In the future, AI algorithms used for the automated localisation of cephalometric landmarks may be more accurate than manual analysis.
Collapse
Affiliation(s)
| | | | | | | | - Ewa Czochrowska
- Department of Orthodontics, Medical University in Warsaw, 02-097 Warsaw, Poland; (M.K.); (K.K.); (K.P.); (M.Z.)
| |
Collapse
|
24
|
Shafi I, Fatima A, Afzal H, Díez IDLT, Lipari V, Breñosa J, Ashraf I. A Comprehensive Review of Recent Advances in Artificial Intelligence for Dentistry E-Health. Diagnostics (Basel) 2023; 13:2196. [PMID: 37443594 DOI: 10.3390/diagnostics13132196] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Revised: 06/14/2023] [Accepted: 06/23/2023] [Indexed: 07/15/2023] Open
Abstract
Artificial intelligence has made substantial progress in medicine. Automated dental imaging interpretation is one of the most prolific areas of research using AI. X-ray and infrared imaging systems have enabled dental clinicians to identify dental diseases since the 1950s. However, the manual process of dental disease assessment is tedious and error-prone when diagnosed by inexperienced dentists. Thus, researchers have employed different advanced computer vision techniques, and machine- and deep-learning models for dental disease diagnoses using X-ray and near-infrared imagery. Despite the notable development of AI in dentistry, certain factors affect the performance of the proposed approaches, including limited data availability, imbalanced classes, and lack of transparency and interpretability. Hence, it is of utmost importance for the research community to formulate suitable approaches, considering the existing challenges and leveraging findings from the existing studies. Based on an extensive literature review, this survey provides a brief overview of X-ray and near-infrared imaging systems. Additionally, a comprehensive insight into challenges faced by researchers in the dental domain has been brought forth in this survey. The article further offers an amalgamative assessment of both performances and methods evaluated on public benchmarks and concludes with ethical considerations and future research avenues.
Collapse
Affiliation(s)
- Imran Shafi
- College of Electrical and Mechanical Engineering, National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan
| | - Anum Fatima
- National Centre for Robotics, National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan
| | - Hammad Afzal
- Military College of Signals (MCS), National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan
| | - Isabel de la Torre Díez
- Department of Signal Theory and Communications and Telematic Engineering, University of Valladolid, Paseo de Belén 15, 47011 Valladolid, Spain
| | - Vivian Lipari
- Research Unit in Food Technologies, Agro-Food Industries and Nutrition, Universidad Europea del Atlántico, Isabel Torres 21, 39011 Santander, Spain
- Research Unit in Food Technologies, Agro-Food Industries and Nutrition, Universidad Internacional Iberoamericana, Campeche 24560, Mexico
- Research Unit in Food Technologies, Agro-Food Industries and Nutrition, Fundación Universitaria Internacional de Colombia, Bogotá 111311, Colombia
| | - Jose Breñosa
- Research Unit in Food Technologies, Agro-Food Industries and Nutrition, Universidad Europea del Atlántico, Isabel Torres 21, 39011 Santander, Spain
- Universidade Internacional do Cuanza, Cuito EN250, Bié, Angola
- Research Unit in Food Technologies, Agro-Food Industries and Nutrition, Universidad Internacional Iberoamericana Arecibo, Puerto Rico, PR 00613, USA
| | - Imran Ashraf
- Department of Information and Communication Engineering, Yeungnam University, Gyeongsan 38541, Republic of Korea
| |
Collapse
|
25
|
Amasya H, Aydoğan T, Cesur E, Kemaloğlu Alagöz N, Uğurlu M, Bayrakdar İŞ, Orhan K. Using artificial intelligence models to evaluate envisaged points initially: A pilot study. Proc Inst Mech Eng H 2023:9544119231173165. [PMID: 37211725 DOI: 10.1177/09544119231173165] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
The morphology of the finger bones in hand-wrist radiographs (HWRs) can be considered as a radiological skeletal maturity indicator, along with the other indicators. This study aims to validate the anatomical landmarks envisaged to be used for classification of the morphology of the phalanges, by developing classical neural network (NN) classifiers based on a sub-dataset of 136 HWRs. A web-based tool was developed and 22 anatomical landmarks were labeled on four region of interests (proximal (PP3), medial (MP3), distal (DP3) phalanges of the third and medial phalanx (MP5) of the fifth finger) and the epiphysis-diaphysis relationships were saved as "narrow,""equal,""capping" or "fusion" by three observers. In each region, 18 ratios and 15 angles were extracted using anatomical points. The data set is analyzed by developing two NN classifiers, without (NN-1) and with (NN-2) the 5-fold cross-validation. The performance of the models was evaluated with percentage of agreement, Cohen's (cκ) and Weighted (wκ) Kappa coefficients, precision, recall, F1-score and accuracy (statistically significance: p < 0.05). Method error was found to be in the range of cκ: 0.7-1. Overall classification performance of the models was changed between 82.14% and 89.29%. On average, performance of the NN-1 and NN-2 models were found to be 85.71% and 85.52%, respectively. The cκ and wκ of the NN-1 model were changed between -0.08 (p > 0.05) and 0.91 among regions. The average performance was found to be promising except the regions without adequate samples and the anatomical points are validated to be used in the future studies, initially.
Collapse
Affiliation(s)
- Hakan Amasya
- Faculty of Dentistry, Department of Oral and Maxillofacial Radiology, Istanbul University-Cerrahpaşa, Istanbul, Turkey
- CAST (Cerrahpasa Research, Simulation and Design Laboratory), Istanbul University-Cerrahpaşa, Istanbul, Turkey
- Health Biotechnology Joint Research and Application Center of Excellence, Istanbul, Turkey
| | - Turgay Aydoğan
- Faculty of Engineering, Department of Computer Engineering, Süleyman Demirel University, Isparta, Turkey
| | - Emre Cesur
- Faculty of Dentistry, Department of Orthodontics, Medipol Mega University Hospital, Istanbul, Turkey
| | - Nazan Kemaloğlu Alagöz
- Uluborlu Selahattin Karasoy Vocational School, Isparta University of Applied Sciences, Isparta, Turkey
| | - Mehmet Uğurlu
- Faculty of Dentistry, Department of Orthodontics, Eskişehir Osmangazi University, Eskisehir, Turkey
| | - İbrahim Şevki Bayrakdar
- Faculty of Dentistry, Department of Oral and Maxillofacial Radiology, Eskişehir Osmangazi University, Eskisehir, Turkey
| | - Kaan Orhan
- Health Biotechnology Joint Research and Application Center of Excellence, Istanbul, Turkey
- Faculty of Dentistry, Department of Oral and Maxillofacial Radiology, Ankara University, Ankara, Turkey
- Ankara University Medical Design Application and Research Center (MEDITAM), Ankara, Turkey
| |
Collapse
|
26
|
Nan L, Tang M, Liang B, Mo S, Kang N, Song S, Zhang X, Zeng X. Automated Sagittal Skeletal Classification of Children Based on Deep Learning. Diagnostics (Basel) 2023; 13:diagnostics13101719. [PMID: 37238203 DOI: 10.3390/diagnostics13101719] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2023] [Revised: 05/02/2023] [Accepted: 05/05/2023] [Indexed: 05/28/2023] Open
Abstract
Malocclusions are a type of cranio-maxillofacial growth and developmental deformity that occur with high incidence in children. Therefore, a simple and rapid diagnosis of malocclusions would be of great benefit to our future generation. However, the application of deep learning algorithms to the automatic detection of malocclusions in children has not been reported. Therefore, the aim of this study was to develop a deep learning-based method for automatic classification of the sagittal skeletal pattern in children and to validate its performance. This would be the first step in establishing a decision support system for early orthodontic treatment. In this study, four different state-of-the-art (SOTA) models were trained and compared by using 1613 lateral cephalograms, and the best performance model, Densenet-121, was selected was further subsequent validation. Lateral cephalograms and profile photographs were used as the input for the Densenet-121 model, respectively. The models were optimized using transfer learning and data augmentation techniques, and label distribution learning was introduced during model training to address the inevitable label ambiguity between adjacent classes. Five-fold cross-validation was conducted for a comprehensive evaluation of our method. The sensitivity, specificity, and accuracy of the CNN model based on lateral cephalometric radiographs were 83.99, 92.44, and 90.33%, respectively. The accuracy of the model with profile photographs was 83.39%. The accuracy of both CNN models was improved to 91.28 and 83.98%, respectively, while the overfitting decreased after addition of label distribution learning. Previous studies have been based on adult lateral cephalograms. Therefore, our study is novel in using deep learning network architecture with lateral cephalograms and profile photographs obtained from children in order to obtain a high-precision automatic classification of the sagittal skeletal pattern in children.
Collapse
Affiliation(s)
- Lan Nan
- College of Stomatology, Guangxi Medical University, Nanning 530021, China
| | - Min Tang
- College of Stomatology, Guangxi Medical University, Nanning 530021, China
| | - Bohui Liang
- School of Computer, Electronics and Information, Guangxi University, Nanning 530004, China
| | - Shuixue Mo
- College of Stomatology, Guangxi Medical University, Nanning 530021, China
| | - Na Kang
- College of Stomatology, Guangxi Medical University, Nanning 530021, China
| | - Shaohua Song
- College of Stomatology, Guangxi Medical University, Nanning 530021, China
| | - Xuejun Zhang
- School of Computer, Electronics and Information, Guangxi University, Nanning 530004, China
| | - Xiaojuan Zeng
- College of Stomatology, Guangxi Medical University, Nanning 530021, China
- Guangxi Health Commission Key Laboratory of Prevention and Treatment for Oral Infectious Diseases, Nanning 530021, China
- Guangxi Key Laboratory of Oral and Maxillofacial Rehabilitation and Reconstruction, Nanning 530021, China
| |
Collapse
|
27
|
Automatic determination of pubertal growth spurts based on the cervical vertebral maturation staging using deep convolutional neural networks. J World Fed Orthod 2023; 12:56-63. [PMID: 36890034 DOI: 10.1016/j.ejwf.2023.02.003] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2022] [Revised: 02/15/2023] [Accepted: 02/15/2023] [Indexed: 03/08/2023]
Abstract
BACKGROUND This study aimed to develop a deep convolutional neural network (CNN) for automatic classification of pubertal growth spurts using cervical vertebral maturation (CVM) staging based on the lateral cephalograms of an Iranian subpopulation. MATERIAL AND METHODS Cephalometric radiographs were collected from 1846 eligible patients (aged 5-18 years) referred to the orthodontic department of Hamadan University of Medical Sciences. These images were labeled by two experienced orthodontists. Two scenarios, including two- and three-class (pubertal growth spurts using CVM), were considered as the output for the classification task. The cropped image of the second to fourth cervical vertebrae was used as input to the network. After the preprocessing, the augmentation step, and hyperparameter tuning, the networks were trained with initial random weighting and transfer learning. Finally, the best architecture among the different architectures was determined based on the accuracy and F-score criteria. RESULTS The CNN based on the ConvNeXtBase-296 architecture had the highest accuracy for automatically assessing pubertal growth spurts based on CVM staging in both three-class (82% accuracy) and two-class (93% accuracy) scenarios. Given the limited amount of data available for training the target networks for most of the architectures in use, transfer learning improves predictive performance. CONCLUSIONS The results of this study confirm the potential of CNNs as an auxiliary diagnostic tool for intelligent assessment of skeletal maturation staging with high accuracy even with a relatively small number of images. Considering the development of orthodontic science toward digitalization, the development of such intelligent decision systems is proposed.
Collapse
|
28
|
Mathew R, Palatinus S, Padala S, Alshehri A, Awadh W, Bhandi S, Thomas J, Patil S. Neural networks for classification of cervical vertebrae maturation: a systematic review. Angle Orthod 2022; 92:796-804. [PMID: 36069934 PMCID: PMC9598845 DOI: 10.2319/031022-210.1] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2022] [Accepted: 06/01/2022] [Indexed: 11/23/2022] Open
Abstract
OBJECTIVE To assess the accuracy of identification and/or classification of the stage of cervical vertebrae maturity on lateral cephalograms by neural networks as compared with the ground truth determined by human observers. MATERIALS AND METHODS Search results from four electronic databases (PubMed [MEDLINE], Embase, Scopus, and Web of Science) were screened by two independent reviewers, and potentially relevant articles were chosen for full-text evaluation. Articles that fulfilled the inclusion criteria were selected for data extraction and methodologic assessment by the QUADAS-2 tool. RESULTS The search identified 425 articles across the databases, from which 8 were selected for inclusion. Most publications concerned the development of the models with different input features. Performance of the systems was evaluated against the classifications performed by human observers. The accuracy of the models on the test data ranged from 50% to more than 90%. There were concerns in all studies regarding the risk of bias in the index test and the reference standards. Studies that compared models with other algorithms in machine learning showed better results using neural networks. CONCLUSIONS Neural networks can detect and classify cervical vertebrae maturation stages on lateral cephalograms. However, further studies need to develop robust models using appropriate reference standards that can be generalized to external data.
Collapse
|
29
|
Fatima A, Shafi I, Afzal H, Díez IDLT, Lourdes DRSM, Breñosa J, Espinosa JCM, Ashraf I. Advancements in Dentistry with Artificial Intelligence: Current Clinical Applications and Future Perspectives. Healthcare (Basel) 2022; 10:2188. [PMID: 36360529 PMCID: PMC9690084 DOI: 10.3390/healthcare10112188] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2022] [Revised: 10/11/2022] [Accepted: 10/26/2022] [Indexed: 08/31/2023] Open
Abstract
Artificial intelligence has been widely used in the field of dentistry in recent years. The present study highlights current advances and limitations in integrating artificial intelligence, machine learning, and deep learning in subfields of dentistry including periodontology, endodontics, orthodontics, restorative dentistry, and oral pathology. This article aims to provide a systematic review of current clinical applications of artificial intelligence within different fields of dentistry. The preferred reporting items for systematic reviews (PRISMA) statement was used as a formal guideline for data collection. Data was obtained from research studies for 2009-2022. The analysis included a total of 55 papers from Google Scholar, IEEE, PubMed, and Scopus databases. Results show that artificial intelligence has the potential to improve dental care, disease diagnosis and prognosis, treatment planning, and risk assessment. Finally, this study highlights the limitations of the analyzed studies and provides future directions to improve dental care.
Collapse
Affiliation(s)
- Anum Fatima
- National Centre for Robotics, National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan
| | - Imran Shafi
- College of Electrical and Mechanical Engineering, National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan
| | - Hammad Afzal
- Military College of Signals (MCS), National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan
| | - Isabel De La Torre Díez
- Department of Signal Theory and Communications and Telematic Engineering, University of Valladolid, Paseo de Belén 15, 47011 Valladolid, Spain
| | - Del Rio-Solá M. Lourdes
- Department of Vascular Surgery, University Hospital of Valladolid, Paseo de Belén 15, 47011 Valladolid, Spain
| | - Jose Breñosa
- Universidad Europea del Atlántico, Isabel Torres 21, 39011 Santander, Spain
- Universidad Internacional Iberoamericana, Arecibo, PR 00613, USA
- Universidade Internacional do Cuanza, Estrada Nacional 250, Bairro Kaluapanda Cuito- Bié, Angola
| | - Julio César Martínez Espinosa
- Universidad Europea del Atlántico, Isabel Torres 21, 39011 Santander, Spain
- Universidad Internacional Iberoamericana, Campeche 24560, Mexico
- Fundación Universitaria Internacional de Colombia, Calle 39A #19-18 Bogotá D.C, Colombia
| | - Imran Ashraf
- Department of Information and Communication Engineering, Yeungnam University, Gyeongsan 38541, Korea
| |
Collapse
|
30
|
Li H, Chen Y, Wang Q, Gong X, Lei Y, Tian J, Gao X. Convolutional neural network-based automatic cervical vertebral maturation classification method. Dentomaxillofac Radiol 2022; 51:20220070. [PMID: 35612567 PMCID: PMC10043621 DOI: 10.1259/dmfr.20220070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2022] [Revised: 05/05/2022] [Accepted: 05/10/2022] [Indexed: 11/05/2022] Open
Abstract
OBJECTIVES This study aimed to develop a fully automated artificial intelligence-aided cervical vertebral maturation (CVM) classification method based on convolutional neural networks (CNNs) to provide an auxiliary diagnosis for orthodontists. METHODS This study consisted of cephalometric images from patients aged between 5 and 18 years. After grouping them into six cervical stages (CSs) by orthodontists, a data set was constructed for analyzing CVM using CNNs. The data set was divided into training, validation, and test sets in the ratio of 70, 15, and 15%. Four CNN models namely, VGG16, GoogLeNet, DenseNet161, and ResNet152 were selected as the candidate models. After training and validation, the models were evaluated to determine which of them is most suitable for CVM analysis. Heat maps were analyzed for a deeper understanding of what the CNNs had learned. RESULTS The final classification accuracy ranking was ResNet152>DenseNet161>GoogLeNet>VGG16, as evaluated on the test set. ResNet152 proved to be the best model among the four models for CVM classification with a weighted κ of 0.826, an average AUC of 0.933 and total accuracy of 67.06%. The F1 score rank for each subgroup was: CS6>CS1>CS4>CS5>CS3>CS2. The area of the third (C3) and fourth (C4) cervical vertebrae were activated when CNNs were assessing the images. CONCLUSION CNN models proved to be a convenient, fast and reliable method for CVM analysis. CNN models have the potential to provide automatic auxiliary diagnostic tools in the future.
Collapse
Affiliation(s)
- Haizhen Li
- Department of Orthodontics, Peking University School and Hospital of Stomatology, 22 Zhongguancun South Avenue, Haidian District, Beijing, P.R. China
| | - Yanlong Chen
- Department of Orthodontics, Peking University School and Hospital of Stomatology, 22 Zhongguancun South Avenue, Haidian District, Beijing, P.R. China
| | | | - Xu Gong
- Department of Orthodontics, Peking University School and Hospital of Stomatology, 22 Zhongguancun South Avenue, Haidian District, Beijing, P.R. China
| | - Yi Lei
- School of Software Engineering, Faculty of Information Technology, No.100 Pingleyuan, Chaoyang District, Beijing, P.R. China
| | - Jialiang Tian
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, No.10 Xitucheng Road, Haidian District, Beijing, P.R. China
| | - Xuemei Gao
- Department of Orthodontics, Peking University School and Hospital of Stomatology, 22 Zhongguancun South Avenue, Haidian District, Beijing, P.R. China
| |
Collapse
|
31
|
Lin Y, Chi Y, Han H, Han M, Guo Y. Multimodal Orthodontic Corpus Construction Based on Semantic Tag Classification Method. Neural Process Lett 2022. [DOI: 10.1007/s11063-021-10558-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
32
|
Liao N, Dai J, Tang Y, Zhong Q, Mo S. iCVM: An Interpretable Deep Learning Model for CVM Assessment under Label Uncertainty. IEEE J Biomed Health Inform 2022; 26:4325-4334. [PMID: 35653451 DOI: 10.1109/jbhi.2022.3179619] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
The Cervical Vertebral Maturation (CVM) method aims to determine the craniofacial skeletal maturational stage, which is crucial for orthodontic and orthopedic treatment. In this paper, we explore the potential of deep learning for automatic CVM assessment. In particular, we propose a convolutional neural network named iCVM. Based on the residual network, it is specialized for the challenges unique to the task of CVM assessment. 1) To combat overfitting due to limited data size, multiple dropout layers are utilized. 2) To address the inevitable label ambiguity between adjacent maturational stages, we introduce the concept of label distribution learning in the loss function. Besides, we attempt to analyze the regions important for the prediction of the model by using the Grad-CAM technique. The learned strategy shows surprisingly high consistency with the clinical criteria. This indicates that the decisions made by our model are well interpretable, which is critical in evaluation of growth and development in orthodontics. Moreover, to drive future research in the field, we release a new dataset named CVM-900 along with the paper. It contains the cervical part of 900 lateral cephalograms collected from orthodontic patients of different ages and genders. Experimental results show that the proposed approach achieves superior performance on CVM-900 in terms of various evaluation metrics.
Collapse
|
33
|
Mohammad-Rahimi H, Motamadian SR, Nadimi M, Hassanzadeh-Samani S, Minabi MAS, Mahmoudinia E, Lee VY, Rohban MH. Deep learning for the classification of cervical maturation degree and pubertal growth spurts: A pilot study. Korean J Orthod 2022; 52:112-122. [PMID: 35321950 PMCID: PMC8964471 DOI: 10.4041/kjod.2022.52.2.112] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2021] [Revised: 09/25/2021] [Accepted: 10/01/2021] [Indexed: 11/10/2022] Open
Abstract
Objective This study aimed to present and evaluate a new deep learning model for determining cervical vertebral maturation (CVM) degree and growth spurts by analyzing lateral cephalometric radiographs. Methods The study sample included 890 cephalograms. The images were classified into six cervical stages independently by two orthodontists. The images were also categorized into three degrees on the basis of the growth spurt pre-pubertal, growth spurt, and post-pubertal. Subsequently, the samples were fed to a transfer learning model implemented using the Python programming language and PyTorch library. In the last step, the test set of cephalograms was randomly coded and provided to two new orthodontists in order to compare their diagnosis to the artificial intelligence (AI) model’s performance using weighted kappa and Cohen’s kappa statistical analyses. Results The model’s validation and test accuracy for the six-class CVM diagnosis were 62.63% and 61.62%, respectively. Moreover, the model’s validation and test accuracy for the three-class classification were 75.76% and 82.83%, respectively. Furthermore, substantial agreements were observed between the two orthodontists as well as one of them and the AI model. Conclusions The newly developed AI model had reasonable accuracy in detecting the CVM stage and high reliability in detecting the pubertal stage. However, its accuracy was still less than that of human observers. With further improvements in data quality, this model should be able to provide practical assistance to practicing dentists in the future.
Collapse
Affiliation(s)
- Hossein Mohammad-Rahimi
- Department of Computer Engineering, Sharif University of Technology, Tehran, Iran.,Topic Group Dental Diagnostics and Digital Dentistry, ITU/WHO Focus Group AI on Health, Berlin, Germany
| | - Saeed Reza Motamadian
- Dentofacial Deformities Research Center, Research Institute of Dental Sciences & Department of Orthodontics, School of Dentistry, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Mohadeseh Nadimi
- Department of Medical Physics and Biomedical Engineering, Tehran University of Medical Sciences (TUMS), Tehran, Iran
| | - Sahel Hassanzadeh-Samani
- Dentofacial Deformities Research Center, Research Institute of Dental Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Mohammad A S Minabi
- Department of Computer Engineering, Sirjan University of Technology, Kerman, Iran
| | - Erfan Mahmoudinia
- Department of Computer Engineering, Sharif University of Technology, Tehran, Iran
| | | | | |
Collapse
|
34
|
Development of a multi-stage model for intelligent and quantitative appraising of skeletal maturity using cervical vertebras cone-beam CT images of Chinese girls. Int J Comput Assist Radiol Surg 2022; 17:761-773. [PMID: 34982398 DOI: 10.1007/s11548-021-02550-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2021] [Accepted: 12/17/2021] [Indexed: 11/05/2022]
Abstract
PURPOSE Nowadays, the integration of Artificial intelligence algorithms and quantified radiographic imaging-based diagnostic procedures is hailing amplified deliberation particularly in assessment of skeletal maturity. So we intend to formulate a logistic regression model for intelligent and quantitative estimation of Fishman skeletal maturation index (SMI) based on the parameters attained from the cervical vertebrae CBCT images of Chinese girls. METHODS From 709 hand wrist radiographs and CBCT images, 447 samples were randomly selected (called as G1) to build a logistic regression model. The reliability and reproducibility were assessed by the intraclass correlation coefficient (ICC) and weighted Cohen's kappa, followed by Spearman's rank correlation coefficient to identify the parameters significantly associated with the SMI. Two hundred and sixty-two other subjects (named G2) were recruited for external examination of the models by direct visual comparison and the receiver operating characteristic (ROC) curve. In cases of confusion and mispredictions, the model was modified to improve the consistency. RESULTS Five significant parameters (Chronological age, C3 height (H3)[Formula: see text], C4 upper width (UW4), C4 lower width (LW4), and the ratio of posterior height to lower width of C4 ([Formula: see text]) were administered into logistic regression model. Despite total agreement percentage which was 84% (total AUC = 0.92), unsatisfactory performance was noticed for the 6th and 8th stages which were confused with their neighboring stages. After adjustments of the models, the total agreement percentage and AUC were upgraded to 88% and 0.96, respectively. CONCLUSION Consistency and fitness evaluation of our models demonstrated adequate prediction percentage and reliability for automated classification of skeletal maturation. The presented constructed logistic regression model has the potential to serve as a maturity evaluation index in clinical craniofacial orthopedics in Chinese girls. The proposed model in this study showed promising strength for being expended in the event of other clinical multi-stage conditions.
Collapse
|
35
|
Yan KX, Liu L, Li H. Application of machine learning in oral and maxillofacial surgery. Artif Intell Med Imaging 2021; 2:104-114. [DOI: 10.35711/aimi.v2.i6.104] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/07/2021] [Revised: 12/20/2021] [Accepted: 12/28/2021] [Indexed: 02/06/2023] Open
Abstract
Oral and maxillofacial anatomy is extremely complex, and medical imaging is critical in the diagnosis and treatment of soft and bone tissue lesions. Hence, there exists accumulating imaging data without being properly utilized over the last decades. As a result, problems are emerging regarding how to integrate and interpret a large amount of medical data and alleviate clinicians’ workload. Recently, artificial intelligence has been developing rapidly to analyze complex medical data, and machine learning is one of the specific methods of achieving this goal, which is based on a set of algorithms and previous results. Machine learning has been considered useful in assisting early diagnosis, treatment planning, and prognostic estimation through extracting key features and building mathematical models by computers. Over the past decade, machine learning techniques have been applied to the field of oral and maxillofacial surgery and increasingly achieved expert-level performance. Thus, we hold a positive attitude towards developing machine learning for reducing the number of medical errors, improving the quality of patient care, and optimizing clinical decision-making in oral and maxillofacial surgery. In this review, we explore the clinical application of machine learning in maxillofacial cysts and tumors, maxillofacial defect reconstruction, orthognathic surgery, and dental implant and discuss its current problems and solutions.
Collapse
Affiliation(s)
- Kai-Xin Yan
- State Key Laboratory of Oral Diseases & National Clinical Research Center for Oral Diseases & Department of Oral and Maxillofacial Surgery, West China Hospital of Stomatology, Sichuan University, Chengdu 610041, Sichuan Province, China
| | - Lei Liu
- State Key Laboratory of Oral Diseases & National Clinical Research Center for Oral Diseases & Department of Oral and Maxillofacial Surgery, West China Hospital of Stomatology, Sichuan University, Chengdu 610041, Sichuan Province, China
| | - Hui Li
- State Key Laboratory of Oral Diseases & National Clinical Research Center for Oral Diseases & Department of Oral and Maxillofacial Surgery, West China Hospital of Stomatology, Sichuan University, Chengdu 610041, Sichuan Province, China
| |
Collapse
|
36
|
Kim EG, Oh IS, So JE, Kang J, Le VNT, Tak MK, Lee DW. Estimating Cervical Vertebral Maturation with a Lateral Cephalogram Using the Convolutional Neural Network. J Clin Med 2021; 10:jcm10225400. [PMID: 34830682 PMCID: PMC8620598 DOI: 10.3390/jcm10225400] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2021] [Revised: 11/15/2021] [Accepted: 11/16/2021] [Indexed: 11/16/2022] Open
Abstract
Recently, the estimation of bone maturation using deep learning has been actively conducted. However, many studies have considered hand–wrist radiographs, while a few studies have focused on estimating cervical vertebral maturation (CVM) using lateral cephalograms. This study proposes the use of deep learning models for estimating CVM from lateral cephalograms. As the second, third, and fourth cervical vertebral regions (denoted as C2, C3, and C4, respectively) are considerably smaller than the whole image, we propose a stepwise segmentation-based model that focuses on the C2–C4 regions. We propose three convolutional neural network-based classification models: a one-step model with only CVM classification, a two-step model with region of interest (ROI) detection and CVM classification, and a three-step model with ROI detection, cervical segmentation, and CVM classification. Our dataset contains 600 lateral cephalogram images, comprising six classes with 100 images each. The three-step segmentation-based model produced the best accuracy (62.5%) compared to the models that were not segmentation-based.
Collapse
Affiliation(s)
- Eun-Gyeong Kim
- Division of Computer Science and Engineering, Jeonbuk National University, Jeonju 54907, Korea; (E.-G.K.); (I.-S.O.); (J.-E.S.); (J.K.)
| | - Il-Seok Oh
- Division of Computer Science and Engineering, Jeonbuk National University, Jeonju 54907, Korea; (E.-G.K.); (I.-S.O.); (J.-E.S.); (J.K.)
| | - Jeong-Eun So
- Division of Computer Science and Engineering, Jeonbuk National University, Jeonju 54907, Korea; (E.-G.K.); (I.-S.O.); (J.-E.S.); (J.K.)
| | - Junhyeok Kang
- Division of Computer Science and Engineering, Jeonbuk National University, Jeonju 54907, Korea; (E.-G.K.); (I.-S.O.); (J.-E.S.); (J.K.)
| | - Van Nhat Thang Le
- Department of Pediatric Dentistry, Research Institute of Clinical Medicine, Jeonbuk National University, Jeonju 54907, Korea; (V.N.T.L.); (M.-K.T.)
- Biomedical Research Institute, Jeonbuk National University Hospital, Jeonju 54907, Korea
- Faculty of Odonto-Stomatology, Hue University of Medicine and Pharmacy, Hue University, Hue 49120, Vietnam
| | - Min-Kyung Tak
- Department of Pediatric Dentistry, Research Institute of Clinical Medicine, Jeonbuk National University, Jeonju 54907, Korea; (V.N.T.L.); (M.-K.T.)
- Biomedical Research Institute, Jeonbuk National University Hospital, Jeonju 54907, Korea
| | - Dae-Woo Lee
- Department of Pediatric Dentistry, Research Institute of Clinical Medicine, Jeonbuk National University, Jeonju 54907, Korea; (V.N.T.L.); (M.-K.T.)
- Biomedical Research Institute, Jeonbuk National University Hospital, Jeonju 54907, Korea
- Correspondence:
| |
Collapse
|
37
|
Kim DW, Kim J, Kim T, Kim T, Kim YJ, Song IS, Ahn B, Choo J, Lee DY. Prediction of hand-wrist maturation stages based on cervical vertebrae images using artificial intelligence. Orthod Craniofac Res 2021; 24 Suppl 2:68-75. [PMID: 34405944 DOI: 10.1111/ocr.12514] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2021] [Revised: 06/01/2021] [Accepted: 06/21/2021] [Indexed: 12/13/2022]
Abstract
OBJECTIVE To predict the hand-wrist maturation stages based on the cervical vertebrae (CV) images, and to analyse the accuracy of the proposed algorithms. SETTINGS AND POPULATION A total of 499 pairs of hand-wrist radiographs and lateral cephalograms of 455 orthodontic patients aged 6-18 years were used for developing the prediction model for hand-wrist skeletal maturation stages. MATERIALS AND METHODS The hand-wrist radiographs and the lateral cephalograms were collected from two university hospitals and a paediatric dental clinic. After identifying the 13 anatomic landmarks of the CV, the width-height ratio, width-perpendicular height ratio and concavity ratio of the CV were used as the morphometric features of the CV. Patients' chronological age and sex were also included as input data. The ground truth data were the Fishman SMI based on the hand-wrist radiographs. Three specialists determined the ground truth SMI. An ensemble machine learning methods were used to predict the Fishman SMI. Five-fold cross-validation was performed. The mean absolute error (MAE), round MAE and root mean square error (RMSE) values were used to assess the performance of the final ensemble model. RESULTS The final ensemble model consisted of eight machine learning models. The MAE, round MAE and RMSE were 0.90, 0.87 and 1.20, respectively. CONCLUSION Prediction of hand-wrist SMI based on CV images is possible using machine learning methods. Chronological age and sex increased the prediction accuracy. An automated diagnosis of the skeletal maturation may aid as a decision-supporting tool for evaluating the optimal treatment timing for growing patients.
Collapse
Affiliation(s)
- Dong-Wook Kim
- Department of Orthodontics, Korea University Anam Hospital, Seoul, Korea
| | - Jinhee Kim
- Graduate School of Artificial Intelligence, Korea Advanced Institute of Science and Technology, Daejeon, Korea
| | - Taesung Kim
- Graduate School of Artificial Intelligence, Korea Advanced Institute of Science and Technology, Daejeon, Korea
| | - Taewoo Kim
- Graduate School of Artificial Intelligence, Korea Advanced Institute of Science and Technology, Daejeon, Korea
| | - Yoon-Ji Kim
- Department of Orthodontics, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea
| | - In-Seok Song
- Department of Oral and Maxillofacial Surgery, Korea University Anam Hospital, Seoul, Korea
| | | | - Jaegul Choo
- Graduate School of Artificial Intelligence, Korea Advanced Institute of Science and Technology, Daejeon, Korea
| | - Dong-Yul Lee
- Department of Orthodontics, Korea University Guro Hospital, Seoul, Korea
| |
Collapse
|
38
|
Seo H, Hwang J, Jeong T, Shin J. Comparison of Deep Learning Models for Cervical Vertebral Maturation Stage Classification on Lateral Cephalometric Radiographs. J Clin Med 2021; 10:jcm10163591. [PMID: 34441887 PMCID: PMC8397111 DOI: 10.3390/jcm10163591] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2021] [Revised: 08/08/2021] [Accepted: 08/13/2021] [Indexed: 11/16/2022] Open
Abstract
The purpose of this study is to evaluate and compare the performance of six state-of-the-art convolutional neural network (CNN)-based deep learning models for cervical vertebral maturation (CVM) on lateral cephalometric radiographs, and implement visualization of CVM classification for each model using gradient-weighted class activation map (Grad-CAM) technology. A total of 600 lateral cephalometric radiographs obtained from patients aged 6–19 years between 2013 and 2020 in Pusan National University Dental Hospital were used in this study. ResNet-18, MobileNet-v2, ResNet-50, ResNet-101, Inception-v3, and Inception-ResNet-v2 were tested to determine the optimal pre-trained network architecture. Multi-class classification metrics, accuracy, recall, precision, F1-score, and area under the curve (AUC) values from the receiver operating characteristic (ROC) curve were used to evaluate the performance of the models. All deep learning models demonstrated more than 90% accuracy, with Inception-ResNet-v2 performing the best, relatively. In addition, visualizing each deep learning model using Grad-CAM led to a primary focus on the cervical vertebrae and surrounding structures. The use of these deep learning models in clinical practice will facilitate dental practitioners in making accurate diagnoses and treatment plans.
Collapse
Affiliation(s)
- Hyejun Seo
- Department of Pediatric Dentistry, School of Dentistry, Pusan National University, Yangsan 50612, Korea; (H.S.); (T.J.)
| | - JaeJoon Hwang
- Department of Oral and Maxillofacial Radiology, School of Dentistry, Pusan National University, Yangsan 50612, Korea;
- Dental and Life Science Institute & Dental Research Institute, School of dentistry, Pusan National University, Yangsan 50612, Korea
| | - Taesung Jeong
- Department of Pediatric Dentistry, School of Dentistry, Pusan National University, Yangsan 50612, Korea; (H.S.); (T.J.)
- Dental and Life Science Institute & Dental Research Institute, School of dentistry, Pusan National University, Yangsan 50612, Korea
| | - Jonghyun Shin
- Department of Pediatric Dentistry, School of Dentistry, Pusan National University, Yangsan 50612, Korea; (H.S.); (T.J.)
- Dental and Life Science Institute & Dental Research Institute, School of dentistry, Pusan National University, Yangsan 50612, Korea
- Correspondence: ; Tel.: +82-55-360-5183
| |
Collapse
|
39
|
Mohammad-Rahimi H, Nadimi M, Rohban MH, Shamsoddin E, Lee VY, Motamedian SR. Machine learning and orthodontics, current trends and the future opportunities: A scoping review. Am J Orthod Dentofacial Orthop 2021; 160:170-192.e4. [PMID: 34103190 DOI: 10.1016/j.ajodo.2021.02.013] [Citation(s) in RCA: 40] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2020] [Revised: 01/01/2021] [Accepted: 02/01/2021] [Indexed: 12/29/2022]
Abstract
INTRODUCTION In recent years, artificial intelligence (AI) has been applied in various ways in medicine and dentistry. Advancements in AI technology show promising results in the practice of orthodontics. This scoping review aimed to investigate the effectiveness of AI-based models employed in orthodontic landmark detection, diagnosis, and treatment planning. METHODS A precise search of electronic databases was conducted, including PubMed, Google Scholar, Scopus, and Embase (English publications from January 2010 to July 2020). Quality Assessment and Diagnostic Accuracy Tool 2 (QUADAS-2) was used to assess the quality of the articles included in this review. RESULTS After applying inclusion and exclusion criteria, 49 articles were included in the final review. AI technology has achieved state-of-the-art results in various orthodontic applications, including automated landmark detection on lateral cephalograms and photography images, cervical vertebra maturation degree determination, skeletal classification, orthodontic tooth extraction decisions, predicting the need for orthodontic treatment or orthognathic surgery, and facial attractiveness. Most of the AI models used in these applications are based on artificial neural networks. CONCLUSIONS AI can help orthodontists save time and provide accuracy comparable to the trained dentists in diagnostic assessments and prognostic predictions. These systems aim to boost performance and enhance the quality of care in orthodontics. However, based on current studies, the most promising application was cephalometry landmark detection, skeletal classification, and decision making on tooth extractions.
Collapse
Affiliation(s)
| | - Mohadeseh Nadimi
- Department of Medical Physics and Biomedical Engineering, Tehran University of Medical Sciences, Tehran, Iran
| | | | - Erfan Shamsoddin
- National Institute for Medical Research Development, Tehran, Iran
| | | | - Saeed Reza Motamedian
- Department of Orthodontics, School of Dentistry, & Dentofacial Deformities Research Center, Research Institute of Dental Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran.
| |
Collapse
|
40
|
Tanikawa C, Lee C, Lim J, Oka A, Yamashiro T. Clinical applicability of automated cephalometric landmark identification: Part I-Patient-related identification errors. Orthod Craniofac Res 2021; 24 Suppl 2:43-52. [PMID: 34021976 DOI: 10.1111/ocr.12501] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Revised: 04/29/2021] [Accepted: 05/10/2021] [Indexed: 12/20/2022]
Abstract
OBJECTIVES To determine whether AI systems that recognize cephalometric landmarks can apply to various patient groups and to examine the patient-related factors associated with identification errors. SETTING AND SAMPLE POPULATION The present retrospective cohort study analysed digital lateral cephalograms obtained from 1785 Japanese orthodontic patients. Patients were categorized into eight subgroups according to dental age, cleft lip and/or palate, orthodontic appliance use and overjet. MATERIALS AND METHODS An AI system that automatically recognizes anatomic landmarks on lateral cephalograms was used. Thirty cephalograms in each subgroup were randomly selected and used to test the system's performance. The remaining cephalograms were used for system learning. The success rates in landmark recognition were evaluated using confidence ellipses with α = 0.99 for each landmark. The selection of test samples, learning of the system and evaluation of the system were repeated five times for each subgroup. The mean success rate and identification error were calculated. Factors associated with identification errors were examined using a multiple linear regression model. RESULTS The success rate and error varied among subgroups, ranging from 85% to 91% and 1.32 mm to 1.50 mm, respectively. Cleft lip and/or palate was found to be a factor associated with greater identification errors, whereas dental age, orthodontic appliances and overjet were not significant factors (all, P < .05). CONCLUSION Artificial intelligence systems that recognize cephalometric landmarks could be applied to various patient groups. Patient-oriented errors were found in patients with cleft lip and/or palate.
Collapse
Affiliation(s)
- Chihiro Tanikawa
- Graduate School of Dentistry, Osaka University, Suita, Japan.,Center for Advanced Medical Engineering and Informatics, Osaka University, Suita, Japan.,Institute for Datability Science, Osaka University, Suita, Japan
| | - Chonho Lee
- Cybermedia Center, Osaka University, Suita, Japan
| | - Jaeyoen Lim
- Graduate School of Dentistry, Osaka University, Suita, Japan
| | - Ayaka Oka
- Graduate School of Dentistry, Osaka University, Suita, Japan
| | | |
Collapse
|
41
|
Kök H, İzgi MS, Acılar AM. Evaluation of the Artificial Neural Network and Naive Bayes Models Trained with Vertebra Ratios for Growth and Development Determination. Turk J Orthod 2021; 34:2-9. [PMID: 33828872 DOI: 10.5152/turkjorthod.2020.20059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2020] [Accepted: 10/22/2020] [Indexed: 11/22/2022]
Abstract
Objective This study aimed to evaluate the success rates of the artificial neural network models (NNMs) and naive Bayes models (NBMs) trained with various cervical vertebra ratios in cephalometric radiographs for determining growth and development. Methods Our retrospective study was performed on 360 individuals between the ages of 8 and 17 years, whose cephalometric radiographs were taken. According to the evaluation of cephalometric radiographs, growth and development periods were divided into 6 vertebral stages. Each stage was considered as a group, each group had 30 girls and 30 boys. Twenty-eight cervical vertebral ratios were obtained by using 10 horizontal and 13 vertical measurements. These 28 vertebral ratios were combined in 4 different combinations, leading to 4 different datasets. Each dataset was split into 2 parts as training and testing. To prevent the overfitting, a 5-cross fold validation technique was also used in the training phase. The experiments were conducted on 2 different train/test ratios as 80%-20% and 70%-30% for both NNMs and NBMs. Results The highest determination success rate was obtained in NNM 3 (0.95) and the lowest in NBM 4 (0.50). The determination success of NBM 1 and NBM 3 was almost similar (0.60). The success of NNM 2 did not differ much from that of NNM 1 (0.94). The determination success of stage 5 was relatively lower than the others in NNM 1 and NNM 2 (0.83). Conclusion The NNMs were more successful than the NBMs in our developed models. It is important to determine the effective ratio and/or measurements that will be useful for differentiation.
Collapse
Affiliation(s)
- Hatice Kök
- Department of Orthodontics, Selçuk University, Faculty of Dentistry, Konya, Turkey
| | | | - Ayşe Merve Acılar
- Department of Computer Engineering, Necmettin Erbakan University, Konya Engineering and Architecture Faculty, Turkey
| |
Collapse
|
42
|
Sin Ç, Akkaya N, Aksoy S, Orhan K, Öz U. A deep learning algorithm proposal to automatic pharyngeal airway detection and segmentation on CBCT images. Orthod Craniofac Res 2021; 24 Suppl 2:117-123. [DOI: 10.1111/ocr.12480] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2020] [Revised: 01/23/2021] [Accepted: 02/17/2021] [Indexed: 12/22/2022]
Affiliation(s)
- Çağla Sin
- Faculty of Dentistry Department of Orthodontics Near East University Mersin10 Turkey
| | - Nurullah Akkaya
- Department of Computer Engineering Applied Artificial Intelligence Research Centre Near East University Mersin10 Turkey
| | - Seçil Aksoy
- Faculty of Dentistry Department of Dentomaxillofacial Radiology Near East University Mersin10 Turkey
| | - Kaan Orhan
- Faculty of Dentistry Department of Dentomaxillofacial Radiology Ankara University Ankara Turkey
- Medical Design Application and Research Center (MEDITAM) Ankara University Ankara Turkey
| | - Ulaş Öz
- Faculty of Dentistry Department of Orthodontics Near East University Mersin10 Turkey
| |
Collapse
|
43
|
Amasya H, Cesur E, Yıldırım D, Orhan K. Validation of cervical vertebral maturation stages: Artificial intelligence vs human observer visual analysis. Am J Orthod Dentofacial Orthop 2020; 158:e173-e179. [PMID: 33250108 DOI: 10.1016/j.ajodo.2020.08.014] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2020] [Revised: 08/01/2020] [Accepted: 08/01/2020] [Indexed: 12/22/2022]
Abstract
INTRODUCTION This study aimed to develop an artificial neural network (ANN) model for cervical vertebral maturation (CVM) analysis and validate the model's output with the results of human observers. METHODS A total of 647 lateral cephalograms were selected from patients with 10-30 years of chronological age (mean ± standard deviation, 15.36 ± 4.13 years). New software with a decision support system was developed for manual labeling of the dataset. A total of 26 points were marked on each radiograph. The CVM stages were saved on the basis of the final decision of the observer. Fifty-four image features were saved in text format. A new subset of 72 radiographs was created according to the classification result, and these 72 radiographs were visually evaluated by 4 observers. Weighted kappa (wκ) and Cohen's kappa (cκ) coefficients and percentage agreement were calculated to evaluate the compatibility of the results. RESULTS Intraobserver agreement ranges were as follows: wκ = 0.92-0.98, cκ = 0.65-0.85, and 70.8%-87.5%. Interobserver agreement ranges were as follows: wκ = 0.76-0.92, cκ = 0.4-0.65, and 50%-72.2%. Agreement between the ANN model and observers 1, 2, 3, and 4 were as follows: wκ = 0.85 (cκ = 0.52, 59.7%), wκ = 0.8 (cκ = 0.4, 50%), wκ = 0.87 (cκ = 0.55, 62.5%), and wκ = 0.91 (cκ = 0.53, 61.1%), respectively (P <0.001). An average of 58.3% agreement was observed between the ANN model and the human observers. CONCLUSIONS This study demonstrated that the developed ANN model performed close to, if not better than, human observers in CVM analysis. By generating new algorithms, automatic classification of CVM with artificial intelligence may replace conventional evaluation methods used in the future.
Collapse
Affiliation(s)
- Hakan Amasya
- Department of Dentomaxillofacial Radiology, Faculty of Dentistry, Istanbul University-Cerrahpasa, İstanbul, Turkey; Corlu Oral and Dental Health Center, Ministry of Health, Tekirdağ, Turkey; Department of Dentomaxillofacial Radiology, Faculty of Dentistry, Suleyman Demirel University, Isparta, Turkey.
| | - Emre Cesur
- Department of Orthodontics, Faculty of Dentistry, Istanbul Medipol University, İstanbul, Turkey
| | - Derya Yıldırım
- Department of Dentomaxillofacial Radiology, Faculty of Dentistry, Istanbul University-Cerrahpasa, İstanbul, Turkey
| | - Kaan Orhan
- Department of Dentomaxillofacial Radiology, Faculty of Dentistry, Ankara University, Ankara, Turkey; Ankara University Medical Design Application and Research Center (MEDITAM), Ankara, Turkey
| |
Collapse
|
44
|
Kök H, Izgi MS, Acilar AM. Determination of growth and development periods in orthodontics with artificial neural network. Orthod Craniofac Res 2020; 24 Suppl 2:76-83. [PMID: 33232582 DOI: 10.1111/ocr.12443] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2020] [Revised: 10/30/2020] [Accepted: 11/16/2020] [Indexed: 12/13/2022]
Abstract
BACKGROUND We aimed to determine the growth-development periods and gender from the cervical vertebrae using the artificial neural network (ANN). SETTING AND SAMPLE POPULATION The cephalometric and hand-wrist radiographs obtained from 419 patients aged between 8 and 17 years were included in our study. MATERIALS AND METHODS Our retrospective study consisted of 419 patients' cephalometric and hand-wrist radiographs. The cephalometric radiographs were divided into six cervical vertebrae stages (CVS). Correlations were evaluated between hand-wrist maturation level, CVS, and ages. Twenty-seven vertebral reference points are marked on the cephalometric radiograph, and 32 linear measurements were taken. With the combination of these measurements, 24 different data sets were formed to train ANN. Thus, 24 different ANN models for the determination of the growth-development periods were obtained. According to the results, seven ANN models that have a high success level and clinically applicable were selected. Also, an ANN model was done by all measurements and age for the determination of gender from cervical vertebrae. RESULTS Significantly positive correlations between hand-wrist maturation level, CVS and ages were detected. The ANN-7 model (32 linear measurements and age) accuracy value was found 0.9427. The highest model accuracy, 0.8687, with the least linear measurements, was obtained by drawing 13 linear measurements, using vertical measurements and indents. Gender was determined using ANN (0.8950) on cervical vertebrae data. CONCLUSION The growth-development periods and gender were determined from the cervical vertebrae by using ANN. The success of the ANN algorithm has been satisfactory. Further studies are needed for a fully automatic decision support system.
Collapse
Affiliation(s)
- Hatice Kök
- Faculty of Dentistry, Department of Orthodontics, Selçuk University [SU], Konya, Turkey
| | | | - Ayşe Merve Acilar
- Engineering and Architecture Faculty, Department of Computer Engineering, Necmettin Erbakan University [NEÜ], Konya, Turkey
| |
Collapse
|
45
|
Abstract
Artificial intelligence (AI) is a technology that utilizes machines to mimic intelligent human behavior. To appreciate human-technology interaction in the clinical setting, augmented intelligence has been proposed as a cognitive extension of AI in health care, emphasizing its assistive and supplementary role to medical professionals. While truly autonomous medical robotic systems are still beyond reach, the virtual component of AI, known as software-type algorithms, is the main component used in dentistry. Because of their powerful capabilities in data analysis, these virtual algorithms are expected to improve the accuracy and efficacy of dental diagnosis, provide visualized anatomic guidance for treatment, simulate and evaluate prospective results, and project the occurrence and prognosis of oral diseases. Potential obstacles in contemporary algorithms that prevent routine implementation of AI include the lack of data curation, sharing, and readability; the inability to illustrate the inner decision-making process; the insufficient power of classical computing; and the neglect of ethical principles in the design of AI frameworks. It is necessary to maintain a proactive attitude toward AI to ensure its affirmative development and promote human-technology rapport to revolutionize dental practice. The present review outlines the progress and potential dental applications of AI in medical-aided diagnosis, treatment, and disease prediction and discusses their data limitations, interpretability, computing power, and ethical considerations, as well as their impact on dentists, with the objective of creating a backdrop for future research in this rapidly expanding arena.
Collapse
Affiliation(s)
- T Shan
- Department of Operative Dentistry and Endodontics, Guanghua School of Stomatology, Hospital of Stomatology, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Stomatology, Guangzhou, China
| | - F R Tay
- The Dental College of Georgia, Augusta University, Augusta, GA, USA
| | - L Gu
- Department of Operative Dentistry and Endodontics, Guanghua School of Stomatology, Hospital of Stomatology, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Stomatology, Guangzhou, China
| |
Collapse
|