A deep learning approach to automatic gingivitis screening based on classification and localization in RGB photos

Mapping the Use of Artificial Intelligence-Based Image Analysis for Clinical Decision-Making in Dentistry: A Scoping Review

OBJECTIVES

Artificial intelligence (AI) is an emerging field in dentistry. AI is gradually being integrated into dentistry to improve clinical dental practice. The aims of this scoping review were to investigate the application of AI in image analysis for decision-making in clinical dentistry and identify trends and research gaps in the current literature.

MATERIAL AND METHODS

This review followed the guidelines provided by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (PRISMA-ScR). An electronic literature search was performed through PubMed and Scopus. After removing duplicates, a preliminary screening based on titles and abstracts was performed. A full-text review and analysis were performed according to predefined inclusion criteria, and data were extracted from eligible articles.

RESULTS

Of the 1334 articles returned, 276 met the inclusion criteria (consisting of 601,122 images in total) and were included in the qualitative synthesis. Most of the included studies utilized convolutional neural networks (CNNs) on dental radiographs such as orthopantomograms (OPGs) and intraoral radiographs (bitewings and periapicals). AI was applied across all fields of dentistry - particularly oral medicine, oral surgery, and orthodontics - for direct clinical inference and segmentation. AI-based image analysis was use in several components of the clinical decision-making process, including diagnosis, detection or classification, prediction, and management.

CONCLUSIONS

A variety of machine learning and deep learning techniques are being used for dental image analysis to assist clinicians in making accurate diagnoses and choosing appropriate interventions in a timely manner.

Embracing technological revolution: A panorama of machine learning in dentistry

BACKGROUND

The overarching aim of this study is to furnish dental experts and researchers with a comprehensive understanding of the role of machine learning in dentistry. This entails a nuanced understanding of prevailing technologies, discerning emerging trends, and providing strategic guidance for future research endeavors and practical implementations.

MATERIAL AND METHODS

We assessed the literature by looking for papers related to the issue after 2019 in the Pubmed, Web of Science, and Google Scholar databases. A narrative review of 29 papers satisfying the search criteria was undertaken, with an emphasis on the application of machine learning in dentistry.

RESULTS

A review was conducted, including 29 publications. The advent of emerging technologies holds promise for enhancing the accuracy and efficiency of dental diagnosis, treatment, and prognosis. Nevertheless, the intricate nature of oral disease diagnosis and outcome prediction mandates acknowledgment of variables such as individual idiosyncrasies, lifestyle, genetics, image quality, and tooth morphology. These factors may impact the precision of machine learning models. Dental professionals should not rely solely on AI-based results but rather use them as references. Integrating these findings with clinical examinations, assessing the patient's overall health, and oral condition is crucial for informed decision-making.

CONCLUSIONS

This review explores the clinical applications of machine learning in dentistry, encompassing disciplines like cariology, endodontics, periodontology, oral medicine, oral and maxillofacial surgery, prosthodontics and orthodontics. It serves as a valuable resource for dental practitioners and scholars in understanding the computer algorithms employed in each study, facilitating the clinical translation of machine learning research outcomes.

Toward Digital Periodontal Health: Recent Advances and Future Perspectives

Periodontal diseases, ranging from gingivitis to periodontitis, are prevalent oral diseases affecting over 50% of the global population. These diseases arise from infections and inflammation of the gums and supporting bones, significantly impacting oral health. The established link between periodontal diseases and systemic diseases, such as cardiovascular diseases, underscores their importance as a public health concern. Consequently, the early detection and prevention of periodontal diseases have become critical objectives in healthcare, particularly through the integration of advanced artificial intelligence (AI) technologies. This paper aims to bridge the gap between clinical practices and cutting-edge technologies by providing a comprehensive review of current research. We examine the identification of causative factors, disease progression, and the role of AI in enhancing early detection and treatment. Our goal is to underscore the importance of early intervention in improving patient outcomes and to stimulate further interest among researchers, bioengineers, and AI specialists in the ongoing exploration of AI applications in periodontal disease diagnosis.

Evaluation of transfer ensemble learning-based convolutional neural network models for the identification of chronic gingivitis from oral photographs

BACKGROUND

To evaluate the performances of several advanced deep convolutional neural network models (AlexNet, VGG, GoogLeNet, ResNet) based on ensemble learning for recognizing chronic gingivitis from screening oral images.

METHODS

A total of 683 intraoral clinical images acquired from 134 volunteers were used to construct the database and evaluate the models. Four deep ConvNet models were developed using ensemble learning and outperformed a single model. The performances of the different models were evaluated by comparing the accuracy and sensitivity for recognizing the existence of gingivitis from intraoral images.

RESULTS

The ResNet model achieved an area under the curve (AUC) value of 97%, while the AUC values for the GoogLeNet, AlexNet, and VGG models were 94%, 92%, and 89%, respectively. Although the ResNet and GoogLeNet models performed best in classifying gingivitis from images, the sensitivity outcomes were not significantly different among the ResNet, GoogLeNet, and Alexnet models (p>0.05). However, the sensitivity of the VGGNet model differed significantly from those of the other models (p < 0.001).

CONCLUSION

The ResNet and GoogLeNet models show promise for identifying chronic gingivitis from images. These models can help doctors diagnose periodontal diseases efficiently or based on self-examination of the oral cavity by patients.

Simultaneous detection of dental caries and fissure sealant in intraoral photos by deep learning: a pilot study

BACKGROUND

Deep learning, as an artificial intelligence method has been proved to be powerful in analyzing images. The purpose of this study is to construct a deep learning-based model (ToothNet) for the simultaneous detection of dental caries and fissure sealants in intraoral photos.

METHODS

A total of 1020 intraoral photos were collected from 762 volunteers. Teeth, caries and sealants were annotated by two endodontists using the LabelMe tool. ToothNet was developed by modifying the YOLOX framework for simultaneous detection of caries and fissure sealants. The area under curve (AUC) in the receiver operating characteristic curve (ROC) and free-response ROC (FROC) curves were used to evaluate model performance in the following aspects: (i) classification accuracy of detecting dental caries and fissure sealants from a photograph (image-level); and (ii) localization accuracy of the locations of predicted dental caries and fissure sealants (tooth-level). The performance of ToothNet and dentist with 1year of experience (1-year dentist) were compared at tooth-level and image-level using Wilcoxon test and DeLong test.

RESULTS

At the image level, ToothNet achieved an AUC of 0.925 (95% CI, 0.880-0.958) for caries detection and 0.902 (95% CI, 0.853-0.940) for sealant detection. At the tooth level, with a confidence threshold of 0.5, the sensitivity, precision, and F1-score for caries detection were 0.807, 0.814, and 0.810, respectively. For fissure sealant detection, the values were 0.714, 0.750, and 0.731. Compared with ToothNet, the 1-year dentist had a lower F1 value (0.599, p < 0.0001) and AUC (0.749, p < 0.0001) in caries detection, and a lower F1 value (0.727, p = 0.023) and similar AUC (0.829, p = 0.154) in sealant detection.

CONCLUSIONS

The proposed deep learning model achieved multi-task simultaneous detection in intraoral photos and showed good performance in the detection of dental caries and fissure sealants. Compared with 1-year dentist, the model has advantages in caries detection and is equivalent in fissure sealants detection.

Detecting dental caries on oral photographs using artificial intelligence: A systematic review

OBJECTIVES

This systematic review aimed at evaluating the performance of artificial intelligence (AI) models in detecting dental caries on oral photographs.

METHODS

Methodological characteristics and performance metrics of clinical studies reporting on deep learning and other machine learning algorithms were assessed. The risk of bias was evaluated using the quality assessment of diagnostic accuracy studies 2 (QUADAS-2) tool. A systematic search was conducted in EMBASE, Medline, and Scopus.

RESULTS

Out of 3410 identified records, 19 studies were included with six and seven studies having low risk of biases and applicability concerns for all the domains, respectively. Metrics varied widely and were assessed on multiple levels. F1-scores for classification and detection tasks were 68.3%-94.3% and 42.8%-95.4%, respectively. Irrespective of the task, F1-scores were 68.3%-95.4% for professional cameras, 78.8%-87.6%, for intraoral cameras, and 42.8%-80% for smartphone cameras. Limited studies allowed assessing AI performance for lesions of different severity.

CONCLUSION

Automatic detection of dental caries using AI may provide objective verification of clinicians' diagnoses and facilitate patient-clinician communication and teledentistry. Future studies should consider more robust study designs, employ comparable and standardized metrics, and focus on the severity of caries lesions.

Classification of Periapical and Bitewing Radiographs as Periodontally Healthy or Diseased by Deep Learning Algorithms

Objectives The aim of this artificial intelligence (AI) study was to develop a deep learning algorithm capable of automatically classifying periapical and bitewing radiography images as either periodontally healthy or unhealthy and to assess the algorithm's diagnostic success. Materials and methods The sample of the study consisted of 1120 periapical radiographs (560 periodontally healthy, 560 periodontally unhealthy) and 1498 bitewing radiographs (749 periodontally healthy, 749 periodontally ill). From the main datasets of both radiography types, three sub-datasets were randomly created: a training set (80%), a validation set (10%), and a test set (10%). Using these sub-datasets, a deep learning algorithm was developed with the YOLOv8-cls model (Ultralytics, Los Angeles, California, United States) and trained over 300 epochs. The success of the developed algorithm was evaluated using the confusion matrix method. Results The AI algorithm achieved classification accuracies of 75% or higher for both radiograph types. For bitewing radiographs, the sensitivity, specificity, precision, accuracy, and F1 score values were 0.8243, 0.7162, 0.7439, 0.7703, and 0.7821, respectively. For periapical radiographs, the sensitivity, specificity, precision, accuracy, and F1 score were 0.7500, 0.7500, 0.7500, 0.7500, and 0.7500, respectively. Conclusion The AI models developed in this study demonstrated considerable success in classifying periodontal disease. Future applications may involve employing AI algorithms for assessing periodontal status across various types of radiography images and for automated disease detection.

Detection of periodontal bone loss patterns and furcation defects from panoramic radiographs using deep learning algorithm: a retrospective study

BACKGROUND

This retrospective study aimed to develop a deep learning algorithm for the interpretation of panoramic radiographs and to examine the performance of this algorithm in the detection of periodontal bone losses and bone loss patterns.

METHODS

A total of 1121 panoramic radiographs were used in this study. Bone losses in the maxilla and mandibula (total alveolar bone loss) (n = 2251), interdental bone losses (n = 25303), and furcation defects (n = 2815) were labeled using the segmentation method. In addition, interdental bone losses were divided into horizontal (n = 21839) and vertical (n = 3464) bone losses according to the defect patterns. A Convolutional Neural Network (CNN)-based artificial intelligence (AI) system was developed using U-Net architecture. The performance of the deep learning algorithm was statistically evaluated by the confusion matrix and ROC curve analysis.

RESULTS

The system showed the highest diagnostic performance in the detection of total alveolar bone losses (AUC = 0.951) and the lowest in the detection of vertical bone losses (AUC = 0.733). The sensitivity, precision, F1 score, accuracy, and AUC values were found as 1, 0.995, 0.997, 0.994, 0.951 for total alveolar bone loss; found as 0.947, 0.939, 0.943, 0.892, 0.910 for horizontal bone losses; found as 0.558, 0.846, 0.673, 0.506, 0.733 for vertical bone losses and found as 0.892, 0.933, 0.912, 0.837, 0.868 for furcation defects (respectively).

CONCLUSIONS

AI systems offer promising results in determining periodontal bone loss patterns and furcation defects from dental radiographs. This suggests that CNN algorithms can also be used to provide more detailed information such as automatic determination of periodontal disease severity and treatment planning in various dental radiographs.

Machine learning techniques for periodontitis and dental caries detection: A narrative review

OBJECTIVES

In recent years, periodontitis, and dental caries have become common in humans and need to be diagnosed in the early stage to prevent severe complications and tooth loss. These dental issues are diagnosed by visual inspection, measuring pocket probing depth, and radiographs findings from experienced dentists. Though a glut of machine learning (ML) algorithms has been proposed for the automated detection of periodontitis, and dental caries, determining which ML techniques are suitable for clinical practice remains under debate. This review aims to identify the research challenges by analyzing the limitations of current methods and how to address these to obtain robust systems suitable for clinical use or point-of-care testing.

METHODS

An extensive search of the literature published from 2015 to 2022 written in English, related to the subject of study was sought by searching the electronic databases: PubMed, Institute of Electrical and Electronics Engineers (IEEE) Xplore, and ScienceDirect.

RESULTS

The initial electronic search yielded 1743 titles, and 55 studies were eventually included based on the selection criteria adopted in this review. Studies selected were on ML applications for the automatic detection of periodontitis and dental caries and related dental issues: Apical lessons, Periodontal bone loss, and Vertical root fracture.

CONCLUSION

While most of the ML-based studies use radiograph images for the detection of periodontitis and dental caries, few pieces of the literature revealed that good diagnostic accuracy could be achieved by training the ML model even with mobile photos representing the images of dental issues. Nowadays smartphones are used in every sector for different applications. Training the ML model with as many images of dental issues captured by the smartphone can achieve good accuracy, reduce the cost of clinical diagnosis, and provide user interaction.

Deep Learning in Diagnosis of Dental Anomalies and Diseases: A Systematic Review

Deep learning and diagnostic applications in oral and dental health have received significant attention recently. In this review, studies applying deep learning to diagnose anomalies and diseases in dental image material were systematically compiled, and their datasets, methodologies, test processes, explainable artificial intelligence methods, and findings were analyzed. Tests and results in studies involving human-artificial intelligence comparisons are discussed in detail to draw attention to the clinical importance of deep learning. In addition, the review critically evaluates the literature to guide and further develop future studies in this field. An extensive literature search was conducted for the 2019-May 2023 range using the Medline (PubMed) and Google Scholar databases to identify eligible articles, and 101 studies were shortlisted, including applications for diagnosing dental anomalies (n = 22) and diseases (n = 79) using deep learning for classification, object detection, and segmentation tasks. According to the results, the most commonly used task type was classification (n = 51), the most commonly used dental image material was panoramic radiographs (n = 55), and the most frequently used performance metric was sensitivity/recall/true positive rate (n = 87) and accuracy (n = 69). Dataset sizes ranged from 60 to 12,179 images. Although deep learning algorithms are used as individual or at least individualized architectures, standardized architectures such as pre-trained CNNs, Faster R-CNN, YOLO, and U-Net have been used in most studies. Few studies have used the explainable AI method (n = 22) and applied tests comparing human and artificial intelligence (n = 21). Deep learning is promising for better diagnosis and treatment planning in dentistry based on the high-performance results reported by the studies. For all that, their safety should be demonstrated using a more reproducible and comparable methodology, including tests with information about their clinical applicability, by defining a standard set of tests and performance metrics.

Exploring the Intersection of Artificial Intelligence and Clinical Healthcare: A Multidisciplinary Review

Artificial intelligence (AI) plays a more and more important role in our everyday life due to the advantages that it brings when used, such as 24/7 availability, a very low percentage of errors, ability to provide real time insights, or performing a fast analysis. AI is increasingly being used in clinical medical and dental healthcare analyses, with valuable applications, which include disease diagnosis, risk assessment, treatment planning, and drug discovery. This paper presents a narrative literature review of AI use in healthcare from a multi-disciplinary perspective, specifically in the cardiology, allergology, endocrinology, and dental fields. The paper highlights data from recent research and development efforts in AI for healthcare, as well as challenges and limitations associated with AI implementation, such as data privacy and security considerations, along with ethical and legal concerns. The regulation of responsible design, development, and use of AI in healthcare is still in early stages due to the rapid evolution of the field. However, it is our duty to carefully consider the ethical implications of implementing AI and to respond appropriately. With the potential to reshape healthcare delivery and enhance patient outcomes, AI systems continue to reveal their capabilities.

Intra-Oral Photograph Analysis for Gingivitis Screening in Orthodontic Patients

This study aimed to confirm the presence of gingival inflammation through image analysis of the papillary gingiva using intra-oral photographs (IOPs) before and after orthodontic treatment and to confirm the possibility of using gingival image analysis for gingivitis screening. Five hundred and eighty-eight (n  =  588) gingival sites from the IOPs of 98 patients were included. Twenty-five participants who had completed their orthodontic treatments and were aged between 20 and 37 were included. Six points on the papillary gingiva were selected in the maxillary and mandibular anterior incisors. The red/green (R/G) ratio values were obtained for the selected gingival images and the modified gingival index (GI) was compared. The change in the R/G values during the orthodontic treatment period appeared in the order of before orthodontic treatment (BO), mid-point of orthodontic treatment (MO), three-quarters of the way through orthodontic treatment (TO), and immediately after debonding (IDO), confirming that it was similar to the change in the GI. The R/G value of the gingiva in the image correlated with the GI. Therefore, it could be used as a major index for gingivitis diagnosis using images.

Dental Lesion Segmentation Using an Improved ICNet Network with Attention

Precise segmentation of tooth lesions is critical to creation of an intelligent tooth lesion detection system. As a solution to the problem that tooth lesions are similar to normal tooth tissues and difficult to segment, an improved segmentation method of the image cascade network (ICNet) network is proposed to segment various lesion types, such as calculus, gingivitis, and tartar. First, the ICNet network model is used to achieve real-time segmentation of lesions. Second, the Convolutional Block Attention Module (CBAM) is integrated into the ICNet network structure, and large-size convolutions in the spatial attention module are replaced with layered dilated convolutions to enhance the relevant features while suppressing useless features and solve the problem of inaccurate lesion segmentations. Finally, part of the convolution in the network model is replaced with an asymmetric convolution to reduce the calculations added by the attention module. Experimental results show that compared with Fully Convolutional Networks (FCN), U-Net, SegNet, and other segmentation algorithms, our method has a significant improvement in the segmentation effect, and the image processing frequency is higher, which satisfies the real-time requirements of tooth lesion segmentation accuracy.

Automated rock mass condition assessment during TBM tunnel excavation using deep learning

Rock mass condition assessment during tunnel excavation is a critical step for the intelligent control of tunnel boring machine (TBM). To address this and achieve automatic detection, a visual assessment system is installed to the TBM and a lager in-situ rock mass image dataset is collected from the water conveyance channel project. The rock mass condition assessment task is transformed into a fine-grain classification task. To fulfill the task, a self-convolution based attention fusion network (SAFN) is designed in this paper. The core of our method is the discovery and fusion of the object attention map within a deep neural network. The network consists of two novel modules, the self-convolution based attention extractor (SAE) module and the self-convolution based attention pooling algorithm (SAP) module. The former is designed to detect the intact rock regions generating the attention map, and the latter is designed to improve the performance of classifier by fusing the attention map that focuses on the intact rock regions. The results of SAFN are evaluated from aspects of interpretability, ablation, accuracy and cross-validation, and it outperforms state-of-the-art models in the rock mass assessment dataset. Furthermore, the dynamic filed test show that our assessment system based on the SAFN model is accurate and efficient for automated classification of rock mass.