Automatic Registration Between Dental Cone-Beam CT and Scanned Surface via Deep Pose Regression Neural Networks and Clustered Similarities

Accuracy of manual and artificial intelligence-based superimposition of cone-beam computed tomography with digital scan data, utilizing an implant planning software: A randomized clinical study

OBJECTIVES

To investigate the accuracy of conventional and automatic artificial intelligence (AI)-based registration of cone-beam computed tomography (CBCT) with intraoral scans and to evaluate the impact of user's experience, restoration artifact, number of missing teeth, and free-ended edentulous area.

MATERIALS AND METHODS

Three initial registrations were performed for each of the 150 randomly selected patients, in an implant planning software: one from an experienced user, one from an inexperienced operator, and one from a randomly selected post-graduate student of implant dentistry. Six more registrations were performed for each dataset by the experienced clinician: implementing a manual or an automatic refinement, selecting 3 small or 3 large in-diameter surface areas and using multiple small or multiple large in-diameter surface areas. Finally, an automatic AI-driven registration was performed, using the AI tools that were integrated into the utilized implant planning software. The accuracy between each type of registration was measured using linear measurements between anatomical landmarks in metrology software.

RESULTS

Fully automatic-based AI registration was not significantly different from the conventional methods tested for patients without restorations. In the presence of multiple restoration artifacts, user's experience was important for an accurate registration. Registrations' accuracy was affected by the number of free-ended edentulous areas, but not by the absolute number of missing teeth (p < .0083).

CONCLUSIONS

In the absence of imaging artifacts, automated AI-based registration of CBCT data and model scan data can be as accurate as conventional superimposition methods. The number and size of selected superimposition areas should be individually chosen depending on each clinical situation.

Fully automatic integration of dental CBCT images and full-arch intraoral impressions with stitching error correction via individual tooth segmentation and identification

We present a fully automated method of integrating intraoral scan (IOS) and dental cone-beam computerized tomography (CBCT) images into one image by complementing each image's weaknesses. Dental CBCT alone may not be able to delineate precise details of the tooth surface due to limited image resolution and various CBCT artifacts, including metal-induced artifacts. IOS is very accurate for the scanning of narrow areas, but it produces cumulative stitching errors during full-arch scanning. The proposed method is intended not only to compensate the low-quality of CBCT-derived tooth surfaces with IOS, but also to correct the cumulative stitching errors of IOS across the entire dental arch. Moreover, the integration provides both gingival structure of IOS and tooth roots of CBCT in one image. The proposed fully automated method consists of four parts; (i) individual tooth segmentation and identification module for IOS data (TSIM-IOS); (ii) individual tooth segmentation and identification module for CBCT data (TSIM-CBCT); (iii) global-to-local tooth registration between IOS and CBCT; and (iv) stitching error correction for full-arch IOS. The experimental results show that the proposed method achieved landmark and surface distance errors of 112.4μm and 301.7μm, respectively.

Artificial intelligence serving pre-surgical digital implant planning: A scoping review

OBJECTIVES

To conduct a scoping review focusing on artificial intelligence (AI) applications in presurgical dental implant planning. Additionally, to assess the automation degree of clinically available pre-surgical implant planning software.

DATA AND SOURCES

A systematic electronic literature search was performed in five databases (PubMed, Embase, Web of Science, Cochrane Library, and Scopus), along with exploring gray literature web-based resources until November 2023. English-language studies on AI-driven tools for digital implant planning were included based on an independent evaluation by two reviewers. An assessment of automation steps in dental implant planning software available on the market up to November 2023 was also performed.

STUDY SELECTION AND RESULTS

From an initial 1,732 studies, 47 met eligibility criteria. Within this subset, 39 studies focused on AI networks for anatomical landmark-based segmentation, creating virtual patients. Eight studies were dedicated to AI networks for virtual implant placement. Additionally, a total of 12 commonly available implant planning software applications were identified and assessed for their level of automation in pre-surgical digital implant workflows. Notably, only six of these featured at least one fully automated step in the planning software, with none possessing a fully automated implant planning protocol.

CONCLUSIONS

AI plays a crucial role in achieving accurate, time-efficient, and consistent segmentation of anatomical landmarks, serving the process of virtual patient creation. Additionally, currently available systems for virtual implant placement demonstrate different degrees of automation. It is important to highlight that, as of now, full automation of this process has not been documented nor scientifically validated.

CLINICAL SIGNIFICANCE

Scientific and clinical validation of AI applications for presurgical dental implant planning is currently scarce. The present review allows the clinician to identify AI-based automation in presurgical dental implant planning and assess the potential underlying scientific validation.

Grey Wolf Optimizer with Behavior Considerations and Dimensional Learning in Three-Dimensional Tooth Model Reconstruction

Three-dimensional registration with the affine transform is one of the most important steps in 3D reconstruction. In this paper, the modified grey wolf optimizer with behavior considerations and dimensional learning (BCDL-GWO) algorithm as a registration method is introduced. To refine the 3D registration result, we incorporate the iterative closet point (ICP). The BCDL-GWO with ICP method is implemented on the scanned commercial orthodontic tooth and regular tooth models. Since this is a registration from multi-views of optical images, the hierarchical structure is implemented. According to the results for both models, the proposed algorithm produces high-quality 3D visualization images with the smallest mean squared error of about 7.2186 and 7.3999 μm2, respectively. Our results are compared with the statistical randomization-based particle swarm optimization (SR-PSO). The results show that the BCDL-GWO with ICP is better than those from the SR-PSO. However, the computational complexities of both methods are similar.

State of the art and prospects for artificial intelligence in orthognathic surgery: A systematic review with meta-analysis

OBJECTIVE

To present a systematic review of the state of the art regarding clinical applications, main features, and outcomes of artificial intelligence (AI) in orthognathic surgery.

METHODS

The PICOS strategy was performed on a systematic review (SR) to answer the following question: "What are the state of the art, characteristics and outcomes of applications with artificial intelligence for orthognathic surgery?" After registering in PROSPERO (CRD42021270789) a systematic search was performed in the databases: PubMed (including MedLine), Scopus, Embase, LILACS, MEDLINE EBSCOHOST and Cochrane Library. 195 studies were selected, after screening titles and abstracts, of which thirteen manuscripts were included in the qualitative analysis and six in the quantitative analysis. The treatment effects were plotted in a Forest-plot. JBI questionnaire for observational studies was used to asses the risk of bias. The quality of the SR evidence was assessed using the GRADE tool.

RESULTS

AI studies on 2D cephalometry for orthognathic surgery, the Tau2 = 0.00, Chi2 = 3.78, p = 1.00 and I² of 0 %, indicating low heterogeneity, AI did not differ statistically from control (p = 0.79). AI studies in the diagnosis of the decision of whether or not to perform orthognathic surgery showed heterogeneity, and therefore meta-analysis was not peformed.

CONCLUSION

The outcome of AI is similar to the control group, with a low degree of bias, highlighting its potential for use in various applications.

AI in Orthodontics: Revolutionizing Diagnostics and Treatment Planning-A Comprehensive Review

The advent of artificial intelligence (AI) in medicine has transformed various medical specialties, including orthodontics. AI has shown promising results in enhancing the accuracy of diagnoses, treatment planning, and predicting treatment outcomes. Its usage in orthodontic practices worldwide has increased with the availability of various AI applications and tools. This review explores the principles of AI, its applications in orthodontics, and its implementation in clinical practice. A comprehensive literature review was conducted, focusing on AI applications in dental diagnostics, cephalometric evaluation, skeletal age determination, temporomandibular joint (TMJ) evaluation, decision making, and patient telemonitoring. Due to study heterogeneity, no meta-analysis was possible. AI has demonstrated high efficacy in all these areas, but variations in performance and the need for manual supervision suggest caution in clinical settings. The complexity and unpredictability of AI algorithms call for cautious implementation and regular manual validation. Continuous AI learning, proper governance, and addressing privacy and ethical concerns are crucial for successful integration into orthodontic practice.

Automatic registration of dental CT and 3D scanned model using deep split jaw and surface curvature

BACKGROUND AND OBJECTIVES

In the medical field, various image registration applications have been studied. In dentistry, the registration of computed tomography (CT) volume data and 3D optically scanned models is essential for various clinical applications, including orthognathic surgery, implant surgical planning, and augmented reality. Our purpose was to present a fully automatic registration method of dental CT data and 3D scanned models.

METHODS

We use a 2D convolutional neural network to regress a curve splitting the maxilla (i.e., upper jaw) and mandible (i.e., lower jaw) and the points specifying the front and back ends of the crown from the CT data. Using this regressed information, we extract the point cloud and vertices corresponding to the tooth crown from the CT and scanned data, respectively. We introduce a novel metric, called curvature variance of neighbor (CVN), to discriminate between highly fluctuating and smoothly varying regions of the tooth crown. The registration based on CVN enables more accurate fine registration while reducing the effects of metal artifacts. Moreover, the proposed method does not require any preprocessing such as extracting the iso-surface for the tooth crown from the CT data, thereby significantly reducing the computation time.

RESULTS

We evaluated the proposed method with the comparison to several promising registration techniques. Our experimental results using three datasets demonstrated that the proposed method exhibited higher registration accuracy (i.e., 2.85, 1.92, and 7.73 times smaller distance errors for individual datasets) and smaller computation time (i.e., 4.12 times faster registration) than one of the state-of-the-art methods. Moreover, the proposed method worked considerably well for partially scanned data, whereas other methods suffered from the unbalancing of information between the CT and scanned data.

CONCLUSIONS

The proposed method was able to perform fully automatic and highly accurate registration of dental CT data and 3D scanned models, even with severe metal artifacts. In addition, it could achieve fast registration because it did not require any preprocessing for iso-surface reconstruction from the CT data.

Synergy between artificial intelligence and precision medicine for computer-assisted oral and maxillofacial surgical planning

OBJECTIVES

The aim of this review was to investigate the application of artificial intelligence (AI) in maxillofacial computer-assisted surgical planning (CASP) workflows with the discussion of limitations and possible future directions.

MATERIALS AND METHODS

An in-depth search of the literature was undertaken to review articles concerned with the application of AI for segmentation, multimodal image registration, virtual surgical planning (VSP), and three-dimensional (3D) printing steps of the maxillofacial CASP workflows.

RESULTS

The existing AI models were trained to address individual steps of CASP, and no single intelligent workflow was found encompassing all steps of the planning process. Segmentation of dentomaxillofacial tissue from computed tomography (CT)/cone-beam CT imaging was the most commonly explored area which could be applicable in a clinical setting. Nevertheless, a lack of generalizability was the main issue, as the majority of models were trained with the data derived from a single device and imaging protocol which might not offer similar performance when considering other devices. In relation to registration, VSP and 3D printing, the presence of inadequate heterogeneous data limits the automatization of these tasks.

CONCLUSION

The synergy between AI and CASP workflows has the potential to improve the planning precision and efficacy. However, there is a need for future studies with big data before the emergent technology finds application in a real clinical setting.

CLINICAL RELEVANCE

The implementation of AI models in maxillofacial CASP workflows could minimize a surgeon's workload and increase efficiency and consistency of the planning process, meanwhile enhancing the patient-specific predictability.

Multi-task deep learning for medical image computing and analysis: A review

The renaissance of deep learning has provided promising solutions to various tasks. While conventional deep learning models are constructed for a single specific task, multi-task deep learning (MTDL) that is capable to simultaneously accomplish at least two tasks has attracted research attention. MTDL is a joint learning paradigm that harnesses the inherent correlation of multiple related tasks to achieve reciprocal benefits in improving performance, enhancing generalizability, and reducing the overall computational cost. This review focuses on the advanced applications of MTDL for medical image computing and analysis. We first summarize four popular MTDL network architectures (i.e., cascaded, parallel, interacted, and hybrid). Then, we review the representative MTDL-based networks for eight application areas, including the brain, eye, chest, cardiac, abdomen, musculoskeletal, pathology, and other human body regions. While MTDL-based medical image processing has been flourishing and demonstrating outstanding performance in many tasks, in the meanwhile, there are performance gaps in some tasks, and accordingly we perceive the open challenges and the perspective trends. For instance, in the 2018 Ischemic Stroke Lesion Segmentation challenge, the reported top dice score of 0.51 and top recall of 0.55 achieved by the cascaded MTDL model indicate further research efforts in high demand to escalate the performance of current models.

Personalized dental medicine, artificial intelligence, and their relevance for dentomaxillofacial imaging

Personalized medicine refers to the tailoring of diagnostics and therapeutics to individuals based on one's biological, social, and behavioral characteristics. While personalized dental medicine is still far from being a reality, advanced artificial intelligence (AI) technologies with improved data analytic approaches are expected to integrate diverse data from the individual, setting, and system levels, which may facilitate a deeper understanding of the interaction of these multilevel data and therefore bring us closer to more personalized, predictive, preventive, and participatory dentistry, also known as P4 dentistry. In the field of dentomaxillofacial imaging, a wide range of AI applications, including several commercially available software options, have been proposed to assist dentists in the diagnosis and treatment planning of various dentomaxillofacial diseases, with performance similar or even superior to that of specialists. Notably, the impact of these dental AI applications on treatment decision, clinical and patient-reported outcomes, and cost-effectiveness has so far been assessed sparsely. Such information should be further investigated in future studies to provide patients, providers, and healthcare organizers a clearer picture of the true usefulness of AI in daily dental practice.

Current Applications of Deep Learning and Radiomics on CT and CBCT for Maxillofacial Diseases

The increasing use of computed tomography (CT) and cone beam computed tomography (CBCT) in oral and maxillofacial imaging has driven the development of deep learning and radiomics applications to assist clinicians in early diagnosis, accurate prognosis prediction, and efficient treatment planning of maxillofacial diseases. This narrative review aimed to provide an up-to-date overview of the current applications of deep learning and radiomics on CT and CBCT for the diagnosis and management of maxillofacial diseases. Based on current evidence, a wide range of deep learning models on CT/CBCT images have been developed for automatic diagnosis, segmentation, and classification of jaw cysts and tumors, cervical lymph node metastasis, salivary gland diseases, temporomandibular (TMJ) disorders, maxillary sinus pathologies, mandibular fractures, and dentomaxillofacial deformities, while CT-/CBCT-derived radiomics applications mainly focused on occult lymph node metastasis in patients with oral cancer, malignant salivary gland tumors, and TMJ osteoarthritis. Most of these models showed high performance, and some of them even outperformed human experts. The models with performance on par with human experts have the potential to serve as clinically practicable tools to achieve the earliest possible diagnosis and treatment, leading to a more precise and personalized approach for the management of maxillofacial diseases. Challenges and issues, including the lack of the generalizability and explainability of deep learning models and the uncertainty in the reproducibility and stability of radiomic features, should be overcome to gain the trust of patients, providers, and healthcare organizers for daily clinical use of these models.

Applications of artificial intelligence and machine learning in orthognathic surgery: A scoping review

Over the recent years, Artificial Intelligence (AI) has been progressing rapidly with its ability to mimic human cognitive functions. The potential applications of AI technology in diagnosis, treatment planning, and prognosis prediction have been demonstrated in various studies. The present scoping review aimed to provide an overview of AI and Machine Learning (ML) algorithms and their applications in orthognathic surgery. A comprehensive search was conducted in databases including PubMed, Embase, Scopus, Web of Science and OVID Medline until November 2021. This scoping review was conducted following the PRISMA-ScR guidelines. After applying the inclusion and exclusion criteria, a total of 19 studies were included for final review. AI has profoundly impacted the diagnosis and prediction of orthognathic surgeries with a clinically acceptable accuracy range. Furthermore, AI reduces the work burden of the clinician by eliminating the tedious registration procedures, thereby helping in efficient and automated planning. However, focussing on the research gaps, there is a need to foster the AI models/algorithms to contemporize their efficiency in clinical decision making, diagnosis and surgical planning in future studies.

Evaluation of different registration methods and dental restorations on the registration duration and accuracy of cone beam computed tomography data and intraoral scans: a retrospective clinical study

OBJECTIVES

To evaluate whether the accuracy and duration of registration for cone beam computed tomography (CBCT) and intraoral scans differ according to the method of registration and ratio of dental restorations to natural teeth.

MATERIALS AND METHODS

CBCT data and intraoral scans of eligible patients were grouped as follows according to the ratio of the number of dental restorations to the number of natural teeth (N): group 1, N = 0%; group 2, 0% < N < 50%; group 3, 50% ≤ N < 100%; and group 4, 100% ≤ N. Marker-free registration was performed with a deep learning-based platform and four implant planning software with different registration methods (two point-based, one surface-based, and one manual registration software) by a single operator, and the time consumption was recorded. Registration accuracy was evaluated by measuring the distances between the three-dimensional models of CBCT data and intraoral scans.

RESULTS

A total of 36 patients, one jaw per patient, were enrolled. Although registration accuracy was similar, the time consumed for registration significantly differed for the different methods. The deep learning-based registration method consumed the least time. Greater proportions of dental restorations significantly reduced the registration accuracy for semi-automatic and deep learning-based methods and reduced the time consumed for semi-automatic registration.

CONCLUSIONS

No superiority in registration accuracy was found. The proportion of dental restorations significantly affects the accuracy and duration of registration for CBCT data and intraoral scans.

CLINICAL TRIAL REGISTRATION

ClinicalTrials.gov Identifier: KCT0006710 CLINICAL RELEVANCE: Registration accuracy for virtual implant planning decreases when the proportion of dental restorations increases regardless of registration methods.

A Dual Discriminator Adversarial Learning Approach for Dental Occlusal Surface Reconstruction

Objective. Restoring the correct masticatory function of partially edentulous patient is a challenging task primarily due to the complex tooth morphology between individuals. Although some deep learning-based approaches have been proposed for dental restorations, most of them do not consider the influence of dental biological characteristics for the occlusal surface reconstruction. Description. In this article, we propose a novel dual discriminator adversarial learning network to address these challenges. In particular, this network architecture integrates two models: a dilated convolutional-based generative model and a dual global-local discriminative model. While the generative model adopts dilated convolution layers to generate a feature representation that preserves clear tissue structure, the dual discriminative model makes use of two discriminators to jointly distinguish whether the input is real or fake. While the global discriminator focuses on the missing teeth and adjacent teeth to assess whether it is coherent as a whole, the local discriminator aims only at the defective teeth to ensure the local consistency of the generated dental crown. Results. Experiments on 1000 real-world patient dental samples demonstrate the effectiveness of our method. For quantitative comparison, the image quality metrics are used to measure the similarity of the generated occlusal surface, and the root mean square between the generated result and the target crown calculated by our method is 0.114 mm. In qualitative analysis, the proposed approach can generate more reasonable dental biological morphology. Conclusion. The results demonstrate that our method significantly outperforms the state-of-the-art methods in occlusal surface reconstruction. Importantly, the designed occlusal surface has enough anatomical morphology of natural teeth and superior clinical application value.

DCPR-GAN: Dental Crown Prosthesis Restoration Using Two-stage Generative Adversarial Networks

Restoring the correct masticatory function of broken teeth is the basis of dental crown prosthesis rehabilitation. However, it is a challenging task primarily due to the complex and personalized morphology of the occlusal surface. In this article, we address this problem by designing a new two-stage generative adversarial network (GAN) to reconstruct a dental crown surface in the data-driven perspective. Specifically, in the first stage, a conditional GAN (CGAN) is designed to learn the inherent relationship between the defective tooth and the target crown, which can solve the problem of the occlusal relationship restoration. In the second stage, an improved CGAN is further devised by considering an occlusal groove parsing network (GroNet) and an occlusal fingerprint constraint to enforce the generator to enrich the functional characteristics of the occlusal surface. Experimental results demonstrate that the proposed framework significantly outperforms the state-of-the-art deep learning methods in functional occlusal surface reconstruction using a real-world patient database. Moreover, the standard deviation (SD) and root mean square (RMS) between the generated occlusal surface and the target crown calculated by our method are both less than 0.161mm. Importantly, the designed dental crown has enough anatomical morphology and higher clinical applicability.

Integration of imaging modalities in digital dental workflows - possibilities, limitations, and potential future developments

The digital workflow process follows different steps for all dental specialties. However, the main ingredient for the diagnosis, treatment planning and follow-up workflow recipes is the imaging chain. The steps in the imaging chain usually include all or at least some of the following modalities: cone-beam computed tomographic data acquisition, segmentation of the cone-beam computed tomography image, intraoral scanning, facial three-dimensional soft tissue capture and superimposition of all the images for the creation of a virtual augmented model. As a relevant clinical problem, the accumulation of error at each step of the chain might negatively influence the final outcome. For an efficient digital workflow, it is important to be aware of the existing challenges within the imaging chain. Furthermore, artificial intelligence-based strategies need to be integrated in the future to make the workflow more simplified, accurate and efficient.

Efficient Computer-Aided Design of Dental Inlay Restoration: A Deep Adversarial Framework

Restoring the normal masticatory function of broken teeth is a challenging task primarily due to the defect location and size of a patient's teeth. In recent years, although some representative image-to-image transformation methods (e.g. Pix2Pix) can be potentially applicable to restore the missing crown surface, most of them fail to generate dental inlay surface with realistic crown details (e.g. occlusal groove) that are critical to the restoration of defective teeth with varying shapes. In this article, we design a computer-aided Deep Adversarial-driven dental Inlay reStoration (DAIS) framework to automatically reconstruct a realistic surface for a defective tooth. Specifically, DAIS consists of a Wasserstein generative adversarial network (WGAN) with a specially designed loss measurement, and a new local-global discriminator mechanism. The local discriminator focuses on missing regions to ensure the local consistency of a generated occlusal surface, while the global discriminator aims at defective teeth and adjacent teeth to assess if it is coherent as a whole. Experimental results demonstrate that DAIS is highly efficient to deal with a large area of missing teeth in arbitrary shapes and generate realistic occlusal surface completion. Moreover, the designed watertight inlay prostheses have enough anatomical morphology, thus providing higher clinical applicability compared with more state-of-the-art methods.