Deep learning for biomechanical modeling of facial tissue deformation in orthognathic surgical planning

Patient-specific reference model estimation for orthognathic surgical planning

PURPOSE

Accurate estimation of reference bony shape models is fundamental for orthognathic surgical planning. Existing methods to derive this model are of two types: one determines the reference model by estimating the deformation field to correct the patient's deformed jaw, often introducing distortions in the predicted reference model; The other derives the reference model using a linear combination of their landmarks/vertices but overlooks the intricate nonlinear relationship between the subjects, compromising the model's precision and quality.

METHODS

We have created a self-supervised learning framework to estimate the reference model. The core of this framework is a deep query network, which estimates the similarity scores between the patient's midface and those of the normal subjects in a high-dimensional space. Subsequently, it aggregates high-dimensional features of these subjects and projects these features back to 3D structures, ultimately achieving a patient-specific reference model.

RESULTS

Our approach was trained using a dataset of 51 normal subjects and tested on 30 patient subjects to estimate their reference models. Performance assessment against the actual post-operative bone revealed a mean Chamfer distance error of 2.25 mm and an average surface distance error of 2.30 mm across the patient subjects.

CONCLUSION

Our proposed method emphasizes the correlation between the patients and the normal subjects in a high-dimensional space, facilitating the generation of the patient-specific reference model. Both qualitative and quantitative results demonstrate its superiority over current state-of-the-art methods in reference model estimation.

Predicting the Future Focus of Orthognathic Surgery: Outcome-Driven Planning and Treatment With Function, Esthetics, and Occlusion as Key Indicators

As an international group of orthognathic surgeons, we believe the next big thing in orthognathic surgery will be a clinical and research focus on patient-oriented outcomes and improved quality of life. We expect to see advances in diagnosis and treatment planning, materials development, and patient management.

The Accuracy of Three-Dimensional Soft Tissue Simulation in Orthognathic Surgery-A Systematic Review

Three-dimensional soft tissue simulation has become a popular tool in the process of virtual orthognathic surgery planning and patient-surgeon communication. To apply 3D soft tissue simulation software in routine clinical practice, both qualitative and quantitative validation of its accuracy are required. The objective of this study was to systematically review the literature on the accuracy of 3D soft tissue simulation in orthognathic surgery. The Web of Science, PubMed, Cochrane, and Embase databases were consulted for the literature search. The systematic review (SR) was conducted according to the PRISMA statement, and 40 articles fulfilled the inclusion and exclusion criteria. The Quadas-2 tool was used for the risk of bias assessment for selected studies. A mean error varying from 0.27 mm to 2.9 mm for 3D soft tissue simulations for the whole face was reported. In the studies evaluating 3D soft tissue simulation accuracy after a Le Fort I osteotomy only, the upper lip and paranasal regions were reported to have the largest error, while after an isolated bilateral sagittal split osteotomy, the largest error was reported for the lower lip and chin regions. In the studies evaluating simulation after bimaxillary osteotomy with or without genioplasty, the highest inaccuracy was reported at the level of the lips, predominantly the lower lip, chin, and, sometimes, the paranasal regions. Due to the variability in the study designs and analysis methods, a direct comparison was not possible. Therefore, based on the results of this SR, guidelines to systematize the workflow for evaluating the accuracy of 3D soft tissue simulations in orthognathic surgery in future studies are proposed.

Accuracy of Artificial Intelligence in Predicting Facial Changes Post-Orthognathic Surgery: A Comprehensive Scoping Review

Background

Accurate prediction of facial soft tissue changes post-orthognathic surgery is crucial for treatment planning and patient communication. Current models pose limitations due to the complexity of facial biomechanics and individual variances. Artificial intelligence (AI) has emerged as an important tool in many disciplines, including the dental field.

Objectives

The aim of this scoping review is to assess the accuracy of AI in predicting facial changes post-orthognathic surgery in comparison to traditional models. Explore the strengths and limitations of the current AI models.

Material and Methods

Following PRISMA-DTA guidelines, a comprehensive search was conducted manually and through Medline, Embase, Web of Science, Scopus, and Google Scholar databases was conducted, focusing on studies that applied AI models with various machine learning and deep learning algorithms for post-surgical outcome prediction. Selection criteria were based on the PICO format, emphasizing studies that compared AI-predicted outcomes with actual post-surgical results. Literature was searched until January 31, 2024.

Results

The initial search result yielded 1579 records. After screening and assessment for eligibility, seven studies met the inclusion criteria, with publication dates ranging from 2009 to 2023. Several AI algorithms were evaluated on different orthognathic surgical procedures, revealing the high predictive accuracy of AI models across various facial regions.

Conclusions

AI demonstrates significant potential for enhancing the precision of facial outcome predictions following orthognathic surgery. However, despite the promising results, limitations such as small sample sizes and a lack of external validation were noted. Further research with larger, more diverse datasets and standardized validation methods is essential for optimizing AI's clinical utility. Key words:Artificial Intelligence (AI), Machine Learning (ML), Deep Learning (DL), Orthognathic Surgery, Facial Soft-tissue Prediction, Predictive Accuracy, Orthodontics.

Correspondence attention for facial appearance simulation

In orthognathic surgical planning for patients with jaw deformities, it is crucial to accurately simulate the changes in facial appearance that follow the bony movement. Compared with the traditional biomechanics-based methods like the finite-element method (FEM), which are both labor-intensive and computationally inefficient, deep learning-based methods offer an efficient and robust modeling alternative. However, current methods do not account for the physical relationship between facial soft tissue and bony structure, causing them to fall short in accuracy compared to FEM. In this work, we propose an Attentive Correspondence assisted Movement Transformation network (ACMT-Net) to predict facial changes by correlating facial soft tissue changes with bony movement through a point-to-point attentive correspondence matrix. To ensure efficient training, we also introduce a contrastive loss for self-supervised pre-training of the ACMT-Net with a k-Nearest Neighbors (k-NN) based clustering. Experimental results on patients with jaw deformities show that our proposed solution can achieve significantly improved computational efficiency over the state-of-the-art FEM-based method with comparable facial change prediction accuracy.

Current Trends in Orthognathic Surgery

Orthognathic surgery has evolved significantly over the past century. Osteotomies of the midface and mandible are contemporaneously used to perform independent or coordinated movements to address functional and aesthetic problems. Specific advances in the past twenty years include increasing fidelity with computer-assisted planning, the use of patient-specific fixation, expanding indications for management of upper airway obstruction, and shifts in orthodontic-surgical paradigms. This review article serves to highlight the contemporary practice of orthognathic surgery.

Soft tissue prediction in orthognathic surgery: Improving accuracy by means of anatomical details

Three-dimensional virtual simulation of orthognathic surgery is now a well-established method in maxillo-facial surgery. The commercial software packages are still burdened by a consistent imprecision on soft tissue predictions. In this study, the authors produced an anatomically detailed patient specific numerical model for simulation of soft tissue changes in orthognathic surgery. Eight patients were prospectively enrolled. Each patient underwent CBCT and planar x-rays prior to surgery and in addition received an MRI scan. Postoperative soft-tissue change was simulated using Finite Element Modeling (FEM) relying on a patient-specific 3D models generated combining data from preoperative CBCT (hard tissue) scans and MRI scans (muscles and skin). An initial simulation was performed assuming that all the muscles and the other soft tissue had the same material properties (Homogeneous Model). This model was compared with the postoperative CBCT 3D simulation for validation purpose. Design of experiments (DoE) was used to assess the effect of the presence of the muscles considered and of their variation in stiffness. The effect of single muscles was evaluated in specific areas of the midface. The quantitative distance error between the homogeneous model and actual patient surfaces for the midface area was 0.55 mm, standard deviation 2.9 mm. In our experience, including muscles in the numerical simulation of orthognathic surgery, brought an improvement in the quality of the simulation obtained.

Revealing the representative facial traits of different sagittal skeletal types: decipher what artificial intelligence can see by Grad-CAM

OBJECTIVES

Aesthetic improvement is a significant concern in dental therapy. While orthodontic treatment primarily targets hard tissue, the impact on soft tissue and the extent of these changes remains empirical. This study aims to unveil the intricate relationship between facial soft tissue and skeletal types using artificial intelligence (AI) analysis.

METHODS

First, we collected a dataset of 1044 3-side-photographs and categorized them based on cephalometric measurements. After pre-processing and data augmentation, samples were fed to two independent models (Sfa, Res model) for training and testing. After validating that the Sfa model could accurately recognize the skeletal types based merely on photographs, Grad-CAM algorithm was utilized for model decipherment. Verification of the vital traits were carried out by facial adjustment simulation.

RESULTS

The Sfa model demonstrated superior accuracy (0.9293) in identifying skeletal types based solely on soft tissue, compared to the Res model (0.8395) and even trained orthodontists (0.764), testifying our hypothesis that AI could be more capable of processing imperceptible cues compared to mankind. Intriguingly, Grad-CAM revealed that cheek volume, forehead, chin and nasolabial traits could be representative features of each type, exceeding the traditional knowledge which merely concerns mandible and chin.

CONCLUSION

By constructing a deep learning model as a classifier and then decipher it with Grad-CAM, we revealed the subtle and unnoticed cues associating skeletal and soft tissue, as well as provided a novel approach that could aid practitioners in devising tailored treatment plans for enhanced esthetic outcomes.

CLINICAL SIGNIFICANCE

The proposed AI methods offer valuable assistance to practitioners in identifying uncoordinated facial traits that may detract from a patient's attractiveness. By incorporating these insights into customized treatment plans, dental therapy can maximize esthetic benefits for individual patient.

Prediction of orthognathic surgery plan from 3D cephalometric analysis via deep learning

BACKGROUND

Preoperative planning of orthognathic surgery is indispensable for achieving ideal surgical outcome regarding the occlusion and jaws' position. However, orthognathic surgery planning is sophisticated and highly experience-dependent, which requires comprehensive consideration of facial morphology and occlusal function. This study aimed to investigate a robust and automatic method based on deep learning to predict reposition vectors of jawbones in orthognathic surgery plan.

METHODS

A regression neural network named VSP transformer was developed based on Transformer architecture. Firstly, 3D cephalometric analysis was employed to quantify skeletal-facial morphology as input features. Next, input features were weighted using pretrained results to minimize bias resulted from multicollinearity. Through encoder-decoder blocks, ten landmark-based reposition vectors of jawbones were predicted. Permutation importance (PI) method was used to calculate contributions of each feature to final prediction to reveal interpretability of the proposed model.

RESULTS

VSP transformer model was developed with 383 samples and clinically tested with 49 prospectively collected samples. Our proposed model outperformed other four classic regression models in prediction accuracy. Mean absolute errors (MAE) of prediction were 1.41 mm in validation set and 1.34 mm in clinical test set. The interpretability results of the model were highly consistent with clinical knowledge and experience.

CONCLUSIONS

The developed model can predict reposition vectors of orthognathic surgery plan with high accuracy and good clinically practical-effectiveness. Moreover, the model was proved reliable because of its good interpretability.

Discussion on the possibility of multi-layer intelligent technologies to achieve the best recover of musculoskeletal injuries: Smart materials, variable structures, and intelligent therapeutic planning

Although intelligent technologies has facilitated the development of precise orthopaedic, simple internal fixation, ligament reconstruction or arthroplasty can only relieve pain of patients in short-term. To achieve the best recover of musculoskeletal injuries, three bottlenecks must be broken through, which includes scientific path planning, bioactive implants and personalized surgical channels building. As scientific surgical path can be planned and built by through AI technology, 4D printing technology can make more bioactive implants be manufactured, and variable structures can establish personalized channels precisely, it is possible to achieve satisfied and effective musculoskeletal injury recovery with the progress of multi-layer intelligent technologies (MLIT).