A New Approach of Predicting Facial Changes following Orthognathic Surgery using Realistic Lip Sliding Effect

Postoperative facial prediction for mandibular defect based on surface mesh deformation

OBJECTIVES

This study aims to introduce a novel predictive model for the post-operative facial contours of patients with mandibular defect, addressing limitations in current methodologies that fail to preserve geometric features and lack interpretability.

METHODS

Utilizing surface mesh theory and deep learning, our model diverges from traditional point cloud approaches by employing surface triangular mesh grids. We extract latent variables using a Mesh Convolutional Restricted Boltzmann Machines (MCRBM) model to generate a three-dimensional deformation field, aiming to enhance geometric information preservation and interpretability.

RESULTS

Experimental evaluations of our model demonstrate a prediction accuracy of 91.2 %, which represents a significant improvement over traditional machine learning-based methods.

CONCLUSIONS

The proposed model offers a promising new tool for pre-operative planning in oral and maxillofacial surgery. It significantly enhances the accuracy of post-operative facial contour predictions for mandibular defect reconstructions, providing substantial advancements over previous approaches.

The Accuracy of Three-Dimensional Soft Tissue Simulation in Orthognathic Surgery-A Systematic Review

Three-dimensional soft tissue simulation has become a popular tool in the process of virtual orthognathic surgery planning and patient-surgeon communication. To apply 3D soft tissue simulation software in routine clinical practice, both qualitative and quantitative validation of its accuracy are required. The objective of this study was to systematically review the literature on the accuracy of 3D soft tissue simulation in orthognathic surgery. The Web of Science, PubMed, Cochrane, and Embase databases were consulted for the literature search. The systematic review (SR) was conducted according to the PRISMA statement, and 40 articles fulfilled the inclusion and exclusion criteria. The Quadas-2 tool was used for the risk of bias assessment for selected studies. A mean error varying from 0.27 mm to 2.9 mm for 3D soft tissue simulations for the whole face was reported. In the studies evaluating 3D soft tissue simulation accuracy after a Le Fort I osteotomy only, the upper lip and paranasal regions were reported to have the largest error, while after an isolated bilateral sagittal split osteotomy, the largest error was reported for the lower lip and chin regions. In the studies evaluating simulation after bimaxillary osteotomy with or without genioplasty, the highest inaccuracy was reported at the level of the lips, predominantly the lower lip, chin, and, sometimes, the paranasal regions. Due to the variability in the study designs and analysis methods, a direct comparison was not possible. Therefore, based on the results of this SR, guidelines to systematize the workflow for evaluating the accuracy of 3D soft tissue simulations in orthognathic surgery in future studies are proposed.

Accuracy of Artificial Intelligence in Predicting Facial Changes Post-Orthognathic Surgery: A Comprehensive Scoping Review

Background

Accurate prediction of facial soft tissue changes post-orthognathic surgery is crucial for treatment planning and patient communication. Current models pose limitations due to the complexity of facial biomechanics and individual variances. Artificial intelligence (AI) has emerged as an important tool in many disciplines, including the dental field.

Objectives

The aim of this scoping review is to assess the accuracy of AI in predicting facial changes post-orthognathic surgery in comparison to traditional models. Explore the strengths and limitations of the current AI models.

Material and Methods

Following PRISMA-DTA guidelines, a comprehensive search was conducted manually and through Medline, Embase, Web of Science, Scopus, and Google Scholar databases was conducted, focusing on studies that applied AI models with various machine learning and deep learning algorithms for post-surgical outcome prediction. Selection criteria were based on the PICO format, emphasizing studies that compared AI-predicted outcomes with actual post-surgical results. Literature was searched until January 31, 2024.

Results

The initial search result yielded 1579 records. After screening and assessment for eligibility, seven studies met the inclusion criteria, with publication dates ranging from 2009 to 2023. Several AI algorithms were evaluated on different orthognathic surgical procedures, revealing the high predictive accuracy of AI models across various facial regions.

Conclusions

AI demonstrates significant potential for enhancing the precision of facial outcome predictions following orthognathic surgery. However, despite the promising results, limitations such as small sample sizes and a lack of external validation were noted. Further research with larger, more diverse datasets and standardized validation methods is essential for optimizing AI's clinical utility. Key words:Artificial Intelligence (AI), Machine Learning (ML), Deep Learning (DL), Orthognathic Surgery, Facial Soft-tissue Prediction, Predictive Accuracy, Orthodontics.

Predicting Optimal Patient-Specific Postoperative Facial Landmarks for Patients with Craniomaxillofacial Deformities

Orthognathic surgery traditionally focuses on correcting skeletal abnormalities and malocclusion, with the expectation that an optimal facial appearance will naturally follow. However, this skeletal-driven approach can lead to undesirable facial aesthetics and residual asymmetry. To address these issues, a soft-tissue-driven planning method has been proposed. This innovative method bases bone movement estimates on the targeted ideal facial appearance, thus increasing the surgical plan's accuracy and effectiveness. This study explores the initial phase of implementing a soft-tissue-driven approach, simulating the patient's optimal facial look by repositioning deformed facial landmarks to an ideal state. The algorithm incorporates symmetrization and weighted optimization strategies, aligning projected optimal landmarks with standard cephalometric values for both facial symmetry and form, which are integral to facial aesthetics in orthognathic surgery. It also includes regularization to preserve the patient's original facial characteristics. Validated using retrospective analysis of data from both preoperative patients and normal subjects, this approach effectively achieves not only facial symmetry, particularly in the lower face, but also a more natural and normalized facial form. This novel approach, aligning with soft-tissue-driven planning principles, shows promise in surpassing traditional methods, potentially leading to enhanced facial outcomes and patient satisfaction in orthognathic surgery.

Simulation of Postoperative Facial Appearances via Geometric Deep Learning for Efficient Orthognathic Surgical Planning

Orthognathic surgery corrects jaw deformities to improve aesthetics and functions. Due to the complexity of the craniomaxillofacial (CMF) anatomy, orthognathic surgery requires precise surgical planning, which involves predicting postoperative changes in facial appearance. To this end, most conventional methods involve simulation with biomechanical modeling methods, which are labor intensive and computationally expensive. Here we introduce a learning-based framework to speed up the simulation of postoperative facial appearances. Specifically, we introduce a facial shape change prediction network (FSC-Net) to learn the nonlinear mapping from bony shape changes to facial shape changes. FSC-Net is a point transform network weakly-supervised by paired preoperative and postoperative data without point-wise correspondence. In FSC-Net, a distance-guided shape loss places more emphasis on the jaw region. A local point constraint loss restricts point displacements to preserve the topology and smoothness of the surface mesh after point transformation. Evaluation results indicate that FSC-Net achieves 15× speedup with accuracy comparable to a state-of-the-art (SOTA) finite-element modeling (FEM) method.

Evaluation of soft tissue prediction accuracy for orthognathic surgery with skeletal class III malocclusion using maxillofacial regional aesthetic units

OBJECTIVES

This study aimed to evaluate the soft tissue prediction accuracy of patients undergoing orthognathic surgery to correct skeletal class III malocclusion using maxillofacial regional aesthetic units.

MATERIALS AND METHODS

Pre- and postoperative cone-beam computed tomography (CBCT) and 3D facial scans were taken for 58 patients who had undergone orthognathic surgery. The preoperative 3D facial scan was integrated with the preoperative CBCT using ProPlan CMF software. The software simulated the surgery and generated postoperative soft tissue prediction. The simulated 3D facial scan was then compared with the actual 3D facial scan obtained at least 6 months after the surgery by the maxillofacial regional aesthetic units and the facial soft tissue landmark points.

RESULTS

The anatomical regions of the upper lip, lower lip, chin, right external buccal and left external buccal prediction were above 2.0 mm. As for the soft tissue landmarks, at chl, chr, ls, stm and li, the position of predicted scan was higher than that of the actual postoperative scan.

CONCLUSIONS

The accuracy of 3D soft tissue predictions using ProPlan CMF software in Skeletal III patients was clinically satisfactory according to maxillofacial regional aesthetic units combined with facial soft tissue landmark points. However, the accuracy of prediction still needed improvement in some areas.

CLINICAL RELEVANCE

The accuracy of soft tissue prediction can be analyzed more clearly through maxillofacial regional aesthetic units so that clinicians have a deeper understanding of the use of the software to predict soft tissue change after orthognathic surgery.

A Quantitative and Qualitative Clinical Validation of Soft Tissue Simulation for Orthognathic Surgery Planning

The purpose of this study was to perform a quantitative and qualitative validation of a soft tissue simulation pipeline for orthognathic surgery planning, necessary for clinical use. Simulation results were retrospectively obtained in 10 patients who underwent orthognathic surgery. Quantitatively, error was measured at 9 anatomical landmarks for each patient and different types of comparative analysis were performed considering two mesh resolutions, clinically accepted error, simulation time and error measured by means of percentage of the whole surface. Qualitatively, evaluation and binary questions were asked to two surgeons, both before and after seeing the actual surgical outcome, and their answers were compared. Finally, the quantitative and qualitative results were compared to check if these two types of validation are correlated. The quantitative results were accurate, with greater errors corresponding to gonions and lower lip. Qualitatively, surgeons answered similarly mostly and their evaluations improved when seeing the actual outcome of the surgery. The quantitative validation was not correlated to the qualitative validation. In this study, quantitative and qualitative validations were performed and compared, and the need to carry out both types of analysis in validation studies of soft tissue simulation software for orthognathic surgery planning was proved.

Deep learning for biomechanical modeling of facial tissue deformation in orthognathic surgical planning

PURPOSE

Orthognathic surgery requires an accurate surgical plan of how bony segments are moved and how the face passively responds to the bony movement. Currently, finite element method (FEM) is the standard for predicting facial deformation. Deep learning models have recently been used to approximate FEM because of their faster simulation speed. However, current solutions are not compatible with detailed facial meshes and often do not explicitly provide the network with known boundary type information. Therefore, the purpose of this proof-of-concept study is to develop a biomechanics-informed deep neural network that accepts point cloud data and explicit boundary types as inputs to the network for fast prediction of soft-tissue deformation.

METHODS

A deep learning network was developed based on the PointNet++ architecture. The network accepts the starting facial mesh, input displacement, and explicit boundary type information and predicts the final facial mesh deformation.

RESULTS

We trained and tested our deep learning model on datasets created from FEM simulations of facial meshes. Our model achieved a mean error between 0.159 and 0.642 mm on five subjects. Including explicit boundary types had mixed results, improving performance in simulations with large deformations but decreasing performance in simulations with small deformations. These results suggest that including explicit boundary types may not be necessary to improve network performance.

CONCLUSION

Our deep learning method can approximate FEM for facial change prediction in orthognathic surgical planning by accepting geometrically detailed meshes and explicit boundary types while significantly reducing simulation time.

Virtual Surgical Planning: Modeling from the Present to the Future

Virtual surgery planning is a non-invasive procedure, which uses digital clinical data for diagnostic, procedure selection and treatment planning purposes, including the forecast of potential outcomes. The technique begins with 3D data acquisition, using various methods, which may or may not utilize ionizing radiation, such as 3D stereophotogrammetry, 3D cone-beam CT scans, etc. Regardless of the imaging technique selected, landmark selection, whether it is manual or automated, is the key to transforming clinical data into objects that can be interrogated in virtual space. As a prerequisite, the data require alignment and correspondence such that pre- and post-operative configurations can be compared in real and statistical shape space. In addition, these data permit predictive modeling, using either model-based, data-based or hybrid modeling. These approaches provide perspectives for the development of customized surgical procedures and medical devices with accuracy, precision and intelligence. Therefore, this review briefly summarizes the current state of virtual surgery planning.

Soft-Tissue Simulation for Computational Planning of Orthognathic Surgery

Simulation technologies offer interesting opportunities for computer planning of orthognathic surgery. However, the methods used to date require tedious set up of simulation meshes based on patient imaging data, and they rely on complex simulation models that require long computations. In this work, we propose a modeling and simulation methodology that addresses model set up and runtime simulation in a holistic manner. We pay special attention to modeling the coupling of rigid-bone and soft-tissue components of the facial model, such that the resulting model is computationally simple yet accurate. The proposed simulation methodology has been evaluated on a cohort of 10 patients of orthognathic surgery, comparing quantitatively simulation results to post-operative scans. The results suggest that the proposed simulation methods admit the use of coarse simulation meshes, with planning computation times of less than 10 seconds in most cases, and with clinically viable accuracy.

Deep Simulation of Facial Appearance Changes Following Craniomaxillofacial Bony Movements in Orthognathic Surgical Planning

Facial appearance changes with the movements of bony segments in orthognathic surgery of patients with craniomaxillofacial (CMF) deformities. Conventional bio-mechanical methods, such as finite element modeling (FEM), for simulating such changes, are labor intensive and computationally expensive, preventing them from being used in clinical settings. To overcome these limitations, we propose a deep learning framework to predict post-operative facial changes. Specifically, FC-Net, a facial appearance change simulation network, is developed to predict the point displacement vectors associated with a facial point cloud. FC-Net learns the point displacements of a pre-operative facial point cloud from the bony movement vectors between pre-operative and simulated post-operative bony models. FC-Net is a weakly-supervised point displacement network trained using paired data with strict point-to-point correspondence. To preserve the topology of the facial model during point transform, we employ a local-point-transform loss to constrain the local movements of points. Experimental results on real patient data reveal that the proposed framework can predict post-operative facial appearance changes remarkably faster than a state-of-the-art FEM method with comparable prediction accuracy.

A novel incremental simulation of facial changes following orthognathic surgery using FEM with realistic lip sliding effect

Accurate prediction of facial soft-tissue changes following orthognathic surgery is crucial for surgical outcome improvement. We developed a novel incremental simulation approach using finite element method (FEM) with a realistic lip sliding effect to improve the prediction accuracy in the lip region. First, a lip-detailed mesh is generated based on accurately digitized lip surface points. Second, an improved facial soft-tissue change simulation method is developed by applying a lip sliding effect along with the mucosa sliding effect. Finally, the orthognathic surgery initiated soft-tissue change is simulated incrementally to facilitate a natural transition of the facial change and improve the effectiveness of the sliding effects. Our method was quantitatively validated using 35 retrospective clinical data sets by comparing it to the traditional FEM simulation method and the FEM simulation method with mucosa sliding effect only. The surface deviation error of our method showed significant improvement in the upper and lower lips over the other two prior methods. In addition, the evaluation results using our lip-shape analysis, which reflects clinician's qualitative evaluation, also proved significant improvement of the lip prediction accuracy of our method for the lower lip and both upper and lower lips as a whole compared to the other two methods. In conclusion, the prediction accuracy in the clinically critical region, i.e., the lips, significantly improved after applying incremental simulation with realistic lip sliding effect compared with the FEM simulation methods without the lip sliding effect.