A simulator for maxillofacial surgery integrating 3D cephalometry and orthodontia

Structure-Aware Long Short-Term Memory Network for 3D Cephalometric Landmark Detection

Detecting 3D landmarks on cone-beam computed tomography (CBCT) is crucial to assessing and quantifying the anatomical abnormalities in 3D cephalometric analysis. However, the current methods are time-consuming and suffer from large biases in landmark localization, leading to unreliable diagnosis results. In this work, we propose a novel Structure-Aware Long Short-Term Memory framework (SA-LSTM) for efficient and accurate 3D landmark detection. To reduce the computational burden, SA-LSTM is designed in two stages. It first locates the coarse landmarks via heatmap regression on a down-sampled CBCT volume and then progressively refines landmarks by attentive offset regression using multi-resolution cropped patches. To boost accuracy, SA-LSTM captures global-local dependence among the cropping patches via self-attention. Specifically, a novel graph attention module implicitly encodes the landmark's global structure to rationalize the predicted position. Moreover, a novel attention-gated module recursively filters irrelevant local features and maintains high-confident local predictions for aggregating the final result. Experiments conducted on an in-house dataset and a public dataset show that our method outperforms state-of-the-art methods, achieving 1.64 mm and 2.37 mm average errors, respectively. Furthermore, our method is very efficient, taking only 0.5 seconds for inferring the whole CBCT volume of resolution 768×768×576 .

Development of a simulation system in mandibular orthognathic surgery based on integrated three-dimensional data

Purpose

Surgical simulation should reflect the 3D movement of dentition and the resultant movement of the osteotomized segments, which can influence surgical outcome. The present study was aimed at developing a new simulation system that enables virtual osteotomy of a given surgical situation and evaluation of the bony interference between the osteotomized segments of the mandible.

Subjects and methods

The data of 3D computer tomography (CT) for maxillomandibular dental casts were integrated into the standard coordinates of a 3D cephalogram. To evaluate the accuracy of the system, measurement errors of the 3D CT virtual model from a dry skull were compared with the computer simulation system and a contact-type 3D digitizer. To examine the clinical accessibility, 15 mandibular prognathism patients with mild to severe asymmetry were evaluated with the simulation program.

Results

The average error of measurement in all directions was 1.31 mm. It was possible to simulate various osteotomy procedures by conversion of the 3D coordinates of the dental cast and CT data into the standard coordinate system of a 3D cephalogram. Using this simulation system, it was possible to prevent condylar torque or segment malpositioning by removing the bony interference visualized by a 3D virtual model.

Conclusion

A new system, which enables the precise visualization of osteotomized segments and calculation of bony interference, was proposed in the present study. This new system provides an acceptable precision of treatment planning of orthognathic surgery, especially for facial asymmetry.

Three-dimensional surgical simulation

In this article, we discuss the development of methods for computer-aided jaw surgery, which allows us to incorporate the high level of precision necessary for transferring virtual plans into the operating room. We also present a complete computer-aided surgery system developed in close collaboration with surgeons. Surgery planning and simulation include construction of 3-dimensional surface models from cone-beam computed tomography, dynamic cephalometry, semiautomatic mirroring, interactive cutting of bone, and bony segment repositioning. A virtual setup can be used to manufacture positioning splints for intraoperative guidance. The system provides further intraoperative assistance with a computer display showing jaw positions and 3-dimensional positioning guides updated in real time during the surgical procedure. The computer-aided surgery system aids in dealing with complex cases with benefits for the patient, with surgical practice, and for orthodontic finishing. Advanced software tools for diagnosis and treatment planning allow preparation of detailed operative plans, osteotomy repositioning, bone reconstructions, surgical resident training, and assessing the difficulties of the surgical procedures before the surgery. Computer-aided surgery can make the elaboration of the surgical plan a more flexible process, increase the level of detail and accuracy of the plan, yield higher operative precision and control, and enhance documentation of cases.

Single-Tooth Modeling for 3D Dental Model

An integrated single-tooth modeling scheme is proposed for the 3D dental model acquired by optical digitizers. The cores of the modeling scheme are fusion regions extraction, single tooth shape restoration, and single tooth separation. According to the “valley” shape-like characters of the fusion regions between two adjoining teeth, the regions of the 3D dental model are analyzed and classified based on the minimum curvatures of the surface. The single tooth shape is restored according to the bioinformation along the hole boundary, which is generated after the fusion region being removed. By using the extracted boundary from the blending regions between the teeth and soft tissues as reference, the teeth can be separated from the 3D dental model one by one correctly. Experimental results show that the proposed method can achieve satisfying modeling results with high-degree approximation of the real tooth and meet the requirements of clinical oral medicine.

A new system for computer-aided preoperative planning and intraoperative navigation during corrective jaw surgery

A new system for computer-aided corrective surgery of the jaws has been developed and introduced clinically. It combines three-dimensional (3-D) surgical planning with conventional dental occlusion planning. The developed software allows simulating the surgical correction on virtual 3-D models of the facial skeleton generated from computed tomography (CT) scans. Surgery planning and simulation include dynamic cephalometry, semi-automatic mirroring, interactive cutting of bone and segment repositioning. By coupling the software with a tracking system and with the help of a special registration procedure, we are able to acquire dental occlusion plans from plaster model mounts. Upon completion of the surgical plan, the setup is used to manufacture positioning splints for intraoperative guidance. The system provides further intraoperative assistance with the help of a display showing jaw positions and 3-D positioning guides updated in real time during the surgical procedure. The proposed approach offers the advantages of 3-D visualization and tracking technology without sacrificing long-proven cast-based techniques for dental occlusion evaluation. The system has been applied on one patient. Throughout this procedure, we have experienced improved assessment of pathology, increased precision, and augmented control.