2
|
Bao J, Zhang X, Xiang S, Liu H, Cheng M, Yang Y, Huang X, Xiang W, Cui W, Lai HC, Huang S, Wang Y, Qian D, Yu H. Deep Learning-Based Facial and Skeletal Transformations for Surgical Planning. J Dent Res 2024; 103:809-819. [PMID: 38808566 DOI: 10.1177/00220345241253186] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/30/2024] Open
Abstract
The increasing application of virtual surgical planning (VSP) in orthognathic surgery implies a critical need for accurate prediction of facial and skeletal shapes. The craniofacial relationship in patients with dentofacial deformities is still not understood, and transformations between facial and skeletal shapes remain a challenging task due to intricate anatomical structures and nonlinear relationships between the facial soft tissue and bones. In this study, a novel bidirectional 3-dimensional (3D) deep learning framework, named P2P-ConvGC, was developed and validated based on a large-scale data set for accurate subject-specific transformations between facial and skeletal shapes. Specifically, the 2-stage point-sampling strategy was used to generate multiple nonoverlapping point subsets to represent high-resolution facial and skeletal shapes. Facial and skeletal point subsets were separately input into the prediction system to predict the corresponding skeletal and facial point subsets via the skeletal prediction subnetwork and facial prediction subnetwork. For quantitative evaluation, the accuracy was calculated with shape errors and landmark errors between the predicted skeleton or face with corresponding ground truths. The shape error was calculated by comparing the predicted point sets with the ground truths, with P2P-ConvGC outperforming existing state-of-the-art algorithms including P2P-Net, P2P-ASNL, and P2P-Conv. The total landmark errors (Euclidean distances of craniomaxillofacial landmarks) of P2P-ConvGC in the upper skull, mandible, and facial soft tissues were 1.964 ± 0.904 mm, 2.398 ± 1.174 mm, and 2.226 ± 0.774 mm, respectively. Furthermore, the clinical feasibility of the bidirectional model was validated using a clinical cohort. The result demonstrated its prediction ability with average surface deviation errors of 0.895 ± 0.175 mm for facial prediction and 0.906 ± 0.082 mm for skeletal prediction. To conclude, our proposed model achieved good performance on the subject-specific prediction of facial and skeletal shapes and showed clinical application potential in postoperative facial prediction and VSP for orthognathic surgery.
Collapse
Affiliation(s)
- J Bao
- Department of Oral and Craniomaxillofacial Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
- College of Stomatology, Shanghai Jiao Tong University, Shanghai, China
- National Center for Stomatology, Shanghai, China
- National Clinical Research Center for Oral Diseases, Shanghai Key Laboratory of Stomatology, Shanghai, China
- Shanghai Research Institute of Stomatology, Shanghai, China
| | - X Zhang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - S Xiang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - H Liu
- School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - M Cheng
- Department of Oral and Craniomaxillofacial Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
- College of Stomatology, Shanghai Jiao Tong University, Shanghai, China
- National Center for Stomatology, Shanghai, China
- National Clinical Research Center for Oral Diseases, Shanghai Key Laboratory of Stomatology, Shanghai, China
- Shanghai Research Institute of Stomatology, Shanghai, China
| | - Y Yang
- Shanghai Lanhui Medical Technology Co., Ltd, Shanghai, China
| | - X Huang
- Department of Oral and Craniomaxillofacial Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
- College of Stomatology, Shanghai Jiao Tong University, Shanghai, China
- National Center for Stomatology, Shanghai, China
- National Clinical Research Center for Oral Diseases, Shanghai Key Laboratory of Stomatology, Shanghai, China
- Shanghai Research Institute of Stomatology, Shanghai, China
| | - W Xiang
- Department of Oral and Craniomaxillofacial Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
- College of Stomatology, Shanghai Jiao Tong University, Shanghai, China
- National Center for Stomatology, Shanghai, China
- National Clinical Research Center for Oral Diseases, Shanghai Key Laboratory of Stomatology, Shanghai, China
- Shanghai Research Institute of Stomatology, Shanghai, China
| | - W Cui
- Department of Oral and Craniomaxillofacial Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
- College of Stomatology, Shanghai Jiao Tong University, Shanghai, China
- National Center for Stomatology, Shanghai, China
- National Clinical Research Center for Oral Diseases, Shanghai Key Laboratory of Stomatology, Shanghai, China
- Shanghai Research Institute of Stomatology, Shanghai, China
| | - H C Lai
- Department of Oral and Craniomaxillofacial Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
- College of Stomatology, Shanghai Jiao Tong University, Shanghai, China
- National Center for Stomatology, Shanghai, China
- National Clinical Research Center for Oral Diseases, Shanghai Key Laboratory of Stomatology, Shanghai, China
- Shanghai Research Institute of Stomatology, Shanghai, China
| | - S Huang
- Department of Oral and Maxillofacial Surgery, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China
| | - Y Wang
- Qingdao Stomatological Hospital Affiliated to Qingdao University, Qingdao, Shandong, China
| | - D Qian
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - H Yu
- Department of Oral and Craniomaxillofacial Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
- College of Stomatology, Shanghai Jiao Tong University, Shanghai, China
- National Center for Stomatology, Shanghai, China
- National Clinical Research Center for Oral Diseases, Shanghai Key Laboratory of Stomatology, Shanghai, China
- Shanghai Research Institute of Stomatology, Shanghai, China
| |
Collapse
|
3
|
Ritschl LM, Classen C, Kilbertus P, Eufinger J, Storck K, Fichter AM, Wolff KD, Grill FD. Comparison of three-dimensional imaging of the nose using three different 3D-photography systems: an observational study. Head Face Med 2024; 20:7. [PMID: 38267982 PMCID: PMC10807178 DOI: 10.1186/s13005-024-00406-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Accepted: 01/04/2024] [Indexed: 01/26/2024] Open
Abstract
BACKGROUND New 3D technologies for superficial soft tissue changes, especially in plastic and reconstructive surgical procedures, can improve the planning and documentation of facial surgeries. The purpose of this study was to compare and determine the applicability and feasibility of three different 3D-photography systems in clinical practice imaging the nose. METHODS A total of 16 healthy non-operated noses were included in this prospective study. A plaster model of each nose was produced, digitized, and converted to a .stl mesh (= ground truth model). Three-dimensional images of each nose were then taken using Artec Space Spider (gold standard), Planmeca ProFace®, and the Bellus3D Dental Pro application. All resulting .stl files were aligned to the ground truth model using MeshLab software, and the root mean square error (RMSE), mean surface distance (MSD), and Hausdorff distance (HD) were calculated. RESULTS The Artec Space Spider 3D-photography system showed significantly better results compared to the two other systems in regard to RMSE, MSD, and HD (each p < 0.001). There was no significant difference between Planmeca ProFace® and Bellus3D Dental Pro in terms of RMSE, MSD, and HD. Overall, all three camera systems showed a clinically acceptable deviation to the reference model (range: -1.23-1.57 mm). CONCLUSIONS The three evaluated 3D-photography systems were suitable for nose imaging in the clinical routine. While Artec Space Spider showed the highest accuracy, the Bellus3D Dental Pro app may be the most feasible option for everyday clinical use due to its portability, ease of use, and low cost. This study presents three different systems, allowing readers to extrapolate to other systems when planning to introduce 3D photography in the clinical routine.
Collapse
Affiliation(s)
- Lucas M Ritschl
- Department of Oral and Maxillofacial Surgery, School of Medicine and Health, Technical University of Munich, Klinikum rechts der Isar, Ismaninger Strasse 22, D-81675, Munich, Germany
| | - Carolina Classen
- Department of Oral and Maxillofacial Surgery, School of Medicine and Health, Technical University of Munich, Klinikum rechts der Isar, Ismaninger Strasse 22, D-81675, Munich, Germany.
- Department of Oral and Maxillofacial Surgery, Saarland University Medical Centre, 66421, Homburg, Germany.
| | - Paul Kilbertus
- Department of Oral and Maxillofacial Surgery, School of Medicine and Health, Technical University of Munich, Klinikum rechts der Isar, Ismaninger Strasse 22, D-81675, Munich, Germany
| | - Julia Eufinger
- Department of Oral and Maxillofacial Surgery, School of Medicine and Health, Technical University of Munich, Klinikum rechts der Isar, Ismaninger Strasse 22, D-81675, Munich, Germany
| | - Katharina Storck
- Department of Otorhinolaryngology, Head and Neck Surgery, School of Medicine and Health, Technical University of Munich, Klinikum rechts der Isar, Ismaninger Strasse 22, D-81675, Munich, Germany
| | - Andreas M Fichter
- Department of Oral and Maxillofacial Surgery, School of Medicine and Health, Technical University of Munich, Klinikum rechts der Isar, Ismaninger Strasse 22, D-81675, Munich, Germany
| | - Klaus-Dietrich Wolff
- Department of Oral and Maxillofacial Surgery, School of Medicine and Health, Technical University of Munich, Klinikum rechts der Isar, Ismaninger Strasse 22, D-81675, Munich, Germany
| | - Florian D Grill
- Department of Oral and Maxillofacial Surgery, School of Medicine and Health, Technical University of Munich, Klinikum rechts der Isar, Ismaninger Strasse 22, D-81675, Munich, Germany
- Private Practice Oral and Maxillofacial Surgery, Wolfratshausen, Germany
| |
Collapse
|
4
|
Chen P, Zheng H. Drug-target interaction prediction based on spatial consistency constraint and graph convolutional autoencoder. BMC Bioinformatics 2023; 24:151. [PMID: 37069493 PMCID: PMC10109239 DOI: 10.1186/s12859-023-05275-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Accepted: 04/05/2023] [Indexed: 04/19/2023] Open
Abstract
BACKGROUND Drug-target interaction (DTI) prediction plays an important role in drug discovery and repositioning. However, most of the computational methods used for identifying relevant DTIs do not consider the invariance of the nearest neighbour relationships between drugs or targets. In other words, they do not take into account the invariance of the topological relationships between nodes during representation learning. It may limit the performance of the DTI prediction methods. RESULTS Here, we propose a novel graph convolutional autoencoder-based model, named SDGAE, to predict DTIs. As the graph convolutional network cannot handle isolated nodes in a network, a pre-processing step was applied to reduce the number of isolated nodes in the heterogeneous network and facilitate effective exploitation of the graph convolutional network. By maintaining the graph structure during representation learning, the nearest neighbour relationships between nodes in the embedding space remained as close as possible to the original space. CONCLUSIONS Overall, we demonstrated that SDGAE can automatically learn more informative and robust feature vectors of drugs and targets, thus exhibiting significantly improved predictive accuracy for DTIs.
Collapse
Affiliation(s)
- Peng Chen
- School of Computer Science and Technology, University of Science and Technology of China, Jinzhai Road 96, Hefei, 230027, People's Republic of China
- Anhui Key Laboratory of Software Engineering in Computing and Communication, University of Science and Technology of China, Jinzhai Road 96, Hefei, 230027, People's Republic of China
| | - Haoran Zheng
- School of Computer Science and Technology, University of Science and Technology of China, Jinzhai Road 96, Hefei, 230027, People's Republic of China.
- Anhui Key Laboratory of Software Engineering in Computing and Communication, University of Science and Technology of China, Jinzhai Road 96, Hefei, 230027, People's Republic of China.
| |
Collapse
|