A machine learning framework for automated diagnosis and computer-assisted planning in plastic and reconstructive surgery

The online attention analysis on orthognathic surgery research

OBJECTIVES

Altmetrics is one of the fields of bibliometrics that seeks to assess the impact and interest of a given subject through Internet users. The aim of this study is to make an altmetric analysis of the orthognathic surgery literature.

METHODS

A literature search was conducted using Dimensions app up to December 2023. A list of the 100 most mentioned articles on the topic was compiled. A Google Trends search was performed with same strategy to visualize important data regarding internet search. Charts and tables were created using Microsoft Excel and VOSviewer software to allow bibliometric visualization.

RESULTS

There was a very poor correlation between the number of mentions and the number of citations (r = 0.0202). Most articles discussed on technical innovations associated to orthognathic surgery, majority related to virtual planning (n = 26). Other topics considered interesting to internet readers were complications (n = 18), surgical technique (n = 14), and psychological aspects/quality of life (n = 13).

CONCLUSION

Online interest in orthognathic surgery closely aligns with the level of academic interest but is also influenced by factors such as location and economic status. The internet is a powerful tool for disseminating scientific research to a broad audience, making it more accessible and engaging than traditional academic channels.

Artificial intelligence in maxillofacial and facial plastic and reconstructive surgery

PURPOSE OF REVIEW

To provide a current review of artificial intelligence and its subtypes in maxillofacial and facial plastic surgery including a discussion of implications and ethical concerns.

RECENT FINDINGS

Artificial intelligence has gained popularity in recent years due to technological advancements. The current literature has begun to explore the use of artificial intelligence in various medical fields, but there is limited contribution to maxillofacial and facial plastic surgery due to the wide variance in anatomical facial features as well as subjective influences. In this review article, we found artificial intelligence's roles, so far, are to automatically update patient records, produce 3D models for preoperative planning, perform cephalometric analyses, and provide diagnostic evaluation of oropharyngeal malignancies.

SUMMARY

Artificial intelligence has solidified a role in maxillofacial and facial plastic surgery within the past few years. As high-quality databases expand with more patients, the role for artificial intelligence to assist in more complicated and unique cases becomes apparent. Despite its potential, ethical questions have been raised that should be noted as artificial intelligence continues to thrive. These questions include concerns such as compromise of the physician-patient relationship and healthcare justice.

Prediction of surgery-first approach orthognathic surgery using deep learning models

The surgery-first approach (SFA) orthognathic surgery can be beneficial due to reduced overall treatment time and earlier profile improvement. The objective of this study was to utilize deep learning to predict the treatment modality of SFA or the orthodontics-first approach (OFA) in orthognathic surgery patients and assess its clinical accuracy. A supervised deep learning model using three convolutional neural networks (CNNs) was trained based on lateral cephalograms and occlusal views of 3D dental model scans from 228 skeletal Class III malocclusion patients (114 treated by SFA and 114 by OFA). An ablation study of five groups (lateral cephalogram only, mandible image only, maxilla image only, maxilla and mandible images, and all data combined) was conducted to assess the influence of each input type. The results showed the average validation accuracy, precision, recall, F1 score, and AUROC for the five folds were 0.978, 0.980, 0.980, 0.980, and 0.998 ; the average testing results for the five folds were 0.906, 0.986, 0.828, 0.892, and 0.952. The lateral cephalogram only group had the least accuracy, while the maxilla image only group had the best accuracy. Deep learning provides a novel method for an accelerated workflow, automated assisted decision-making, and personalized treatment planning.

Deep Learning-Based Facial and Skeletal Transformations for Surgical Planning

The increasing application of virtual surgical planning (VSP) in orthognathic surgery implies a critical need for accurate prediction of facial and skeletal shapes. The craniofacial relationship in patients with dentofacial deformities is still not understood, and transformations between facial and skeletal shapes remain a challenging task due to intricate anatomical structures and nonlinear relationships between the facial soft tissue and bones. In this study, a novel bidirectional 3-dimensional (3D) deep learning framework, named P2P-ConvGC, was developed and validated based on a large-scale data set for accurate subject-specific transformations between facial and skeletal shapes. Specifically, the 2-stage point-sampling strategy was used to generate multiple nonoverlapping point subsets to represent high-resolution facial and skeletal shapes. Facial and skeletal point subsets were separately input into the prediction system to predict the corresponding skeletal and facial point subsets via the skeletal prediction subnetwork and facial prediction subnetwork. For quantitative evaluation, the accuracy was calculated with shape errors and landmark errors between the predicted skeleton or face with corresponding ground truths. The shape error was calculated by comparing the predicted point sets with the ground truths, with P2P-ConvGC outperforming existing state-of-the-art algorithms including P2P-Net, P2P-ASNL, and P2P-Conv. The total landmark errors (Euclidean distances of craniomaxillofacial landmarks) of P2P-ConvGC in the upper skull, mandible, and facial soft tissues were 1.964 ± 0.904 mm, 2.398 ± 1.174 mm, and 2.226 ± 0.774 mm, respectively. Furthermore, the clinical feasibility of the bidirectional model was validated using a clinical cohort. The result demonstrated its prediction ability with average surface deviation errors of 0.895 ± 0.175 mm for facial prediction and 0.906 ± 0.082 mm for skeletal prediction. To conclude, our proposed model achieved good performance on the subject-specific prediction of facial and skeletal shapes and showed clinical application potential in postoperative facial prediction and VSP for orthognathic surgery.

The Accuracy of Three-Dimensional Soft Tissue Simulation in Orthognathic Surgery-A Systematic Review

Three-dimensional soft tissue simulation has become a popular tool in the process of virtual orthognathic surgery planning and patient-surgeon communication. To apply 3D soft tissue simulation software in routine clinical practice, both qualitative and quantitative validation of its accuracy are required. The objective of this study was to systematically review the literature on the accuracy of 3D soft tissue simulation in orthognathic surgery. The Web of Science, PubMed, Cochrane, and Embase databases were consulted for the literature search. The systematic review (SR) was conducted according to the PRISMA statement, and 40 articles fulfilled the inclusion and exclusion criteria. The Quadas-2 tool was used for the risk of bias assessment for selected studies. A mean error varying from 0.27 mm to 2.9 mm for 3D soft tissue simulations for the whole face was reported. In the studies evaluating 3D soft tissue simulation accuracy after a Le Fort I osteotomy only, the upper lip and paranasal regions were reported to have the largest error, while after an isolated bilateral sagittal split osteotomy, the largest error was reported for the lower lip and chin regions. In the studies evaluating simulation after bimaxillary osteotomy with or without genioplasty, the highest inaccuracy was reported at the level of the lips, predominantly the lower lip, chin, and, sometimes, the paranasal regions. Due to the variability in the study designs and analysis methods, a direct comparison was not possible. Therefore, based on the results of this SR, guidelines to systematize the workflow for evaluating the accuracy of 3D soft tissue simulations in orthognathic surgery in future studies are proposed.

Artificial Intelligence for Rhinoplasty Design in Asian Patients

BACKGROUND

Rhinoplasty is one of the most challenging plastic surgeries because it lacks a uniform standard for preoperative design or implementation. For a long time, rhinoplasties were done without an accurate consensus of aesthetic design between surgeons and patients before surgery and consequently brought unsatisfactory appearance for patients. In recent years, three-dimensional (3D) simulation has been used to visualize the preoperative design of rhinoplasty, and good results have been achieved. However, it still relied on individual aesthetics and experience. The preoperative design remained a huge challenge for inexperienced surgeons and could be time-consuming to perform manually. Therefore, we adopted artificial intelligence (AI) in this work to provide a new idea for automated and efficient preoperative nasal contour design.

METHODS

We collected a dataset of 3D facial images from 209 patients. For each patient, both the original face and the manually designed face using 3D simulation software were included. The 3D images were transformed into point clouds, based on which we used the modified FoldingNet model for deep neural network training (by pytorch 1.12).

RESULTS

The trained AI model gained the ability to perform aesthetic design automatically and achieved similar results to manual design. We analysed the 1027 facial features captured by the AI model and concluded two of its possible cognitive modes. One is to resemble the human aesthetic considerations while the other is to fulfil the given task in a special way of the machine.

CONCLUSION

We presented the first AI model for automated preoperative 3D simulation of rhinoplasty in this study. It provided a new idea for the automated, individual and efficient preoperative design, which was expected to bring a new paradigm for rhinoplasty and even the whole field of plastic surgery.

LEVEL OF EVIDENCE IV

This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .

Frontiers in Three-Dimensional Surface Imaging Systems for 3D Face Acquisition in Craniofacial Research and Practice: An Updated Literature Review

Digitalizing all aspects of dental care is a contemporary approach to ensuring the best possible clinical outcomes. Ongoing advancements in 3D face acquisition have been driven by continuous research on craniofacial structures and treatment effects. An array of 3D surface-imaging systems are currently available for generating photorealistic 3D facial images. However, choosing a purpose-specific system is challenging for clinicians due to variations in accuracy, reliability, resolution, and portability. Therefore, this review aims to provide clinicians and researchers with an overview of currently used or potential 3D surface imaging technologies and systems for 3D face acquisition in craniofacial research and daily practice. Through a comprehensive literature search, 71 articles meeting the inclusion criteria were included in the qualitative analysis, investigating the hardware, software, and operational aspects of these systems. The review offers updated information on 3D surface imaging technologies and systems to guide clinicians in selecting an optimal 3D face acquisition system. While some of these systems have already been implemented in clinical settings, others hold promise. Furthermore, driven by technological advances, novel devices will become cost-effective and portable, and will also enable accurate quantitative assessments, rapid treatment simulations, and improved outcomes.

State of the art and prospects for artificial intelligence in orthognathic surgery: A systematic review with meta-analysis

OBJECTIVE

To present a systematic review of the state of the art regarding clinical applications, main features, and outcomes of artificial intelligence (AI) in orthognathic surgery.

METHODS

The PICOS strategy was performed on a systematic review (SR) to answer the following question: "What are the state of the art, characteristics and outcomes of applications with artificial intelligence for orthognathic surgery?" After registering in PROSPERO (CRD42021270789) a systematic search was performed in the databases: PubMed (including MedLine), Scopus, Embase, LILACS, MEDLINE EBSCOHOST and Cochrane Library. 195 studies were selected, after screening titles and abstracts, of which thirteen manuscripts were included in the qualitative analysis and six in the quantitative analysis. The treatment effects were plotted in a Forest-plot. JBI questionnaire for observational studies was used to asses the risk of bias. The quality of the SR evidence was assessed using the GRADE tool.

RESULTS

AI studies on 2D cephalometry for orthognathic surgery, the Tau2 = 0.00, Chi2 = 3.78, p = 1.00 and I² of 0 %, indicating low heterogeneity, AI did not differ statistically from control (p = 0.79). AI studies in the diagnosis of the decision of whether or not to perform orthognathic surgery showed heterogeneity, and therefore meta-analysis was not peformed.

CONCLUSION

The outcome of AI is similar to the control group, with a low degree of bias, highlighting its potential for use in various applications.

AI in Orthodontics: Revolutionizing Diagnostics and Treatment Planning-A Comprehensive Review

The advent of artificial intelligence (AI) in medicine has transformed various medical specialties, including orthodontics. AI has shown promising results in enhancing the accuracy of diagnoses, treatment planning, and predicting treatment outcomes. Its usage in orthodontic practices worldwide has increased with the availability of various AI applications and tools. This review explores the principles of AI, its applications in orthodontics, and its implementation in clinical practice. A comprehensive literature review was conducted, focusing on AI applications in dental diagnostics, cephalometric evaluation, skeletal age determination, temporomandibular joint (TMJ) evaluation, decision making, and patient telemonitoring. Due to study heterogeneity, no meta-analysis was possible. AI has demonstrated high efficacy in all these areas, but variations in performance and the need for manual supervision suggest caution in clinical settings. The complexity and unpredictability of AI algorithms call for cautious implementation and regular manual validation. Continuous AI learning, proper governance, and addressing privacy and ethical concerns are crucial for successful integration into orthodontic practice.

Biomedical Big Data Technologies, Applications, and Challenges for Precision Medicine: A Review

The explosive growth of biomedical Big Data presents both significant opportunities and challenges in the realm of knowledge discovery and translational applications within precision medicine. Efficient management, analysis, and interpretation of big data can pave the way for groundbreaking advancements in precision medicine. However, the unprecedented strides in the automated collection of large-scale molecular and clinical data have also introduced formidable challenges in terms of data analysis and interpretation, necessitating the development of novel computational approaches. Some potential challenges include the curse of dimensionality, data heterogeneity, missing data, class imbalance, and scalability issues. This overview article focuses on the recent progress and breakthroughs in the application of big data within precision medicine. Key aspects are summarized, including content, data sources, technologies, tools, challenges, and existing gaps. Nine fields-Datawarehouse and data management, electronic medical record, biomedical imaging informatics, Artificial intelligence-aided surgical design and surgery optimization, omics data, health monitoring data, knowledge graph, public health informatics, and security and privacy-are discussed.

Can smartphones be used for routine dental clinical application? A validation study for using smartphone-generated 3D facial images

OBJECTIVES

To compare the accuracy of smartphone-generated three-dimensional (3D) facial images to that of direct anthropometry (DA) and 3dMD with the aim of assessing the validity and reliability of smartphone-generated 3D facial images for routine clinical applications.

MATERIALS AND METHODS

Twenty-five anthropometric soft-tissue facial landmarks were labelled manually on 22 orthognathic surgery patients (11 males and 11 females; mean age 26.2 ± 5.3 years). For each labelled face, two imaging operations were performed using two different surface imaging systems: 3dMDface and Bellus3D FaceApp. Next, 42 inter-landmark facial measurements amongst the identified facial landmarks were measured directly on each labelled face and also digitally on 3D facial images. The measurements obtained from smartphone-generated 3D facial images (SGI) were statistically compared with those from DA and 3dMD.

RESULTS

SGI had slightly higher measurement values than DA and 3dMD, but there was no statistically significant difference between the mean values of inter-landmark measures across the three methods. Clinically acceptable differences (≤3 mm or ≤5°) were observed for 67 % and 74 % of measurements with good agreement between DA and SGI, and 3dMD and SGI, respectively. An overall small systematic bias of ± 0.2 mm was observed between the three methods. Furthermore, the mean absolute difference between DA and SGI methods was highest for linear (1.41 ± 0.33 mm) as well as angular measurements (3.07 ± 0.73°).

CONCLUSIONS

SGI demonstrated fair trueness compared to DA and 3dMD. The central region and flat areas of the face in SGI are more accurate. Despite this, SGI have limited clinical application, and the panfacial accuracy of the SGI would be more desirable from a clinical application standpoint.

CLINICAL SIGNIFICANCE

The usage of SGI in clinical practice for region-specific macro-proportional facial assessment involving central and flat regions of the face or for patient education purposes, which does not require accuracy within 3 mm and 5° can be considered.

Automated surgical planning in spring-assisted sagittal craniosynostosis correction using finite element analysis and machine learning

Sagittal synostosis is a condition caused by the fused sagittal suture and results in a narrowed skull in infants. Spring-assisted cranioplasty is a correction technique used to expand skulls with sagittal craniosynostosis by placing compressed springs on the skull before six months of age. Proposed methods for surgical planning in spring-assisted sagittal craniosynostosis correction provide information only about the skull anatomy or require iterative finite element simulations. Therefore, the selection of surgical parameters such as spring dimensions and osteotomy sizes may remain unclear and spring-assisted cranioplasty may yield sub-optimal surgical results. The aim of this study is to develop the architectural structure of an automated tool to predict post-operative surgical outcomes in sagittal craniosynostosis correction with spring-assisted cranioplasty using machine learning and finite element analyses. Six different machine learning algorithms were tested using a finite element model which simulated a combination of various mechanical and geometric properties of the calvarium, osteotomy sizes, spring characteristics, and spring implantation positions. Also, a statistical shape model representing an average sagittal craniosynostosis calvarium in 5-month-old patients was used to assess the machine learning algorithms. XGBoost algorithm predicted post-operative cephalic index in spring-assisted sagittal craniosynostosis correction with high accuracy. Finite element simulations confirmed the prediction of the XGBoost algorithm. The presented architectural structure can be used to develop a tool to predict the post-operative cephalic index in spring-assisted cranioplasty in patients with sagittal craniosynostosis can be used to automate surgical planning and improve post-operative surgical outcomes in spring-assisted cranioplasty.

"Facekit"-Toward an Automated Facial Analysis App Using a Machine Learning-Derived Facial Recognition Algorithm

Introduction: Multiple tools have been developed for facial feature measurements and analysis using facial recognition machine learning techniques. However, several challenges remain before these will be useful in the clinical context for reconstructive and aesthetic plastic surgery. Smartphone-based applications utilizing open-access machine learning tools can be rapidly developed, deployed, and tested for use in clinical settings. This research compares a smartphone-based facial recognition algorithm to direct and digital measurement performance for use in facial analysis. Methods: Facekit is a camera application developed for Android that utilizes ML Kit, an open-access computer vision Application Programing Interface developed by Google. Using the facial landmark module, we measured 4 facial proportions in 15 healthy subjects and compared them to direct surface and digital measurements using intraclass correlation (ICC) and Pearson correlation. Results: Measurement of the naso-facial proportion achieved the highest ICC of 0.321, where ICC > 0.75 is considered an excellent agreement between methods. Repeated measures analysis of variance of proportion measurements between ML Kit, direct and digital methods, were significantly different (F[2,14] = 6-26, P<<.05). Facekit measurements of orbital, orbitonasal, naso-oral, and naso-facial ratios had overall low correlation and agreement to both direct and digital measurements (R<<0.5, ICC<<0.75). Conclusion: Facekit is a smartphone camera application for rapid facial feature analysis. Agreement between Facekit's machine learning measurements and direct and digital measurements was low. We conclude that the chosen pretrained facial recognition software is not accurate enough for conducting a clinically useful facial analysis. Custom models trained on accurate and clinically relevant landmarks may provide better performance.

Application of Artificial Intelligence in Orthodontics: Current State and Future Perspectives

In recent years, there has been the notable emergency of artificial intelligence (AI) as a transformative force in multiple domains, including orthodontics. This review aims to provide a comprehensive overview of the present state of AI applications in orthodontics, which can be categorized into the following domains: (1) diagnosis, including cephalometric analysis, dental analysis, facial analysis, skeletal-maturation-stage determination and upper-airway obstruction assessment; (2) treatment planning, including decision making for extractions and orthognathic surgery, and treatment outcome prediction; and (3) clinical practice, including practice guidance, remote care, and clinical documentation. We have witnessed a broadening of the application of AI in orthodontics, accompanied by advancements in its performance. Additionally, this review outlines the existing limitations within the field and offers future perspectives.

Contemporary Role and Applications of Artificial Intelligence in Dentistry

Artificial Intelligence (AI) technologies play a significant role and significantly impact various sectors, including healthcare, engineering, sciences, and smart cities. AI has the potential to improve the quality of patient care and treatment outcomes while minimizing the risk of human error. Artificial Intelligence (AI) is transforming the dental industry, just like it is revolutionizing other sectors. It is used in dentistry to diagnose dental diseases and provide treatment recommendations. Dental professionals are increasingly relying on AI technology to assist in diagnosis, clinical decision-making, treatment planning, and prognosis prediction across ten dental specialties. One of the most significant advantages of AI in dentistry is its ability to analyze vast amounts of data quickly and accurately, providing dental professionals with valuable insights to enhance their decision-making processes. The purpose of this paper is to identify the advancement of artificial intelligence algorithms that have been frequently used in dentistry and assess how well they perform in terms of diagnosis, clinical decision-making, treatment, and prognosis prediction in ten dental specialties; dental public health, endodontics, oral and maxillofacial surgery, oral medicine and pathology, oral & maxillofacial radiology, orthodontics and dentofacial orthopedics, pediatric dentistry, periodontics, prosthodontics, and digital dentistry in general. We will also show the pros and cons of using AI in all dental specialties in different ways. Finally, we will present the limitations of using AI in dentistry, which made it incapable of replacing dental personnel, and dentists, who should consider AI a complimentary benefit and not a threat.

[Pediatric oral maxillofacial management and artificial intelligence]

With the enhancement of aesthetic awareness of children's oral maxillofacial development, multi-disciplinary doctors pay attention to children's oral maxillofacial management. Artificial intelligence (AI) technology has been gradually applied to all fields of children's oral maxillofacial management because of its outstanding advantages in medical screening and auxiliary decision-making. This article reviews the application of AI technology in the screening, diagnosis, treatment and follow-up of oral maxillofacial management in children.

Synergy between artificial intelligence and precision medicine for computer-assisted oral and maxillofacial surgical planning

OBJECTIVES

The aim of this review was to investigate the application of artificial intelligence (AI) in maxillofacial computer-assisted surgical planning (CASP) workflows with the discussion of limitations and possible future directions.

MATERIALS AND METHODS

An in-depth search of the literature was undertaken to review articles concerned with the application of AI for segmentation, multimodal image registration, virtual surgical planning (VSP), and three-dimensional (3D) printing steps of the maxillofacial CASP workflows.

RESULTS

The existing AI models were trained to address individual steps of CASP, and no single intelligent workflow was found encompassing all steps of the planning process. Segmentation of dentomaxillofacial tissue from computed tomography (CT)/cone-beam CT imaging was the most commonly explored area which could be applicable in a clinical setting. Nevertheless, a lack of generalizability was the main issue, as the majority of models were trained with the data derived from a single device and imaging protocol which might not offer similar performance when considering other devices. In relation to registration, VSP and 3D printing, the presence of inadequate heterogeneous data limits the automatization of these tasks.

CONCLUSION

The synergy between AI and CASP workflows has the potential to improve the planning precision and efficacy. However, there is a need for future studies with big data before the emergent technology finds application in a real clinical setting.

CLINICAL RELEVANCE

The implementation of AI models in maxillofacial CASP workflows could minimize a surgeon's workload and increase efficiency and consistency of the planning process, meanwhile enhancing the patient-specific predictability.

A Systematic Review of Artificial Intelligence Applications in Plastic Surgery: Looking to the Future

Artificial intelligence (AI) is presently employed in several medical specialties, particularly those that rely on large quantities of standardized data. The integration of AI in surgical subspecialties is under preclinical investigation but is yet to be widely implemented. Plastic surgeons collect standardized data in various settings and could benefit from AI. This systematic review investigates the current clinical applications of AI in plastic and reconstructive surgery.

METHODS

A comprehensive literature search of the Medline, EMBASE, Cochrane, and PubMed databases was conducted for AI studies with multiple search terms. Articles that progressed beyond the title and abstract screening were then subcategorized based on the plastic surgery subspecialty and AI application.

RESULTS

The systematic search yielded a total of 1820 articles. Forty-four studies met inclusion criteria warranting further analysis. Subcategorization of articles by plastic surgery subspecialties revealed that most studies fell into aesthetic and breast surgery (27%), craniofacial surgery (23%), or microsurgery (14%). Analysis of the research study phase of included articles indicated that the current research is primarily in phase 0 (discovery and invention; 43.2%), phase 1 (technical performance and safety; 27.3%), or phase 2 (efficacy, quality improvement, and algorithm performance in a medical setting; 27.3%). Only one study demonstrated translation to clinical practice.

CONCLUSIONS

The potential of AI to optimize clinical efficiency is being investigated in every subfield of plastic surgery, but much of the research to date remains in the preclinical status. Future implementation of AI into everyday clinical practice will require collaborative efforts.

Facial Scanners in Dentistry: An Overview

Purpose: This narrative review aims to explore the current status of facial scanning technology in the dental field; outlining the history, mechanisms, and current evidence regarding its use and limitations within digital dentistry. Methods: Subtopics within facial scanner technology in dentistry were identified and divided among four reviewers. Electronic searches of the Medline (PubMed) database were performed with the following search terms: facial scanner, dentistry, prosthodontics, virtual patient, sleep apnea, maxillofacial prosthetics, accuracy. For this review only studies or review papers evaluating facial scanning technology for dental or medical applications were included. A total of 44 articles were included. Due to the narrative nature of this review, no formal evidence-based quality assessment was performed and the search was limited to the English language. No further restrictions were applied. Results: The significance, applications, limitations, and future directions of facial scanning technology were reviewed. Specific subtopics include significant history of facial scanner use and development for dentistry, different types and mechanisms used in facial scanning technology, accuracy of scanning technology, use as a diagnostic tool, use in creating a virtual patient, virtual articulation, smile design, diagnosing and treating obstructive sleep apnea, limitations of scanning technology, and future directions with artificial intelligence. Conclusions: Despite limitations in scan quality and software operation, 3D facial scanners are rapid and non-invasive tools that can be utilized in multiple facets of dental care. Facial scanners can serve an invaluable role in the digital workflow by capturing facial records to facilitate interdisciplinary communication, virtual articulation, smile design, and obstructive sleep apnea diagnosis and treatment. Looking into the future, facial scanning technology has promising applications in the fields of craniofacial research, and prosthodontic diagnosis and treatment planning.

Applications of artificial intelligence and machine learning in orthognathic surgery: A scoping review

Over the recent years, Artificial Intelligence (AI) has been progressing rapidly with its ability to mimic human cognitive functions. The potential applications of AI technology in diagnosis, treatment planning, and prognosis prediction have been demonstrated in various studies. The present scoping review aimed to provide an overview of AI and Machine Learning (ML) algorithms and their applications in orthognathic surgery. A comprehensive search was conducted in databases including PubMed, Embase, Scopus, Web of Science and OVID Medline until November 2021. This scoping review was conducted following the PRISMA-ScR guidelines. After applying the inclusion and exclusion criteria, a total of 19 studies were included for final review. AI has profoundly impacted the diagnosis and prediction of orthognathic surgeries with a clinically acceptable accuracy range. Furthermore, AI reduces the work burden of the clinician by eliminating the tedious registration procedures, thereby helping in efficient and automated planning. However, focussing on the research gaps, there is a need to foster the AI models/algorithms to contemporize their efficiency in clinical decision making, diagnosis and surgical planning in future studies.

Clinical applications of machine learning in predicting 3D shapes of the human body: a systematic review

BACKGROUND

Predicting morphological changes to anatomical structures from 3D shapes such as blood vessels or appearance of the face is a growing interest to clinicians. Machine learning (ML) has had great success driving predictions in 2D, however, methods suitable for 3D shapes are unclear and the use cases unknown.

OBJECTIVE AND METHODS

This systematic review aims to identify the clinical implementation of 3D shape prediction and ML workflows. Ovid-MEDLINE, Embase, Scopus and Web of Science were searched until 28th March 2022.

RESULTS

13,754 articles were identified, with 12 studies meeting final inclusion criteria. These studies involved prediction of the face, head, aorta, forearm, and breast, with most aiming to visualize shape changes after surgical interventions. ML algorithms identified were regressions (67%), artificial neural networks (25%), and principal component analysis (8%). Meta-analysis was not feasible due to the heterogeneity of the outcomes.

CONCLUSION

3D shape prediction is a nascent but growing area of research in medicine. This review revealed the feasibility of predicting 3D shapes using ML clinically, which could play an important role for clinician-patient visualization and communication. However, all studies were early phase and there were inconsistent language and reporting. Future work could develop guidelines for publication and promote open sharing of source code.

Precision medicine using patient-specific modelling: state of the art and perspectives in dental practice

The dental practice has largely evolved in the last 50 years following a better understanding of the biomechanical behaviour of teeth and its supporting structures, as well as developments in the fields of imaging and biomaterials. However, many patients still encounter treatment failures; this is related to the complex nature of evaluating the biomechanical aspects of each clinical situation due to the numerous patient-specific parameters, such as occlusion and root anatomy. In parallel, the advent of cone beam computed tomography enabled researchers in the field of odontology as well as clinicians to gather and model patient data with sufficient accuracy using image processing and finite element technologies. These developments gave rise to a new precision medicine concept that proposes to individually assess anatomical and biomechanical characteristics and adapt treatment options accordingly. While this approach is already applied in maxillofacial surgery, its implementation in dentistry is still restricted. However, recent advancements in artificial intelligence make it possible to automate several parts of the laborious modelling task, bringing such user-assisted decision-support tools closer to both clinicians and researchers. Therefore, the present narrative review aimed to present and discuss the current literature investigating patient-specific modelling in dentistry, its state-of-the-art applications, and research perspectives.

Performance of Artificial Intelligence Models Designed for Diagnosis, Treatment Planning and Predicting Prognosis of Orthognathic Surgery (OGS)—A Scoping Review

The technological advancements in the field of medical science have led to an escalation in the development of artificial intelligence (AI) applications, which are being extensively used in health sciences. This scoping review aims to outline the application and performance of artificial intelligence models used for diagnosing, treatment planning and predicting the prognosis of orthognathic surgery (OGS). Data for this paper was searched through renowned electronic databases such as PubMed, Google Scholar, Scopus, Web of science, Embase and Cochrane for articles related to the research topic that have been published between January 2000 and February 2022. Eighteen articles that met the eligibility criteria were critically analyzed based on QUADAS-2 guidelines and the certainty of evidence of the included studies was assessed using the GRADE approach. AI has been applied for predicting the post-operative facial profiles and facial symmetry, deciding on the need for OGS, predicting perioperative blood loss, planning OGS, segmentation of maxillofacial structures for OGS, and differential diagnosis of OGS. AI models have proven to be efficient and have outperformed the conventional methods. These models are reported to be reliable and reproducible, hence they can be very useful for less experienced practitioners in clinical decision making and in achieving better clinical outcomes.

Growth patterns and shape development of the paediatric mandible – A 3D statistical model

Background/aim

To develop a 3D morphable model of the normal paediatric mandible to analyse shape development and growth patterns for males and females.

Methods

Computed tomography (CT) data was collected for 242 healthy children referred for CT scan between 2011 and 2018 aged between 0 and 47 months (mean, 20.6 ± 13.4 months, 59.9% male). Thresholding techniques were used to segment the mandible from the CT scans. All mandible meshes were annotated using a defined set of 52 landmarks and processed such that all meshes followed a consistent triangulation. Following this, the mandible meshes were rigidly aligned to remove translation and rotation effects, while size effects were retained. Principal component analysis (PCA) was applied to the processed meshes to construct a generative 3D morphable model. Partial least squares (PLS) regression was also applied to the processed data to extract the shape modes with which to evaluate shape differences for age and sex. Growth curves were constructed for anthropometric measurements.

Results

A 3D morphable model of the paediatric mandible was constructed and validated with good generalisation, compactness, and specificity. Growth curves of the assessed anthropometric measurements were plotted without significant differences between male and female subjects. The first principal component was dominated by size effects and is highly correlated with age at time of scan (Spearman's r = 0.94, p < 0.01). As with PCA, the first extracted PLS mode captures much of the size variation within the dataset and is highly correlated with age (Spearman's r = −0.94, p < 0.01). Little correlation was observed between extracted shape modes and sex with either PCA or PLS for this study population.

Conclusion

The presented 3D morphable model of the paediatric mandible enables an understanding of mandibular shape development and variation by age and sex. It allowed for the construction of growth curves, which contains valuable information that can be used to enhance our understanding of various disorders that affect the mandibular development. Knowledge of shape changes in the growing mandible has potential to improve diagnostic accuracy for craniofacial conditions that impact the mandibular morphology, objective evaluation, surgical planning, and patient follow-up.

•

Shape and development patterns of the paediatric mandible (0 – 4 years) were evaluated using a dataset of 242 CT scans.

•

A 3D morphable model of the paediatric mandible was constructed using principal component analysis (PCA).

•

Validation experiments demonstrated that the 3D morphable model can produce realistic novel mandible samples.

•

Partial least squares (PLS) regression was applied to the dataset to evaluate shape differences for age and sex.

•

The first shape model correlated strongly with age for PCA and PLS, though little correlation was seen between shape and sex.

Advancing pharmacy and healthcare with virtual digital technologies

Digitalisation of the healthcare sector promises to revolutionise patient healthcare globally. From the different technologies, virtual tools including artificial intelligence, blockchain, virtual, and augmented reality, to name but a few, are providing significant benefits to patients and the pharmaceutical sector alike, ranging from improving access to clinicians and medicines, as well as improving real-time diagnoses and treatments. Indeed, it is envisioned that such technologies will communicate together in real-time, as well as with their physical counterparts, to create a large-scale, cyber healthcare system. Despite the significant benefits that virtual-based digital health technologies can bring to patient care, a number of challenges still remain, ranging from data security to acceptance within the healthcare sector. This review provides a timely account of the benefits and challenges of virtual health interventions, as well an outlook on how such technologies can be transitioned from research-focused towards real-world healthcare and pharmaceutical applications to transform treatment pathways for patients worldwide.

Convolutional mesh autoencoders for the 3-dimensional identification of FGFR-related craniosynostosis

Clinical diagnosis of craniofacial anomalies requires expert knowledge. Recent studies have shown that artificial intelligence (AI) based facial analysis can match the diagnostic capabilities of expert clinicians in syndrome identification. In general, these systems use 2D images and analyse texture and colour. They are powerful tools for photographic analysis but are not suitable for use with medical imaging modalities such as ultrasound, MRI or CT, and are unable to take shape information into consideration when making a diagnostic prediction. 3D morphable models (3DMMs), and their recently proposed successors, mesh autoencoders, analyse surface topography rather than texture enabling analysis from photography and all common medical imaging modalities and present an alternative to image-based analysis. We present a craniofacial analysis framework for syndrome identification using Convolutional Mesh Autoencoders (CMAs). The models were trained using 3D photographs of the general population (LSFM and LYHM), computed tomography data (CT) scans from healthy infants and patients with 3 genetically distinct craniofacial syndromes (Muenke, Crouzon, Apert). Machine diagnosis outperformed expert clinical diagnosis with an accuracy of 99.98%, sensitivity of 99.95% and specificity of 100%. The diagnostic precision of this technique supports its potential inclusion in clinical decision support systems. Its reliance on 3D topography characterisation make it suitable for AI assisted diagnosis in medical imaging as well as photographic analysis in the clinical setting.

Application of machine learning in oral and maxillofacial surgery

Oral and maxillofacial anatomy is extremely complex, and medical imaging is critical in the diagnosis and treatment of soft and bone tissue lesions. Hence, there exists accumulating imaging data without being properly utilized over the last decades. As a result, problems are emerging regarding how to integrate and interpret a large amount of medical data and alleviate clinicians’ workload. Recently, artificial intelligence has been developing rapidly to analyze complex medical data, and machine learning is one of the specific methods of achieving this goal, which is based on a set of algorithms and previous results. Machine learning has been considered useful in assisting early diagnosis, treatment planning, and prognostic estimation through extracting key features and building mathematical models by computers. Over the past decade, machine learning techniques have been applied to the field of oral and maxillofacial surgery and increasingly achieved expert-level performance. Thus, we hold a positive attitude towards developing machine learning for reducing the number of medical errors, improving the quality of patient care, and optimizing clinical decision-making in oral and maxillofacial surgery. In this review, we explore the clinical application of machine learning in maxillofacial cysts and tumors, maxillofacial defect reconstruction, orthognathic surgery, and dental implant and discuss its current problems and solutions.

The 3D skull 0-4 years: A validated, generative, statistical shape model

Background

This study aims to capture the 3D shape of the human skull in a healthy paediatric population (0-4 years old) and construct a generative statistical shape model.

Methods

The skull bones of 178 healthy children (55% male, 20.8 ± 12.9 months) were reconstructed from computed tomography (CT) images. 29 anatomical landmarks were placed on the 3D skull reconstructions. Rotation, translation and size were removed, and all skull meshes were placed in dense correspondence using a dimensionless skull mesh template and a non-rigid iterative closest point algorithm. A 3D morphable model (3DMM) was created using principal component analysis, and intrinsically and geometrically validated with anthropometric measurements. Synthetic skull instances were generated exploiting the 3DMM and validated by comparison of the anthropometric measurements with the selected input population.

Results

The 3DMM of the paediatric skull 0-4 years was successfully constructed. The model was reasonably compact - 90% of the model shape variance was captured within the first 10 principal components. The generalisation error, quantifying the ability of the 3DMM to represent shape instances not encountered during training, was 0.47 mm when all model components were used. The specificity value was <0.7 mm demonstrating that novel skull instances generated by the model are realistic. The 3DMM mean shape was representative of the selected population (differences <2%). Overall, good agreement was observed in the anthropometric measures extracted from the selected population, and compared to normative literature data (max difference in the intertemporal distance) and to the synthetic generated cases.

Conclusion

This study presents a reliable statistical shape model of the paediatric skull 0-4 years that adheres to known skull morphometric measures, can accurately represent unseen skull samples not used during model construction and can generate novel realistic skull instances, thus presenting a solution to limited availability of normative data in this field.

Virtual Surgical Planning: Modeling from the Present to the Future

Virtual surgery planning is a non-invasive procedure, which uses digital clinical data for diagnostic, procedure selection and treatment planning purposes, including the forecast of potential outcomes. The technique begins with 3D data acquisition, using various methods, which may or may not utilize ionizing radiation, such as 3D stereophotogrammetry, 3D cone-beam CT scans, etc. Regardless of the imaging technique selected, landmark selection, whether it is manual or automated, is the key to transforming clinical data into objects that can be interrogated in virtual space. As a prerequisite, the data require alignment and correspondence such that pre- and post-operative configurations can be compared in real and statistical shape space. In addition, these data permit predictive modeling, using either model-based, data-based or hybrid modeling. These approaches provide perspectives for the development of customized surgical procedures and medical devices with accuracy, precision and intelligence. Therefore, this review briefly summarizes the current state of virtual surgery planning.

Three-dimensional simulation of aesthetic outcome from breast-conserving surgery compared with viewing photographs or standard care: randomized clinical trial

INTRODUCTION

Over half of women with surgically managed breast cancer in the UK undergo breast-conserving treatment (BCT). While photographs are shown prior to reconstructive surgery or complex oncoplastic procedures, standard practice prior to breast conservation is to simply describe the likely aesthetic changes. Patients have expressed the desire for more personalized information about likely appearance after surgery. The hypothesis was that viewing a three-dimensional (3D) simulation improves patients' confidence in knowing their likely aesthetic outcome after surgery.

METHODS

A randomized, controlled trial of 117 women planning unilateral BCT was undertaken. The randomization was three-way: standard of care (verbal description alone, control group), viewing two-dimensional (2D) photographs, or viewing a 3D simulation before surgery. The primary endpoint was the comparison between groups' median answer on a visual analogue scale (VAS) for the question administered before surgery: 'How confident are you that you know how your breasts are likely to look after treatment?'

RESULTS

The median VAS in the control group was 5.2 (i.q.r. 2.6-7.8); 8.0 (i.q.r. 5.7-8.7) for 2D photography, and 8.9 (i.q.r. 8.2-9.5) for 3D simulation. There was a significant difference between groups (P < 0.010) with post-hoc pairwise comparisons demonstrating a statistically significant difference between 3D simulation and both standard care and viewing 2D photographs (P < 0.010 and P = 0.012, respectively).

CONCLUSION

This RCT has demonstrated that women who viewed an individualized 3D simulation of likely aesthetic outcome for BCT were more confident going into surgery than those who received standard care or who were shown 2D photographs of other women. The impact on longer-term satisfaction with outcome remains to be determined.Registration number: NCT03250260 (http://www.clinicaltrials.gov).

Maxillary Changes Following Facial Bipartition - A Three-Dimensional Quantification

INTRODUCTION

Children with Apert syndrome have hypertelorism and midfacial hypoplasia, which can be treated with facial bipartition (FB), often aided by rigid external distraction. The technique involves a midline osteotomy that lateralizes the maxillary segments, resulting in posterior cross-bites and midline diastema. Varying degrees of spontaneous realignment of the dental arches occurs postoperatively. This study aims to quantify these movements and assess whether they occur as part of a wider skeletal relapse or as dental compensation.

METHODS

Patients who underwent FB and had high quality computed tomography scans at the preoperative stage, immediately postsurgery, and later postoperatively were reviewed. DICOM files were converted to three-dimensional bone meshes and anatomical point-to-point displacements were quantified using nonrigid iterative closest point registration. Displacements were visualized using arrow maps, thereby providing an overview of the movements of the facial skeleton and dentition.

RESULTS

Five patients with Apert syndrome were included. In all cases, the arrow maps demonstrated initial significant anterior movement of the frontofacial segment coupled with medial rotation of the orbits and transverse divergence of the maxillary arches. The bony position following initial surgery was shown to be largely stable, with primary dentoalveolar relapse correcting the dental alignment.

CONCLUSIONS

This study showed that spontaneous dental compensation occurs following FB without compromising the surgical result. It may be appropriate to delay active orthodontic for 6-months postoperatively until completion of this early compensatory phase.

A Case of Complex Facial Reconstruction Illuminates Paul Tessier's Surgical State of Mind

ABSTRACT

Successful head and neck reconstructions tackle both morphological and functional issues within treatment plans involving multiple coordinated steps. Nowadays, biomaterials, computer-assisted surgery, and free tissue transfers have greatly increased the potentialities of craniofacial surgeons. In the 1970s, when Paul Tessier, one of the founders of modern plastic surgery, was at the peak of his career, complex reconstructions had little technology to rely on. Here we report a case of facial reconstruction after gunshot trauma performed by Paul Tessier based on his "craniofacial autarchy" principle, that is using solely local flaps and grafts harvested in the head and neck area. This case involved 30 procedures on the mandible, maxilla, chin, lips, and nose. Based on data from the archives from the "Association Française des Chirurgiens de la Face" (Amiens, France) we provide details on Tessier's approach to surgical planning and on his global conception of treatment plans in reconstructive surgery.

A review on patient-specific facial and cranial implant design using Artificial Intelligence (AI) techniques

INTRODUCTION

Researchers and engineers have found their importance in healthcare industry including recent updates in patient-specific implant (PSI) design. CAD/CAM technology plays an important role in the design and development of Artificial Intelligence (AI) based implants.The across the globe have their interest focused on the design and manufacturing of AI-based implants in everyday professional use can decrease the cost, improve patient's health and increase efficiency, and thus many implant designers and manufacturers practice.

AREAS COVERED

The focus of this study has been to manufacture smart devices that can make contact with the world as normal people do, understand their language, and learn to improve from real-life examples. Machine learning can be guided using a heavy amount of data sets and algorithms that can improve its ability to learn to perform the task. In this review, artificial intelligence (AI), deep learning, and machine-learning techniques are studied in the design of biomedical implants.

EXPERT OPINION

The main purpose of this article was to highlight important AI techniques to design PSIs. These are the automatic techniques to help designers to design patient-specific implants using AI algorithms such as deep learning, machine learning, and some other automatic methods.

Local Soft Tissue and Bone Displacements Following Midfacial Bipartition Distraction in Apert Syndrome - Quantification Using a Semi-Automated Method

ABSTRACT

Patients with Apert syndrome experience midfacial hypoplasia, hypertelorism, and downslanting palpebral fissures which can be corrected by midfacial bipartition distraction with rigid external distraction device. Quantitative studies typically focus on quantifying rigid advancement and rotation postdistraction, but intrinsic shape changes of bone and soft tissue remain unknown. This study presents a method to quantify these changes. Pre- and post-operative computed tomography scans from patients with Apert syndrome undergoing midfacial bipartition distraction with rigid external distraction device were collected. Digital Imaging and Communications in Medicine files were converted to three-dimensional bone and soft tissue reconstructions. Postoperative reconstructions were aligned on the preoperative maxilla, followed by nonrigid iterative closest point transformation to determine local shape changes. Anatomical point-to-point displacements were calculated and visualized using a heatmap and arrow map. Nine patients were included.Zygomatic arches and frontal bone demonstrated the largest changes. Mid-lateral to supra-orbital rim showed an upward, inward motion. Mean bone displacements ranged from 3.3 to 12.8 mm. Soft tissue displacements were relatively smaller, with greatest changes at the lateral canthi. Midfacial bipartition distraction with rigid external distraction device results in upward, inward rotation of the orbits, upward rotation of the zygomatic arch, and relative posterior motion of the frontal bone. Local movements were successfully quantified using a novel method, which can be applied to other surgical techniques/syndromes.

Shape My Face: Registering 3D Face Scans by Surface-to-Surface Translation

Standard registration algorithms need to be independently applied to each surface to register, following careful pre-processing and hand-tuning. Recently, learning-based approaches have emerged that reduce the registration of new scans to running inference with a previously-trained model. The potential benefits are multifold: inference is typically orders of magnitude faster than solving a new instance of a difficult optimization problem, deep learning models can be made robust to noise and corruption, and the trained model may be re-used for other tasks, e.g. through transfer learning. In this paper, we cast the registration task as a surface-to-surface translation problem, and design a model to reliably capture the latent geometric information directly from raw 3D face scans. We introduce Shape-My-Face (SMF), a powerful encoder-decoder architecture based on an improved point cloud encoder, a novel visual attention mechanism, graph convolutional decoders with skip connections, and a specialized mouth model that we smoothly integrate with the mesh convolutions. Compared to the previous state-of-the-art learning algorithms for non-rigid registration of face scans, SMF only requires the raw data to be rigidly aligned (with scaling) with a pre-defined face template. Additionally, our model provides topologically-sound meshes with minimal supervision, offers faster training time, has orders of magnitude fewer trainable parameters, is more robust to noise, and can generalize to previously unseen datasets. We extensively evaluate the quality of our registrations on diverse data. We demonstrate the robustness and generalizability of our model with in-the-wild face scans across different modalities, sensor types, and resolutions. Finally, we show that, by learning to register scans, SMF produces a hybrid linear and non-linear morphable model. Manipulation of the latent space of SMF allows for shape generation, and morphing applications such as expression transfer in-the-wild. We train SMF on a dataset of human faces comprising 9 large-scale databases on commodity hardware.

Disrupting 3D printing of medicines with machine learning

3D printing (3DP) is a progressive technology capable of transforming pharmaceutical development. However, despite its promising advantages, its transition into clinical settings remains slow. To make the vital leap to mainstream clinical practice and improve patient care, 3DP must harness modern technologies. Machine learning (ML), an influential branch of artificial intelligence, may be a key partner for 3DP. Together, 3DP and ML can utilise intelligence based on human learning to accelerate drug product development, ensure stringent quality control (QC), and inspire innovative dosage-form design. With ML's capabilities, streamlined 3DP drug delivery could mark the next era of personalised medicine. This review details how ML can be applied to elevate the 3DP of pharmaceuticals and importantly, how it can expedite 3DP's integration into mainstream healthcare.

Machine Learning Demonstrates High Accuracy for Disease Diagnosis and Prognosis in Plastic Surgery

INTRODUCTION

Machine learning (ML) is a set of models and methods that can detect patterns in vast amounts of data and use this information to perform various kinds of decision-making under uncertain conditions. This review explores the current role of this technology in plastic surgery by outlining the applications in clinical practice, diagnostic and prognostic accuracies, and proposed future direction for clinical applications and research.

METHODS

EMBASE, MEDLINE, CENTRAL and ClinicalTrials.gov were searched from 1990 to 2020. Any clinical studies (including case reports) which present the diagnostic and prognostic accuracies of machine learning models in the clinical setting of plastic surgery were included. Data collected were clinical indication, model utilised, reported accuracies, and comparison with clinical evaluation.

RESULTS

The database identified 1181 articles, of which 51 articles were included in this review. The clinical utility of these algorithms was to assist clinicians in diagnosis prediction (n=22), outcome prediction (n=21) and pre-operative planning (n=8). The mean accuracy is 88.80%, 86.11% and 80.28% respectively. The most commonly used models were neural networks (n=31), support vector machines (n=13), decision trees/random forests (n=10) and logistic regression (n=9).

CONCLUSIONS

ML has demonstrated high accuracies in diagnosis and prognostication of burn patients, congenital or acquired facial deformities, and in cosmetic surgery. There are no studies comparing ML to clinician's performance. Future research can be enhanced using larger datasets or utilising data augmentation, employing novel deep learning models, and applying these to other subspecialties of plastic surgery.

An Artificial Intelligence Tool for Image Simulation in Rhinoplasty

During rhinoplasty consultations, surgeons typically create a computer simulation of the expected result. An artificial intelligence model (AIM) can learn a surgeon's style and criteria and generate the simulation automatically. The objective of this study is to determine if an AIM is capable of imitating a surgeon's criteria to generate simulated images of an aesthetic rhinoplasty surgery. This is a cross-sectional survey study of resident and specialist doctors in otolaryngology conducted in the month of November 2019 during a rhinoplasty conference. Sequential images of rhinoplasty simulations created by a surgeon and by an AIM were shown at random. Participants used a seven-point Likert scale to evaluate their level of agreement with the simulation images they were shown, with 1 indicating total disagreement and 7 total agreement. Ninety-seven of 122 doctors agreed to participate in the survey. The median level of agreement between the participant and the surgeon was 6 (interquartile range or IQR 5-7); between the participant and the AIM it was 5 (IQR 4-6), p-value < 0.0001. The evaluators were in total or partial agreement with the results of the AIM's simulation 68.4% of the time (95% confidence interval or CI 64.9-71.7). They were in total or partial agreement with the surgeon's simulation 77.3% of the time (95% CI 74.2-80.3). An AIM can emulate a surgeon's aesthetic criteria to generate a computer-simulated image of rhinoplasty. This can allow patients to have a realistic approximation of the possible results of a rhinoplasty ahead of an in-person consultation. The level of evidence of the study is 4.

A Role for Artificial Intelligence in the Classification of Craniofacial Anomalies

ABSTRACT

Development of an objective algorithm to diagnose and assess craniofacial conditions has the potential to facilitate early diagnosis, especially for care providers with limited craniofacial expertise. Deep learning, a branch of artificial intelligence, can automatically analyze and categorize disease without human assistance. Convolutional neural networks (CNN) have excelled in utilizing medical images to automatically classify disease. In this study, the authors developed CNN models to detect and classify non-syndromic craniosynostosis (CS) using 2D images. The authors created an annotated data set of labeled CS (normal, metopic, sagittal, and unicoronal) conditions using standard clinical photography from the image repository at our center. The authors extended this dataset set by adding photographic images of children with craniofacial conditions from the internet. A total of 1076 images were used in this study. The authors developed a CNN model using a pre-trained ResNet-50 model to classify the data as metopic, sagittal, and unicoronal. The testing accuracy for the CS ResNet50 model achieved an overall testing accuracy of 90.6%. The sensitivity and precision were: 100% and 100% for metopic, 93.3% and 100% for sagittal, and 66.7% and 100% for unicoronal, respectively. The CNN model performed with promising accuracy. These results support the idea that deep learning has a role in diagnosis of craniofacial conditions. Using standard 2D clinical photography, such systems can provide automated screening and detection of these conditions. In the future, ML may be applied to prediction and assessment of surgical outcomes, or as an open-source remote diagnostic resource.

Three-dimensional virtual planning in mandibular advancement surgery: Soft tissue prediction based on deep learning

The study aimed at developing a deep-learning (DL)-based algorithm to predict the virtual soft tissue profile after mandibular advancement surgery, and to compare its accuracy with the mass tensor model (MTM). Subjects who underwent mandibular advancement surgery were enrolled and divided into a training group and a test group. The DL model was trained using 3D photographs and CBCT data based on surgically achieved mandibular displacements (training group). Soft tissue simulations generated by DL and MTM based on the actual surgical jaw movements (test group) were compared with soft-tissue profiles on postoperative 3D photographs using distance mapping in terms of mean absolute error in the lower face, lower lip, and chin regions. 133 subjects were included - 119 in the training group and 14 in the test group. The mean absolute error for DL-based simulations of the lower face region was 1.0 ± 0.6 mm and was significantly lower (p = 0.02) compared with MTM-based simulations (1.5 ± 0.5 mm). CONCLUSION: The DL-based algorithm can predict 3D soft tissue profiles following mandibular advancement surgery. With a clinically acceptable mean absolute error. Therefore, it seems to be a relevant option for soft tissue prediction in orthognathic surgery. Therefore, it seems to be a relevant options.

Validating machine learning approaches for prediction of donor related complication in microsurgical breast reconstruction: a retrospective cohort study

Autologous reconstruction using abdominal flaps remains the most popular method for breast reconstruction worldwide. We aimed to evaluate a prediction model using machine-learning methods and to determine which factors increase abdominal flap donor site complications with logistic regression. We evaluated the predictive ability of different machine learning packages, reviewing a cohort of breast reconstruction patients who underwent abdominal flaps. We analyzed 13 treatment variables for effects on the abdominal donor site complication rates. To overcome data imbalances, random over sampling example (ROSE) method was used. Data were divided into training and testing sets. Prediction accuracy, sensitivity, specificity, and predictive power (AUC) were measured by applying neuralnet, nnet, and RSNNS machine learning packages. A total of 568 patients were analyzed. The supervised learning package that performed the most effective prediction was neuralnet. Factors that significantly affected donor-related complication was size of the fascial defect, history of diabetes, muscle sparing type, and presence or absence of adjuvant chemotherapy. The risk cutoff value for fascial defect was 37.5 cm². High-risk group complication rates analyzed by statistical method were significant compared to the low-risk group (26% vs 1.7%). These results may help surgeons to achieve better surgical outcomes and reduce postoperative burden.

The role of artificial intelligence in surgical patient perioperative management

Perioperative medicine is a patient-centered, multidisciplinary and integrated clinical practice that starts from the moment of contemplation of surgery until full recovery. Every perioperative phase (preoperative, intraoperative and postoperative) must be studied and planned in order to optimize the entire patient management. Perioperative optimization does not only concern a short-term outcome improvement, but it has also a strong impact on long term survival. Clinical cases variability leads to the collection and analysis of a huge amount of different data, coming from multiple sources, making perioperative management standardization very difficult. Artificial Intelligence (AI) can play a primary role in this challenge, helping human mind in perioperative practice planning and decision-making process. AI refers to the ability of a computer system to perform functions and reasoning typical of the human mind; Machine Learning (ML) could play a fundamental role in presurgical planning, during intraoperative phase and postoperative management. Perioperative medicine is the cornerstone of surgical patient management and the tools deriving from the application of AI seem very promising as a support in optimizing the management of each individual patient. Despite the increasing help that will derive from the use of AI tools, the uniqueness of the patient and the particularity of each individual clinical case will always keep the role of the human mind central in clinical and perioperative management. The role of the physician, who must analyze the outputs provided by AI by following his own experience and knowledge, remains and will always be essential.

Artificial Intelligence in Plastic Surgery: Current Applications, Future Directions, and Ethical Implications

Background:

Artificial intelligence (AI) in healthcare delivery has become an important area of research due to the rapid progression of technology, which has allowed the growth of many processes historically reliant upon human input. AI has become particularly important in plastic surgery in a variety of settings. This article highlights current applications of AI in plastic surgery and discusses future implications. We further detail ethical issues that may arise in the implementation of AI in plastic surgery.

Methods:

We conducted a systematic literature review of all electronically available publications in the PubMed, Scopus, and Web of Science databases as of February 5, 2020. All returned publications regarding the application of AI in plastic surgery were considered for inclusion.

Results:

Of the 89 novel articles returned, 14 satisfied inclusion and exclusion criteria. Articles procured from the references of those of the database search and those pertaining to historical and ethical implications were summarized when relevant.

Conclusions:

Numerous applications of AI exist in plastic surgery. Big data, machine learning, deep learning, natural language processing, and facial recognition are examples of AI-based technology that plastic surgeons may utilize to advance their surgical practice. Like any evolving technology, however, the use of AI in healthcare raises important ethical issues, including patient autonomy and informed consent, confidentiality, and appropriate data use. Such considerations are significant, as high ethical standards are key to appropriate and longstanding implementation of AI.

Using machine learning to construct nomograms for patients with metastatic colon cancer

AIM

Patients with synchronous colon cancer metastases have highly variable overall survival (OS), making accurate predictive models challenging to build. We aim to use machine learning to more accurately predict OS in these patients and to present this predictive model in the form of nomograms for patients and clinicians.

METHODS

Using the National Cancer Database (2010-2014), we identified right colon (RC) and left colon (LC) cancer patients with synchronous metastases. Each primary site was split into training and testing datasets. Nomograms predicting 3- year OS were created for each site using Cox proportional hazard regression with lasso regression. Each model was evaluated by both calibration (comparison of predicted vs observed OS) and validation (degree of concordance as measured by the c-index) methodologies.

RESULTS

A total of 11 018 RC and 8346 LC patients were used to construct and validate the nomograms. After stratifying each model into five risk groups, the predicted OS was within the 95% CI of the observed OS in four out of five risk groups for both the RC and LC models. Externally validated c-indexes at 3 years for the RC and LC models were 0.794 and 0.761, respectively.

CONCLUSIONS

Utilization of machine learning can result in more accurate predictive models for patients with metastatic colon cancer. Nomograms built from these models can assist clinicians and patients in the shared decision-making process of their cancer care.

Current Applications, Opportunities, and Limitations of AI for 3D Imaging in Dental Research and Practice

The increasing use of three-dimensional (3D) imaging techniques in dental medicine has boosted the development and use of artificial intelligence (AI) systems for various clinical problems. Cone beam computed tomography (CBCT) and intraoral/facial scans are potential sources of image data to develop 3D image-based AI systems for automated diagnosis, treatment planning, and prediction of treatment outcome. This review focuses on current developments and performance of AI for 3D imaging in dentomaxillofacial radiology (DMFR) as well as intraoral and facial scanning. In DMFR, machine learning-based algorithms proposed in the literature focus on three main applications, including automated diagnosis of dental and maxillofacial diseases, localization of anatomical landmarks for orthodontic and orthognathic treatment planning, and general improvement of image quality. Automatic recognition of teeth and diagnosis of facial deformations using AI systems based on intraoral and facial scanning will very likely be a field of increased interest in the future. The review is aimed at providing dental practitioners and interested colleagues in healthcare with a comprehensive understanding of the current trend of AI developments in the field of 3D imaging in dental medicine.