1
|
Fung E, Patel D, Tatum S. Artificial intelligence in maxillofacial and facial plastic and reconstructive surgery. Curr Opin Otolaryngol Head Neck Surg 2024; 32:257-262. [PMID: 38837245 DOI: 10.1097/moo.0000000000000983] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/07/2024]
Abstract
PURPOSE OF REVIEW To provide a current review of artificial intelligence and its subtypes in maxillofacial and facial plastic surgery including a discussion of implications and ethical concerns. RECENT FINDINGS Artificial intelligence has gained popularity in recent years due to technological advancements. The current literature has begun to explore the use of artificial intelligence in various medical fields, but there is limited contribution to maxillofacial and facial plastic surgery due to the wide variance in anatomical facial features as well as subjective influences. In this review article, we found artificial intelligence's roles, so far, are to automatically update patient records, produce 3D models for preoperative planning, perform cephalometric analyses, and provide diagnostic evaluation of oropharyngeal malignancies. SUMMARY Artificial intelligence has solidified a role in maxillofacial and facial plastic surgery within the past few years. As high-quality databases expand with more patients, the role for artificial intelligence to assist in more complicated and unique cases becomes apparent. Despite its potential, ethical questions have been raised that should be noted as artificial intelligence continues to thrive. These questions include concerns such as compromise of the physician-patient relationship and healthcare justice.
Collapse
Affiliation(s)
| | | | - Sherard Tatum
- Department of Otolaryngology
- Department of Pediatrics, SUNY Upstate Medical University, Syracuse, New York, USA
| |
Collapse
|
2
|
Zhu C, Attaluri PK, Wirth PJ, Shaffrey EC, Friedrich JB, Rao VK. Current Applications of Artificial Intelligence in Billing Practices and Clinical Plastic Surgery. PLASTIC AND RECONSTRUCTIVE SURGERY-GLOBAL OPEN 2024; 12:e5939. [PMID: 38957712 PMCID: PMC11216662 DOI: 10.1097/gox.0000000000005939] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2024] [Accepted: 05/10/2024] [Indexed: 07/04/2024]
Abstract
Integration of artificial intelligence (AI), specifically with natural language processing and machine learning, holds tremendous potential to enhance both clinical practices and administrative workflows within plastic surgery. AI has been applied to various aspects of patient care in plastic surgery, including postoperative free flap monitoring, evaluating preoperative risk assessments, and analyzing clinical documentation. Previous studies have demonstrated the ability to interpret current procedural terminology codes from clinical documentation using natural language processing. Various automated medical billing companies have used AI to improve the revenue management cycle at hospitals nationwide. Additionally, AI has been piloted by insurance companies to streamline the prior authorization process. AI implementation holds potential to enhance billing practices and maximize healthcare revenue for practicing physicians.
Collapse
Affiliation(s)
- Christina Zhu
- From the Division of Plastic and Reconstructive Surgery, University of Wisconsin School of Medicine and Public Health, Madison, Wis
- Texas Tech University Health Sciences Center School of Medicine, Lubbock, Tex
| | - Pradeep K Attaluri
- From the Division of Plastic and Reconstructive Surgery, University of Wisconsin School of Medicine and Public Health, Madison, Wis
| | - Peter J Wirth
- From the Division of Plastic and Reconstructive Surgery, University of Wisconsin School of Medicine and Public Health, Madison, Wis
| | - Ellen C Shaffrey
- From the Division of Plastic and Reconstructive Surgery, University of Wisconsin School of Medicine and Public Health, Madison, Wis
| | | | - Venkat K Rao
- From the Division of Plastic and Reconstructive Surgery, University of Wisconsin School of Medicine and Public Health, Madison, Wis
| |
Collapse
|
3
|
Kenig N, Monton Echeverria J, Rubi C. Ethics for AI in Plastic Surgery: Guidelines and Review. Aesthetic Plast Surg 2024; 48:2204-2209. [PMID: 38456892 DOI: 10.1007/s00266-024-03932-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Accepted: 02/09/2024] [Indexed: 03/09/2024]
Abstract
INTRODUCTION Artificial intelligence (AI) holds the potential to revolutionize medicine, offering vast improvements for plastic surgery. While human physicians are limited to one lifetime of experience, AI is poised to soon surpass human capabilities, as it draws on limitless information and continuous learning abilities. Nevertheless, as AI becomes increasingly prevalent in this domain, it gives rise to critical ethical considerations that must be addressed by professionals. MATERIALS AND METHODS This work reviews the literature referring to the ethical challenges brought on by the ever-expanding use of AI in plastic surgery and offers guidelines for its application. RESULTS Ethical challenges include the disclosure of use of AI by caregivers, validation of decision-making, data privacy, informed consent and autonomy, potential biases in AI systems, the opaque nature of AI models, questions of liability, and the need for regulations. CONCLUSIONS There is a lack of consensus for the ethical use of AI in plastic surgery. Guidelines, such as those presented in this work, are needed within each discipline of medicine to respond to important ethical considerations for the safe use of AI. LEVEL OF EVIDENCE V This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .
Collapse
Affiliation(s)
- Nitzan Kenig
- Instituto Rubi, Cami dels Reis, 308, 07010, Palma de Mallorca, Spain.
| | | | - Carlos Rubi
- Instituto Rubi, Cami dels Reis, 308, 07010, Palma de Mallorca, Spain
| |
Collapse
|
4
|
Grippaudo F, Nigrelli S, Patrignani A, Ribuffo D. Quality of the Information provided by ChatGPT for Patients in Breast Plastic Surgery: Are we already in the future? JPRAS Open 2024; 40:99-105. [PMID: 38444627 PMCID: PMC10914413 DOI: 10.1016/j.jpra.2024.02.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Accepted: 02/04/2024] [Indexed: 03/07/2024] Open
Abstract
Introduction In recent years, artificial intelligence (AI) has gained popularity, even in the field of plastic surgery. It is increasingly common for patients to use the internet to gather information about plastic surgery, and AI-based chatbots, such as ChatGPT, could be employed to answer patients' questions.The aim of this study was to evaluate the quality of medical information provided by ChatGPT regarding three of the most common procedures in breast plastic surgery: breast reconstruction, breast reduction, and augmentation mammaplasty. Methods The quality of information was evaluated through the expanded EQIP scale. Responses were collected from a pool made by ten resident doctors in plastic surgery and then processed by SPSS software ver. 28.0. Results The analysis of the contents provided by ChatGPT revealed sufficient quality of information across all selected topics, with a high bias in terms of distribution of the score between the different items. There was a critical lack in the "Information data field" (0/6 score in all the 3 investigations) but a very high overall evaluation concerning the "Structure data" (>7/11 in all the 3 investigations). Conclusion Currently, AI serves as a valuable tool for patients; however, engineers and developers must address certain critical issues. It is possible that models like ChatGPT will play an important role in improving patient's consciousness about medical procedures and surgical interventions in the future, but their role must be considered ancillary to that of surgeons.
Collapse
Affiliation(s)
- F.R. Grippaudo
- Department of Plastic Reconstructive and Aesthetic Surgery, Policlinico Umberto I, Sapienza University of Rome, Viale del Policlinico 155, 00161, Rome, Italy
| | - S. Nigrelli
- Department of Plastic Reconstructive and Aesthetic Surgery, Policlinico Umberto I, Sapienza University of Rome, Viale del Policlinico 155, 00161, Rome, Italy
| | - A. Patrignani
- Department of Plastic Reconstructive and Aesthetic Surgery, Policlinico Umberto I, Sapienza University of Rome, Viale del Policlinico 155, 00161, Rome, Italy
| | - D. Ribuffo
- Department of Plastic Reconstructive and Aesthetic Surgery, Policlinico Umberto I, Sapienza University of Rome, Viale del Policlinico 155, 00161, Rome, Italy
| |
Collapse
|
5
|
Barone M, De Bernardis R, Persichetti P. Artificial Intelligence in Plastic Surgery: Analysis of Applications, Perspectives, and Psychological Impact. Aesthetic Plast Surg 2024:10.1007/s00266-024-03988-1. [PMID: 38472350 DOI: 10.1007/s00266-024-03988-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2024] [Accepted: 02/29/2024] [Indexed: 03/14/2024]
Abstract
Artificial intelligence (AI) is emerging as a promising tool in the field of plastic surgery, offering a wide array of applications that enhance surgical outcomes, patient satisfaction, and overall efficiency. This paper explores the utilization of AI, highlighting its various advantages and potential drawbacks. AI-driven technologies such as computer vision, machine learning algorithms, and robotic assistance facilitate preoperative planning, intraoperative guidance, and postoperative monitoring. These advancements enable precise anatomical measurements, personalized treatment plans, and real-time feedback during surgery, leading to improved accuracy and safety. Furthermore, AI-powered image analysis aids in facial recognition, skin texture assessment, and simulation of surgical outcomes, enabling enhanced patient consultations and predictive modeling. However, the integration of AI in plastic surgery also presents challenges, including ethical concerns, data privacy, algorithm biases, and the need for comprehensive training among healthcare professionals. Additionally, the reliance on AI systems may potentially lead to over-reliance or reduced surgeon autonomy, necessitating careful validation and continuous refinement of these technologies. Despite these challenges, the synergistic collaboration between AI and plastic surgery holds great promise in advancing clinical practice, fostering innovation, and ultimately benefiting patients through optimized esthetic and reconstructive outcomes.Level of Evidence V This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors https://www.springer.com/00266 .
Collapse
Affiliation(s)
- Mauro Barone
- Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200, 00128, Rome, Italy
| | - Riccardo De Bernardis
- Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200, 00128, Rome, Italy.
| | - Paolo Persichetti
- Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200, 00128, Rome, Italy
| |
Collapse
|
6
|
Fortune-Ely M, Achanta M, Song MS. The future of artificial intelligence in facial plastic surgery. JPRAS Open 2024; 39:89-92. [PMID: 38186379 PMCID: PMC10770469 DOI: 10.1016/j.jpra.2023.11.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Accepted: 11/26/2023] [Indexed: 01/09/2024] Open
Abstract
The role of artificial intelligence is emergent in facial plastic surgery. It offers specialists a potentially precise and efficient method of understanding our technical skills and pathways, and their impacts on patient outcomes and error rates. Algorithms have given life to personalised pre-operative assessment, surgical planning and outcome simulation, and post-operative monitoring. Despite these benefits, limitations at this time include the ethical acquisition of large datasets, biases produced by human input and trust in novel technologies. Careful consideration should be given to the role artificial intelligence may play in shaping the patient-surgeon relationship in the near future.
Collapse
Affiliation(s)
- Mariella Fortune-Ely
- Imperial College Healthcare NHS Trust, Department of Otolaryngology, Head and Neck Surgery, Imperial College Healthcare NHS Trust, Charing Cross Hospital, Fulham Palace Road, London, W6 8RF, United Kingdom
| | - Mohit Achanta
- Imperial College Healthcare NHS Trust, Department of Otolaryngology, Head and Neck Surgery, Imperial College Healthcare NHS Trust, Charing Cross Hospital, Fulham Palace Road, London, W6 8RF, United Kingdom
| | - Marie S.H. Song
- Guys and St Thomas NHS Foundation Trust, St Thomas Hospital, Westminster Bridge Road London, SE1 7EH, United Kingdom
| |
Collapse
|
7
|
Tuazon R, Mortezavi S. Automatic labeling of facial zones for digital clinical application: An ensemble of semantic segmentation models. Skin Res Technol 2024; 30:e13625. [PMID: 38385865 PMCID: PMC10883254 DOI: 10.1111/srt.13625] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2024] [Accepted: 02/05/2024] [Indexed: 02/23/2024]
Abstract
INTRODUCTION The application of artificial intelligence to facial aesthetics has been limited by the inability to discern facial zones of interest, as defined by complex facial musculature and underlying structures. Although semantic segmentation models (SSMs) could potentially overcome this limitation, existing facial SSMs distinguish only three to nine facial zones of interest. METHODS We developed a new supervised SSM, trained on 669 high-resolution clinical-grade facial images; a subset of these images was used in an iterative process between facial aesthetics experts and manual annotators that defined and labeled 33 facial zones of interest. RESULTS Because some zones overlap, some pixels are included in multiple zones, violating the one-to-one relationship between a given pixel and a specific class (zone) required for SSMs. The full facial zone model was therefore used to create three sub-models, each with completely non-overlapping zones, generating three outputs for each input image that can be treated as standalone models. For each facial zone, the output demonstrating the best Intersection Over Union (IOU) value was selected as the winning prediction. CONCLUSIONS The new SSM demonstrates mean IOU values superior to manual annotation and landmark analyses, and it is more robust than landmark methods in handling variances in facial shape and structure.
Collapse
|
8
|
Espinosa Reyes JA, Puerta Romero M, Cobo R, Heredia N, Solís Ruiz LA, Corredor Zuluaga DA. Artificial Intelligence in Facial Plastic and Reconstructive Surgery: A Systematic Review. Facial Plast Surg 2024. [PMID: 37992752 DOI: 10.1055/a-2216-5099] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2023] Open
Abstract
Artificial intelligence (AI) is a technology that is evolving rapidly and is changing the world and medicine as we know it. After reviewing the PROSPERO database of systematic reviews, there is no article related to this topic in facial plastic and reconstructive surgery. The objective of this article was to review the literature regarding AI applications in facial plastic and reconstructive surgery.A systematic review of the literature about AI in facial plastic and reconstructive surgery using the following keywords: Artificial Intelligence, robotics, plastic surgery procedures, and surgery plastic and the following databases: PubMed, SCOPUS, Embase, BVS, and LILACS. The inclusion criteria were articles about AI in facial plastic and reconstructive surgery. Articles written in a language other than English and Spanish were excluded. In total, 17 articles about AI in facial plastic met the inclusion criteria; after eliminating the duplicated papers and applying the exclusion criteria, these articles were reviewed thoroughly. The leading type of AI used in these articles was computer vision, explicitly using models of convolutional neural networks to objectively compare the preoperative with the postoperative state in multiple interventions such as facial lifting and facial transgender surgery.In conclusion, AI is a rapidly evolving technology, and it could significantly impact the treatment of patients in facial plastic and reconstructive surgery. Legislation and regulations are developing slower than this technology. It is imperative to learn about this topic as soon as possible and that all stakeholders proactively promote discussions about ethical and regulatory dilemmas.
Collapse
Affiliation(s)
- Jorge Alberto Espinosa Reyes
- Department of Otolaryngology and Facial Plastic & Reconstructive Surgery, The Face & Nose Institute, Private Practice Clínica INO, Bogotá, DC, Colombia
| | - Mauricio Puerta Romero
- Department of Otolaryngology and Facial Plastic & Reconstructive Surgery, Private Practice Clínica Sebastían de Belalcázar, Cali, Valle del Cauca, Colombia
| | - Roxana Cobo
- Department of Otolaryngology and Facial Plastic & Reconstructive Surgery, The Face & Nose Institute, Private Practice at Clínica Imbanaco, Cali, Valle del Cauca Colombia
| | - Nicolas Heredia
- Department of Otolaryngology and Facial Plastic & Reconstructive Surgery, The Face & Nose Institute, Bogotá, D.C, Colombia
| | - Luis Alberto Solís Ruiz
- Department of Otolaryngology and Facial Plastic & Reconstructive Surgery, Private Practice, Chihuahua, Chihuahua, México
| | - Diego Andres Corredor Zuluaga
- Department of Otolaryngology and Facial Plastic & Reconstructive Surgery, Private Practice, Pereira, Risaralda, Colombia
| |
Collapse
|
9
|
Hallock GR, Hallock GG. ChatEd.Mgr.com/SAP. Ann Plast Surg 2023; 91:632-633. [PMID: 37625099 DOI: 10.1097/sap.0000000000003672] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/27/2023]
Affiliation(s)
| | - Geoffrey G Hallock
- Division of Plastic Surgery, Sacred Heart Campus, St Luke's Hospital, Allentown, PA
| |
Collapse
|
10
|
Atiyeh B, Emsieh S, Hakim C, Chalhoub R. A Narrative Review of Artificial Intelligence (AI) for Objective Assessment of Aesthetic Endpoints in Plastic Surgery. Aesthetic Plast Surg 2023; 47:2862-2873. [PMID: 37000298 DOI: 10.1007/s00266-023-03328-9] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Accepted: 03/19/2023] [Indexed: 04/01/2023]
Abstract
Notoriously characterized by subjectivity and lack of solid scientific validation, reporting aesthetic outcome in plastic surgery is usually based on ill-defined end points and subjective measures very often from the patients' and/or providers' perspective. With the tremendous increase in demand for all types of aesthetic procedures, there is an urgent need for better understanding of aesthetics and beauty in addition to reliable and objective outcome measures to quantitate what is perceived as beautiful and attractive. In an era of evidence-based medicine, recognition of the importance of science with evidence-based approach to aesthetic surgery is long overdue. View the many limitations of conventional outcome evaluation tools of aesthetic interventions, objective outcome analysis provided by tools described to be reliable is being investigated such as advanced artificial intelligence (AI). The current review is intended to analyze available evidence regarding advantages as well as limitations of this technology in objectively documenting outcome of aesthetic interventions. It has shown that some AI applications such as facial emotions recognition systems are capable of objectively measuring and quantitating patients' reported outcomes and defining aesthetic interventions success from the patients' perspective. Though not reported yet, observers' satisfaction with the results and their appreciation of aesthetic attributes may also be measured in the same manner.Level of Evidence III This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .
Collapse
Affiliation(s)
- Bishara Atiyeh
- American University of Beirut Medical Center, Beirut, Lebanon
| | - Saif Emsieh
- American University of Beirut Medical Center, Beirut, Lebanon.
| | | | - Rawad Chalhoub
- American University of Beirut Medical Center, Beirut, Lebanon
| |
Collapse
|
11
|
Huang RW, Tsai TY, Hsieh YH, Hsu CC, Chen SH, Lee CH, Lin YT, Kao HK, Lin CH. Reliability of Postoperative Free Flap Monitoring with a Novel Prediction Model Based on Supervised Machine Learning. Plast Reconstr Surg 2023; 152:943e-952e. [PMID: 36790782 DOI: 10.1097/prs.0000000000010307] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/16/2023]
Abstract
BACKGROUND Postoperative free flap monitoring is a critical part of reconstructive microsurgery. Postoperative clinical assessments rely heavily on specialty-trained staff. Therefore, in regions with limited specialist availability, the feasibility of performing microsurgery is restricted. This study aimed to apply artificial intelligence in postoperative free flap monitoring and validate the ability of machine learning in predicting and differentiating types of postoperative free flap circulation. METHODS Postoperative data from 176 patients who received free flap surgery were prospectively collected, including free flap photographs and clinical evaluation measures. Flap circulation outcome variables included normal, arterial insufficiency, and venous insufficiency. The Synthetic Minority Oversampling Technique plus Tomek Links (SMOTE-Tomek) was applied for data balance. Data were divided into 80%:20% for model training and validation. Shapley Additive Explanations were used for prediction interpretations of the model. RESULTS Of 805 total included flaps, 555 (69%) were normal, 97 (12%) had arterial insufficiency, and 153 (19%) had venous insufficiency. The most effective prediction model was developed based on random forest, with an accuracy of 98.4%. Temperature and color differences between the flap and the surrounding skin were the most significant contributing factors to predict a vascular compromised flap. CONCLUSIONS This study demonstrated the reliability of a machine-learning model in differentiating various types of postoperative flap circulation. This novel technique may reduce the burden of free flap monitoring and encourage the broader use of reconstructive microsurgery in regions with a limited number of staff specialists.
Collapse
Affiliation(s)
- Ren-Wen Huang
- From the Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Chang Gung Medical College and Chang Gung University
| | - Tzong-Yueh Tsai
- From the Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Chang Gung Medical College and Chang Gung University
| | - Yun-Huan Hsieh
- From the Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Chang Gung Medical College and Chang Gung University
| | - Chung-Chen Hsu
- From the Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Chang Gung Medical College and Chang Gung University
| | - Shih-Heng Chen
- From the Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Chang Gung Medical College and Chang Gung University
| | - Che-Hsiung Lee
- From the Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Chang Gung Medical College and Chang Gung University
| | - Yu-Te Lin
- From the Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Chang Gung Medical College and Chang Gung University
| | - Huang-Kai Kao
- From the Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Chang Gung Medical College and Chang Gung University
| | - Cheng-Hung Lin
- From the Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Chang Gung Medical College and Chang Gung University
| |
Collapse
|
12
|
Nachmani O, Saun T, Huynh M, Forrest CR, McRae M. "Facekit"-Toward an Automated Facial Analysis App Using a Machine Learning-Derived Facial Recognition Algorithm. Plast Surg (Oakv) 2023; 31:321-329. [PMID: 37915352 PMCID: PMC10617451 DOI: 10.1177/22925503211073843] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2021] [Revised: 11/14/2021] [Accepted: 11/22/2021] [Indexed: 11/03/2023] Open
Abstract
Introduction: Multiple tools have been developed for facial feature measurements and analysis using facial recognition machine learning techniques. However, several challenges remain before these will be useful in the clinical context for reconstructive and aesthetic plastic surgery. Smartphone-based applications utilizing open-access machine learning tools can be rapidly developed, deployed, and tested for use in clinical settings. This research compares a smartphone-based facial recognition algorithm to direct and digital measurement performance for use in facial analysis. Methods: Facekit is a camera application developed for Android that utilizes ML Kit, an open-access computer vision Application Programing Interface developed by Google. Using the facial landmark module, we measured 4 facial proportions in 15 healthy subjects and compared them to direct surface and digital measurements using intraclass correlation (ICC) and Pearson correlation. Results: Measurement of the naso-facial proportion achieved the highest ICC of 0.321, where ICC > 0.75 is considered an excellent agreement between methods. Repeated measures analysis of variance of proportion measurements between ML Kit, direct and digital methods, were significantly different (F[2,14] = 6-26, P<<.05). Facekit measurements of orbital, orbitonasal, naso-oral, and naso-facial ratios had overall low correlation and agreement to both direct and digital measurements (R<<0.5, ICC<<0.75). Conclusion: Facekit is a smartphone camera application for rapid facial feature analysis. Agreement between Facekit's machine learning measurements and direct and digital measurements was low. We conclude that the chosen pretrained facial recognition software is not accurate enough for conducting a clinically useful facial analysis. Custom models trained on accurate and clinically relevant landmarks may provide better performance.
Collapse
Affiliation(s)
- Omri Nachmani
- Michael G. DeGroote School of Medicine, McMaster University, Hamilton, Ontario, Canada
| | - Tomas Saun
- Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Minh Huynh
- Division of Plastic and Reconstructive Surgery, McMaster University, Hamilton, Ontario, Canada
| | | | - Mark McRae
- Division of Plastic and Reconstructive Surgery, McMaster University, Hamilton, Ontario, Canada
| |
Collapse
|
13
|
ElHawary H, Watt A, Chartier C, Gorgy A, Gilardino MS. Pocket Predictors: Are Smartphones the Future of Artificial Intelligence in Plastic Surgery. Plast Surg (Oakv) 2023; 31:415-416. [PMID: 37915351 PMCID: PMC10617461 DOI: 10.1177/22925503221078687] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2023] Open
Affiliation(s)
- Hassan ElHawary
- Division of Plastic and Reconstructive Surgery, McGill University Health Centre, Montreal, Quebec, Canada
- Co-First Authors, contributed equally to this work
| | - Ayden Watt
- Department of Experimental Surgery, Faculty of Medicine, McGill University, Montreal, Quebec, Canada
- Co-First Authors, contributed equally to this work
| | | | - Andrew Gorgy
- Division of Plastic and Reconstructive Surgery, McGill University Health Centre, Montreal, Quebec, Canada
| | - Mirko S. Gilardino
- Division of Plastic and Reconstructive Surgery, McGill University Health Centre, Montreal, Quebec, Canada
| |
Collapse
|
14
|
Choi E, Leonard KW, Jassal JS, Levin AM, Ramachandra V, Jones LR. Artificial Intelligence in Facial Plastic Surgery: A Review of Current Applications, Future Applications, and Ethical Considerations. Facial Plast Surg 2023; 39:454-459. [PMID: 37353051 DOI: 10.1055/s-0043-1770160] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/25/2023] Open
Abstract
From virtual chat assistants to self-driving cars, artificial intelligence (AI) is often heralded as the technology that has and will continue to transform this generation. Among widely adopted applications in other industries, its potential use in medicine is being increasingly explored, where the vast amounts of data present in electronic health records and need for continuous improvements in patient care and workflow efficiency present many opportunities for AI implementation. Indeed, AI has already demonstrated capabilities for assisting in tasks such as documentation, image classification, and surgical outcome prediction. More specifically, this technology can be harnessed in facial plastic surgery, where the unique characteristics of the field lends itself well to specific applications. AI is not without its limitations, however, and the further adoption of AI in medicine and facial plastic surgery must necessarily be accompanied by discussion on the ethical implications and proper usage of AI in healthcare. In this article, we review current and potential uses of AI in facial plastic surgery, as well as its ethical ramifications.
Collapse
Affiliation(s)
- Elizabeth Choi
- Wayne State University School of Medicine, Detroit, Michigan
| | - Kyle W Leonard
- Department of Otolaryngology, Henry Ford Hospital, Detroit, Michigan
| | - Japnam S Jassal
- Department of Otolaryngology, Henry Ford Hospital, Detroit, Michigan
| | - Albert M Levin
- Department of Public Health Science, Henry Ford Health, Detroit, Michigan
- Center for Bioinformatics, Henry Ford Health, Detroit, Michigan
| | - Vikas Ramachandra
- Department of Public Health Science, Henry Ford Health, Detroit, Michigan
- Center for Bioinformatics, Henry Ford Health, Detroit, Michigan
| | - Lamont R Jones
- Department of Otolaryngology, Henry Ford Hospital, Detroit, Michigan
| |
Collapse
|
15
|
Oleck NC, Naga HI, Nichols DS, Morris MX, Dhingra B, Patel A. Navigating the Ethical Landmines of ChatGPT: Implications of Intelligent Chatbots in Plastic Surgery Clinical Practice. PLASTIC AND RECONSTRUCTIVE SURGERY-GLOBAL OPEN 2023; 11:e5290. [PMID: 38152714 PMCID: PMC10752483 DOI: 10.1097/gox.0000000000005290] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Accepted: 08/09/2023] [Indexed: 12/29/2023]
Abstract
ChatGPT is a cutting-edge language model developed by OpenAI with the potential to impact all facets of plastic surgery from research to clinical practice. New applications for ChatGPT are emerging at a rapid pace in both the scientific literature and popular media. It is important for clinicians to understand the capabilities and limitations of these tools before patient-facing implementation. In this article, the authors explore some of the technical details behind ChatGPT: what it is, and what it is not. As with any emerging technology, attention should be given to the ethical and health equity implications of this technology on our plastic surgery patients. The authors explore these concerns within the framework of the foundational principles of biomedical ethics: patient autonomy, nonmaleficence, beneficence, and justice. ChatGPT and similar intelligent conversation agents have incredible promise in the field of plastic surgery but should be used cautiously and sparingly in their current form. To protect patients, it is imperative that societal guidelines for the safe use of this rapidly developing technology are developed.
Collapse
Affiliation(s)
- Nicholas C. Oleck
- From the Division of Plastic, Maxillofacial and Oral Surgery, Duke University Medical Center, Durham, N.C
| | - Hani I. Naga
- From the Division of Plastic, Maxillofacial and Oral Surgery, Duke University Medical Center, Durham, N.C
| | - D. Spencer Nichols
- From the Division of Plastic, Maxillofacial and Oral Surgery, Duke University Medical Center, Durham, N.C
| | - Miranda X. Morris
- From the Division of Plastic, Maxillofacial and Oral Surgery, Duke University Medical Center, Durham, N.C
| | - Bhuwan Dhingra
- Department of Computer Science, Duke University, Durham, N.C
| | - Ash Patel
- From the Division of Plastic, Maxillofacial and Oral Surgery, Duke University Medical Center, Durham, N.C
| |
Collapse
|
16
|
Sharma SC, Ramchandani JP, Thakker A, Lahiri A. ChatGPT in Plastic and Reconstructive Surgery. Indian J Plast Surg 2023; 56:320-325. [PMID: 37705820 PMCID: PMC10497341 DOI: 10.1055/s-0043-1771514] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/15/2023] Open
Abstract
Background Chat Generative Pre-Trained Transformer (ChatGPT) is a versatile large language model-based generative artificial intelligence. It is proficient in a variety of tasks from drafting emails to coding to composing music to passing medical licensing exams. While the potential role of ChatGPT in plastic surgery is promising, evidence-based research is needed to guide its implementation in practice. Methods This review aims to summarize the literature surrounding ChatGPT's use in plastic surgery. Results A literature search revealed several applications for ChatGPT in the field of plastic surgery, including the ability to create academic literature and to aid the production of research. However, the ethical implications of using such chatbots in scientific writing requires careful consideration. ChatGPT can also generate high-quality patient discharge summaries and operation notes within seconds, freeing up busy junior doctors to complete other tasks. However, currently clinical information must still be manually inputted, and clinicians must consider data privacy implications. Its use in aiding patient communication and education and training is also widely documented in the literature. However, questions have been raised over the accuracy of answers generated given that current versions of ChatGPT cannot access the most up-to-date sources. Conclusions While one must be aware of its shortcomings, ChatGPT is a useful tool for plastic surgeons to improve productivity for a range of tasks from manuscript preparation to healthcare communication generation to drafting teaching sessions to studying and learning. As access improves and technology becomes more refined, surely more uses for ChatGPT in plastic surgery will become apparent.
Collapse
Affiliation(s)
- Sanjeev Chaand Sharma
- Department of Plastic Surgery, Leicester Royal Infirmary, Infirmary Square, Leicester, United Kingdom
| | - Jai Parkash Ramchandani
- Faculty of Life Sciences & Medicine, King's College London, Guy's Campus, Great Maze Pond, London, United Kingdom
| | - Arjuna Thakker
- Academic Team of Musculoskeletal Surgery, Leicester General Hospital, University Hospitals of Leicester NHS Trust, United Kingdom
| | - Anindya Lahiri
- Department of Plastic Surgery, Sandwell General Hospital, West Bromwich, United Kingdom
| |
Collapse
|
17
|
Najafali D, Reiche E, Araya S, Camacho JM, Liu FC, Johnstone T, Patel SA, Morrison SD, Dorafshar AH, Fox PM. Bard Versus the 2022 American Society of Plastic Surgeons In-Service Examination: Performance on the Examination in Its Intern Year. Aesthet Surg J Open Forum 2023; 6:ojad066. [PMID: 38196964 PMCID: PMC10776237 DOI: 10.1093/asjof/ojad066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2024] Open
Abstract
Background Bard is a conversational generative artificial intelligence (AI) platform released by Google (Mountain View, CA) to the public in May 2023. Objectives This study investigates the performance of Bard on the American Society of Plastic Surgeons (ASPS) In-Service Examination to compare it to residents' performance nationally. We hypothesized that Bard would perform best on the comprehensive and core surgical principles portions of the examination. Methods Google's 2023 Bard was used to answer questions from the 2022 ASPS In-Service Examination. Each question was asked as written with the stem and multiple-choice options. The 2022 ASPS Norm Table was utilized to compare Bard's performance to that of subgroups of plastic surgery residents. Results A total of 231 questions were included. Bard answered 143 questions correctly corresponding to an accuracy of 62%. The highest-performing section was the comprehensive portion (73%). When compared with integrated residents nationally, Bard scored in the 74th percentile for post-graduate year (PGY)-1, 34th percentile for PGY-2, 20th percentile for PGY-3, 8th percentile for PGY-4, 1st percentile for PGY-5, and 2nd percentile for PGY-6. Conclusions Bard outperformed more than half of the first-year integrated residents (74th percentile). Its best sections were the comprehensive and core surgical principle portions of the examination. Further analysis of the chatbot's incorrect questions might help improve the overall quality of the examination's questions.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | | | | | - Paige M Fox
- Corresponding Author: Dr Paige M. Fox, 770 Welch Road , Suite 400, Palo Alto, CA 94304, USA. E-mail: ; Instagram: @drpaigefox
| |
Collapse
|
18
|
Mortada H, AlBraithen G, Al Jabbar I, Al Qurashi A, Alnujaim N, Alrobaiea S, Kattan AE, Arab K. Advancing Surgical Education: A Comprehensive Systematic Review with Meta-Analysis and Novel Approach to Training Models for Local Skin Advancement Flaps. Cureus 2023; 15:e42066. [PMID: 37602042 PMCID: PMC10433785 DOI: 10.7759/cureus.42066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/14/2023] [Indexed: 08/22/2023] Open
Abstract
Performing local skin flaps is a challenging task that requires cognitive and technical skills to design flaps with proper orientation to avoid distorting normal anatomy. Junior trainees need adequate exposure to gain confidence and expertise in such procedures. This article systematically reviews the literature's different local skin advancement flap training models and describes a new, easy-to-use training model. A systematic review was performed following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. PubMed, Cochrane, Web of Science, and Google Scholar databases were searched from their inception until August 2022 for articles about local skin advancement flap training models. The meta-analysis results were pooled across the studies using a random-effects model and presented as a weighted mean difference with a 95% confidence interval (95% CI). Out of 773 reviewed articles, 18 were included in the systematic review, and four reported enough data to be included in the meta-analysis. Rhomboid and Z-plasty flaps were the most commonly taught flaps by training models. The most commonly used training models were synthetic-based, followed by animal-based models. The training models significantly increased the trainees' confidence and expertise regarding local skin flap procedures (p<0.00001) for both domains. Training models, per our reported data, significantly improve the trainees' confidence and expertise in performing local skin advancement flap procedures; continuous efforts in developing and establishing new, simple-to-use, and effective training models are strongly encouraged to further improvement of surgical education and enhance the trainees' surgical skills.
Collapse
Affiliation(s)
- Hatan Mortada
- Division of Plastic Surgery, Department of Surgery, King Saud University Medical City, King Saud University, Riyadh, SAU
- Department of Plastic Surgery & Burn Unit, King Saud Medical City, Riyadh, SAU
| | | | | | - Abdullah Al Qurashi
- College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, Jeddah, SAU
| | - Nujaim Alnujaim
- Division of Plastic Surgery, Department of Surgery, King Saud University Medical City, King Saud University, Riyadh, SAU
| | - Saad Alrobaiea
- Plastic Surgery and Burn Unit, Security Forces Hospital, Riyadh, SAU
| | - Abdullah E Kattan
- Division of Plastic Surgery, Department of Surgery, College of Medicine, King Saud University, Riyadh, SAU
| | - Khalid Arab
- Division of Plastic Surgery, Department of Surgery, College of Medicine, King Saud University, Riyadh, SAU
| |
Collapse
|
19
|
Hsu SY, Chen LW, Huang RW, Tsai TY, Hung SY, Cheong DCF, Lu JCY, Chang TNJ, Huang JJ, Tsao CK, Lin CH, Chuang DCC, Wei FC, Kao HK. Quantization of extraoral free flap monitoring for venous congestion with deep learning integrated iOS applications on smartphones: a diagnostic study. Int J Surg 2023; 109:1584-1593. [PMID: 37055021 PMCID: PMC10389505 DOI: 10.1097/js9.0000000000000391] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Accepted: 03/28/2023] [Indexed: 04/15/2023]
Abstract
BACKGROUND Free flap monitoring is essential for postmicrosurgical management and outcomes but traditionally relies on human observers; the process is subjective and qualitative and imposes a heavy burden on staffing. To scientifically monitor and quantify the condition of free flaps in a clinical scenario, we developed and validated a successful clinical transitional deep learning (DL) model integrated application. MATERIAL AND METHODS Patients from a single microsurgical intensive care unit between 1 April 2021 and 31 March 2022, were retrospectively analyzed for DL model development, validation, clinical transition, and quantification of free flap monitoring. An iOS application that predicted the probability of flap congestion based on computer vision was developed. The application calculated probability distribution that indicates the flap congestion risks. Accuracy, discrimination, and calibration tests were assessed for model performance evaluations. RESULTS From a total of 1761 photographs of 642 patients, 122 patients were included during the clinical application period. Development (photographs =328), external validation (photographs =512), and clinical application (photographs =921) cohorts were assigned to corresponding time periods. The performance measurements of the DL model indicate a 92.2% training and a 92.3% validation accuracy. The discrimination (area under the receiver operating characteristic curve) was 0.99 (95% CI: 0.98-1.0) during internal validation and 0.98 (95% CI: 0.97-0.99) under external validation. Among clinical application periods, the application demonstrates 95.3% accuracy, 95.2% sensitivity, and 95.3% specificity. The probabilities of flap congestion were significantly higher in the congested group than in the normal group (78.3 (17.1)% versus 13.2 (18.1)%; 0.8%; 95% CI, P <0.001). CONCLUSION The DL integrated smartphone application can accurately reflect and quantify flap condition; it is a convenient, accurate, and economical device that can improve patient safety and management and assist in monitoring flap physiology.
Collapse
Affiliation(s)
- Shao-Yun Hsu
- School of Biological Sciences, Georgia Institute of Technology, Atlanta, Georgia, USA
- Division of Reconstructive Microsurgery, Department of Plastic and Reconstructive Surgery
- Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Linkou
- College of Medicine, Chang Gung University
| | | | - Ren-Wen Huang
- Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Linkou
- College of Medicine, Chang Gung University
- Division of Traumatic Plastic Surgery, Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Taoyuan, Taiwan
| | | | - Shao-Yu Hung
- Division of Reconstructive Microsurgery, Department of Plastic and Reconstructive Surgery
- Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Linkou
- College of Medicine, Chang Gung University
| | - David Chon-Fok Cheong
- Division of Reconstructive Microsurgery, Department of Plastic and Reconstructive Surgery
- Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Linkou
- College of Medicine, Chang Gung University
| | - Johnny Chuieng-Yi Lu
- Division of Reconstructive Microsurgery, Department of Plastic and Reconstructive Surgery
- Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Linkou
- College of Medicine, Chang Gung University
| | - Tommy Nai-Jen Chang
- Division of Reconstructive Microsurgery, Department of Plastic and Reconstructive Surgery
- Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Linkou
- College of Medicine, Chang Gung University
| | - Jung-Ju Huang
- Division of Reconstructive Microsurgery, Department of Plastic and Reconstructive Surgery
- Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Linkou
- College of Medicine, Chang Gung University
| | - Chung-Kan Tsao
- Division of Reconstructive Microsurgery, Department of Plastic and Reconstructive Surgery
- Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Linkou
- College of Medicine, Chang Gung University
| | - Chih-Hung Lin
- Division of Reconstructive Microsurgery, Department of Plastic and Reconstructive Surgery
- Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Linkou
- College of Medicine, Chang Gung University
| | - David Chwei-Chin Chuang
- Division of Reconstructive Microsurgery, Department of Plastic and Reconstructive Surgery
- Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Linkou
- College of Medicine, Chang Gung University
| | - Fu-Chan Wei
- Division of Reconstructive Microsurgery, Department of Plastic and Reconstructive Surgery
- Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Linkou
- College of Medicine, Chang Gung University
| | - Huang-Kai Kao
- Division of Reconstructive Microsurgery, Department of Plastic and Reconstructive Surgery
- Department of Plastic and Reconstructive Surgery, Chang Gung Memorial Hospital, Linkou
- College of Medicine, Chang Gung University
| |
Collapse
|
20
|
Jarvis NR, Jarvis T, Morris BE, Verhey EM, Rebecca AM, Howard MA, Teven CM. A Scoping Review of Mobile Apps in Plastic Surgery: Patient Care, Trainee Education, and Professional Development. PLASTIC AND RECONSTRUCTIVE SURGERY-GLOBAL OPEN 2023; 11:e4943. [PMID: 37063506 PMCID: PMC10101243 DOI: 10.1097/gox.0000000000004943] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2022] [Accepted: 02/16/2023] [Indexed: 04/18/2023]
Abstract
Over the past 10 years, smartphones have become ubiquitous, and mobile apps serve a seemingly endless number of functions in our everyday lives. These functions have entered the realm of plastic surgery, impacting patient care, education, and delivery of services. This article reviews the current uses of plastic surgery mobile apps, app awareness within the plastic surgery community, and the ethical issues surrounding their use in patient care. Methods A scoping review of electronically available literature within PubMed, Embase, and Scopus databases was conducted in two waves in November and May 2022. Publications discussing mobile application use in plastic surgery were screened for inclusion. Results Of the 80 nonduplicate publications retrieved, 20 satisfied the inclusion criteria. Articles acquired from the references of these publications were reviewed and summarized when relevant. The average American Society of Plastic Surgeons evidence rating of the publications was 4.2. Applications could be categorized broadly into three categories: patient care and surgical applications, professional development and education, and marketing and practice development. Conclusions Mobile apps related to plastic surgery have become an abundant resource for patients, attending surgeons, and trainees. Many help bridge gaps in patient care and surgeon-patient communication, and facilitate marketing and practice development. Others make educational content more accessible to trainees and performance assessment more efficient and equitable. The extent of their impact on patient decision-making and expectations has not been completely elucidated.
Collapse
Affiliation(s)
| | - Tyler Jarvis
- Division of Plastic Surgery, Penn State Health Medical Center, Hershey, Penn
| | - Bryn E. Morris
- Division of Plastic and Reconstructive Surgery, Department of Surgery, Mayo Clinic, Phoenix, Ariz
| | - Erik M. Verhey
- From the Mayo Clinic Alix School of Medicine, Scottsdale, Ariz
| | - Alanna M. Rebecca
- Division of Plastic and Reconstructive Surgery, Department of Surgery, Mayo Clinic, Phoenix, Ariz
| | - Michael A. Howard
- Division of Plastic and Reconstructive Surgery, Northwestern Medicine, Chicago, Ill
| | - Chad M. Teven
- Division of Plastic and Reconstructive Surgery, Northwestern Medicine, Chicago, Ill
| |
Collapse
|
21
|
Rokhshad R, Keyhan SO, Yousefi P. Artificial intelligence applications and ethical challenges in oral and maxillo-facial cosmetic surgery: a narrative review. Maxillofac Plast Reconstr Surg 2023; 45:14. [PMID: 36913002 PMCID: PMC10011265 DOI: 10.1186/s40902-023-00382-w] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2023] [Accepted: 03/01/2023] [Indexed: 03/14/2023] Open
Abstract
Artificial intelligence (AI) refers to using technologies to simulate human cognition to solve a specific problem. The rapid development of AI in the health sector has been attributed to the improvement of computing speed, exponential increase in data production, and routine data collection. In this paper, we review the current applications of AI for oral and maxillofacial (OMF) cosmetic surgery to provide surgeons with the fundamental technical elements needed to understand its potential. AI plays an increasingly important role in OMF cosmetic surgery in various settings, and its usage may raise ethical issues. In addition to machine learning algorithms (a subtype of AI), convolutional neural networks (a subtype of deep learning) are widely used in OMF cosmetic surgeries. Depending on their complexity, these networks can extract and process the elementary characteristics of an image. They are, therefore, commonly used in the diagnostic process for medical images and facial photos. AI algorithms have been used to assist surgeons with diagnosis, therapeutic decisions, preoperative planning, and outcome prediction and evaluation. AI algorithms complement human skills while minimizing shortcomings through their capabilities to learn, classify, predict, and detect. This algorithm should, however, be rigorously evaluated clinically, and a systematic ethical reflection should be conducted regarding data protection, diversity, and transparency. It is possible to revolutionize the practice of functional and aesthetic surgeries with 3D simulation models and AI models. Planning, decision-making, and evaluation during and after surgery can be improved with simulation systems. A surgical AI model can also perform time-consuming or challenging tasks for surgeons.
Collapse
Affiliation(s)
- Rata Rokhshad
- Topic Group Dental Diagnostics and Digital Dentistry, ITU/WHO Focus Group AI on Health, Berlin, Germany. .,Department of Medicine, Boston University Medical Center, Boston, MA, USA.
| | - Seied Omid Keyhan
- College of Dentistry, Department of Oral & Maxillofacial Surgery, Gangneung-Wonju National University, Gangneung, South Korea.,Department of Oral & Maxillofacial Surgery, University of Florida, College of Medicine, Jacksonville, FL, USA.,Maxillofacial Surgery & Implantology & Biomaterial Research Foundation, Tehran, Iran.,Iface Academy, Atlanta, GA, USA
| | - Parisa Yousefi
- Maxillofacial Surgery & Implantology & Biomaterial Research Foundation, Tehran, Iran
| |
Collapse
|
22
|
Alabdaljabar MS, Hasan B, Noseworthy PA, Maalouf JF, Ammash NM, Hashmi SK. Machine Learning in Cardiology: A Potential Real-World Solution in Low- and Middle-Income Countries. J Multidiscip Healthc 2023; 16:285-295. [PMID: 36741292 PMCID: PMC9891080 DOI: 10.2147/jmdh.s383810] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Accepted: 11/07/2022] [Indexed: 01/30/2023] Open
Abstract
Artificial intelligence (AI) and machine learning (ML) is a promising field of cardiovascular medicine. Many AI tools have been shown to be efficacious with a high level of accuracy. Yet, their use in real life is not well established. In the era of health technology and data science, it is crucial to consider how these tools could improve healthcare delivery. This is particularly important in countries with limited resources, such as low- and middle-income countries (LMICs). LMICs have many barriers in the care continuum of cardiovascular diseases (CVD), and big portion of these barriers come from scarcity of resources, mainly financial and human power constraints. AI/ML could potentially improve healthcare delivery if appropriately applied in these countries. Expectedly, the current literature lacks original articles about AI/ML originating from these countries. It is important to start early with a stepwise approach to understand the obstacles these countries face in order to develop AI/ML-based solutions. This could be detrimental to many patients' lives, in addition to other expected advantages in other sectors, including the economy sector. In this report, we aim to review what is known about AI/ML in cardiovascular medicine, and to discuss how it could benefit LMICs.
Collapse
Affiliation(s)
- Mohamad S Alabdaljabar
- Department of Internal Medicine, Mayo Clinic, Rochester, MN, USA,College of Medicine, Alfaisal University, Riyadh, Saudi Arabia
| | - Babar Hasan
- Sindh Institute of Urology and Transplantation (SIUT), Karachi, Pakistan
| | | | - Joseph F Maalouf
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN, USA,Department of Medicine, Sheikh Shakhbout Medical City, Abu Dhabi, United Arab Emirates
| | - Naser M Ammash
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN, USA,Department of Medicine, Sheikh Shakhbout Medical City, Abu Dhabi, United Arab Emirates
| | - Shahrukh K Hashmi
- Department of Medicine, Sheikh Shakhbout Medical City, Abu Dhabi, United Arab Emirates,Division of Hematology, Department of Medicine, Mayo Clinic, Rochester, MN, USA,Correspondence: Shahrukh K Hashmi, Department of Medicine, SSMC, Abu Dhabi, United Arab Emirates, Email
| |
Collapse
|
23
|
A Systematic Review of Artificial Intelligence Applications in Plastic Surgery: Looking to the Future. Plast Reconstr Surg Glob Open 2022; 10:e4608. [PMID: 36479133 PMCID: PMC9722565 DOI: 10.1097/gox.0000000000004608] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Accepted: 08/24/2022] [Indexed: 01/25/2023]
Abstract
UNLABELLED Artificial intelligence (AI) is presently employed in several medical specialties, particularly those that rely on large quantities of standardized data. The integration of AI in surgical subspecialties is under preclinical investigation but is yet to be widely implemented. Plastic surgeons collect standardized data in various settings and could benefit from AI. This systematic review investigates the current clinical applications of AI in plastic and reconstructive surgery. METHODS A comprehensive literature search of the Medline, EMBASE, Cochrane, and PubMed databases was conducted for AI studies with multiple search terms. Articles that progressed beyond the title and abstract screening were then subcategorized based on the plastic surgery subspecialty and AI application. RESULTS The systematic search yielded a total of 1820 articles. Forty-four studies met inclusion criteria warranting further analysis. Subcategorization of articles by plastic surgery subspecialties revealed that most studies fell into aesthetic and breast surgery (27%), craniofacial surgery (23%), or microsurgery (14%). Analysis of the research study phase of included articles indicated that the current research is primarily in phase 0 (discovery and invention; 43.2%), phase 1 (technical performance and safety; 27.3%), or phase 2 (efficacy, quality improvement, and algorithm performance in a medical setting; 27.3%). Only one study demonstrated translation to clinical practice. CONCLUSIONS The potential of AI to optimize clinical efficiency is being investigated in every subfield of plastic surgery, but much of the research to date remains in the preclinical status. Future implementation of AI into everyday clinical practice will require collaborative efforts.
Collapse
|
24
|
A Machine Learning Approach to Identify Previously Unconsidered Causes for Complications in Aesthetic Breast Augmentation. Aesthetic Plast Surg 2022; 46:2669-2676. [PMID: 35802149 DOI: 10.1007/s00266-022-02997-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2022] [Accepted: 06/04/2022] [Indexed: 12/13/2022]
Abstract
INTRODUCTION Primary breast augmentation is one of the most commonly requested aesthetic procedures. Considering the large number of procedures performed in connection with a high demand, it is crucial to prevent complications. For this reason, finding and avoiding possible sources of complications is decisive. METHODS Between January 2010 and December 2021, 1625 female patients underwent an aesthetic breast augmentation performed by a single surgeon. The data collected were analyzed through a machine learning technique for binary recursive partitioning. This made it possible to detect unknown sources of a complication and determine a vertex for the various features. RESULTS When analyzing the data, for most features a high importance score with low entropy was achieved, concluding a high significance. In addition, reproducibility was demonstrated through detailed testing and training accuracies in the algorithm. With this procedure, in addition to known risks such as a high BMI and round implant shape, a larger than A preoperative bra-cup size (OR: 2.7) and a taller body could also be identified as most significant influencing factors for complications. DISCUSSION Preoperative breast size plays an exceptionally important role in the occurrence of complications and should be a factor held in a surgeon's considerations. In addition, this study shows ways to transfer artificial intelligence into plastic surgery to increase medical quality. LEVEL OF EVIDENCE IV This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .
Collapse
|
25
|
Hamamoto R, Koyama T, Kouno N, Yasuda T, Yui S, Sudo K, Hirata M, Sunami K, Kubo T, Takasawa K, Takahashi S, Machino H, Kobayashi K, Asada K, Komatsu M, Kaneko S, Yatabe Y, Yamamoto N. Introducing AI to the molecular tumor board: one direction toward the establishment of precision medicine using large-scale cancer clinical and biological information. Exp Hematol Oncol 2022; 11:82. [PMID: 36316731 PMCID: PMC9620610 DOI: 10.1186/s40164-022-00333-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Accepted: 10/05/2022] [Indexed: 11/10/2022] Open
Abstract
Since U.S. President Barack Obama announced the Precision Medicine Initiative in his New Year's State of the Union address in 2015, the establishment of a precision medicine system has been emphasized worldwide, particularly in the field of oncology. With the advent of next-generation sequencers specifically, genome analysis technology has made remarkable progress, and there are active efforts to apply genome information to diagnosis and treatment. Generally, in the process of feeding back the results of next-generation sequencing analysis to patients, a molecular tumor board (MTB), consisting of experts in clinical oncology, genetic medicine, etc., is established to discuss the results. On the other hand, an MTB currently involves a large amount of work, with humans searching through vast databases and literature, selecting the best drug candidates, and manually confirming the status of available clinical trials. In addition, as personalized medicine advances, the burden on MTB members is expected to increase in the future. Under these circumstances, introducing cutting-edge artificial intelligence (AI) technology and information and communication technology to MTBs while reducing the burden on MTB members and building a platform that enables more accurate and personalized medical care would be of great benefit to patients. In this review, we introduced the latest status of elemental technologies that have potential for AI utilization in MTB, and discussed issues that may arise in the future as we progress with AI implementation.
Collapse
Affiliation(s)
- Ryuji Hamamoto
- grid.272242.30000 0001 2168 5385Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan ,grid.509456.bCancer Translational Research Team, RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027 Japan
| | - Takafumi Koyama
- grid.272242.30000 0001 2168 5385Department of Experimental Therapeutics, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan
| | - Nobuji Kouno
- grid.272242.30000 0001 2168 5385Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan ,grid.258799.80000 0004 0372 2033Department of Surgery, Graduate School of Medicine, Kyoto University, Yoshida-konoe-cho, Sakyo-ku, Kyoto, 606-8303 Japan
| | - Tomohiro Yasuda
- grid.272242.30000 0001 2168 5385Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan ,grid.417547.40000 0004 1763 9564Research and Development Group, Hitachi, Ltd., 1-280 Higashi-koigakubo, Kokubunji, Tokyo, 185-8601 Japan
| | - Shuntaro Yui
- grid.272242.30000 0001 2168 5385Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan ,grid.417547.40000 0004 1763 9564Research and Development Group, Hitachi, Ltd., 1-280 Higashi-koigakubo, Kokubunji, Tokyo, 185-8601 Japan
| | - Kazuki Sudo
- grid.272242.30000 0001 2168 5385Department of Experimental Therapeutics, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan ,grid.272242.30000 0001 2168 5385Department of Medical Oncology, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan
| | - Makoto Hirata
- grid.272242.30000 0001 2168 5385Department of Genetic Medicine and Services, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan
| | - Kuniko Sunami
- grid.272242.30000 0001 2168 5385Department of Laboratory Medicine, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan
| | - Takashi Kubo
- grid.272242.30000 0001 2168 5385Department of Laboratory Medicine, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan
| | - Ken Takasawa
- grid.272242.30000 0001 2168 5385Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan ,grid.509456.bCancer Translational Research Team, RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027 Japan
| | - Satoshi Takahashi
- grid.272242.30000 0001 2168 5385Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan ,grid.509456.bCancer Translational Research Team, RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027 Japan
| | - Hidenori Machino
- grid.272242.30000 0001 2168 5385Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan ,grid.509456.bCancer Translational Research Team, RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027 Japan
| | - Kazuma Kobayashi
- grid.272242.30000 0001 2168 5385Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan ,grid.509456.bCancer Translational Research Team, RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027 Japan
| | - Ken Asada
- grid.272242.30000 0001 2168 5385Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan ,grid.509456.bCancer Translational Research Team, RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027 Japan
| | - Masaaki Komatsu
- grid.272242.30000 0001 2168 5385Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan ,grid.509456.bCancer Translational Research Team, RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027 Japan
| | - Syuzo Kaneko
- grid.272242.30000 0001 2168 5385Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan ,grid.509456.bCancer Translational Research Team, RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027 Japan
| | - Yasushi Yatabe
- grid.272242.30000 0001 2168 5385Department of Diagnostic Pathology, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan ,grid.272242.30000 0001 2168 5385Division of Molecular Pathology, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan
| | - Noboru Yamamoto
- grid.272242.30000 0001 2168 5385Department of Experimental Therapeutics, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045 Japan
| |
Collapse
|
26
|
A Ready-to-Use Grading Tool for Facial Palsy Examiners—Automated Grading System in Facial Palsy Patients Made Easy. J Pers Med 2022; 12:jpm12101739. [PMID: 36294878 PMCID: PMC9605133 DOI: 10.3390/jpm12101739] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 10/15/2022] [Accepted: 10/16/2022] [Indexed: 11/25/2022] Open
Abstract
Background: The grading process in facial palsy (FP) patients is crucial for time- and cost-effective therapy decision-making. The House-Brackmann scale (HBS) represents the most commonly used classification system in FP diagnostics. This study investigated the benefits of linking machine learning (ML) techniques with the HBS. Methods: Image datasets of 51 patients seen at the Department of Plastic, Hand, and Reconstructive Surgery at the University Hospital Regensburg, Germany, between June 2020 and May 2021, were used to build the neural network. A total of nine facial poses per patient were used to automatically determine the HBS. Results: The algorithm had an accuracy of 98%. The algorithm processed the real patient image series (i.e., nine images per patient) in 112 ms. For optimized accuracy, we found 30 training runs to be the most effective training length. Conclusion: We have developed an easy-to-use, time- and cost-efficient algorithm that provides highly accurate automated grading of FP patient images. In combination with our application, the algorithm may facilitate the FP surgeon’s clinical workflow.
Collapse
|
27
|
Soh CL, Shah V, Arjomandi Rad A, Vardanyan R, Zubarevich A, Torabi S, Weymann A, Miller G, Malawana J. Present and future of machine learning in breast surgery: systematic review. Br J Surg 2022; 109:1053-1062. [PMID: 35945894 PMCID: PMC10364755 DOI: 10.1093/bjs/znac224] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2022] [Revised: 02/09/2022] [Accepted: 05/30/2022] [Indexed: 08/02/2023]
Abstract
BACKGROUND Machine learning is a set of models and methods that can automatically detect patterns in vast amounts of data, extract information, and use it to perform decision-making under uncertain conditions. The potential of machine learning is significant, and breast surgeons must strive to be informed with up-to-date knowledge and its applications. METHODS A systematic database search of Embase, MEDLINE, the Cochrane database, and Google Scholar, from inception to December 2021, was conducted of original articles that explored the use of machine learning and/or artificial intelligence in breast surgery in EMBASE, MEDLINE, Cochrane database and Google Scholar. RESULTS The search yielded 477 articles, of which 14 studies were included in this review, featuring 73 847 patients. Four main areas of machine learning application were identified: predictive modelling of surgical outcomes; breast imaging-based context; screening and triaging of patients with breast cancer; and as network utility for detection. There is evident value of machine learning in preoperative planning and in providing information for surgery both in a cancer and an aesthetic context. Machine learning outperformed traditional statistical modelling in all studies for predicting mortality, morbidity, and quality of life outcomes. Machine learning patterns and associations could support planning, anatomical visualization, and surgical navigation. CONCLUSION Machine learning demonstrated promising applications for improving breast surgery outcomes and patient-centred care. Neveretheless, there remain important limitations and ethical concerns relating to implementing artificial intelligence into everyday surgical practices.
Collapse
Affiliation(s)
- Chien Lin Soh
- School of Clinical Medicine, University of Cambridge, Cambridge, UK
| | - Viraj Shah
- Department of Medicine, Faculty of Medicine, Imperial College London, London, UK
| | - Arian Arjomandi Rad
- Correspondence to: Arian Arjomandi Rad, Imperial College London, Department of Medicine, Faculty of Medicine, South Kensington Campus, Sir Alexander Fleming Building, London SW7 2AZ, UK (e-mail: )
| | - Robert Vardanyan
- Department of Medicine, Faculty of Medicine, Imperial College London, London, UK
| | - Alina Zubarevich
- Department of Thoracic and Cardiovascular Surgery, West German Heart and Vascular Center Essen, University Hospital of Essen, University Duisburg-Essen, Essen, Germany
| | - Saeed Torabi
- Department of Anesthesiology and Intensive Care Medicine, University Hospital of Cologne, Cologne, Germany
| | - Alexander Weymann
- Department of Thoracic and Cardiovascular Surgery, West German Heart and Vascular Center Essen, University Hospital of Essen, University Duisburg-Essen, Essen, Germany
| | - George Miller
- Research Unit, The Healthcare Leadership Academy, London, UK
- Centre for Digital Health and Education Research (CoDHER), University of Central Lancashire Medical School, Preston, UK
| | - Johann Malawana
- Research Unit, The Healthcare Leadership Academy, London, UK
- Centre for Digital Health and Education Research (CoDHER), University of Central Lancashire Medical School, Preston, UK
| |
Collapse
|
28
|
Lam K, Abràmoff MD, Balibrea JM, Bishop SM, Brady RR, Callcut RA, Chand M, Collins JW, Diener MK, Eisenmann M, Fermont K, Neto MG, Hager GD, Hinchliffe RJ, Horgan A, Jannin P, Langerman A, Logishetty K, Mahadik A, Maier-Hein L, Antona EM, Mascagni P, Mathew RK, Müller-Stich BP, Neumuth T, Nickel F, Park A, Pellino G, Rudzicz F, Shah S, Slack M, Smith MJ, Soomro N, Speidel S, Stoyanov D, Tilney HS, Wagner M, Darzi A, Kinross JM, Purkayastha S. A Delphi consensus statement for digital surgery. NPJ Digit Med 2022; 5:100. [PMID: 35854145 PMCID: PMC9296639 DOI: 10.1038/s41746-022-00641-6] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Accepted: 06/24/2022] [Indexed: 12/13/2022] Open
Abstract
The use of digital technology is increasing rapidly across surgical specialities, yet there is no consensus for the term ‘digital surgery’. This is critical as digital health technologies present technical, governance, and legal challenges which are unique to the surgeon and surgical patient. We aim to define the term digital surgery and the ethical issues surrounding its clinical application, and to identify barriers and research goals for future practice. 38 international experts, across the fields of surgery, AI, industry, law, ethics and policy, participated in a four-round Delphi exercise. Issues were generated by an expert panel and public panel through a scoping questionnaire around key themes identified from the literature and voted upon in two subsequent questionnaire rounds. Consensus was defined if >70% of the panel deemed the statement important and <30% unimportant. A final online meeting was held to discuss consensus statements. The definition of digital surgery as the use of technology for the enhancement of preoperative planning, surgical performance, therapeutic support, or training, to improve outcomes and reduce harm achieved 100% consensus agreement. We highlight key ethical issues concerning data, privacy, confidentiality and public trust, consent, law, litigation and liability, and commercial partnerships within digital surgery and identify barriers and research goals for future practice. Developers and users of digital surgery must not only have an awareness of the ethical issues surrounding digital applications in healthcare, but also the ethical considerations unique to digital surgery. Future research into these issues must involve all digital surgery stakeholders including patients.
Collapse
Affiliation(s)
- Kyle Lam
- Department of Surgery and Cancer, Imperial College, London, UK.,Institute of Global Health Innovation, Imperial College London, London, UK
| | - Michael D Abràmoff
- Department of Ophthalmology and Visual Sciences, University of Iowa, Iowa City, IA, USA.,Department of Electrical and Computer Engineering, University of Iowa, Iowa City, IA, USA
| | - José M Balibrea
- Department of Gastrointestinal Surgery, Hospital Clínic de Barcelona, Barcelona, Spain.,Universitat de Barcelona, Barcelona, Spain
| | | | - Richard R Brady
- Newcastle Centre for Bowel Disease Research Hub, Newcastle University, Newcastle, UK.,Department of Colorectal Surgery, Newcastle Hospitals, Newcastle, UK
| | | | - Manish Chand
- Department of Surgery and Interventional Sciences, University College London, London, UK
| | - Justin W Collins
- CMR Surgical Limited, Cambridge, UK.,Department of Surgery and Interventional Sciences, University College London, London, UK
| | - Markus K Diener
- Department of General and Visceral Surgery, University of Freiburg, Freiburg im Breisgau, Germany.,Faculty of Medicine, University of Freiburg, Freiburg im Breisgau, Germany
| | - Matthias Eisenmann
- Division of Computer Assisted Medical Interventions (CAMI), German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Kelly Fermont
- Solicitor of the Senior Courts of England and Wales, Independent Researcher, Bristol, UK
| | - Manoel Galvao Neto
- Endovitta Institute, Sao Paulo, Brazil.,FMABC Medical School, Santo Andre, Brazil
| | - Gregory D Hager
- The Malone Center for Engineering in Healthcare, The Johns Hopkins University, Baltimore, MD, USA.,Department of Computer Science, The Johns Hopkins University, Baltimore, MD, USA
| | | | - Alan Horgan
- Department of Colorectal Surgery, Newcastle Hospitals, Newcastle, UK
| | - Pierre Jannin
- LTSI, Inserm UMR 1099, University of Rennes 1, Rennes, France
| | - Alexander Langerman
- Otolaryngology, Head & Neck Surgery and Radiology & Radiological Sciences, Vanderbilt University Medical Center, Nashville, TN, USA.,International Centre for Surgical Safety, Li Ka Shing Knowledge Institute, St. Michael's Hospital, University of Toronto, Toronto, ON, Canada
| | | | | | - Lena Maier-Hein
- Division of Computer Assisted Medical Interventions (CAMI), German Cancer Research Center (DKFZ), Heidelberg, Germany.,Faculty of Mathematics and Computer Science, Heidelberg University, Heidelberg, Germany.,Medical Faculty, Heidelberg University, Heidelberg, Germany.,LKSK Institute of St. Michael's Hospital, Toronto, ON, Canada
| | | | - Pietro Mascagni
- Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy.,IHU-Strasbourg, Institute of Image-Guided Surgery, Strasbourg, France.,ICube, University of Strasbourg, Strasbourg, France
| | - Ryan K Mathew
- School of Medicine, University of Leeds, Leeds, UK.,Department of Neurosurgery, Leeds Teaching Hospitals NHS Trust, Leeds, UK
| | - Beat P Müller-Stich
- Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany.,National Center for Tumor Diseases, Heidelberg, Germany
| | - Thomas Neumuth
- Innovation Center Computer Assisted Surgery (ICCAS), Universität Leipzig, Leipzig, Germany
| | - Felix Nickel
- Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
| | - Adrian Park
- Department of Surgery, Anne Arundel Medical Center, School of Medicine, Johns Hopkins University, Annapolis, MD, USA
| | - Gianluca Pellino
- Department of Advanced Medical and Surgical Sciences, Università degli Studi della Campania "Luigi Vanvitelli", Naples, Italy.,Colorectal Surgery, Vall d'Hebron University Hospital, Barcelona, Spain
| | - Frank Rudzicz
- Department of Computer Science, University of Toronto, Toronto, ON, Canada.,Vector Institute for Artificial Intelligence, Toronto, ON, Canada.,Unity Health Toronto, Toronto, ON, Canada.,Surgical Safety Technologies Inc, Toronto, ON, Canada
| | - Sam Shah
- Faculty of Future Health, College of Medicine and Dentistry, Ulster University, Birmingham, UK
| | - Mark Slack
- CMR Surgical Limited, Cambridge, UK.,Department of Urogynaecology, Addenbrooke's Hospital, Cambridge, UK.,University of Cambridge, Cambridge, UK
| | - Myles J Smith
- The Royal Marsden Hospital, London, UK.,Institute of Cancer Research, London, UK
| | - Naeem Soomro
- Department of Urology, Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK
| | - Stefanie Speidel
- Division of Translational Surgical Oncology, National Center for Tumor Diseases (NCT/UCC), Dresden, Germany.,Centre for Tactile Internet with Human-in-the-Loop (CeTI), TU Dresden, Dresden, Germany
| | - Danail Stoyanov
- Wellcome/ESPRC Centre for Interventional and Surgical Sciences, University College London, London, UK
| | - Henry S Tilney
- Department of Surgery and Cancer, Imperial College, London, UK.,Department of Colorectal Surgery, Frimley Health NHS Foundation Trust, Frimley, UK
| | - Martin Wagner
- Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany.,National Center for Tumor Diseases, Heidelberg, Germany
| | - Ara Darzi
- Department of Surgery and Cancer, Imperial College, London, UK.,Institute of Global Health Innovation, Imperial College London, London, UK
| | - James M Kinross
- Department of Surgery and Cancer, Imperial College, London, UK.
| | | |
Collapse
|
29
|
Eldaly AS, Avila FR, Torres-Guzman RA, Maita K, Garcia JP, Palmieri Serrano L, Forte AJ. Simulation and Artificial Intelligence in Rhinoplasty: A Systematic Review. Aesthetic Plast Surg 2022; 46:2368-2377. [PMID: 35437664 DOI: 10.1007/s00266-022-02883-x] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Accepted: 03/19/2022] [Indexed: 11/26/2022]
Abstract
BACKGROUND Rhinoplasty is one of the most popular cosmetic procedures. The complexity of the nasal structure and the substantial aesthetic and functional impact of the operation make rhinoplasty very challenging. The past few years have witnessed an increasing implementation of artificial intelligence (AI) and simulation systems into plastic surgery practice. This review explores the potential uses of AI and simulation models in rhinoplasty. METHODS Five electronic databases were searched: PubMed, CINAHL, EMBASE, Scopus, and Web of Science. We used the Preferred Reporting Items for Systematic Reviews and Meta-Analysis as our basis of organization. RESULTS Several simulation models were described to predict the nasal shape that aesthetically matches the patient's face, indicate the implant size in augmentation rhinoplasty and construct three-dimensional (3D) facial images from two-dimensional images. Machine learning was used to learn surgeons' rhinoplasty styles and accurately simulate the outcomes. Deep learning was used to predict rhinoplasty status accurately and analyze the factors associated with increased facial attractiveness after rhinoplasty. Finally, a deep learning model was used to predict patients' age before and after rhinoplasty proving that the procedure made the patients look younger. CONCLUSION 3D simulation models and AI models can revolutionalize the practice of functional and aesthetic rhinoplasty. Simulation systems can be beneficial in preoperative planning, intra-operative decision making, and postoperative evaluation. In addition, AI models can be trained to carry out tasks that are either challenging or time-consuming for surgeons. LEVEL OF EVIDENCE III This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .
Collapse
Affiliation(s)
- Abdullah S Eldaly
- Division of Plastic Surgery, Mayo Clinic, 4500 San Pablo Rd, Jacksonville, FL, 32224, USA
| | - Francisco R Avila
- Division of Plastic Surgery, Mayo Clinic, 4500 San Pablo Rd, Jacksonville, FL, 32224, USA
| | | | - Karla Maita
- Division of Plastic Surgery, Mayo Clinic, 4500 San Pablo Rd, Jacksonville, FL, 32224, USA
| | - John P Garcia
- Division of Plastic Surgery, Mayo Clinic, 4500 San Pablo Rd, Jacksonville, FL, 32224, USA
| | - Luiza Palmieri Serrano
- Division of Plastic Surgery, Mayo Clinic, 4500 San Pablo Rd, Jacksonville, FL, 32224, USA
| | - Antonio J Forte
- Division of Plastic Surgery, Mayo Clinic, 4500 San Pablo Rd, Jacksonville, FL, 32224, USA.
| |
Collapse
|
30
|
Commercial Artificial Intelligence Software as a Tool for Assessing Facial Attractiveness: A Proof-of-Concept Study in an Orthognathic Surgery Cohort. Aesthetic Plast Surg 2022; 46:1013-1016. [PMID: 34494125 DOI: 10.1007/s00266-021-02537-4] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2021] [Accepted: 08/08/2021] [Indexed: 01/11/2023]
|
31
|
Perceived Age and Attractiveness Using Facial Recognition Software in Rhinoplasty Patients. J Craniofac Surg 2022; 33:1540-1544. [DOI: 10.1097/scs.0000000000008625] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2021] [Accepted: 02/19/2022] [Indexed: 11/25/2022] Open
|
32
|
Li B, Feridooni T, Cuen-Ojeda C, Kishibe T, de Mestral C, Mamdani M, Al-Omran M. Machine learning in vascular surgery: a systematic review and critical appraisal. NPJ Digit Med 2022; 5:7. [PMID: 35046493 PMCID: PMC8770468 DOI: 10.1038/s41746-021-00552-y] [Citation(s) in RCA: 44] [Impact Index Per Article: 22.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2021] [Accepted: 12/13/2021] [Indexed: 12/18/2022] Open
Abstract
Machine learning (ML) is a rapidly advancing field with increasing utility in health care. We conducted a systematic review and critical appraisal of ML applications in vascular surgery. MEDLINE, Embase, and Cochrane CENTRAL were searched from inception to March 1, 2021. Study screening, data extraction, and quality assessment were performed by two independent reviewers, with a third author resolving discrepancies. All original studies reporting ML applications in vascular surgery were included. Publication trends, disease conditions, methodologies, and outcomes were summarized. Critical appraisal was conducted using the PROBAST risk-of-bias and TRIPOD reporting adherence tools. We included 212 studies from a pool of 2235 unique articles. ML techniques were used for diagnosis, prognosis, and image segmentation in carotid stenosis, aortic aneurysm/dissection, peripheral artery disease, diabetic foot ulcer, venous disease, and renal artery stenosis. The number of publications on ML in vascular surgery increased from 1 (1991-1996) to 118 (2016-2021). Most studies were retrospective and single center, with no randomized controlled trials. The median area under the receiver operating characteristic curve (AUROC) was 0.88 (range 0.61-1.00), with 79.5% [62/78] studies reporting AUROC ≥ 0.80. Out of 22 studies comparing ML techniques to existing prediction tools, clinicians, or traditional regression models, 20 performed better and 2 performed similarly. Overall, 94.8% (201/212) studies had high risk-of-bias and adherence to reporting standards was poor with a rate of 41.4%. Despite improvements over time, study quality and reporting remain inadequate. Future studies should consider standardized tools such as PROBAST and TRIPOD to improve study quality and clinical applicability.
Collapse
Affiliation(s)
- Ben Li
- Department of Surgery, University of Toronto, 149 College St, Toronto, ON, M5T 1P5, Canada
- Division of Vascular Surgery, St. Michael's Hospital, Unity Health Toronto, 30 Bond Street, Toronto, ON, M5B 1W8, Canada
- Temerty Centre for Artificial Intelligence Research and Education in Medicine (T-CAIREM), University of Toronto, 1 King's College Circle, Toronto, ON, M5S 1A8, Canada
| | - Tiam Feridooni
- Department of Surgery, University of Toronto, 149 College St, Toronto, ON, M5T 1P5, Canada
- Division of Vascular Surgery, St. Michael's Hospital, Unity Health Toronto, 30 Bond Street, Toronto, ON, M5B 1W8, Canada
| | - Cesar Cuen-Ojeda
- Department of Surgery, University of Toronto, 149 College St, Toronto, ON, M5T 1P5, Canada
- Division of Vascular Surgery, St. Michael's Hospital, Unity Health Toronto, 30 Bond Street, Toronto, ON, M5B 1W8, Canada
| | - Teruko Kishibe
- Health Sciences Library, St. Michael's Hospital, Unity Health Toronto, 209 Victoria St, Toronto, ON, M5B 1T8, Canada
- Li Ka Shing Knowledge Institute, St. Michael's Hospital, Unity Health Toronto, 209 Victoria St, Toronto, ON, M5B 1T8, Canada
| | - Charles de Mestral
- Department of Surgery, University of Toronto, 149 College St, Toronto, ON, M5T 1P5, Canada
- Division of Vascular Surgery, St. Michael's Hospital, Unity Health Toronto, 30 Bond Street, Toronto, ON, M5B 1W8, Canada
- Li Ka Shing Knowledge Institute, St. Michael's Hospital, Unity Health Toronto, 209 Victoria St, Toronto, ON, M5B 1T8, Canada
- Institute of Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, 155 College St, Toronto, ON, M5T 3M7, Canada
| | - Muhammad Mamdani
- Temerty Centre for Artificial Intelligence Research and Education in Medicine (T-CAIREM), University of Toronto, 1 King's College Circle, Toronto, ON, M5S 1A8, Canada
- Li Ka Shing Knowledge Institute, St. Michael's Hospital, Unity Health Toronto, 209 Victoria St, Toronto, ON, M5B 1T8, Canada
- Institute of Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, 155 College St, Toronto, ON, M5T 3M7, Canada
- Leslie Dan Faculty of Pharmacy, University of Toronto, 144 College St, Toronto, ON, M5S 3M2, Canada
| | - Mohammed Al-Omran
- Department of Surgery, University of Toronto, 149 College St, Toronto, ON, M5T 1P5, Canada.
- Division of Vascular Surgery, St. Michael's Hospital, Unity Health Toronto, 30 Bond Street, Toronto, ON, M5B 1W8, Canada.
- Temerty Centre for Artificial Intelligence Research and Education in Medicine (T-CAIREM), University of Toronto, 1 King's College Circle, Toronto, ON, M5S 1A8, Canada.
- Li Ka Shing Knowledge Institute, St. Michael's Hospital, Unity Health Toronto, 209 Victoria St, Toronto, ON, M5B 1T8, Canada.
- Institute of Medical Science, University of Toronto, 1 King's College Circle, Toronto, ON, M5S 1A8, Canada.
- Department of Surgery, King Saud University, ZIP 4545, Riyadh, 11451, Kingdom of Saudi Arabia.
| |
Collapse
|
33
|
Takiddin A, Shaqfeh M, Boyaci O, Serpedin E, Stotland MA. Toward a Universal Measure of Facial Difference Using Two Novel Machine Learning Models. PLASTIC AND RECONSTRUCTIVE SURGERY-GLOBAL OPEN 2022; 10:e4034. [PMID: 35070595 PMCID: PMC8769118 DOI: 10.1097/gox.0000000000004034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2021] [Accepted: 11/09/2021] [Indexed: 11/26/2022]
Abstract
A sensitive, objective, and universally accepted method of measuring facial deformity does not currently exist. Two distinct machine learning methods are described here that produce numerical scores reflecting the level of deformity of a wide variety of facial conditions. METHODS The first proposed technique utilizes an object detector based on a cascade function of Haar features. The model was trained using a dataset of 200,000 normal faces, as well as a collection of images devoid of faces. With the model trained to detect normal faces, the face detector confidence score was shown to function as a reliable gauge of facial abnormality. The second technique developed is based on a deep learning architecture of a convolutional autoencoder trained with the same rich dataset of normal faces. Because the convolutional autoencoder regenerates images disposed toward their training dataset (ie, normal faces), we utilized its reconstruction error as an indicator of facial abnormality. Scores generated by both methods were compared with human ratings obtained using a survey of 80 subjects evaluating 60 images depicting a range of facial deformities [rating from 1 (abnormal) to 7 (normal)]. RESULTS The machine scores were highly correlated to the average human score, with overall Pearson's correlation coefficient exceeding 0.96 (P < 0.00001). Both methods were computationally efficient, reporting results within 3 seconds. CONCLUSIONS These models show promise for adaptation into a clinically accessible handheld tool. It is anticipated that ongoing development of this technology will facilitate multicenter collaboration and comparison of outcomes between conditions, techniques, operators, and institutions.
Collapse
Affiliation(s)
- Abdulrahman Takiddin
- From the Electrical and Computer Engineering Department, Texas A&M University, College Station, Tex
| | - Mohammad Shaqfeh
- Electrical and Computer Engineering Department, Texas A&M University, Doha, Qatar
| | - Osman Boyaci
- From the Electrical and Computer Engineering Department, Texas A&M University, College Station, Tex
| | - Erchin Serpedin
- From the Electrical and Computer Engineering Department, Texas A&M University, College Station, Tex
| | - Mitchell A. Stotland
- Division of Plastic, Craniofacial and Hand Surgery, Sidra Medicine, Doha, Qatar
- Weill Cornell Medical College, Doha, Qatar
| |
Collapse
|
34
|
Parsa S, Basagaoglu B, Mackley K, Aitson P, Kenkel J, Amirlak B. Current and Future Photography Techniques in Aesthetic Surgery. AESTHETIC SURGERY JOURNAL OPEN FORUM 2021; 4:ojab050. [PMID: 35156020 PMCID: PMC8830310 DOI: 10.1093/asjof/ojab050] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/02/2022] Open
Abstract
Background The rapidly increasing modalities and mediums of clinical photography, use of 3-dimensional (3D) and 4-dimensional (4D) patient modeling, and widening implementation of cloud-based storage and artificial intelligence (AI) call for an overview of various methods currently in use as well as future considerations in the field. Objectives Through a close look at the methods used in aesthetic surgery photography, clinicians will be able to select the modality best suited to their practice and goals. Methods Review and discussion of current data pertaining to: 2-dimensional (2D) and 3D clinical photography, current photography software, augmented reality reconstruction, AI photography, and cloud-based storage. Results Important considerations for current image capture include a device with a gridded viewing screen and high megapixel resolution, a tripod with leveling base, studio lighting with dual-sourced light, standardized matte finish background, and consistency in patient orientation. Currently, 3D and 4D photography devices offer advantages such as improved communication to the patient on outcome expectation and better quality of patient service and safety. AI may contribute to post-capture processing and 3D printing of postoperative outcomes. Current smartphones distort patient perceptions about their appearance and should be used cautiously in an aesthetic surgery setting. Cloud-based storage provides flexibility, cost, and ease of service while remaining vulnerable to data breaches. Conclusions While there are advancements to be made in the physical equipment and preparation for the photograph, the future of clinical photography will be heavily influenced by innovations in software and 3D and 4D modeling of outcomes.
Collapse
Affiliation(s)
- Shyon Parsa
- Department of Plastic Surgery, UT Southwestern Medical Center, Dallas, TX, USA
| | - Berkay Basagaoglu
- Department of Plastic Surgery, UT Southwestern Medical Center, Dallas, TX, USA
| | - Kate Mackley
- Department of Plastic Surgery, UT Southwestern Medical Center, Dallas, TX, USA
| | - Patricia Aitson
- Department of Plastic Surgery, UT Southwestern Medical Center, Dallas, TX, USA
| | - Jeffrey Kenkel
- Department of Plastic Surgery, UT Southwestern Medical Center, Dallas, TX, USA
| | - Bardia Amirlak
- Department of Plastic Surgery, UT Southwestern Medical Center, Dallas, TX, USA
| |
Collapse
|
35
|
Mantelakis A, Assael Y, Sorooshian P, Khajuria A. Machine Learning Demonstrates High Accuracy for Disease Diagnosis and Prognosis in Plastic Surgery. PLASTIC AND RECONSTRUCTIVE SURGERY-GLOBAL OPEN 2021; 9:e3638. [PMID: 34235035 PMCID: PMC8225366 DOI: 10.1097/gox.0000000000003638] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2020] [Accepted: 04/14/2021] [Indexed: 01/25/2023]
Abstract
INTRODUCTION Machine learning (ML) is a set of models and methods that can detect patterns in vast amounts of data and use this information to perform various kinds of decision-making under uncertain conditions. This review explores the current role of this technology in plastic surgery by outlining the applications in clinical practice, diagnostic and prognostic accuracies, and proposed future direction for clinical applications and research. METHODS EMBASE, MEDLINE, CENTRAL and ClinicalTrials.gov were searched from 1990 to 2020. Any clinical studies (including case reports) which present the diagnostic and prognostic accuracies of machine learning models in the clinical setting of plastic surgery were included. Data collected were clinical indication, model utilised, reported accuracies, and comparison with clinical evaluation. RESULTS The database identified 1181 articles, of which 51 articles were included in this review. The clinical utility of these algorithms was to assist clinicians in diagnosis prediction (n=22), outcome prediction (n=21) and pre-operative planning (n=8). The mean accuracy is 88.80%, 86.11% and 80.28% respectively. The most commonly used models were neural networks (n=31), support vector machines (n=13), decision trees/random forests (n=10) and logistic regression (n=9). CONCLUSIONS ML has demonstrated high accuracies in diagnosis and prognostication of burn patients, congenital or acquired facial deformities, and in cosmetic surgery. There are no studies comparing ML to clinician's performance. Future research can be enhanced using larger datasets or utilising data augmentation, employing novel deep learning models, and applying these to other subspecialties of plastic surgery.
Collapse
Affiliation(s)
| | | | | | - Ankur Khajuria
- Kellogg College, University of Oxford
- Department of Surgery and Cancer, Imperial College London, UK
| |
Collapse
|