1
|
Zhong C, Xiong Y, Tang W, Guo J. A Stage-Wise Residual Attention Generation Adversarial Network for Mandibular Defect Repairing and Reconstruction. Int J Neural Syst 2024; 34:2450033. [PMID: 38623651 DOI: 10.1142/s0129065724500333] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/17/2024]
Abstract
Surgical reconstruction of mandibular defects is a clinical routine manner for the rehabilitation of patients with deformities. The mandible plays a crucial role in maintaining the facial contour and ensuring the speech and mastication functions. The repairing and reconstruction of mandible defects is a significant yet challenging task in oral-maxillofacial surgery. Currently, the mainly available methods are traditional digitalized design methods that suffer from substantial artificial operations, limited applicability and high reconstruction error rates. An automated, precise, and individualized method is imperative for maxillofacial surgeons. In this paper, we propose a Stage-wise Residual Attention Generative Adversarial Network (SRA-GAN) for mandibular defect reconstruction. Specifically, we design a stage-wise residual attention mechanism for generator to enhance the extraction capability of mandibular remote spatial information, making it adaptable to various defects. For the discriminator, we propose a multi-field perceptual network, consisting of two parallel discriminators with different perceptual fields, to reduce the cumulative reconstruction errors. Furthermore, we design a self-encoder perceptual loss function to ensure the correctness of mandibular anatomical structures. The experimental results on a novel custom-built mandibular defect dataset demonstrate that our method has a promising prospect in clinical application, achieving the best Dice Similarity Coefficient (DSC) of 94.238% and 95% Hausdorff Distance (HD95) of 4.787.
Collapse
Affiliation(s)
- Chenglan Zhong
- Machine Intelligence Laboratory, College of Computer Science, Sichuan University, Chengdu 610065, P. R. China
| | - Yutao Xiong
- State Key Laboratory of Oral Diseases & National Center for Stomatology & National Clinical Research Center for Oral Diseases & Department of Oral and Maxillofacial Surgery, West China Hospital of Stomatology, Sichuan University, Chengdu 610041, P. R. China
| | - Wei Tang
- State Key Laboratory of Oral Diseases & National Center for Stomatology & National Clinical Research Center for Oral Diseases & Department of Oral and Maxillofacial Surgery, West China Hospital of Stomatology, Sichuan University, Chengdu 610041, P. R. China
| | - Jixiang Guo
- Machine Intelligence Laboratory, College of Computer Science, Sichuan University, Chengdu 610065, P. R. China
| |
Collapse
|
2
|
George MJ, Dias-Neto M, Ramos Tenorio E, Skibber MA, Morris JM, Oderich GS. 3D printing in aortic endovascular therapies. THE JOURNAL OF CARDIOVASCULAR SURGERY 2022; 63:597-605. [PMID: 35822744 DOI: 10.23736/s0021-9509.22.12407-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Endovascular treatment of aortic disease, including aneurysm or dissection, is expanding at a rapid pace. Often, the specific patient anatomy in these cases is complex. Additive manufacturing, also known as three-dimensional (3D) printing, is especially useful in the treatment of aortic disease, due to its ability to manufacture physical models of complex patient anatomy. Compared to other surgical procedures, endovascular aortic repair can readily exploit the advantages of 3D printing with regard to operative planning and preoperative training. To date, there have been numerous uses of 3D printing in the treatment of aortic pathology as an adjunct in presurgical planning and as a basis for training modules for fellows and residents. In this review, we summarize the current uses of 3D printing in the endovascular management of aortic disease. We also review the process of producing these models, the limitations of their applications, and future directions of 3D printing in this field.
Collapse
Affiliation(s)
- Mitchell J George
- Department of Cardiothoracic and Vascular Surgery, McGovern Medical School at The University of Texas Health Science Center at Houston (UTHealth), Houston, TX, USA -
| | - Marina Dias-Neto
- Department of Cardiothoracic and Vascular Surgery, McGovern Medical School at The University of Texas Health Science Center at Houston (UTHealth), Houston, TX, USA
| | - Emanuel Ramos Tenorio
- Department of Cardiothoracic and Vascular Surgery, McGovern Medical School at The University of Texas Health Science Center at Houston (UTHealth), Houston, TX, USA
| | - Max A Skibber
- Department of Cardiothoracic and Vascular Surgery, McGovern Medical School at The University of Texas Health Science Center at Houston (UTHealth), Houston, TX, USA
| | - Jonathan M Morris
- Unit of Anatomic Modeling, Division of Neuroradiology, Department of Radiology, Mayo Clinic, Rochester, MN, USA
| | - Gustavo S Oderich
- Department of Cardiothoracic and Vascular Surgery, McGovern Medical School at The University of Texas Health Science Center at Houston (UTHealth), Houston, TX, USA
| |
Collapse
|
3
|
Li J, Pimentel P, Szengel A, Ehlke M, Lamecker H, Zachow S, Estacio L, Doenitz C, Ramm H, Shi H, Chen X, Matzkin F, Newcombe V, Ferrante E, Jin Y, Ellis DG, Aizenberg MR, Kodym O, Spanel M, Herout A, Mainprize JG, Fishman Z, Hardisty MR, Bayat A, Shit S, Wang B, Liu Z, Eder M, Pepe A, Gsaxner C, Alves V, Zefferer U, von Campe G, Pistracher K, Schafer U, Schmalstieg D, Menze BH, Glocker B, Egger J. AutoImplant 2020-First MICCAI Challenge on Automatic Cranial Implant Design. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:2329-2342. [PMID: 33939608 DOI: 10.1109/tmi.2021.3077047] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/17/2023]
Abstract
The aim of this paper is to provide a comprehensive overview of the MICCAI 2020 AutoImplant Challenge. The approaches and publications submitted and accepted within the challenge will be summarized and reported, highlighting common algorithmic trends and algorithmic diversity. Furthermore, the evaluation results will be presented, compared and discussed in regard to the challenge aim: seeking for low cost, fast and fully automated solutions for cranial implant design. Based on feedback from collaborating neurosurgeons, this paper concludes by stating open issues and post-challenge requirements for intra-operative use. The codes can be found at https://github.com/Jianningli/tmi.
Collapse
|
4
|
Memon AR, Li J, Egger J, Chen X. A review on patient-specific facial and cranial implant design using Artificial Intelligence (AI) techniques. Expert Rev Med Devices 2021; 18:985-994. [PMID: 34404280 DOI: 10.1080/17434440.2021.1969914] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
INTRODUCTION Researchers and engineers have found their importance in healthcare industry including recent updates in patient-specific implant (PSI) design. CAD/CAM technology plays an important role in the design and development of Artificial Intelligence (AI) based implants.The across the globe have their interest focused on the design and manufacturing of AI-based implants in everyday professional use can decrease the cost, improve patient's health and increase efficiency, and thus many implant designers and manufacturers practice. AREAS COVERED The focus of this study has been to manufacture smart devices that can make contact with the world as normal people do, understand their language, and learn to improve from real-life examples. Machine learning can be guided using a heavy amount of data sets and algorithms that can improve its ability to learn to perform the task. In this review, artificial intelligence (AI), deep learning, and machine-learning techniques are studied in the design of biomedical implants. EXPERT OPINION The main purpose of this article was to highlight important AI techniques to design PSIs. These are the automatic techniques to help designers to design patient-specific implants using AI algorithms such as deep learning, machine learning, and some other automatic methods.
Collapse
Affiliation(s)
- Afaque Rafique Memon
- State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Institute of Bio-medical Manufacturing and Life Quality Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Jianning Li
- Faculty of Computer Science and Biomedical Engineering, Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria.,The Laboratory of Computer Algorithm for Medicine, Medical University of Graz, Graz, Austria.,Department of Neurosurgery, Medical University of Graz, Graz, Austria
| | - Jan Egger
- Faculty of Computer Science and Biomedical Engineering, Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria.,The Laboratory of Computer Algorithm for Medicine, Medical University of Graz, Graz, Austria.,Department of Neurosurgery, Medical University of Graz, Graz, Austria.,Department of Oral and Maxillofacial Surgery, Medical University of Graz, Graz, Austria
| | - Xiaojun Chen
- State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Institute of Bio-medical Manufacturing and Life Quality Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
5
|
Hangge P, Pershad Y, Witting AA, Albadawi H, Oklu R. Three-dimensional (3D) printing and its applications for aortic diseases. Cardiovasc Diagn Ther 2018; 8:S19-S25. [PMID: 29850416 DOI: 10.21037/cdt.2017.10.02] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
Three-dimensional (3D) printing is a process which generates prototypes from virtual objects in computer-aided design (CAD) software. Since 3D printing enables the creation of customized objects, it is a rapidly expanding field in an age of personalized medicine. We discuss the use of 3D printing in surgical planning, training, and creation of devices for the treatment of aortic diseases. 3D printing can provide operators with a hands-on model to interact with complex anatomy, enable prototyping of devices for implantation based upon anatomy, or even provide pre-procedural simulation. Potential exists to expand upon current uses of 3D printing to create personalized implantable devices such as grafts. Future studies should aim to demonstrate the impact of 3D printing on outcomes to make this technology more accessible to patients with complex aortic diseases.
Collapse
Affiliation(s)
- Patrick Hangge
- Division of Interventional Radiology, Mayo Clinic, Phoenix, AZ, USA
| | - Yash Pershad
- Division of Interventional Radiology, Mayo Clinic, Phoenix, AZ, USA
| | - Avery A Witting
- Division of Interventional Radiology, Mayo Clinic, Phoenix, AZ, USA
| | - Hassan Albadawi
- Division of Interventional Radiology, Mayo Clinic, Phoenix, AZ, USA
| | - Rahmi Oklu
- Division of Interventional Radiology, Mayo Clinic, Phoenix, AZ, USA
| |
Collapse
|
6
|
Chen X, Xu L, Li X, Egger J. Computer-aided implant design for the restoration of cranial defects. Sci Rep 2017; 7:4199. [PMID: 28646207 PMCID: PMC5482863 DOI: 10.1038/s41598-017-04454-6] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2016] [Accepted: 05/12/2017] [Indexed: 12/03/2022] Open
Abstract
Patient-specific cranial implants are important and necessary in the surgery of cranial defect restoration. However, traditional methods of manual design of cranial implants are complicated and time-consuming. Our purpose is to develop a novel software named EasyCrania to design the cranial implants conveniently and efficiently. The process can be divided into five steps, which are mirroring model, clipping surface, surface fitting, the generation of the initial implant and the generation of the final implant. The main concept of our method is to use the geometry information of the mirrored model as the base to generate the final implant. The comparative studies demonstrated that the EasyCrania can improve the efficiency of cranial implant design significantly. And, the intra- and inter-rater reliability of the software were stable, which were 87.07 ± 1.6% and 87.73 ± 1.4% respectively.
Collapse
Affiliation(s)
- Xiaojun Chen
- Institute of Biomedical Manufacturing and Life Quality Engineering, State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China.
| | - Lu Xu
- Institute of Biomedical Manufacturing and Life Quality Engineering, State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Xing Li
- Institute of Biomedical Manufacturing and Life Quality Engineering, State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Jan Egger
- Faculty of Computer Science and Biomedical Engineering, Institute for Computer Graphics and Vision, Graz University of Technology, Graz, Austria.
- BioTechMed-Graz, Graz, Austria.
| |
Collapse
|
7
|
Egger J, Gall M, Wallner J, Boechat P, Hann A, Li X, Chen X, Schmalstieg D. HTC Vive MeVisLab integration via OpenVR for medical applications. PLoS One 2017; 12:e0173972. [PMID: 28323840 PMCID: PMC5360258 DOI: 10.1371/journal.pone.0173972] [Citation(s) in RCA: 62] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2016] [Accepted: 03/01/2017] [Indexed: 01/30/2023] Open
Abstract
Virtual Reality, an immersive technology that replicates an environment via computer-simulated reality, gets a lot of attention in the entertainment industry. However, VR has also great potential in other areas, like the medical domain, Examples are intervention planning, training and simulation. This is especially of use in medical operations, where an aesthetic outcome is important, like for facial surgeries. Alas, importing medical data into Virtual Reality devices is not necessarily trivial, in particular, when a direct connection to a proprietary application is desired. Moreover, most researcher do not build their medical applications from scratch, but rather leverage platforms like MeVisLab, MITK, OsiriX or 3D Slicer. These platforms have in common that they use libraries like ITK and VTK, and provide a convenient graphical interface. However, ITK and VTK do not support Virtual Reality directly. In this study, the usage of a Virtual Reality device for medical data under the MeVisLab platform is presented. The OpenVR library is integrated into the MeVisLab platform, allowing a direct and uncomplicated usage of the head mounted display HTC Vive inside the MeVisLab platform. Medical data coming from other MeVisLab modules can directly be connected per drag-and-drop to the Virtual Reality module, rendering the data inside the HTC Vive for immersive virtual reality inspection.
Collapse
Affiliation(s)
- Jan Egger
- Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, Graz, Austria
- BioTechMed-Graz, Krenngasse 37/1, Graz, Austria
- * E-mail:
| | - Markus Gall
- Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, Graz, Austria
| | - Jürgen Wallner
- Medical University of Graz, Department of Oral and Maxillofacial Surgery, Auenbruggerplatz 5/1, Graz, Austria
| | - Pedro Boechat
- Medical University of Graz, Department of Oral and Maxillofacial Surgery, Auenbruggerplatz 5/1, Graz, Austria
| | - Alexander Hann
- Department of Internal Medicine I, Ulm University, Albert-Einstein-Allee 23, Ulm, Germany
| | - Xing Li
- Shanghai Jiao Tong University, School of Mechanical Engineering, Shanghai, China
| | - Xiaojun Chen
- Shanghai Jiao Tong University, School of Mechanical Engineering, Shanghai, China
| | - Dieter Schmalstieg
- Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, Graz, Austria
| |
Collapse
|