1
|
Mazzocchetti S, Spezialetti R, Bevini M, Badiali G, Lisanti G, Salti S, Di Stefano L. Neural shape completion for personalized Maxillofacial surgery. Sci Rep 2024; 14:19810. [PMID: 39191797 DOI: 10.1038/s41598-024-68084-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2024] [Accepted: 07/19/2024] [Indexed: 08/29/2024] Open
Abstract
In this paper, we investigate the effectiveness of shape completion neural networks as clinical aids in maxillofacial surgery planning. We present a pipeline to apply shape completion networks to automatically reconstruct complete eumorphic 3D meshes starting from a partial input mesh, easily obtained from CT data routinely acquired for surgery planning. Most of the existing works introduced solutions to aid the design of implants for cranioplasty, i.e. all the defects are located in the neurocranium. In this work, we focus on reconstructing defects localized on both neurocranium and splanchnocranium. To this end, we introduce a new dataset, specifically designed for this task, derived from publicly available CT scans and subjected to a comprehensive pre-processing procedure. All the scans in the dataset have been manually cleaned and aligned to a common reference system. In addition, we devised a pre-processing stage to automatically extract point clouds from the scans and enrich them with virtual defects. We experimentally compare several state-of-the-art point cloud completion networks and identify the two most promising models. Finally, expert surgeons evaluated the best-performing network on a clinical case. Our results show how casting the creation of personalized implants as a problem of shape completion is a promising approach for automatizing this complex task.
Collapse
Affiliation(s)
- Stefano Mazzocchetti
- eDIMES Lab - Laboratory of Bioengineering, Department of Medical and Surgical Sciences, University of Bologna, Bologna, Italy.
| | - Riccardo Spezialetti
- Department of Computer Science and Engineering (DISI), University of Bologna, Bologna, Italy
| | - Mirko Bevini
- Oral and Maxillo-Facial Surgery Unit, IRCCS Azienda Ospedaliero-Universitaria di Bologna, Bologna, Italy
| | - Giovanni Badiali
- Oral and Maxillo-Facial Surgery Unit, IRCCS Azienda Ospedaliero-Universitaria di Bologna, Bologna, Italy
- Department of Biomedical and Neuromotoric Science (DIBINEM), University of Bologna, Bologna, Italy
| | - Giuseppe Lisanti
- Department of Computer Science and Engineering (DISI), University of Bologna, Bologna, Italy
| | - Samuele Salti
- Department of Computer Science and Engineering (DISI), University of Bologna, Bologna, Italy
| | - Luigi Di Stefano
- Department of Computer Science and Engineering (DISI), University of Bologna, Bologna, Italy
| |
Collapse
|
2
|
Kopačin V, Zubčić V, Mumlek I, Mužević D, Rončević A, Lazar AM, Pavić AK, Koruga AS, Krivdić Z, Martinović I, Koruga N. Personalized 3D-printed cranial implants for complex cranioplasty using open-source software. Surg Neurol Int 2024; 15:39. [PMID: 38468644 PMCID: PMC10927182 DOI: 10.25259/sni_906_2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2023] [Accepted: 01/19/2024] [Indexed: 03/13/2024] Open
Abstract
Background Cranioplasty is a routine neurosurgery treatment used to correct cranial vault abnormalities. Utilization of 3D printing technology in the field of cranioplasty involving the reconstruction of cranial defects emerged as an advanced possibility of anatomical reshaping. The transformative impact of patient-specific 3D printed implants, focuses on their remarkable accuracy, customization capabilities, and enhanced biocompatibility. Methods The precise adaptation of implants to patient-specific anatomies, even in complex cases we presented, result in improved aesthetic outcomes and reduced surgical complications. The ability to create highly customized implants addresses the functional aspects of cranial defects and considers the psychological impact on patients. Results By combining technological innovation with personalized patient care, 3D printed cranioplasty emerges as a transformative avenue in cranial reconstruction, ultimately redefining the standards of success in neurosurgery. Conclusion 3D printing allows an excellent cranioplasty cosmesis achieved at a reasonable price without sacrificing patient outcomes. Wider implementation of this strategy can lead to significant healthcare cost savings.
Collapse
Affiliation(s)
- Vjekoslav Kopačin
- Department of Diagnostic and Interventional Radiology, University Hospital Center, Osijek, Croatia
- Faculty of Medicine, Josip Juraj Strossmayer University of Osijek, Croatia
| | - Vedran Zubčić
- Faculty of Medicine, Josip Juraj Strossmayer University of Osijek, Croatia
- Department of Maxillofacial and Oral Surgery, University Hospital Center, Osijek, Croatia
| | - Ivan Mumlek
- Faculty of Medicine, Josip Juraj Strossmayer University of Osijek, Croatia
- Department of Maxillofacial and Oral Surgery, University Hospital Center, Osijek, Croatia
| | - Dario Mužević
- Faculty of Medicine, Josip Juraj Strossmayer University of Osijek, Croatia
- Department of Neurosurgery, University Hospital Center, Osijek, Croatia
| | - Alen Rončević
- Faculty of Medicine, Josip Juraj Strossmayer University of Osijek, Croatia
- Department of Neurosurgery, University Hospital Center, Osijek, Croatia
| | - Ana-Maria Lazar
- Faculty of Medicine, Josip Juraj Strossmayer University of Osijek, Croatia
- Department of Maxillofacial and Oral Surgery, University Hospital Center, Osijek, Croatia
| | - Ana Kvolik Pavić
- Faculty of Medicine, Josip Juraj Strossmayer University of Osijek, Croatia
- Department of Maxillofacial and Oral Surgery, University Hospital Center, Osijek, Croatia
| | - Anamarija Soldo Koruga
- Faculty of Medicine, Josip Juraj Strossmayer University of Osijek, Croatia
- Department of Neurology, University Hospital Center, Osijek, Croatia
| | - Zdravka Krivdić
- Department of Diagnostic and Interventional Radiology, University Hospital Center, Osijek, Croatia
- Faculty of Medicine, Josip Juraj Strossmayer University of Osijek, Croatia
| | - Ivana Martinović
- Department of Information Sciences, Faculty of Humanities and Social Sciences, Josip Juraj Strossmayer University of Osijek, Osijek, Croatia
| | - Nenad Koruga
- Faculty of Medicine, Josip Juraj Strossmayer University of Osijek, Croatia
- Department of Neurosurgery, University Hospital Center, Osijek, Croatia
| |
Collapse
|
3
|
Haque F, Luscher AF, Mitchell KAS, Sutradhar A. Optimization of Fixations for Additively Manufactured Cranial Implants: Insights from Finite Element Analysis. Biomimetics (Basel) 2023; 8:498. [PMID: 37887630 PMCID: PMC10603949 DOI: 10.3390/biomimetics8060498] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2023] [Revised: 10/01/2023] [Accepted: 10/10/2023] [Indexed: 10/28/2023] Open
Abstract
With the emergence of additive manufacturing technology, patient-specific cranial implants using 3D printing have massively influenced the field. These implants offer improved surgical outcomes and aesthetic preservation. However, as additive manufacturing in cranial implants is still emerging, ongoing research is investigating their reliability and sustainability. The long-term biomechanical performance of these implants is critically influenced by factors such as implant material, anticipated loads, implant-skull interface geometry, and structural constraints, among others. The efficacy of cranial implants involves an intricate interplay of these factors, with fixation playing a pivotal role. This study addresses two critical concerns: determining the ideal number of fixation points for cranial implants and the optimal curvilinear distance between those points, thereby establishing a minimum threshold. Employing finite element analysis, the research incorporates variables such as implant shapes, sizes, materials, the number of fixation points, and their relative positions. The study reveals that the optimal number of fixation points ranges from four to five, accounting for defect size and shape. Moreover, the optimal curvilinear distance between two screws is approximately 40 mm for smaller implants and 60 mm for larger implants. Optimal fixation placement away from the center mitigates higher deflection due to overhangs. Notably, a symmetric screw orientation reduces deflection, enhancing implant stability. The findings offer crucial insights into optimizing fixation strategies for cranial implants, thereby aiding surgical decision-making guidelines.
Collapse
Affiliation(s)
- Fariha Haque
- Department of Mechanical and Aerospace Engineering, The Ohio State University, Columbus, OH 43210, USA; (F.H.); (A.F.L.)
| | - Anthony F. Luscher
- Department of Mechanical and Aerospace Engineering, The Ohio State University, Columbus, OH 43210, USA; (F.H.); (A.F.L.)
| | - Kerry-Ann S. Mitchell
- Department of Plastic Surgery, The Ohio State University Wexner Medical Center, Columbus, OH 43210, USA;
| | - Alok Sutradhar
- Department of Mechanical and Aerospace Engineering, The Ohio State University, Columbus, OH 43210, USA; (F.H.); (A.F.L.)
| |
Collapse
|
4
|
Li J, Ellis DG, Kodym O, Rauschenbach L, Rieß C, Sure U, Wrede KH, Alvarez CM, Wodzinski M, Daniol M, Hemmerling D, Mahdi H, Clement A, Kim E, Fishman Z, Whyne CM, Mainprize JG, Hardisty MR, Pathak S, Sindhura C, Gorthi RKSS, Kiran DV, Gorthi S, Yang B, Fang K, Li X, Kroviakov A, Yu L, Jin Y, Pepe A, Gsaxner C, Herout A, Alves V, Španěl M, Aizenberg MR, Kleesiek J, Egger J. Towards clinical applicability and computational efficiency in automatic cranial implant design: An overview of the AutoImplant 2021 cranial implant design challenge. Med Image Anal 2023; 88:102865. [PMID: 37331241 DOI: 10.1016/j.media.2023.102865] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2022] [Revised: 05/23/2023] [Accepted: 06/02/2023] [Indexed: 06/20/2023]
Abstract
Cranial implants are commonly used for surgical repair of craniectomy-induced skull defects. These implants are usually generated offline and may require days to weeks to be available. An automated implant design process combined with onsite manufacturing facilities can guarantee immediate implant availability and avoid secondary intervention. To address this need, the AutoImplant II challenge was organized in conjunction with MICCAI 2021, catering for the unmet clinical and computational requirements of automatic cranial implant design. The first edition of AutoImplant (AutoImplant I, 2020) demonstrated the general capabilities and effectiveness of data-driven approaches, including deep learning, for a skull shape completion task on synthetic defects. The second AutoImplant challenge (i.e., AutoImplant II, 2021) built upon the first by adding real clinical craniectomy cases as well as additional synthetic imaging data. The AutoImplant II challenge consisted of three tracks. Tracks 1 and 3 used skull images with synthetic defects to evaluate the ability of submitted approaches to generate implants that recreate the original skull shape. Track 3 consisted of the data from the first challenge (i.e., 100 cases for training, and 110 for evaluation), and Track 1 provided 570 training and 100 validation cases aimed at evaluating skull shape completion algorithms at diverse defect patterns. Track 2 also made progress over the first challenge by providing 11 clinically defective skulls and evaluating the submitted implant designs on these clinical cases. The submitted designs were evaluated quantitatively against imaging data from post-craniectomy as well as by an experienced neurosurgeon. Submissions to these challenge tasks made substantial progress in addressing issues such as generalizability, computational efficiency, data augmentation, and implant refinement. This paper serves as a comprehensive summary and comparison of the submissions to the AutoImplant II challenge. Codes and models are available at https://github.com/Jianningli/Autoimplant_II.
Collapse
Affiliation(s)
- Jianning Li
- Institute for AI in Medicine (IKIM), University Medicine Essen, Girardetstraße 2, 45131 Essen, Germany; Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16, 8010 Graz, Austria; Computer Algorithms for Medicine Laboratory, Graz, Austria.
| | - David G Ellis
- Department of Neurosurgery, University of Nebraska Medical Center, Omaha, NE, 68198, USA
| | - Oldřich Kodym
- Graph@FIT, Brno University of Technology, Brno, Czech Republic
| | - Laurèl Rauschenbach
- Department of Neurosurgery and Spine Surgery, University Hospital Essen, Hufelandstrasse 55, 45147 Essen, Germany
| | - Christoph Rieß
- Department of Neurosurgery and Spine Surgery, University Hospital Essen, Hufelandstrasse 55, 45147 Essen, Germany
| | - Ulrich Sure
- Department of Neurosurgery and Spine Surgery, University Hospital Essen, Hufelandstrasse 55, 45147 Essen, Germany
| | - Karsten H Wrede
- Department of Neurosurgery and Spine Surgery, University Hospital Essen, Hufelandstrasse 55, 45147 Essen, Germany
| | - Carlos M Alvarez
- Department of Neurosurgery, University of Nebraska Medical Center, Omaha, NE, 68198, USA
| | - Marek Wodzinski
- AGH University of Science and Technology, Department of Measurement and Electronics, Krakow, Poland; University of Applied Sciences Western Switzerland (HES-SO Valais), Information Systems Institute, Sierre, Switzerland
| | - Mateusz Daniol
- AGH University of Science and Technology, Department of Measurement and Electronics, Krakow, Poland
| | - Daria Hemmerling
- AGH University of Science and Technology, Department of Measurement and Electronics, Krakow, Poland
| | - Hamza Mahdi
- Sunnybrook Research Institute, Toronto, ON, Canada
| | | | - Evan Kim
- Sunnybrook Research Institute, Toronto, ON, Canada
| | | | - Cari M Whyne
- Sunnybrook Research Institute, Toronto, ON, Canada; Division of Orthopaedic Surgery, University of Toronto, Toronto, ON, M5T 1P5, Canada
| | - James G Mainprize
- Sunnybrook Research Institute, Toronto, ON, Canada; Calavera Surgical Design Inc., Toronto, ON, Canada
| | - Michael R Hardisty
- Sunnybrook Research Institute, Toronto, ON, Canada; Division of Orthopaedic Surgery, University of Toronto, Toronto, ON, M5T 1P5, Canada
| | - Shashwat Pathak
- Department of Electrical Engineering, Indian Institute of Technology, Tirupati, India
| | - Chitimireddy Sindhura
- Department of Electrical Engineering, Indian Institute of Technology, Tirupati, India
| | | | - Degala Venkata Kiran
- Department of Mechanical Engineering, Indian Institute of Technology, Tirupati, India
| | - Subrahmanyam Gorthi
- Department of Electrical Engineering, Indian Institute of Technology, Tirupati, India
| | - Bokai Yang
- Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB T6G 2R3, Canada
| | - Ke Fang
- Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB T6G 2R3, Canada
| | - Xingyu Li
- Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB T6G 2R3, Canada
| | - Artem Kroviakov
- Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16, 8010 Graz, Austria
| | - Lei Yu
- Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16, 8010 Graz, Austria
| | - Yuan Jin
- Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16, 8010 Graz, Austria; Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Antonio Pepe
- Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16, 8010 Graz, Austria; Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Christina Gsaxner
- Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16, 8010 Graz, Austria; Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Adam Herout
- Graph@FIT, Brno University of Technology, Brno, Czech Republic
| | - Victor Alves
- ALGORITMI Research Centre/LASI, University of Minho, Braga, Portugal
| | | | - Michele R Aizenberg
- Department of Neurosurgery, University of Nebraska Medical Center, Omaha, NE, 68198, USA
| | - Jens Kleesiek
- Institute for AI in Medicine (IKIM), University Medicine Essen, Girardetstraße 2, 45131 Essen, Germany
| | - Jan Egger
- Institute for AI in Medicine (IKIM), University Medicine Essen, Girardetstraße 2, 45131 Essen, Germany; Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16, 8010 Graz, Austria; Computer Algorithms for Medicine Laboratory, Graz, Austria.
| |
Collapse
|
5
|
Tantisatirapong S, Khunakornpattanakarn S, Suesatsakul T, Boonpratatong A, Benjamin I, Tongmeesee S, Kangkorn T, Chanwimalueang T. The simplified tailor-made workflows for a 3D slicer-based craniofacial implant design. Sci Rep 2023; 13:2850. [PMID: 36801943 PMCID: PMC9938178 DOI: 10.1038/s41598-023-30117-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2022] [Accepted: 02/15/2023] [Indexed: 02/19/2023] Open
Abstract
A specific design of craniofacial implant model is vital and urgent for patients with traumatic head injury. The mirror technique is commonly used for modeling these implants, but it requires the presence of a healthy skull region opposite to the defect. To address this limitation, we propose three processing workflows for modeling craniofacial implants: the mirror method, the baffle planner, and the baffle-based mirror guideline. These workflows are based on extension modules on the 3D Slicer platform and were developed to simplify the modeling process for a variety of craniofacial scenarios. To evaluate the effectiveness of these proposed workflows, we investigated craniofacial CT datasets collected from four accidental cases. The designed implant models were created using the three proposed workflows and compared to reference models created by an experienced neurosurgeon. The spatial properties of the models were evaluated using performance metrics. Our results show that the mirror method is suitable for cases where a healthy skull region can be completely reflected to the defect region. The baffle planner module offers a flexible prototype model that can be fit independently to any defect location, but it requires customized refinement of contour and thickness to fill the missing region seamlessly and relies on the user's experience and expertise. The proposed baffle-based mirror guideline method strengthens the baffle planner method by tracing the mirrored surface. Overall, our study suggests that the three proposed workflows for craniofacial implant modeling simplify the process and can be practically applied to a variety of craniofacial scenarios. These findings have the potential to improve the care of patients with traumatic head injuries and could be used by neurosurgeons and other medical professionals.
Collapse
Affiliation(s)
- Suchada Tantisatirapong
- Department of Biomedical Engineering, Faculty of Engineering, Srinakharinwirot University, Nakhon Nayok, 26120, Thailand
| | | | - Thanyakarn Suesatsakul
- Department of Biomedical Engineering, Faculty of Engineering, Srinakharinwirot University, Nakhon Nayok, 26120, Thailand
| | - Amaraporn Boonpratatong
- Department of Biomedical Engineering, Faculty of Engineering, Srinakharinwirot University, Nakhon Nayok, 26120, Thailand
| | - Itsara Benjamin
- Division of Plastic and Reconstructive Surgery, Department of Surgery, Chonburi Hospital, Chonburi, 20000, Thailand
| | - Somprasong Tongmeesee
- Division of Plastic and Reconstructive Surgery, Department of Surgery, Chonburi Hospital, Chonburi, 20000, Thailand
| | - Tanasit Kangkorn
- Division of Plastic and Reconstructive Surgery, Department of Surgery, Chonburi Hospital, Chonburi, 20000, Thailand
| | - Theerasak Chanwimalueang
- Department of Biomedical Engineering, Faculty of Engineering, Srinakharinwirot University, Nakhon Nayok, 26120, Thailand.
| |
Collapse
|
6
|
Abreu de Souza M, Alka Cordeiro DC, de Oliveira J, de Oliveira MFA, Bonafini BL. 3D Multi-Modality Medical Imaging: Combining Anatomical and Infrared Thermal Images for 3D Reconstruction. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23031610. [PMID: 36772650 PMCID: PMC9919921 DOI: 10.3390/s23031610] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Revised: 01/17/2023] [Accepted: 01/25/2023] [Indexed: 06/12/2023]
Abstract
Medical thermography provides an overview of the human body with two-dimensional (2D) information that assists the identification of temperature changes, based on the analysis of surface distribution. However, this approach lacks spatial depth information, which can be enhanced by adding multiple images or three-dimensional (3D) systems. Therefore, the methodology applied for this paper generates a 3D point cloud (from thermal infrared images), a 3D geometry model (from CT images), and the segmented inner anatomical structures. Thus, the following computational processing was employed: Structure from Motion (SfM), image registration, and alignment (affine transformation) between the 3D models obtained to combine and unify them. This paper presents the 3D reconstruction and visualization of the respective geometry of the neck/bust and inner anatomical structures (thyroid, trachea, veins, and arteries). Additionally, it shows the whole 3D thermal geometry in different anatomical sections (i.e., coronal, sagittal, and axial), allowing it to be further examined by a medical team, improving pathological assessments. The generation of 3D thermal anatomy models allows for a combined visualization, i.e., functional and anatomical images of the neck region, achieving encouraging results. These 3D models bring correlation of the inner and outer regions, which could improve biomedical applications and future diagnosis with such a methodology.
Collapse
|
7
|
Thimukonda Jegadeesan J, Baldia M, Basu B. Next-generation personalized cranioplasty treatment. Acta Biomater 2022; 154:63-82. [PMID: 36272686 DOI: 10.1016/j.actbio.2022.10.030] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Revised: 10/10/2022] [Accepted: 10/13/2022] [Indexed: 12/14/2022]
Abstract
Decompressive craniectomy (DC) is a surgical procedure, that is followed by cranioplasty surgery. DC is usually performed to treat patients with traumatic brain injury, intracranial hemorrhage, cerebral infarction, brain edema, skull fractures, etc. In many published clinical case studies and systematic reviews, cranioplasty surgery is reported to restore cranial symmetry with good cosmetic outcomes and neurophysiologically relevant functional outcomes in hundreds of patients. In this review article, we present a number of key issues related to the manufacturing of patient-specific implants, clinical complications, cosmetic outcomes, and newer alternative therapies. While discussing alternative therapeutic treatments for cranioplasty, biomolecules and cellular-based approaches have been emphasized. The current clinical practices in the restoration of cranial defects involve 3D printing to produce patient-specific prefabricated cranial implants, that provide better cosmetic outcomes. Regardless of the advancements in image processing and 3D printing, the complete clinical procedure is time-consuming and requires significant costs. To reduce manual intervention and to address unmet clinical demands, it has been highlighted that automated implant fabrication by data-driven methods can accelerate the design and manufacturing of patient-specific cranial implants. The data-driven approaches, encompassing artificial intelligence (machine learning/deep learning) and E-platforms, such as publicly accessible clinical databases will lead to the development of the next generation of patient-specific cranial implants, which can provide predictable clinical outcomes. STATEMENT OF SIGNIFICANCE: Cranioplasty is performed to reconstruct cranial defects of patients who have undergone decompressive craniectomy. Cranioplasty surgery improves the aesthetic and functional outcomes of those patients. To meet the clinical demands of cranioplasty surgery, accelerated designing and manufacturing of 3D cranial implants are required. This review provides an overview of biomaterial implants and bone flap manufacturing methods for cranioplasty surgery. In addition, tissue engineering and regenerative medicine-based approaches to reduce clinical complications are also highlighted. The potential use of data-driven computer applications and data-driven artificial intelligence-based approaches are emphasized to accelerate the clinical protocols of cranioplasty treatment with less manual intervention and shorter intraoperative time.
Collapse
Affiliation(s)
| | - Manish Baldia
- Department of Neurosurgery, Jaslok Hospital and Research Centre, Mumbai, Maharashtra 400026, India
| | - Bikramjit Basu
- Materials Research Centre, Indian Institute of Science, CV Raman Road, Bangalore, Karnataka 560012, India; Centre for Biosystems Science and Engineering, Indian Institute of Science, Bangalore, Karnataka 560012, India.
| |
Collapse
|
8
|
Veletić M, Apu EH, Simić M, Bergsland J, Balasingham I, Contag CH, Ashammakhi N. Implants with Sensing Capabilities. Chem Rev 2022; 122:16329-16363. [PMID: 35981266 DOI: 10.1021/acs.chemrev.2c00005] [Citation(s) in RCA: 25] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
Because of the aging human population and increased numbers of surgical procedures being performed, there is a growing number of biomedical devices being implanted each year. Although the benefits of implants are significant, there are risks to having foreign materials in the body that may lead to complications that may remain undetectable until a time at which the damage done becomes irreversible. To address this challenge, advances in implantable sensors may enable early detection of even minor changes in the implants or the surrounding tissues and provide early cues for intervention. Therefore, integrating sensors with implants will enable real-time monitoring and lead to improvements in implant function. Sensor integration has been mostly applied to cardiovascular, neural, and orthopedic implants, and advances in combined implant-sensor devices have been significant, yet there are needs still to be addressed. Sensor-integrating implants are still in their infancy; however, some have already made it to the clinic. With an interdisciplinary approach, these sensor-integrating devices will become more efficient, providing clear paths to clinical translation in the future.
Collapse
Affiliation(s)
- Mladen Veletić
- Department of Electronic Systems, Norwegian University of Science and Technology, 7491 Trondheim, Norway.,The Intervention Centre, Technology and Innovation Clinic, Oslo University Hospital, 0372 Oslo, Norway
| | - Ehsanul Hoque Apu
- Institute for Quantitative Health Science and Engineering (IQ) and Department of Biomedical Engineering (BME), Michigan State University, East Lansing, Michigan 48824, United States.,Division of Hematology and Oncology, Department of Internal Medicine, Michigan Medicine, University of Michigan, Ann Arbor, Michigan 48105, United States
| | - Mitar Simić
- Faculty of Electrical Engineering, University of Banja Luka, 78000 Banja Luka, Bosnia and Herzegovina
| | - Jacob Bergsland
- The Intervention Centre, Technology and Innovation Clinic, Oslo University Hospital, 0372 Oslo, Norway
| | - Ilangko Balasingham
- Department of Electronic Systems, Norwegian University of Science and Technology, 7491 Trondheim, Norway.,The Intervention Centre, Technology and Innovation Clinic, Oslo University Hospital, 0372 Oslo, Norway
| | - Christopher H Contag
- Institute for Quantitative Health Science and Engineering (IQ) and Department of Biomedical Engineering (BME), Michigan State University, East Lansing, Michigan 48824, United States
| | - Nureddin Ashammakhi
- Institute for Quantitative Health Science and Engineering (IQ) and Department of Biomedical Engineering (BME), Michigan State University, East Lansing, Michigan 48824, United States.,Department of Bioengineering, University of California, Los Angeles, California 90095, United States
| |
Collapse
|
9
|
Sulakhe H, Li J, Egger J, Goyal P. CranGAN: Adversarial Point Cloud Reconstruction for patient-specific Cranial Implant Design. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:603-608. [PMID: 36085744 DOI: 10.1109/embc48229.2022.9871069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Automatizing cranial implant design has become an increasingly important avenue in biomedical research. Benefits in terms of financial resources, time and patient safety necessitate the formulation of an efficient and accurate procedure for the same. This paper attempts to provide a new research direction to this problem, through an adversarial deep learning solution. Specifically, in this work, we present CranGAN - a 3D Conditional Generative Adversarial Network designed to reconstruct a 3D representation of a complete skull given its defective counterpart. A novel solution of employing point cloud representations instead of conventional 3D meshes and voxel grids is proposed. We provide both qualitative and quantitative analysis of our experiments with three separate GAN objectives, and compare the utility of two 3D reconstruction loss functions viz. Hausdorff Distance and Chamfer Distance. We hope that our work inspires further research in this direction. Clinical relevance- This paper establishes a new research direction to assist in automated implant design for cranioplasty.
Collapse
|
10
|
Xiong YT, Zeng W, Xu L, Guo JX, Liu C, Chen JT, Du XY, Tang W. Virtual reconstruction of midfacial bone defect based on generative adversarial network. Head Face Med 2022; 18:19. [PMID: 35761334 PMCID: PMC9235085 DOI: 10.1186/s13005-022-00325-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2022] [Accepted: 05/19/2022] [Indexed: 02/08/2023] Open
Abstract
BACKGROUND The study aims to evaluate the accuracy of the generative adversarial networks (GAN) for reconstructing bony midfacial defects. METHODS According to anatomy, the bony midface was divided into five subunit structural regions and artificial defects are manually created on the corresponding CT images. GAN is trained to reconstruct artificial defects to their previous normal shape and tested. The clinical defects are reconstructed by the trained GAN, where the midspan defects were used for qualitative evaluation and the unilateral defects were used for quantitative evaluation. The cosine similarity and the mean error are used to evaluate the accuracy of reconstruction. The Mann-Whitney U test is used to detect whether reconstruction errors were consistent in artificial and unilateral clinical defects. RESULTS This study included 518 normal CT data, with 415 in training set and 103 in testing set, and 17 real patient data, with 2 midspan defects and 15 unilateral defects. Reconstruction of midspan clinical defects assessed by experts is acceptable. The cosine similarity in the reconstruction of artificial defects and unilateral clinical defects is 0.97 ± 0.01 and 0.96 ± 0.01, P = 0.695. The mean error in the reconstruction of artificial defects and unilateral clinical defects is 0.59 ± 0.31 mm and 0.48 ± 0.08 mm, P = 0.09. CONCLUSION GAN-based virtual reconstruction technology has reached a high accuracy in testing set, and statistical tests suggest that it can achieve similar results in real patient data. This study has preliminarily solved the problem of bony midfacial defect without reference.
Collapse
Affiliation(s)
- Yu-Tao Xiong
- State Key Laboratory of Oral Diseases and National Clinical Research Centre for Oral Diseases and Department of Oral and Maxillofacial Surgery, West China Hospital of Stomatology, Sichuan University, No.14, 3rd section of Ren Min Nan Road, Chengdu, 610041, China
| | - Wei Zeng
- State Key Laboratory of Oral Diseases and National Clinical Research Centre for Oral Diseases and Department of Oral and Maxillofacial Surgery, West China Hospital of Stomatology, Sichuan University, No.14, 3rd section of Ren Min Nan Road, Chengdu, 610041, China
| | - Lei Xu
- Machine Intelligence Laboratory, College of Computer Science, Sichuan University, Chengdu, 610065, China
| | - Ji-Xiang Guo
- Machine Intelligence Laboratory, College of Computer Science, Sichuan University, Chengdu, 610065, China
| | - Chang Liu
- State Key Laboratory of Oral Diseases and National Clinical Research Centre for Oral Diseases and Department of Oral and Maxillofacial Surgery, West China Hospital of Stomatology, Sichuan University, No.14, 3rd section of Ren Min Nan Road, Chengdu, 610041, China
| | - Jun-Tian Chen
- State Key Laboratory of Oral Diseases and National Clinical Research Centre for Oral Diseases and Department of Oral and Maxillofacial Surgery, West China Hospital of Stomatology, Sichuan University, No.14, 3rd section of Ren Min Nan Road, Chengdu, 610041, China
| | - Xin-Ya Du
- Department of Stomatology, the People's Hospital of Longhua, Shenzhen, 518109, China
| | - Wei Tang
- State Key Laboratory of Oral Diseases and National Clinical Research Centre for Oral Diseases and Department of Oral and Maxillofacial Surgery, West China Hospital of Stomatology, Sichuan University, No.14, 3rd section of Ren Min Nan Road, Chengdu, 610041, China.
| |
Collapse
|
11
|
Egger J, Wild D, Weber M, Bedoya CAR, Karner F, Prutsch A, Schmied M, Dionysio C, Krobath D, Jin Y, Gsaxner C, Li J, Pepe A. Studierfenster: an Open Science Cloud-Based Medical Imaging Analysis Platform. J Digit Imaging 2022; 35:340-355. [PMID: 35064372 PMCID: PMC8782222 DOI: 10.1007/s10278-021-00574-8] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2021] [Revised: 12/14/2021] [Accepted: 12/16/2021] [Indexed: 02/06/2023] Open
Abstract
Imaging modalities such as computed tomography (CT) and magnetic resonance imaging (MRI) are widely used in diagnostics, clinical studies, and treatment planning. Automatic algorithms for image analysis have thus become an invaluable tool in medicine. Examples of this are two- and three-dimensional visualizations, image segmentation, and the registration of all anatomical structure and pathology types. In this context, we introduce Studierfenster (www.studierfenster.at): a free, non-commercial open science client-server framework for (bio-)medical image analysis. Studierfenster offers a wide range of capabilities, including the visualization of medical data (CT, MRI, etc.) in two-dimensional (2D) and three-dimensional (3D) space in common web browsers, such as Google Chrome, Mozilla Firefox, Safari, or Microsoft Edge. Other functionalities are the calculation of medical metrics (dice score and Hausdorff distance), manual slice-by-slice outlining of structures in medical images, manual placing of (anatomical) landmarks in medical imaging data, visualization of medical data in virtual reality (VR), and a facial reconstruction and registration of medical data for augmented reality (AR). More sophisticated features include the automatic cranial implant design with a convolutional neural network (CNN), the inpainting of aortic dissections with a generative adversarial network, and a CNN for automatic aortic landmark detection in CT angiography images. A user study with medical and non-medical experts in medical image analysis was performed, to evaluate the usability and the manual functionalities of Studierfenster. When participants were asked about their overall impression of Studierfenster in an ISO standard (ISO-Norm) questionnaire, a mean of 6.3 out of 7.0 possible points were achieved. The evaluation also provided insights into the results achievable with Studierfenster in practice, by comparing these with two ground truth segmentations performed by a physician of the Medical University of Graz in Austria. In this contribution, we presented an online environment for (bio-)medical image analysis. In doing so, we established a client-server-based architecture, which is able to process medical data, especially 3D volumes. Our online environment is not limited to medical applications for humans. Rather, its underlying concept could be interesting for researchers from other fields, in applying the already existing functionalities or future additional implementations of further image processing applications. An example could be the processing of medical acquisitions like CT or MRI from animals [Clinical Pharmacology & Therapeutics, 84(4):448–456, 68], which get more and more common, as veterinary clinics and centers get more and more equipped with such imaging devices. Furthermore, applications in entirely non-medical research in which images/volumes need to be processed are also thinkable, such as those in optical measuring techniques, astronomy, or archaeology.
Collapse
Affiliation(s)
- Jan Egger
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia.
- Computer Algorithms for Medicine Laboratory, Graz, Austria.
- Institute for Artificial Intelligence in Medicine, AI-guided Therapies, University Hospital Essen, Girardetstraße 2, 45131, Essen, Germany.
| | - Daniel Wild
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Maximilian Weber
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Christopher A Ramirez Bedoya
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Florian Karner
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Alexander Prutsch
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Michael Schmied
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Christina Dionysio
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Dominik Krobath
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Yuan Jin
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
- Research Center for Connected Healthcare Big Data, ZhejiangLab, 311121, Hangzhou, Zhejiang, China
| | - Christina Gsaxner
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Jianning Li
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
- Institute for Artificial Intelligence in Medicine, AI-guided Therapies, University Hospital Essen, Girardetstraße 2, 45131, Essen, Germany
| | - Antonio Pepe
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| |
Collapse
|
12
|
Li J, Pimentel P, Szengel A, Ehlke M, Lamecker H, Zachow S, Estacio L, Doenitz C, Ramm H, Shi H, Chen X, Matzkin F, Newcombe V, Ferrante E, Jin Y, Ellis DG, Aizenberg MR, Kodym O, Spanel M, Herout A, Mainprize JG, Fishman Z, Hardisty MR, Bayat A, Shit S, Wang B, Liu Z, Eder M, Pepe A, Gsaxner C, Alves V, Zefferer U, von Campe G, Pistracher K, Schafer U, Schmalstieg D, Menze BH, Glocker B, Egger J. AutoImplant 2020-First MICCAI Challenge on Automatic Cranial Implant Design. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:2329-2342. [PMID: 33939608 DOI: 10.1109/tmi.2021.3077047] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/17/2023]
Abstract
The aim of this paper is to provide a comprehensive overview of the MICCAI 2020 AutoImplant Challenge. The approaches and publications submitted and accepted within the challenge will be summarized and reported, highlighting common algorithmic trends and algorithmic diversity. Furthermore, the evaluation results will be presented, compared and discussed in regard to the challenge aim: seeking for low cost, fast and fully automated solutions for cranial implant design. Based on feedback from collaborating neurosurgeons, this paper concludes by stating open issues and post-challenge requirements for intra-operative use. The codes can be found at https://github.com/Jianningli/tmi.
Collapse
|
13
|
Memon AR, Li J, Egger J, Chen X. A review on patient-specific facial and cranial implant design using Artificial Intelligence (AI) techniques. Expert Rev Med Devices 2021; 18:985-994. [PMID: 34404280 DOI: 10.1080/17434440.2021.1969914] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
INTRODUCTION Researchers and engineers have found their importance in healthcare industry including recent updates in patient-specific implant (PSI) design. CAD/CAM technology plays an important role in the design and development of Artificial Intelligence (AI) based implants.The across the globe have their interest focused on the design and manufacturing of AI-based implants in everyday professional use can decrease the cost, improve patient's health and increase efficiency, and thus many implant designers and manufacturers practice. AREAS COVERED The focus of this study has been to manufacture smart devices that can make contact with the world as normal people do, understand their language, and learn to improve from real-life examples. Machine learning can be guided using a heavy amount of data sets and algorithms that can improve its ability to learn to perform the task. In this review, artificial intelligence (AI), deep learning, and machine-learning techniques are studied in the design of biomedical implants. EXPERT OPINION The main purpose of this article was to highlight important AI techniques to design PSIs. These are the automatic techniques to help designers to design patient-specific implants using AI algorithms such as deep learning, machine learning, and some other automatic methods.
Collapse
Affiliation(s)
- Afaque Rafique Memon
- State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Institute of Bio-medical Manufacturing and Life Quality Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Jianning Li
- Faculty of Computer Science and Biomedical Engineering, Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria.,The Laboratory of Computer Algorithm for Medicine, Medical University of Graz, Graz, Austria.,Department of Neurosurgery, Medical University of Graz, Graz, Austria
| | - Jan Egger
- Faculty of Computer Science and Biomedical Engineering, Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria.,The Laboratory of Computer Algorithm for Medicine, Medical University of Graz, Graz, Austria.,Department of Neurosurgery, Medical University of Graz, Graz, Austria.,Department of Oral and Maxillofacial Surgery, Medical University of Graz, Graz, Austria
| | - Xiaojun Chen
- State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Institute of Bio-medical Manufacturing and Life Quality Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
14
|
Li J, von Campe G, Pepe A, Gsaxner C, Wang E, Chen X, Zefferer U, Tödtling M, Krall M, Deutschmann H, Schäfer U, Schmalstieg D, Egger J. Automatic skull defect restoration and cranial implant generation for cranioplasty. Med Image Anal 2021; 73:102171. [PMID: 34340106 DOI: 10.1016/j.media.2021.102171] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2020] [Revised: 07/09/2021] [Accepted: 07/12/2021] [Indexed: 11/25/2022]
Abstract
A fast and fully automatic design of 3D printed patient-specific cranial implants is highly desired in cranioplasty - the process to restore a defect on the skull. We formulate skull defect restoration as a 3D volumetric shape completion task, where a partial skull volume is completed automatically. The difference between the completed skull and the partial skull is the restored defect; in other words, the implant that can be used in cranioplasty. To fulfill the task of volumetric shape completion, a fully data-driven approach is proposed. Supervised skull shape learning is performed on a database containing 167 high-resolution healthy skulls. In these skulls, synthetic defects are injected to create training and evaluation data pairs. We propose a patch-based training scheme tailored for dealing with high-resolution and spatially sparse data, which overcomes the disadvantages of conventional patch-based training methods in high-resolution volumetric shape completion tasks. In particular, the conventional patch-based training is applied to images of high resolution and proves to be effective in tasks such as segmentation. However, we demonstrate the limitations of conventional patch-based training for shape completion tasks, where the overall shape distribution of the target has to be learnt, since it cannot be captured efficiently by a sub-volume cropped from the target. Additionally, the standard dense implementation of a convolutional neural network tends to perform poorly on sparse data, such as the skull, which has a low voxel occupancy rate. Our proposed training scheme encourages a convolutional neural network to learn from the high-resolution and spatially sparse data. In our study, we show that our deep learning models, trained on healthy skulls with synthetic defects, can be transferred directly to craniotomy skulls with real defects of greater irregularity, and the results show promise for clinical use. Project page: https://github.com/Jianningli/MIA.
Collapse
Affiliation(s)
- Jianning Li
- Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16, Graz 8010, Austria; Computer Algorithms for Medicine Laboratory, Graz, Austria; BioTechMed-Graz, Mozartgasse 12/II, Graz 8010, Austria; Research Unit Experimental Neurotraumatology, Department of Neurosurgery, Medical University Graz, Auenbruggerplatz 2(2), Graz 8036, Austria.
| | - Gord von Campe
- Department of Neurosurgery, Medical University of Graz, Auenbruggerplatz 29, Graz, Austria
| | - Antonio Pepe
- Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16, Graz 8010, Austria; Computer Algorithms for Medicine Laboratory, Graz, Austria; BioTechMed-Graz, Mozartgasse 12/II, Graz 8010, Austria
| | - Christina Gsaxner
- Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16, Graz 8010, Austria; Computer Algorithms for Medicine Laboratory, Graz, Austria; BioTechMed-Graz, Mozartgasse 12/II, Graz 8010, Austria
| | - Enpeng Wang
- School of Mechanical Engineering, Shanghai Jiao Tong University, Minhang District, Shanghai 200240, China
| | - Xiaojun Chen
- School of Mechanical Engineering, Shanghai Jiao Tong University, Minhang District, Shanghai 200240, China
| | - Ulrike Zefferer
- Research Unit Experimental Neurotraumatology, Department of Neurosurgery, Medical University Graz, Auenbruggerplatz 2(2), Graz 8036, Austria
| | - Martin Tödtling
- Research Unit Experimental Neurotraumatology, Department of Neurosurgery, Medical University Graz, Auenbruggerplatz 2(2), Graz 8036, Austria
| | - Marcell Krall
- Research Unit Experimental Neurotraumatology, Department of Neurosurgery, Medical University Graz, Auenbruggerplatz 2(2), Graz 8036, Austria
| | - Hannes Deutschmann
- Department of Radiology, Medical University of Graz, Auenbruggerplatz 9, Graz 8036, Austria
| | - Ute Schäfer
- Research Unit Experimental Neurotraumatology, Department of Neurosurgery, Medical University Graz, Auenbruggerplatz 2(2), Graz 8036, Austria; BioTechMed-Graz, Mozartgasse 12/II, Graz 8010, Austria
| | - Dieter Schmalstieg
- Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16, Graz 8010, Austria; BioTechMed-Graz, Mozartgasse 12/II, Graz 8010, Austria
| | - Jan Egger
- Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16, Graz 8010, Austria; Department of Oral and Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 2, Graz 8036, Austria; Computer Algorithms for Medicine Laboratory, Graz, Austria; BioTechMed-Graz, Mozartgasse 12/II, Graz 8010, Austria.
| |
Collapse
|
15
|
Wittner C, Borowski M, Pirl L, Kastner J, Schrempf A, Schäfer U, Trieb K, Senck S. Thickness accuracy of virtually designed patient-specific implants for large neurocranial defects. J Anat 2021; 239:755-770. [PMID: 34086982 PMCID: PMC8450480 DOI: 10.1111/joa.13465] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2021] [Revised: 04/27/2021] [Accepted: 05/12/2021] [Indexed: 12/15/2022] Open
Abstract
The combination of computer‐aided design (CAD) techniques based on computed tomography (CT) data to generate patient‐specific implants is in use for decades. However, persisting disadvantages are complicated design procedures and rigid reconstruction protocols, for example, for tailored implants mimicking the patient‐specific thickness distribution of missing cranial bone. In this study we used two different approaches, CAD‐ versus thin‐plate spline (TPS)‐based implants, to reconstruct extensive unilateral and bilateral cranial defects in three clinical cases. We used CT data of three complete human crania that were virtually damaged according to the missing regions in the clinical cases. In total, we carried out 132 virtual reconstructions and quantified accuracy from the original to the generated implant and deviations in the resulting implant thickness as root‐mean‐square error (RMSE). Reconstructions using TPS showed an RMSE of 0.08–0.18 mm in relation to geometric accuracy. CAD‐based implants showed an RMSE of 0.50–1.25 mm. RMSE in relation to implant thickness was between 0.63 and 0.70 mm (TPS) while values for CAD‐based implants were significantly higher (0.63–1.67 mm). While both approaches provide implants showing a high accuracy, the TPS‐based approach additionally provides implants that accurately reproduce the patient‐specific thickness distribution of the affected cranial region.
Collapse
Affiliation(s)
- Claudia Wittner
- Research Group Computed Tomography, University of Applied Sciences Upper Austria, Wels, Austria
| | - Markus Borowski
- Institut für Röntgendiagnostik und Nuklearmedizin, Städtisches Klinikum Braunschweig GmbH, Braunschweig, Germany
| | - Lukas Pirl
- Institut für Röntgendiagnostik und Nuklearmedizin, Städtisches Klinikum Braunschweig GmbH, Braunschweig, Germany
| | - Johann Kastner
- Research Group Computed Tomography, University of Applied Sciences Upper Austria, Wels, Austria
| | - Andreas Schrempf
- Research Group for Surgical Simulators Linz, University of Applied Sciences Upper Austria, Linz, Austria
| | - Ute Schäfer
- Forschungseinheit Experimentelle Neurotraumatologie, Medizinische Universität Graz, Graz, Austria
| | - Klemens Trieb
- Research Group Computed Tomography, University of Applied Sciences Upper Austria, Wels, Austria.,Department of Orthopedic and Trauma Surgery, Paracelsus Medical University Salzburg, Salzburg, Austria
| | - Sascha Senck
- Research Group Computed Tomography, University of Applied Sciences Upper Austria, Wels, Austria
| |
Collapse
|
16
|
Pepe A, Trotta GF, Mohr-Ziak P, Gsaxner C, Wallner J, Bevilacqua V, Egger J. A Marker-Less Registration Approach for Mixed Reality-Aided Maxillofacial Surgery: a Pilot Evaluation. J Digit Imaging 2021; 32:1008-1018. [PMID: 31485953 DOI: 10.1007/s10278-019-00272-6] [Citation(s) in RCA: 35] [Impact Index Per Article: 11.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022] Open
Abstract
As of common routine in tumor resections, surgeons rely on local examinations of the removed tissues and on the swiftly made microscopy findings of the pathologist, which are based on intraoperatively taken tissue probes. This approach may imply an extended duration of the operation, increased effort for the medical staff, and longer occupancy of the operating room (OR). Mixed reality technologies, and particularly augmented reality, have already been applied in surgical scenarios with positive initial outcomes. Nonetheless, these methods have used manual or marker-based registration. In this work, we design an application for a marker-less registration of PET-CT information for a patient. The algorithm combines facial landmarks extracted from an RGB video stream, and the so-called Spatial-Mapping API provided by the HMD Microsoft HoloLens. The accuracy of the system is compared with a marker-based approach, and the opinions of field specialists have been collected during a demonstration. A survey based on the standard ISO-9241/110 has been designed for this purpose. The measurements show an average positioning error along the three axes of (x, y, z) = (3.3 ± 2.3, - 4.5 ± 2.9, - 9.3 ± 6.1) mm. Compared with the marker-based approach, this shows an increment of the positioning error of approx. 3 mm along two dimensions (x, y), which might be due to the absence of explicit markers. The application has been positively evaluated by the specialists; they have shown interest in continued further work and contributed to the development process with constructive criticism.
Collapse
Affiliation(s)
- Antonio Pepe
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Austria. .,Computer Algorithms for Medicine Laboratory, Graz, Austria.
| | - Gianpaolo Francesco Trotta
- Computer Algorithms for Medicine Laboratory, Graz, Austria.,Department of Mechanics, Mathematics and Management, Polytechnic University of Bari, Via Orabona, 4, Bari, Italy
| | - Peter Mohr-Ziak
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Austria.,VRVis-Zentrum für Virtual Reality und Visualisierung Forschungs-GmbH, Donau-City-Straße 11, 1220, Vienna, Austria
| | - Christina Gsaxner
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Austria.,Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Jürgen Wallner
- Computer Algorithms for Medicine Laboratory, Graz, Austria.,Department of Oral & Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 5/1, 8036, Graz, Styria, Austria
| | - Vitoantonio Bevilacqua
- Department of Electrical and Information Engineering, Polytechnic University of Bari, Via Orabona, 4, Bari, Italy
| | - Jan Egger
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Austria.,Computer Algorithms for Medicine Laboratory, Graz, Austria.,Department of Oral & Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 5/1, 8036, Graz, Styria, Austria
| |
Collapse
|
17
|
Li J, Gsaxner C, Pepe A, Morais A, Alves V, von Campe G, Wallner J, Egger J. Synthetic skull bone defects for automatic patient-specific craniofacial implant design. Sci Data 2021; 8:36. [PMID: 33514740 PMCID: PMC7846796 DOI: 10.1038/s41597-021-00806-0] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2020] [Accepted: 12/03/2020] [Indexed: 11/09/2022] Open
Abstract
Patient-specific craniofacial implants are used to repair skull bone defects after trauma or surgery. Currently, cranial implants are designed and produced by third-party suppliers, which is usually time-consuming and expensive. Recent advances in additive manufacturing made the in-hospital or in-operation-room fabrication of personalized implants feasible. However, the implants are still manufactured by external companies. To facilitate an optimized workflow, fast and automatic implant manufacturing is highly desirable. Data-driven approaches, such as deep learning, show currently great potential towards automatic implant design. However, a considerable amount of data is needed to train such algorithms, which is, especially in the medical domain, often a bottleneck. Therefore, we present CT-imaging data of the craniofacial complex from 24 patients, in which we injected various artificial cranial defects, resulting in 240 data pairs and 240 corresponding implants. Based on this work, automatic implant design and manufacturing processes can be trained. Additionally, the data of this work build a solid base for researchers to work on automatic cranial implant designs. Measurement(s) | Image Acquisition Matrix Size • Image Slice Thickness • craniofacial region | Technology Type(s) | imaging technique • computed tomography | Sample Characteristic - Organism | Homo sapiens |
Machine-accessible metadata file describing the reported data: 10.6084/m9.figshare.13265225
Collapse
Affiliation(s)
- Jianning Li
- Institute for Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, 8010, Graz, Austria.,Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Christina Gsaxner
- Institute for Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, 8010, Graz, Austria.,Computer Algorithms for Medicine Laboratory, Graz, Austria.,Department of Oral and Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 6/1, 8036, Graz, Austria
| | - Antonio Pepe
- Institute for Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, 8010, Graz, Austria.,Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Ana Morais
- Department of Informatics, School of Engineering, University of Minho, Braga, Portugal.,Algoritmi Centre, University of Minho, Braga, Portugal
| | - Victor Alves
- Algoritmi Centre, University of Minho, Braga, Portugal
| | - Gord von Campe
- Department of Neurosurgery, Medical University of Graz, Auenbruggerplatz 29, 8036, Graz, Austria
| | - Jürgen Wallner
- Department of Oral and Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 6/1, 8036, Graz, Austria.
| | - Jan Egger
- Institute for Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, 8010, Graz, Austria. .,Computer Algorithms for Medicine Laboratory, Graz, Austria. .,Department of Oral and Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 6/1, 8036, Graz, Austria.
| |
Collapse
|
18
|
Memon AR, Wang E, Hu J, Egger J, Chen X. A review on computer-aided design and manufacturing of patient-specific maxillofacial implants. Expert Rev Med Devices 2020; 17:345-356. [PMID: 32105159 PMCID: PMC7175472 DOI: 10.1080/17434440.2020.1736040] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2019] [Accepted: 02/25/2020] [Indexed: 10/25/2022]
Abstract
Introduction: Various prefabricated maxillofacial implants are used in the clinical routine for the surgical treatment of patients. In addition to these prefabricated implants, customized CAD/CAM implants become increasingly important for a more precise replacement of damaged anatomical structures. This paper reviews the design and manufacturing of patient-specific implants for the maxillofacial area.Areas covered: The contribution of this publication is to give a state-of-the-art overview in the usage of customized facial implants. Moreover, it provides future perspectives, including 3D printing technologies, for the manufacturing of patient-individual facial implants that are based on patient's data acquisitions, like Computed Tomography (CT) or Magnetic Resonance Imaging (MRI).Expert opinion: The main target of this review is to present various designing software and 3D manufacturing technologies that have been applied to fabricate facial implants. In doing so, different CAD designing software's are discussed, which are based on various methods and have been implemented and evaluated by researchers. Finally, recent 3D printing technologies that have been applied to manufacture patient-individual implants will be introduced and discussed.
Collapse
Affiliation(s)
- Afaque Rafique Memon
- Institute of Biomedical Manufacturing and Life Quality Engineering, State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Enpeng Wang
- Institute of Biomedical Manufacturing and Life Quality Engineering, State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Junlei Hu
- Institute of Biomedical Manufacturing and Life Quality Engineering, State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Jan Egger
- Institute of Biomedical Manufacturing and Life Quality Engineering, State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
- Institute for Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Graz, Austria
- Department of Oral &maxillofacial Surgery, Medical University of Graz, Graz, Austria
- The Laboratory of Computer Algorithms for Medicine, Medical University of Graz, Graz, Austria
| | - Xiaojun Chen
- Institute of Biomedical Manufacturing and Life Quality Engineering, State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
19
|
Weber M, Wild D, Wallner J, Egger J. A Client/Server based Online Environment for the Calculation of Medical Segmentation Scores. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2019:3463-3467. [PMID: 31946624 DOI: 10.1109/embc.2019.8856481] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Image segmentation plays a major role in medical imaging. Especially in radiology, the detection and development of tumors and other diseases can be supported by image segmentation applications. Tools that provide image segmentation and calculation of segmentation scores are not available at any time for every device due to the size and scope of functionalities they offer. These tools need huge periodic updates and do not properly work on old or weak systems. However, medical use-cases often require fast and accurate results. A complex and slow software can lead to additional stress and thus unnecessary errors. The aim of this contribution is the development of a cross-platform tool for medical segmentation use-cases. The goal is a device-independent and always available possibility for medical imaging including manual segmentation and metric calculation. The result is Studierfenster (studierfenster.at), a web-tool for manual segmentation and segmentation metric calculation. In this contribution, the focus lies on the segmentation metric calculation part of the tool. It provides the functionalities of calculating directed and undirected Hausdorff Distance (HD) and Dice Similarity Coefficient (DSC) scores for two uploaded volumes, filtering for specific values, searching for specific values in the calculated metrics and exporting filtered metric lists in different file formats.
Collapse
|
20
|
Morais A, Egger J, Alves V. Automated Computer-aided Design of Cranial Implants Using a Deep Volumetric Convolutional Denoising Autoencoder. ADVANCES IN INTELLIGENT SYSTEMS AND COMPUTING 2019. [DOI: 10.1007/978-3-030-16187-3_15] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
|
21
|
Implementation of a semiautomatic method to design patient-specific instruments for corrective osteotomy of the radius. Int J Comput Assist Radiol Surg 2018; 14:829-840. [PMID: 30535827 DOI: 10.1007/s11548-018-1896-2] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2018] [Accepted: 11/30/2018] [Indexed: 10/27/2022]
Abstract
PURPOSE 3D-printed patient-specific instruments (PSIs), such as surgical guides and implants, show great promise for accurate navigation in surgical correction of post-traumatic deformities of the distal radius. However, existing costs of computer-aided design and manufacturing process prevent everyday surgical use. In this paper, we propose an innovative semiautomatic methodology to streamline the PSIs design. METHODS The new method was implemented as an extension of our existing 3D planning software. It facilitates the design of a regular and smooth implant and a companion guide starting from a user-selected surface on the affected bone. We evaluated the software by designing PSIs starting from preoperative virtual 3D plans of five patients previously treated at our institute for corrective osteotomy. We repeated the design for the same cases also with commercially available software, with and without dedicated customization. We measured design time and tracked user activity during the design process of implants, guides and subsequent modifications. RESULTS All the designed shapes were considered valid. Median design times ([Formula: see text]) were reduced for implants (([Formula: see text]) = 2.2 min) and guides (([Formula: see text]) = 1.0 min) compared to the standard (([Formula: see text]) = 13 min and ([Formula: see text]) = 8 min) and the partially customized (([Formula: see text]) = 6.5 min and ([Formula: see text]) = 6.0 min) commercially available alternatives. Mouse and keyboard activities were reduced (median count of strokes and clicks during implant design (([Formula: see text]) = 53, and guide design (([Formula: see text]) = 27) compared to using standard software (([Formula: see text]) = 559 and ([Formula: see text]) = 380) and customized commercial software (([Formula: see text]) = 217 and ([Formula: see text]) = 180). CONCLUSION Our software solution efficiently streamlines the design of PSIs for distal radius malunion. It represents a first step in making 3D-printed PSIs technology more accessible.
Collapse
|
22
|
Planning of skull reconstruction based on a statistical shape model combined with geometric morphometrics. Int J Comput Assist Radiol Surg 2017; 13:519-529. [DOI: 10.1007/s11548-017-1674-6] [Citation(s) in RCA: 41] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2017] [Accepted: 10/01/2017] [Indexed: 01/08/2023]
|