1
|
Barjuei ES, Shin J, Kim K, Lee J. Precision improvement of robotic bioprinting via vision-based tool path compensation. Sci Rep 2024; 14:17764. [PMID: 39085375 PMCID: PMC11291724 DOI: 10.1038/s41598-024-68597-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2023] [Accepted: 07/25/2024] [Indexed: 08/02/2024] Open
Abstract
Robotic 3D bioprinting is a rapidly advancing technology with applications in organ fabrication, tissue restoration, and pharmaceutical testing. While the stepwise generation of organs characterizes bioprinting, challenges such as non-linear material behavior, layer shifting, and trajectory tracking are common in freeform reversible embedding of suspended hydrogels (FRESH) bioprinting, leading to imperfections in complex organ construction. To overcome these limitations, we propose a computer vision-based strategy to identify discrepancies between printed filaments and the reference robot path. Employing error compensation techniques, we generate an adjusted reference path, enhancing robotic 3D bioprinting by adapting the robot path based on vision system data. Experimental assessments confirm the reliability and agility of our vision-based robotic 3D bioprinting approach, showcasing precision in fabricating human blood vessel segments through case studies. Significantly, it minimizes the printing layer width disparity to just 0.15 mm compared to the 0.6 mm in traditional methods, and it decreases the average error for curved filaments to 7.0 mm2 from the previous 12.7 mm2 in conventional printing. While these results underscore the significant potential of our innovation in creating precise biomimetic constructs, further investigation is necessary to tackle challenges such as accurately distinguishing closely stacked layers using a vision system, especially under varying lighting conditions. These limitations, coupled with issues of computational complexity and scalability in larger-scale bioprinting, emphasize the importance of enhancing the reliability of the vision-based approach across various conditions. Nonetheless, our innovation demonstrates substantial promise in creating precise biomimetic constructs and paves the way for future advancements in vision-guided robotic bioprinting, including the integration of multi-material printing techniques to enhance versatility.
Collapse
Affiliation(s)
- Erfan Shojaei Barjuei
- Department of Mechanical and Manufacturing Engineering, Schulich School of Engineering, University of Calgary, Calgary, AB, T2N 1N4, Canada
| | - Joonhwan Shin
- Department of Mechanical and Manufacturing Engineering, Schulich School of Engineering, University of Calgary, Calgary, AB, T2N 1N4, Canada
| | - Keekyoung Kim
- Department of Mechanical and Manufacturing Engineering, Schulich School of Engineering, University of Calgary, Calgary, AB, T2N 1N4, Canada
- Deparement of Biomedical Engineering, Schulich School of Engineering, University of Calgary, Calgary, AB, T2N 1N4, Canada
| | - Jihyun Lee
- Department of Mechanical and Manufacturing Engineering, Schulich School of Engineering, University of Calgary, Calgary, AB, T2N 1N4, Canada.
| |
Collapse
|
2
|
Rukundo O. Challenges of 3D Surface Reconstruction in Capsule Endoscopy. J Clin Med 2023; 12:4955. [PMID: 37568357 PMCID: PMC10420189 DOI: 10.3390/jcm12154955] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2023] [Revised: 07/04/2023] [Accepted: 07/26/2023] [Indexed: 08/13/2023] Open
Abstract
Essential for improving the accuracy and reliability of bowel cancer screening, three-dimensional (3D) surface reconstruction using capsule endoscopy (CE) images remains challenging due to CE hardware and software limitations. This report generally focuses on challenges associated with 3D visualization and specifically investigates the impact of the indeterminate selection of the angle of the line-of-sight on 3D surfaces. Furthermore, it demonstrates that impact through 3D surfaces viewed at the same azimuth angles and different elevation angles of the line-of-sight. The report concludes that 3D printing of reconstructed 3D surfaces can potentially overcome line-of-sight indeterminate selection and 2D screen visual restriction-related errors.
Collapse
Affiliation(s)
- Olivier Rukundo
- Norwegian Colour and Visual Computing Laboratory, Department of Computer Science, Norwegian University of Science and Technology, Teknologiveien 22, 2815 Gjøvik, Norway;
- Center for Clinical Research, University Clinic of Dentistry, Medical University of Vienna, Sensengasse 2a, 1090 Vienna, Austria
| |
Collapse
|
3
|
Yao K, Xie Y, Xia L, Wei S, Yu W, Shen G. The Reliability of Three-Dimensional Landmark-Based Craniomaxillofacial and Airway Cephalometric Analysis. Diagnostics (Basel) 2023; 13:2360. [PMID: 37510103 PMCID: PMC10377994 DOI: 10.3390/diagnostics13142360] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2023] [Revised: 06/25/2023] [Accepted: 07/10/2023] [Indexed: 07/30/2023] Open
Abstract
Cephalometric analysis is a standard diagnostic tool in orthodontics and craniofacial surgery. Today, as conventional 2D cephalometry is limited and susceptible to analysis bias, a more reliable and user-friendly three-dimensional system that includes hard tissue, soft tissue, and airways is demanded in clinical practice. We launched our study to develop such a system based on CT data and landmarks. This study aims to determine whether the data labeled through our process is highly qualified and whether the soft tissue and airway data derived from CT scans are reliable. We enrolled 15 patients (seven males, eight females, 26.47 ± 3.44 years old) diagnosed with either non-syndromic dento-maxillofacial deformities or OSDB in this study to evaluate the intra- and inter-examiner reliability of our system. A total of 126 landmarks were adopted and divided into five sets by region: 28 cranial points, 25 mandibular points, 20 teeth points, 48 soft tissue points, and 6 airway points. All the landmarks were labeled by two experienced clinical practitioners, either of whom had labeled all the data twice at least one month apart. Furthermore, 78 parameters of three sets were calculated in this study: 42 skeletal parameters (23 angular and 19 linear), 27 soft tissue parameters (9 angular and 18 linear), and 9 upper airway parameters (2 linear, 4 areal, and 3 voluminal). Intraclass correlation coefficient (ICC) was used to evaluate the inter-examiner and intra-examiner reliability of landmark coordinate values and measurement parameters. The overwhelming majority of the landmarks showed excellent intra- and inter-examiner reliability. For skeletal parameters, angular parameters indicated better reliability, while linear parameters performed better for soft tissue parameters. The intra- and inter-examiner ICCs of airway parameters referred to excellent reliability. In summary, the data labeled through our process are qualified, and the soft tissue and airway data derived from CT scans are reliable. Landmarks that are not commonly used in clinical practice may require additional attention while labeling as they are prone to poor reliability. Measurement parameters with values close to 0 tend to have low reliability. We believe this three-dimensional cephalometric system would reach clinical application.
Collapse
Affiliation(s)
- Kan Yao
- Department of Oral and Cranio-Maxillofacial Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200011, China
- College of Stomatology, Shanghai Jiao Tong University, Shanghai 200011, China
- National Center for Stomatology, National Clinical Research Center for Oral Diseases, Shanghai Key Laboratory of Stomatology, Shanghai Research Institute of Stomatology, Shanghai 200011, China
| | - Yilun Xie
- Department of Stomatology, Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200127, China
| | - Liang Xia
- Department of Oral and Cranio-Maxillofacial Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200011, China
- College of Stomatology, Shanghai Jiao Tong University, Shanghai 200011, China
- National Center for Stomatology, National Clinical Research Center for Oral Diseases, Shanghai Key Laboratory of Stomatology, Shanghai Research Institute of Stomatology, Shanghai 200011, China
| | - Silong Wei
- Department of Oral and Cranio-Maxillofacial Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200011, China
- College of Stomatology, Shanghai Jiao Tong University, Shanghai 200011, China
- National Center for Stomatology, National Clinical Research Center for Oral Diseases, Shanghai Key Laboratory of Stomatology, Shanghai Research Institute of Stomatology, Shanghai 200011, China
| | - Wenwen Yu
- Department of Oral and Cranio-Maxillofacial Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200011, China
- College of Stomatology, Shanghai Jiao Tong University, Shanghai 200011, China
- National Center for Stomatology, National Clinical Research Center for Oral Diseases, Shanghai Key Laboratory of Stomatology, Shanghai Research Institute of Stomatology, Shanghai 200011, China
| | - Guofang Shen
- Department of Oral and Cranio-Maxillofacial Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200011, China
- College of Stomatology, Shanghai Jiao Tong University, Shanghai 200011, China
- National Center for Stomatology, National Clinical Research Center for Oral Diseases, Shanghai Key Laboratory of Stomatology, Shanghai Research Institute of Stomatology, Shanghai 200011, China
| |
Collapse
|
4
|
Tavoosi J, Zhang C, Mohammadzadeh A, Mobayen S, Mosavi AH. Medical Image Interpolation Using Recurrent Type-2 Fuzzy Neural Network. Front Neuroinform 2021; 15:667375. [PMID: 34539369 PMCID: PMC8441005 DOI: 10.3389/fninf.2021.667375] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2021] [Accepted: 08/11/2021] [Indexed: 11/17/2022] Open
Abstract
Image interpolation is an essential process for image processing and computer graphics in wide applications to medical imaging. For image interpolation used in medical diagnosis, the two-dimensional (2D) to three-dimensional (3D) transformation can significantly reduce human error, leading to better decisions. This research proposes the type-2 fuzzy neural networks method which is a hybrid of the fuzzy logic and neural networks as well as recurrent type-2 fuzzy neural networks (RT2FNNs) for advancing a novel 2D to 3D strategy. The ability of the proposed methods in the approximation of the function for image interpolation is investigated. The results report that both proposed methods are reliable for medical diagnosis. However, the RT2FNN model outperforms the type-2 fuzzy neural networks model. The average squares error for the recurrent network and the typical network reported 0.016 and 0.025, respectively. On the other hand, the number of fuzzy rules for the recurrent network and the typical network reported 16 and 22, respectively.
Collapse
Affiliation(s)
- Jafar Tavoosi
- Department of Electrical Engineering, Ilam University, Ilam, Iran
| | - Chunwei Zhang
- Structural Vibration Control Group, Qingdao University of Technology, Qingdao, China
| | | | - Saleh Mobayen
- Future Technology Research Center, National Yunlin University of Science and Technology, Douliou, Taiwan
| | - Amir H Mosavi
- Faculty of Civil Engineering, Technische Universität Dresden, Dresden, Germany.,Institute of Software Design and Development, Obuda University, Budapest, Hungary
| |
Collapse
|
5
|
Ioannidis GS, Nikiforaki K, Karantanas A. Statistical and spatial correlation between diffusion and perfusion MR imaging parameters: A study on soft tissue sarcomas. Phys Med 2019; 65:59-66. [PMID: 31430588 DOI: 10.1016/j.ejmp.2019.08.007] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/08/2019] [Revised: 07/18/2019] [Accepted: 08/05/2019] [Indexed: 10/26/2022] Open
Abstract
PURPOSE The purpose of this study was to examine the correlation of diffusion and perfusion quantitative MR parameters, on patients with malignant soft tissue tumors. In addition, we investigated the spatial agreement of hallmarks of malignancy as indicated by diffusion and perfusion biomarkers respectively. METHODS Nonlinear least squares were used for the quantification of the DWI and DCE derived parameters for 25 patients of histologically proven soft tissue sarcoma scanned at a 1.5 T scanner. 4D data were analyzed by an in house built software implemented in Python 3.5 resulting in voxel based parametric maps based on the Intra-Voxel Incoherent Motion (IVIM), Extended Toft's (ETM) and Gamma Capillary Transit time (GCTT) models. The root mean squared error (RMSE) was also used for assessing the accuracy of the DCE fitting models. RESULTS A good Pearson's correlation (r > 0.5) was found between micro-perfusion fraction (f-IVIM) and plasma volume (vp-GCTT). There was no significant correlation between all other possible pairs of DCE and DWI derived parameters. Following thresholding the indicators of malignancy from both imaging methods, the percentage of volume overlap between regions of high cellularity and high vascular permeability ranged from 6% to 30%. CONCLUSION A free correlation study among all DCE and DWI derived pairs of parameters, showed a linear relationship between f-IVIM and vp-GCTT in patients with soft tissue sarcomas. DCE in conjunction with DWI MRI can provide useful information on sites of aggressive characteristics for guiding the pre-operative biopsy and for overall treatment planning.
Collapse
Affiliation(s)
- Georgios S Ioannidis
- Foundation for Research and Technology - Hellas (FORTH), Institute of Computer Science (ICS), Computational Bio-Medicine Laboratory (CBML), Heraklion, Greece; Medical School, University of Crete, Heraklion, Greece. http://www.ics.forth.gr/cbml/
| | - Katerina Nikiforaki
- Foundation for Research and Technology - Hellas (FORTH), Institute of Computer Science (ICS), Computational Bio-Medicine Laboratory (CBML), Heraklion, Greece; Medical School, University of Crete, Heraklion, Greece
| | - Apostolos Karantanas
- Foundation for Research and Technology - Hellas (FORTH), Institute of Computer Science (ICS), Computational Bio-Medicine Laboratory (CBML), Heraklion, Greece; Medical School, University of Crete, Heraklion, Greece; Department of Medical Imaging, University Hospital, Heraklion, Greece
| |
Collapse
|