1
|
Cai Z, Zhang K, Li L, Suo Y. Application of 3D reconstruction and 3D printing technology in advanced ovarian cancer surgery: a retrospective study. Front Oncol 2024; 14:1432970. [PMID: 39220654 PMCID: PMC11361939 DOI: 10.3389/fonc.2024.1432970] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2024] [Accepted: 07/25/2024] [Indexed: 09/04/2024] Open
Abstract
Backgrounds Advanced ovarian cancer is frequently accompanied by extensive peritoneal metastasis, complicating surgical interventions. This study aims to explore the application of 3D reconstruction and 3D printing technology in the treatment of advanced ovarian cancer. Methods We conducted a retrospective analysis of 60 patients with stage III ovarian cancer who underwent cytoreductive surgery at Hebei University Affiliated Hospital between 2020 and 2023. Patients were randomly assigned to three groups: a 3D visualization group, a 3D visualization plus 3D printing group, and a traditional 2D CT imaging evaluation group. High-precision medical imaging techniques (e.g., CT, MRI) were employed to create digital 3D models, which were then converted into physical entities using 3D printing for surgical planning and simulation. Results Both the 3D visualization group and the 3D visualization plus 3D printing group demonstrated superior outcomes in terms of surgery duration and blood loss compared to the traditional 2D CT group, indicating the efficacy of 3D reconstruction and 3D printing in preoperative planning. Postoperative recovery indicators, such as hospital stay and time to first flatus, were also more favorable in the groups utilizing 3D technology. Although there were no significant differences in postoperative complications and recurrence rates among the three groups, the groups using 3D technology showed advantages in reducing certain complications. Conclusions The results indicate that medical 3D technology has significant value in the surgical planning of advanced ovarian cancer, enhancing surgical precision and reducing intraoperative risks, which may aid in improving postoperative recovery.
Collapse
Affiliation(s)
- Zhihui Cai
- Gynecology Department, The Fifth Clinical Medical School of Shanxi Medical University, Taiyuan, Shanxi, China
| | - Ke Zhang
- 3D Image and 3D Printing Center, Affiliated Hospital of Hebei University, Baoding, Hebei, China
| | - Linqian Li
- 3D Image and 3D Printing Center, Affiliated Hospital of Hebei University, Baoding, Hebei, China
| | - Yuping Suo
- Gynecology Department, The Fifth Clinical Medical School of Shanxi Medical University, Taiyuan, Shanxi, China
| |
Collapse
|
2
|
Oh J, Koo S. Fast digitally reconstructed radiograph generation using particle-based statistical shape and intensity model. J Med Imaging (Bellingham) 2024; 11:033503. [PMID: 38910836 PMCID: PMC11192206 DOI: 10.1117/1.jmi.11.3.033503] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Revised: 05/23/2024] [Accepted: 05/29/2024] [Indexed: 06/25/2024] Open
Abstract
Purpose Statistical shape and intensity models (SSIMs) and digitally reconstructed radiographs (DRRs) were introduced for non-rigid 2D-3D registration and skeletal geometry/density reconstruction studies. The computation of DRRs takes most of the time during registration or reconstruction. The goal of this study is to propose a particle-based method for composing an SSIM and a DRR image generation scheme and analyze the quality of the images compared with previous DRR generation methods. Approach Particle-based SSIMs consist of densely scattered particles on the surface and inside of an object, with each particle having an intensity value. Generating the DRR resembles ray tracing, which counts the particles that are binned with each ray and calculates the radiation attenuation. The distance between adjacent particles was considered to be the radiologic path during attenuation integration, and the mean linear attenuation coefficient of the two particles was multiplied. The proposed method was compared with the DRR of CT projection. The mean squared error and peak signal-to-noise ratio (PSNR) were calculated between the DRR images from the proposed method and those of existing methods of projecting tetrahedral-based SSIMs or computed tomography (CT) images to verify the accuracy of the proposed scheme. Results The suggested method was about 600 times faster than the tetrahedral-based SSIM without using the hardware acceleration technique. The PSNR was 37.59 dB, and the root mean squared error of the normalized pixel intensities was 0.0136. Conclusions The proposed SSIM and DRR generation procedure showed high temporal performance while maintaining image quality, and particle-based SSIM is a feasible form for representing a 3D volume and generating the DRR images.
Collapse
Affiliation(s)
- Jeongseok Oh
- Korea Advanced Institute of Science and Technology, Department of Mechanical Engineering, Daejeon, Republic of Korea
| | - Seungbum Koo
- Korea Advanced Institute of Science and Technology, Department of Mechanical Engineering, Daejeon, Republic of Korea
| |
Collapse
|
3
|
Factor S, Gurel R, Dan D, Benkovich G, Sagi A, Abialevich A, Benkovich V. Validating a Novel 2D to 3D Knee Reconstruction Method on Preoperative Total Knee Arthroplasty Patient Anatomies. J Clin Med 2024; 13:1255. [PMID: 38592666 PMCID: PMC10931545 DOI: 10.3390/jcm13051255] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Revised: 02/18/2024] [Accepted: 02/20/2024] [Indexed: 04/10/2024] Open
Abstract
BACKGROUND As advanced technology continues to evolve, incorporating robotics into surgical procedures has become imperative for precision and accuracy in preoperative planning. Nevertheless, the integration of three-dimensional (3D) imaging into these processes presents both financial considerations and potential patient safety concerns. This study aims to assess the accuracy of a novel 2D-to-3D knee reconstruction solution, RSIP XPlan.ai™ (RSIP Vision, Jerusalem, Israel), on preoperative total knee arthroplasty (TKA) patient anatomies. METHODS Accuracy was calculated by measuring the Root Mean Square Error (RMSE) between X-ray-based 3D bone models generated by the algorithm and corresponding CT bone segmentations (distances of each mesh vertex to the closest vertex in the second mesh). The RMSE was computed globally for each bone, locally for eight clinically relevant bony landmark regions, and along simulated bone cut contours. In addition, the accuracies of three anatomical axes were assessed by comparing angular deviations to inter- and intra-observer baseline values. RESULTS The global RMSE was 0.93 ± 0.25 mm for the femur and 0.88 ± 0.14 mm for the tibia. Local RMSE values for bony landmark regions were 0.51 ± 0.33 mm for the five femoral landmarks and 0.47 ± 0.17 mm for the three tibial landmarks. The RMSE along simulated cut contours was 0.75 ± 0.35 mm for the distal femur cut and 0.63 ± 0.27 mm for the proximal tibial cut. Anatomical axial average angular deviations were 1.89° for the trans epicondylar axis (with an inter- and intra-observer baseline of 1.43°), 1.78° for the posterior condylar axis (with a baseline of 1.71°), and 2.82° (with a baseline of 2.56°) for the medial-lateral transverse axis. CONCLUSIONS The study findings demonstrate promising results regarding the accuracy of XPlan.ai™ in reconstructing 3D bone models from plain-film X-rays. The observed accuracy on real-world TKA patient anatomies in anatomically relevant regions, including bony landmarks, cut contours, and axes, suggests the potential utility of this method in various clinical scenarios. Further validation studies on larger cohorts are warranted to fully assess the reliability and generalizability of our results. Nonetheless, our findings lay the groundwork for potential advancements in future robotic arthroplasty technologies, with XPlan.ai™ offering a promising alternative to conventional CT scans in certain clinical contexts.
Collapse
Affiliation(s)
- Shai Factor
- Division of Orthopedic Surgery, Tel Aviv Medical Center, Faculty of Medicine, Tel Aviv University, Tel Aviv 6423906, Israel
| | - Ron Gurel
- Division of Orthopedic Surgery, Tel Aviv Medical Center, Faculty of Medicine, Tel Aviv University, Tel Aviv 6423906, Israel
| | - Dor Dan
- Orthopedic Department, Meir Medical Center, Faculty of Medicine, Tel Aviv University, Tel Aviv 4428164, Israel
| | - Guy Benkovich
- Orthopedic Department, Sheba Medical Center, Faculty of Medicine, Tel Aviv University, Tel Aviv 5262000, Israel
| | - Amit Sagi
- Orthopedic Department, Barzilai Medical Center, Ashkelon 78278, Israel
- Faculty of Health Sciences, Ben-Gurion University of the Negev, Beer Sheva 8499000, Israel
- South West London Elective Orthopaedic Centre, Epsom KT18 7EG, UK
| | - Artsiom Abialevich
- Faculty of Health Sciences, Ben-Gurion University of the Negev, Beer Sheva 8499000, Israel
- Department of Orthopedic Surgery, Soroka Medical Center, Beer Sheva 84101, Israel
- Israeli Joint Health Center, Tel Aviv 69710, Israel
| | - Vadim Benkovich
- Faculty of Health Sciences, Ben-Gurion University of the Negev, Beer Sheva 8499000, Israel
- Department of Orthopedic Surgery, Soroka Medical Center, Beer Sheva 84101, Israel
- Israeli Joint Health Center, Tel Aviv 69710, Israel
| |
Collapse
|
4
|
Marsilio L, Moglia A, Rossi M, Manzotti A, Mainardi L, Cerveri P. Combined Edge Loss UNet for Optimized Segmentation in Total Knee Arthroplasty Preoperative Planning. Bioengineering (Basel) 2023; 10:1433. [PMID: 38136024 PMCID: PMC10740423 DOI: 10.3390/bioengineering10121433] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Revised: 12/12/2023] [Accepted: 12/14/2023] [Indexed: 12/24/2023] Open
Abstract
Bone segmentation and 3D reconstruction are crucial for total knee arthroplasty (TKA) surgical planning with Personalized Surgical Instruments (PSIs). Traditional semi-automatic approaches are time-consuming and operator-dependent, although they provide reliable outcomes. Moreover, the recent expansion of artificial intelligence (AI) tools towards various medical domains is transforming modern healthcare. Accordingly, this study introduces an automated AI-based pipeline to replace the current operator-based tibia and femur 3D reconstruction procedure enhancing TKA preoperative planning. Leveraging an 822 CT image dataset, a novel patch-based method and an improved segmentation label generation algorithm were coupled to a Combined Edge Loss UNet (CEL-UNet), a novel CNN architecture featuring an additional decoding branch to boost the bone boundary segmentation. Root Mean Squared Errors and Hausdorff distances compared the predicted surfaces to the reference bones showing median and interquartile values of 0.26 (0.19-0.36) mm and 0.24 (0.18-0.32) mm, and of 1.06 (0.73-2.15) mm and 1.43 (0.82-2.86) mm for the tibia and femur, respectively, outperforming previous results of our group, state-of-the-art, and UNet models. A feasibility analysis for a PSI-based surgical plan revealed sub-millimetric distance errors and sub-angular alignment uncertainties in the PSI contact areas and the two cutting planes. Finally, operational environment testing underscored the pipeline's efficiency. More than half of the processed cases complied with the PSI prototyping requirements, reducing the overall time from 35 min to 13.1 s, while the remaining ones underwent a manual refinement step to achieve such PSI requirements, performing the procedure four to eleven times faster than the manufacturer standards. To conclude, this research advocates the need for real-world applicability and optimization of AI solutions in orthopedic surgical practice.
Collapse
Affiliation(s)
- Luca Marsilio
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Italy; (A.M.); (M.R.); (L.M.)
| | - Andrea Moglia
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Italy; (A.M.); (M.R.); (L.M.)
| | - Matteo Rossi
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Italy; (A.M.); (M.R.); (L.M.)
| | | | - Luca Mainardi
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Italy; (A.M.); (M.R.); (L.M.)
| | - Pietro Cerveri
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Italy; (A.M.); (M.R.); (L.M.)
| |
Collapse
|
5
|
Moglia A, Marsilio L, Rossi M, Pinelli M, Lettieri E, Mainardi L, Manzotti A, Cerveri P. Mixed Reality and Artificial Intelligence: A Holistic Approach to Multimodal Visualization and Extended Interaction in Knee Osteotomy. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2023; 12:279-290. [PMID: 38410183 PMCID: PMC10896423 DOI: 10.1109/jtehm.2023.3335608] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 10/16/2023] [Accepted: 11/17/2023] [Indexed: 02/28/2024]
Abstract
OBJECTIVE Recent advancements in augmented reality led to planning and navigation systems for orthopedic surgery. However little is known about mixed reality (MR) in orthopedics. Furthermore, artificial intelligence (AI) has the potential to boost the capabilities of MR by enabling automation and personalization. The purpose of this work is to assess Holoknee prototype, based on AI and MR for multimodal data visualization and surgical planning in knee osteotomy, developed to run on the HoloLens 2 headset. METHODS Two preclinical test sessions were performed with 11 participants (eight surgeons, two residents, and one medical student) executing three times six tasks, corresponding to a number of holographic data interactions and preoperative planning steps. At the end of each session, participants answered a questionnaire on user perception and usability. RESULTS During the second trial, the participants were faster in all tasks than in the first one, while in the third one, the time of execution decreased only for two tasks ("Patient selection" and "Scrolling through radiograph") with respect to the second attempt, but without statistically significant difference (respectively [Formula: see text] = 0.14 and [Formula: see text] = 0.13, [Formula: see text]). All subjects strongly agreed that MR can be used effectively for surgical training, whereas 10 (90.9%) strongly agreed that it can be used effectively for preoperative planning. Six (54.5%) agreed and two of them (18.2%) strongly agreed that it can be used effectively for intraoperative guidance. DISCUSSION/CONCLUSION In this work, we presented Holoknee, the first holistic application of AI and MR for surgical planning for knee osteotomy. It reported promising results on its potential translation to surgical training, preoperative planning, and surgical guidance. Clinical and Translational Impact Statement - Holoknee can be helpful to support surgeons in the preoperative planning of knee osteotomy. It has the potential to impact positively the training of the future generation of residents and aid surgeons in the intraoperative stage.
Collapse
Affiliation(s)
- Andrea Moglia
- Department of ElectronicsInformation and BioengineeringPolitecnico di Milano20133MilanItaly
| | - Luca Marsilio
- Department of ElectronicsInformation and BioengineeringPolitecnico di Milano20133MilanItaly
| | - Matteo Rossi
- Department of ElectronicsInformation and BioengineeringPolitecnico di Milano20133MilanItaly
- Istituto Auxologico Italiano IRCCS20149MilanItaly
| | - Maria Pinelli
- Department of Management, Economics and Industrial EngineeringPolitecnico di Milano20133MilanItaly
| | - Emanuele Lettieri
- Department of Management, Economics and Industrial EngineeringPolitecnico di Milano20133MilanItaly
| | - Luca Mainardi
- Department of ElectronicsInformation and BioengineeringPolitecnico di Milano20133MilanItaly
| | | | - Pietro Cerveri
- Department of ElectronicsInformation and BioengineeringPolitecnico di Milano20133MilanItaly
- Istituto Auxologico Italiano IRCCS20149MilanItaly
| |
Collapse
|
6
|
Sarmah M, Neelima A, Singh HR. Survey of methods and principles in three-dimensional reconstruction from two-dimensional medical images. Vis Comput Ind Biomed Art 2023; 6:15. [PMID: 37495817 PMCID: PMC10371974 DOI: 10.1186/s42492-023-00142-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Accepted: 06/27/2023] [Indexed: 07/28/2023] Open
Abstract
Three-dimensional (3D) reconstruction of human organs has gained attention in recent years due to advances in the Internet and graphics processing units. In the coming years, most patient care will shift toward this new paradigm. However, development of fast and accurate 3D models from medical images or a set of medical scans remains a daunting task due to the number of pre-processing steps involved, most of which are dependent on human expertise. In this review, a survey of pre-processing steps was conducted, and reconstruction techniques for several organs in medical diagnosis were studied. Various methods and principles related to 3D reconstruction were highlighted. The usefulness of 3D reconstruction of organs in medical diagnosis was also highlighted.
Collapse
Affiliation(s)
- Mriganka Sarmah
- Department of Computer Science and Engineering, National Institute of Technology, Nagaland, 797103, India.
| | - Arambam Neelima
- Department of Computer Science and Engineering, National Institute of Technology, Nagaland, 797103, India
| | - Heisnam Rohen Singh
- Department of Information Technology, Nagaland University, Nagaland, 797112, India
| |
Collapse
|
7
|
Patil A, Kulkarni K, Xie S, Bull AMJ, Jones GG. The accuracy of statistical shape models in predicting bone shape: A systematic review. Int J Med Robot 2023; 19:e2503. [PMID: 36722297 DOI: 10.1002/rcs.2503] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2022] [Revised: 01/14/2023] [Accepted: 01/26/2023] [Indexed: 02/02/2023]
Abstract
BACKGROUND This systematic review aims to ascertain how accurately 3D models can be predicted from two-dimensional (2D) imaging utilising statistical shape modelling. METHODS A systematic search of published literature was conducted in September 2022. All papers which assessed the accuracy of 3D models predicted from 2D imaging utilising statistical shape models and which validated the models against the ground truth were eligible. RESULTS 2127 papers were screened and a total of 34 studies were included for final data extraction. The best overall achievable accuracy was 0.45 mm (root mean square error) and 0.16 mm (average error). CONCLUSION Statistical shape modelling can predict detailed 3D anatomical models from minimal 2D imaging. Future studies should report the intended application domain of the model, the level of accuracy required, the underlying demographics of subjects, and the method in which accuracy was calculated, with root mean square error recommended if appropriate.
Collapse
Affiliation(s)
- Amogh Patil
- The MSk Lab, Imperial College London, London, UK
| | - Krishan Kulkarni
- Department of Trauma and Orthopaedics, East Lancashire Hospitals NHS Trust, Blackburn, UK
| | - Shuqiao Xie
- Department of Bioengineering, Imperial College London, London, UK
| | - Anthony M J Bull
- Department of Bioengineering, Imperial College London, London, UK
| | | |
Collapse
|
8
|
Chien J, Ha HG, Lee S, Hong J. A shape-partitioned statistical shape model for highly deformed femurs using X-ray images. Comput Assist Surg (Abingdon) 2022; 27:50-62. [PMID: 36510708 DOI: 10.1080/24699322.2022.2083016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/31/2023] Open
Abstract
To develop a patient-specific 3 D reconstruction of a femur modeled using the statistical shape model (SSM) and X-ray images, it is assumed that the target shape is not outside the range of variations allowed by the SSM built from a training dataset. We propose the shape-partitioned statistical shape model (SPSSM) to cover significant variations in the target shape. This model can divide a shape into several segments of anatomical interest. We break up the eigenvector matrix into the corresponding representative matrices for the SPSSM by preserving the relevant rows of the original matrix without segmenting the shape and building an independent SSM for each segment. To quantify the reconstruction error of the proposed method, we generated two groups of deformation models of the femur which cannot be easily represented by the conventional SSM. One group of femurs had an anteversion angle deformation, and the other group of femurs had two different scales of the femoral head. Each experiment was performed using the leave-one-out method for twelve femurs. When the femoral head was rotated by 30°, the average reconstruction error of the conventional SSM was 5.34 mm, which was reduced to 3.82 mm for the proposed SPSSM. When the femoral head size was decreased by 20%, the average reconstruction error of the SSM was 4.70 mm, which was reduced to 3.56 mm for the SPSSM. When the femoral head size was increased by 20%, the average reconstruction error of the SSM was 4.28 mm, which was reduced to 3.10 mm for the SPSSM. The experimental results for the two groups of deformation models showed that the proposed SPSSM outperformed the conventional SSM.
Collapse
Affiliation(s)
- Jongho Chien
- Department of Robotics and Mechatronics Engineering, DGIST, Daegu, Republic of Korea
| | - Ho-Gun Ha
- Division of Intelligent Robot, DGIST, Daegu, Republic of Korea
| | - Seongpung Lee
- Department of Robotics and Mechatronics Engineering, DGIST, Daegu, Republic of Korea
| | - Jaesung Hong
- Department of Robotics and Mechatronics Engineering, DGIST, Daegu, Republic of Korea
| |
Collapse
|
9
|
Lu HY, Shih KS, Lin CC, Lu TW, Li SY, Kuo HW, Hsu HC. Three-Dimensional Subject-Specific Knee Shape Reconstruction with Asynchronous Fluoroscopy Images Using Statistical Shape Modeling. Front Bioeng Biotechnol 2021; 9:736420. [PMID: 34746102 PMCID: PMC8564181 DOI: 10.3389/fbioe.2021.736420] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2021] [Accepted: 09/28/2021] [Indexed: 11/13/2022] Open
Abstract
Background and objectives: Statistical shape modeling (SSM) based on computerized tomography (CT) datasets has enabled reasonably accurate reconstructions of subject-specific 3D bone morphology from one or two synchronous radiographs for clinical applications. Increasing the number of radiographic images may increase the reconstruction accuracy, but errors related to the temporal and spatial asynchronization of clinical alternating bi-plane fluoroscopy may also increase. The current study aimed to develop a new approach for subject-specific 3D knee shape reconstruction from multiple asynchronous fluoroscopy images from 2, 4, and 6 X-ray detector views using a CT-based SSM model; and to determine the optimum number of planar images for best accuracy via computer simulations and in vivo experiments. Methods: A CT-based SSM model of the knee was established from 60 training models in a healthy young Chinese male population. A new two-phase optimization approach for 3D subject-specific model reconstruction from multiple asynchronous clinical fluoroscopy images using the SSM was developed, and its performance was evaluated via computer simulation and in vivo experiments using one, two and three image pairs from an alternating bi-plane fluoroscope. Results: The computer simulation showed that subject-specific 3D shape reconstruction using three image pairs had the best accuracy with RMSE of 0.52 ± 0.09 and 0.63 ± 0.085 mm for the femur and tibia, respectively. The corresponding values for the in vivo study were 0.64 ± 0.084 and 0.69 ± 0.069 mm, respectively, which was significantly better than those using one image pair (0.81 ± 0.126 and 0.83 ± 0.108 mm). No significant differences existed between using two and three image pairs. Conclusion: A new two-phase optimization approach was developed for SSM-based 3D subject-specific knee model reconstructions using more than one asynchronous fluoroscopy image pair from widely available alternating bi-plane fluoroscopy systems in clinical settings. A CT-based SSM model of the knee was also developed for a healthy young Chinese male population. The new approach was found to have high mode reconstruction accuracy, and those for both two and three image pairs were much better than for a single image pair. Thus, two image pairs may be used when considering computational costs and radiation dosage. The new approach will be useful for generating patient-specific knee models for clinical applications using multiple asynchronous images from alternating bi-plane fluoroscopy widely available in clinical settings. The current SSM model will serve as a basis for further inclusion of training models with a wider range of sizes and morphological features for broader applications.
Collapse
Affiliation(s)
- Hsuan-Yu Lu
- Department of Biomedical Engineering, National Taiwan University, Taipei, Taiwan
| | - Kao-Shang Shih
- Department of Orthopedics, Shin Kong Wu Ho-Su Memorial Hospital, Taipei, Taiwan.,School of Medicine, Fu Jen Catholic University, Taipei, Taiwan
| | - Cheng-Chung Lin
- Department of Electrical Engineering, Fu Jen Catholic University, Taipei, Taiwan
| | - Tung-Wu Lu
- Department of Biomedical Engineering, National Taiwan University, Taipei, Taiwan.,Department of Orthopaedic Surgery, School of Medicine, National Taiwan University, Taipei, Taiwan
| | - Song-Ying Li
- Department of Biomedical Engineering, National Taiwan University, Taipei, Taiwan
| | - Hsin-Wen Kuo
- Department of Biomedical Engineering, National Taiwan University, Taipei, Taiwan
| | - Horng-Chaung Hsu
- Department of Orthopaedic Surgery, China Medical University, Taipei, Taiwan
| |
Collapse
|
10
|
Shiode R, Kabashima M, Hiasa Y, Oka K, Murase T, Sato Y, Otake Y. 2D-3D reconstruction of distal forearm bone from actual X-ray images of the wrist using convolutional neural networks. Sci Rep 2021; 11:15249. [PMID: 34315946 PMCID: PMC8316567 DOI: 10.1038/s41598-021-94634-2] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Accepted: 05/06/2021] [Indexed: 01/08/2023] Open
Abstract
The purpose of the study was to develop a deep learning network for estimating and constructing highly accurate 3D bone models directly from actual X-ray images and to verify its accuracy. The data used were 173 computed tomography (CT) images and 105 actual X-ray images of a healthy wrist joint. To compensate for the small size of the dataset, digitally reconstructed radiography (DRR) images generated from CT were used as training data instead of actual X-ray images. The DRR-like images were generated from actual X-ray images in the test and adapted to the network, and high-accuracy estimation of a 3D bone model from a small data set was possible. The 3D shape of the radius and ulna were estimated from actual X-ray images with accuracies of 1.05 ± 0.36 and 1.45 ± 0.41 mm, respectively.
Collapse
Affiliation(s)
- Ryoya Shiode
- Department of Orthopaedic Surgery, Osaka University Graduate School of Medicine, 2-2 Yamadaoka, Suita, Osaka, 565-0871, Japan. .,Division of Information Science, Nara Institute of Science and Technology, 8916-5 Takayama, Ikoma, Nara, 630-0192, Japan.
| | - Mototaka Kabashima
- Division of Information Science, Nara Institute of Science and Technology, 8916-5 Takayama, Ikoma, Nara, 630-0192, Japan
| | - Yuta Hiasa
- Division of Information Science, Nara Institute of Science and Technology, 8916-5 Takayama, Ikoma, Nara, 630-0192, Japan
| | - Kunihiro Oka
- Department of Orthopaedic Surgery, Osaka University Graduate School of Medicine, 2-2 Yamadaoka, Suita, Osaka, 565-0871, Japan
| | - Tsuyoshi Murase
- Department of Orthopaedic Surgery, Osaka University Graduate School of Medicine, 2-2 Yamadaoka, Suita, Osaka, 565-0871, Japan
| | - Yoshinobu Sato
- Division of Information Science, Nara Institute of Science and Technology, 8916-5 Takayama, Ikoma, Nara, 630-0192, Japan
| | - Yoshito Otake
- Division of Information Science, Nara Institute of Science and Technology, 8916-5 Takayama, Ikoma, Nara, 630-0192, Japan.
| |
Collapse
|
11
|
Wu J, Mahfouz MR. Reconstruction of knee anatomy from single-plane fluoroscopic x-ray based on a nonlinear statistical shape model. J Med Imaging (Bellingham) 2021; 8:016001. [PMID: 33457444 PMCID: PMC7797787 DOI: 10.1117/1.jmi.8.1.016001] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2020] [Accepted: 10/23/2020] [Indexed: 11/23/2022] Open
Abstract
Purpose: Reconstruction of patient anatomy is critical to patient-specific instrument (PSI) design in total joint replacement (TJR). Conventionally, computed tomography (CT) and magnetic resonance imaging (MRI) are used to obtain the patient anatomy as they are accurate imaging modalities. However, computing anatomical landmarks from the patient anatomy for PSIs requires either high-resolution CT, increasing time of scan and radiation exposure to the patient, or longer and more expensive MRI scans. As an alternative, reconstruction from single-plane fluoroscopic x-ray provides a cost-efficient tool to obtain patient anatomical structures while allowing capture of the patient’s joint dynamics, important clinical information for TJR. Approach: We present a three-dimensional (3D) reconstruction scheme that automatically and accurately reconstructs the 3D knee anatomy from single-plane fluoroscopic x-ray based on a nonlinear statistical shape model called kernel principal component analysis. To increase robustness, we designed a hybrid energy function that integrated feature and intensity information as a similarity measure for the 3D reconstruction. Results: We evaluated the proposed method on five subjects during deep knee bending: the root-mean-square accuracy is 1.19±0.36 mm for reconstructed femur and 1.15±0.17 mm for reconstructed tibia. Conclusions: The proposed method demonstrates reliable 3D bone model reconstruction accuracy with successful elimination of prior 3D imaging and reduction of manual labor and radiation dose on patient as well as characterizing joints in motion. This method is promising for applications in medical interventions such as patient-specific arthroplasty design, surgical planning, surgical navigation, and understanding anatomical and dynamic characteristics of joints.
Collapse
Affiliation(s)
- Jing Wu
- University of Tennessee, Department of Mechanical, Aerospace, and Biomedical Engineering, Knoxville, Tennessee, United States
| | - Mohamed R Mahfouz
- University of Tennessee, Department of Mechanical, Aerospace, and Biomedical Engineering, Knoxville, Tennessee, United States
| |
Collapse
|
12
|
Cerveri P, Belfatto A, Manzotti A. Predicting Knee Joint Instability Using a Tibio-Femoral Statistical Shape Model. Front Bioeng Biotechnol 2020; 8:253. [PMID: 32363179 PMCID: PMC7182437 DOI: 10.3389/fbioe.2020.00253] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2019] [Accepted: 03/12/2020] [Indexed: 11/13/2022] Open
Abstract
Statistical shape models (SSMs) are a well established computational technique to represent the morphological variability spread in a set of matching surfaces by means of compact descriptive quantities, traditionally called "modes of variation" (MoVs). SSMs of bony surfaces have been proposed in biomechanics and orthopedic clinics to investigate the relation between bone shape and joint biomechanics. In this work, an SSM of the tibio-femoral joint has been developed to elucidate the relation between MoVs and bone angular deformities causing knee instability. The SSM was built using 99 bony shapes (distal femur and proximal tibia surfaces obtained from segmented CT scans) of osteoarthritic patients. Hip-knee-ankle (HKA) angle, femoral varus-valgus (FVV) angle, internal-external femoral rotation (IER), tibial varus-valgus (TVV) angles, and tibial slope (TS) were available across the patient set. Discriminant analysis (DA) and logistic regression (LR) classifiers were adopted to underline specific MoVs accounting for knee instability. First, it was found that thirty-four MoVs were enough to describe 95% of the shape variability in the dataset. The most relevant MoVs were the one encoding the height of the femoral and tibial shafts (MoV #2) and the one representing variations of the axial section of the femoral shaft and its bending in the frontal plane (MoV #5). Second, using quadratic DA, the sensitivity results of the classification were very accurate, being all >0.85 (HKA: 0.96, FVV: 0.99, IER: 0.88, TVV: 1, TS: 0.87). The results of the LR classifier were mostly in agreement with DA, confirming statistical significance for MoV #2 (p = 0.02) in correspondence to IER and MoV #5 in correspondence to HKA (p = 0.0001), FVV (p = 0.001), and TS (p = 0.02). We can argue that the SSM successfully identified specific MoVs encoding ranges of alignment variability between distal femur and proximal tibia. This discloses the opportunity to use the SSM to predict potential misalignment in the knee for a new patient by processing the bone shapes, removing the need for measuring clinical landmarks as the rotation centers and mechanical axes.
Collapse
Affiliation(s)
- Pietro Cerveri
- Department of Electronics, Information and Bioengineering, Polytechnic University of Milan, Milan, Italy
| | - Antonella Belfatto
- Department of Electronics, Information and Bioengineering, Polytechnic University of Milan, Milan, Italy
| | - Alfonso Manzotti
- Orthopaedic and Trauma Department, "Luigi Sacco" Hospital, ASST FBF-Sacco, Milan, Italy
| |
Collapse
|
13
|
Kunz M, Rudan JF. Patient-Specific Surgical Guidance System for Intelligent Orthopaedics. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2019; 1093:225-243. [PMID: 30306485 DOI: 10.1007/978-981-13-1396-7_18] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/11/2023]
Abstract
Clinical benefits for image-guided orthopaedic surgical systems are often measured in improved accuracy and precision of tool trajectories, prosthesis component positions and/or reduction of revision rate. However, with an ever-increasing demand for orthopaedic procedures, especially joint replacements, the ability to increase the number of surgeries, as well as lowering the costs per surgery, is generating a similar interest in the evaluation of image-guided orthopaedic systems. Patient-specific instrument guidance has recently gained popularity in various orthopaedic applications. Studies have shown that these guides are comparable to traditional image-guided systems with respect to accuracy and precision of the navigation of tool trajectories and/or prosthesis component positioning. Additionally, reports have shown that these single-use instruments also improve operating room management and reduce surgical time and costs. In this chapter, we discuss how patient-specific instrument guidance provides benefits to patients as well as to the health-care community for various orthopaedic applications.
Collapse
Affiliation(s)
- Manuela Kunz
- Department of Surgery, Queen's University, Kingston, ON, Canada.
| | - John F Rudan
- Department of Surgery, Queen's University, Kingston, ON, Canada
| |
Collapse
|
14
|
Cerveri P, Belfatto A, Manzotti A. Pair-wise vs group-wise registration in statistical shape model construction: representation of physiological and pathological variability of bony surface morphology. Comput Methods Biomech Biomed Engin 2019; 22:772-787. [PMID: 30931618 DOI: 10.1080/10255842.2019.1592378] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
Statistical shape models (SSM) of bony surfaces have been widely proposed in orthopedics, especially for anatomical bone modeling, joint kinematic analysis, staging of morphological abnormality, and pre- and intra-operative shape reconstruction. In the SSM computation, reference shape selection, shape registration and point correspondence computation are fundamental aspects determining the quality (generality, specificity and compactness) of the SSM. Such procedures can be made critical by the presence of large morphological dissimilarities within the surfaces, not only because of anthropometrical variability but also mainly due to pathological abnormalities. In this work, we proposed a SW pipeline for SSM construction based on pair-wise (PW) shape registration, which requires the a-priori selection of the reference shape, and on a custom iterative point correspondence algorithm. We addressed large morphological deformations in five different bony surface sets, namely proximal femur, distal femur, patella, proximal fibula and proximal tibia, extracted from a retrospective patient dataset. The technique was compared to a method from the literature, based on group-wise (GW) shape registration. As a main finding, the proposed technique provided generalization and specificity median errors, for all the five bony regions, lower than 2 mm. The comparative analysis provided basically similar results. Particularly, for the distal femur that was the shape affected by the largest pathological deformations, the differences in generalization, specificity and compactness were lower than 0.5 mm, 0.5 mm, and 1%, respectively. We can argue the proposed pipeline, along with the robust correspondence algorithm, is able to compute high-quality SSM of bony shapes, even affected by large morphological variability.
Collapse
Affiliation(s)
- Pietro Cerveri
- a Department of Electronics, Information and Bioengineering , Politecnico di Milano , Milan , Italy
| | - Antonella Belfatto
- a Department of Electronics, Information and Bioengineering , Politecnico di Milano , Milan , Italy
| | - Alfonso Manzotti
- b Orthopaedic and Trauma Department , Luigi Sacco Hospital, ASST FBF-Sacco , Milan , Italy
| |
Collapse
|
15
|
Van Osch K, Allen D, Gare B, Hudson TJ, Ladak H, Agrawal SK. Morphological analysis of sigmoid sinus anatomy: clinical applications to neurotological surgery. J Otolaryngol Head Neck Surg 2019; 48:2. [PMID: 30635049 PMCID: PMC6329078 DOI: 10.1186/s40463-019-0324-0] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2018] [Accepted: 01/02/2019] [Indexed: 01/18/2023] Open
Abstract
OBJECTIVES The primary objective of this study was to use high-resolution micro-CT images to create accurate three-dimensional (3D) models of several intratemporal structures, and to compare several surgically important dimensions within the temporal bone. The secondary objective was to create a statistical shape model (SSM) of a dominant and non-dominant sigmoid sinus (SS) to provide a template for automated segmentation algorithms. METHODS A free image processing software, 3D Slicer, was utilized to create three-dimensional reconstructions of the SS, jugular bulb (JB), facial nerve (FN), and external auditory canal (EAC) from micro-CT scans. The models were used to compare several clinically important dimensions between the dominant and non-dominant SS. Anatomic variability of the SS was also analyzed using SSMs generated using the Statismo software framework. RESULTS Three-dimensional models from 38 temporal bones were generated and analyzed. Right dominance was observed in 74% of the paired SSs. All distances were significantly shorter on the dominant side (p < 0.05), including: EAC - SS (dominant: 13.7 ± 3.4 mm; non-dominant: 15.3 ± 2.7 mm), FN - SS (dominant: 7.2 ± 1.8 mm; non-dominant: 8.1 ± 2.3 mm), 2nd genu FN - superior tip of JB (dominant: 8.7 ± 2.2 mm; non-dominant: 11.2 ± 2.6 mm), horizontal distance between the superior tip of JB - descending FN (dominant: 9.5 ± 2.3 mm; non-dominant: 13.2 ± 3.5 mm), and horizontal distance between the FN at the stylomastoid foramen - JB (dominant: 5.4 ± 2.2 mm; non-dominant: 7.7 ± 2.1). Analysis of the SSMs indicated that SS morphology is most variable at its junction with the transverse sinus, and least variable at the JB. CONCLUSIONS This is the first known study to investigate the anatomical variation and relationships of the SS using high resolution scans, 3D models and statistical shape analysis. This analysis seeks to guide neurotological surgical approaches and provide a template for automated segmentation and surgical simulation.
Collapse
Affiliation(s)
- Kylen Van Osch
- Schulich School of Medicine & Dentistry, Western University, London, Ontario, N6A 5C1, Canada
| | - Daniel Allen
- Department of Electrical and Computer Engineering, Western University, London, Ontario, N6A 5C1, Canada
| | - Bradley Gare
- Department of Electrical and Computer Engineering, Western University, London, Ontario, N6A 5C1, Canada
| | - Thomas J Hudson
- Schulich School of Medicine & Dentistry, Western University, London, Ontario, N6A 5C1, Canada
| | - Hanif Ladak
- Department of Medical Biophysics, Western University, London, Ontario, N6A 5C1, Canada
| | - Sumit K Agrawal
- Department of Otolaryngology - Head and Neck Surgery, Western University, London, Ontario, N6A 5C1, Canada.
| |
Collapse
|
16
|
Wakaiki T, Tanaka T, Shimatani K, Kurita Y, Iida T. Individualization of Musculoskeletal Model for Analyzing Pelvic Floor Muscles Activity Based on Gait Motion Features. JOURNAL OF ROBOTICS AND MECHATRONICS 2018. [DOI: 10.20965/jrm.2018.p0991] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Stress urinary incontinence (SUI) is a typical quality of life disease in women. The strengthening of the pelvic floor muscle (PFM) is considered effective to prevent this. Specifically, PFM activity is affected by individual pelvic shape and posture. Therefore, it is necessary to analyze muscle activity by considering the individual differences. In this study, individual pelvic alignment was estimated from the feature values of natural gait via multiple regression analysis. In addition, individual pelvic feature points were derived from X-ray images and used to deform the standard model to obtain individual pelvic shapes. Results indicate that the residual averages of the estimated feature angles were less than 2° in most cases. Subsequently, measurements of the pelvis were obtained via MRI to evaluate the estimated pelvis shape. The results indicate that individual adaptation leads to muscle attachment positions, which are important in the muscle activity analysis, and closer to the true MRI value when compared to that of the standard pelvic model.
Collapse
|
17
|
Van Dijck C, Wirix-Speetjens R, Jonkers I, Vander Sloten J. Statistical shape model-based prediction of tibiofemoral cartilage. Comput Methods Biomech Biomed Engin 2018; 21:568-578. [PMID: 30366502 DOI: 10.1080/10255842.2018.1495711] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
Abstract
Computed tomography is used more routinely to design patient-specific instrumentation for knee replacement surgery. Its moderate imaging cost and simplified segmentation reduce design costs compared with magnetic resonance (MR) imaging, but it cannot provide the necessary cartilage information. Our method based on statistical shape modelling proved to be successful in predicting tibiofemoral cartilage in leave-one-out experiments. The obtained accuracy of 0.54 mm for femur and 0.49 mm for tibia outperforms the average cartilage thickness distribution and reported inter-observer MR segmentation variability. These results suggest that shape modelling is able to predict tibiofemoral cartilage with sufficient accuracy to design patient-specific instrumentation.
Collapse
Affiliation(s)
- Christophe Van Dijck
- Biomechanics Section, Mechanical Engineering, KU Leuven, Leuven, Belgium.,Materialise NV, Leuven, Belgium
| | | | - Ilse Jonkers
- Human Movement Biomechanics Research Group, KU Leuven, Leuven, Belgium
| | - Jos Vander Sloten
- Biomechanics Section, Mechanical Engineering, KU Leuven, Leuven, Belgium
| |
Collapse
|
18
|
Reyneke CJF, Luthi M, Burdin V, Douglas TS, Vetter T, Mutsvangwa TEM. Review of 2-D/3-D Reconstruction Using Statistical Shape and Intensity Models and X-Ray Image Synthesis: Toward a Unified Framework. IEEE Rev Biomed Eng 2018; 12:269-286. [PMID: 30334808 DOI: 10.1109/rbme.2018.2876450] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Patient-specific three-dimensional (3-D) bone models are useful for a number of clinical applications such as surgery planning, postoperative evaluation, as well as implant and prosthesis design. Two-dimensional-to-3-D (2-D/3-D) reconstruction, also known as model-to-modality or atlas-based 2-D/3-D registration, provides a means of obtaining a 3-D model of a patient's bones from their 2-D radiographs when 3-D imaging modalities are not available. The preferred approach for estimating both shape and density information (that would be present in a patient's computed tomography data) for 2-D/3-D reconstruction makes use of digitally reconstructed radiographs and deformable models in an iterative, non-rigid, intensity-based approach. Based on a large number of state-of-the-art 2-D/3-D bone reconstruction methods, a unified mathematical formulation of the problem is proposed in a common conceptual framework, using unambiguous terminology. In addition, shortcomings, recent adaptations, and persisting challenges are discussed along with insights for future research.
Collapse
|
19
|
Zheng G, Hommel H, Akcoltekin A, Thelen B, Stifter J, Peersman G. A novel technology for 3D knee prosthesis planning and treatment evaluation using 2D X-ray radiographs: a clinical evaluation. Int J Comput Assist Radiol Surg 2018; 13:1151-1158. [PMID: 29785589 DOI: 10.1007/s11548-018-1789-4] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2018] [Accepted: 05/09/2018] [Indexed: 10/16/2022]
Abstract
PURPOSE To present a clinical validation of a novel technology called "3X" which allows for 3D prosthesis planning and treatment evaluation in total knee arthroplasty (TKA) using only 2D X-ray radiographs. MATERIALS AND METHODS After local institution review board approvals, 3X was evaluated on 43 cases (23 for preoperative planning and 20 for postoperative treatment evaluation). All the patients underwent CT scans according to a standard protocol. The results measured on the CT data were regarded as the ground truth. Additionally, two X-ray images were acquired for each affected leg and were used by 3X technology to derive patient-specific measurements of the leg. In total, we compared seven parameters for planning TKA and five parameters for postoperative prosthesis alignment. RESULTS Our experimental results demonstrated that the mean distances between the surface models reconstructed from 2D X-rays and the associated surface models obtained from 3D CT data were smaller than 1.5 mm. The average differences for all angular parameters were smaller than [Formula: see text]. In over 78% cases 3X technology derived the same femoral component size as the CT-based ground truth and this value went down to 70% when 3X technology was used to predict the size of tibial component. CONCLUSION 3X is a technology that allows for true 3D preoperative planning and postoperative treatment evaluation based on 2D X-ray radiographs.
Collapse
Affiliation(s)
- Guoyan Zheng
- Institute for Surgical Technology and Biomechanics, University of Bern, Bern, Switzerland.
| | - Hagen Hommel
- Clinic for Orthopedic, Sports Medicine and Rehabilitation, Krankenhaus Mrkisch Oderland GmbH, Wriezen, Germany
| | - Alper Akcoltekin
- Institute for Surgical Technology and Biomechanics, University of Bern, Bern, Switzerland
| | - Benedikt Thelen
- Institute for Surgical Technology and Biomechanics, University of Bern, Bern, Switzerland
| | | | - Geert Peersman
- Institute for Orthopaedic Research and Training, KU Leuven, Campus Pellenberg, Louvain, Belgium
| |
Collapse
|