1
|
Rolf O, Blana A, Hagedorn P. Implantation of Reverse Shoulder Endoprothesis Using Navigation. ZEITSCHRIFT FUR ORTHOPADIE UND UNFALLCHIRURGIE 2024. [PMID: 39251203 DOI: 10.1055/a-2346-9916] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/11/2024]
Abstract
The implantation of a reverse shoulder arthroplasty (RSA) is a proven method for pain relief and improvement in shoulder function. Results vary, depending on the patient's age, the severity of the disease, and the experience of the surgeon. Indications for RSA are diverse, ranging from rotator cuff arthropathy to fractures. Recent studies show improved survival rates and reduced complications after primary implantation. Preoperative planning using 3D-CT or MRI is considered to be the gold standard. Patient-specific instruments (PSI) have been introduced, but are associated with costs and waiting times. Navigation with augmented reality (AR) provides a more efficient alternative. The intraoperative transfer of the plan to the patient is carried out via AR glasses, allowing real-time information without having to divert the surgeon's attention from the surgical site. This optimises the workflow and potentially yields more precise implantation results. In summary, the combination of 3D planning, navigation, and AR offers a promising method for precise and efficient RSA-implantations. Nevertheless, long-term results and functional scores are not yet available.
Collapse
Affiliation(s)
- Olaf Rolf
- Franziskus-Hospital Harderberg, Department for Orthopedics and Traumatology, Niels-Stensen-Kliniken GmbH, Georgsmarienhütte, Deutschland
| | - Andreas Blana
- Franziskus-Hospital Harderberg, Department for Orthopedics and Traumatology, Niels-Stensen-Kliniken GmbH, Georgsmarienhütte, Deutschland
| | - Philipp Hagedorn
- Franziskus-Hospital Harderberg, Department for Orthopedics and Traumatology, Niels-Stensen-Kliniken GmbH, Georgsmarienhütte, Deutschland
| |
Collapse
|
2
|
Barreto Vega A, Ramkumar PN, Kassam H, Navarro RA. Advanced technology in shoulder arthroplasty surgery: Artificial intelligence, extended reality, and robotics. Shoulder Elbow 2024; 16:347-351. [PMID: 39318415 PMCID: PMC11418656 DOI: 10.1177/17585732241259165] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/26/2024] [Accepted: 05/12/2024] [Indexed: 09/26/2024]
Abstract
The purpose of this review is to provide an overview of the integration of technological advancements in orthopedic shoulder surgery. Recent technological advancements in orthopedic shoulder surgery include predictive analytics, computer-navigated instrumentation for operative planning, extended reality, and robotics. Separately, these advancements provide distinct methodological attempts to improve surgical experiences and outcomes. Together, these technologies can provide orthopedic surgeons with the tools and capabilities to improve patient care and communication in shoulder arthroplasty. From artificial intelligence-generated predictive analytics to extended reality and robotics, technical innovations may lead to improvements in patient education, surgical accuracy, interdisciplinary communication, and outcomes. A comprehensive narrative review was conducted to explore the technological advancements of orthopedic shoulder arthroplasty. Our findings emphasized the impact of these advancements, exemplified by early enhancements in efficacy and safety. However, certain challenges remain, such as a lack of reproducibly improved outcomes and cost considerations. While the reviewed studies indicate hope for improving shoulder arthroplasty, the true cost-effectiveness and applicability remains to be determined, indicating the need for further research.
Collapse
Affiliation(s)
| | - Prem N Ramkumar
- Department of Orthopedic Surgery, Long Beach Lakewood Orthopedic Institute, Long Beach, CA, USA
| | - Hafiz Kassam
- Department of Orthopedic Surgery, Newport Orthopedic Institute, Newport Beach, CA, USA
| | - Ronald A Navarro
- Department of Orthopedic Surgery, Kaiser Permanente South Bay Medical Center, Harbor City, CA, USA
| |
Collapse
|
3
|
Edalati S, Slobin J, Harsinay A, Vasan V, Taha MA, Del Signore A, Govindaraj S, Iloreta AM. Augmented and Virtual Reality Applications in Rhinology: A Scoping Review. Laryngoscope 2024. [PMID: 38924127 DOI: 10.1002/lary.31602] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2024] [Revised: 05/22/2024] [Accepted: 06/12/2024] [Indexed: 06/28/2024]
Abstract
OBJECTIVES Virtual reality (VR) and augmented reality (AR) are innovative technologies that have a wide range of potential applications in the health care industry. The aim of this study was to investigate the body of research on AR and VR applications in rhinology by performing a scoping review. DATA SOURCES PubMed, Scopus, and Embase. REVIEW METHODS According to PRISM-ScR guidelines, a scoping review of literature on the application of AR and/or VR in the context of Rhinology was conducted using PubMed, Scopus, and Embase. RESULTS Forty-nine articles from 1996 to 2023 met the criteria for review. Five broad types of AR and/or VR applications were found: preoperative, intraoperative, training/education, feasibility, and technical. The subsequent clinical domains were recognized: craniovertebral surgery, nasal endoscopy, transsphenoidal surgery, skull base surgery, endoscopic sinus surgery, and sinonasal malignancies. CONCLUSION AR and VR have comprehensive applications in Rhinology. AR for surgical navigation may have the most emerging potential in skull base surgery and endoscopic sinus surgery. VR can be utilized as an engaging training tool for surgeons and residents and as a distraction analgesia for patients undergoing office-based procedures. Additional research is essential to further understand the tangible effects of these technologies on measurable clinical results. Laryngoscope, 2024.
Collapse
Affiliation(s)
- Shaun Edalati
- Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Jacqueline Slobin
- Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Ariel Harsinay
- Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Vikram Vasan
- Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Mohamed A Taha
- Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Anthony Del Signore
- Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Satish Govindaraj
- Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Alfred Marc Iloreta
- Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| |
Collapse
|
4
|
Berhouet J, Samargandi R. Emerging Innovations in Preoperative Planning and Motion Analysis in Orthopedic Surgery. Diagnostics (Basel) 2024; 14:1321. [PMID: 39001212 PMCID: PMC11240316 DOI: 10.3390/diagnostics14131321] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2024] [Revised: 06/15/2024] [Accepted: 06/20/2024] [Indexed: 07/16/2024] Open
Abstract
In recent years, preoperative planning has undergone significant advancements, with a dual focus: improving the accuracy of implant placement and enhancing the prediction of functional outcomes. These breakthroughs have been made possible through the development of advanced processing methods for 3D preoperative images. These methods not only offer novel visualization techniques but can also be seamlessly integrated into computer-aided design models. Additionally, the refinement of motion capture systems has played a pivotal role in this progress. These "markerless" systems are more straightforward to implement and facilitate easier data analysis. Simultaneously, the emergence of machine learning algorithms, utilizing artificial intelligence, has enabled the amalgamation of anatomical and functional data, leading to highly personalized preoperative plans for patients. The shift in preoperative planning from 2D towards 3D, from static to dynamic, is closely linked to technological advances, which will be described in this instructional review. Finally, the concept of 4D planning, encompassing periarticular soft tissues, will be introduced as a forward-looking development in the field of orthopedic surgery.
Collapse
Affiliation(s)
- Julien Berhouet
- Service de Chirurgie Orthopédique et Traumatologique, Centre Hospitalier Régional Universitaire (CHRU) de Tours, 1C Avenue de la République, 37170 Chambray-les-Tours, France
- Equipe Reconnaissance de Forme et Analyse de l'Image, Laboratoire d'Informatique Fondamentale et Appliquée de Tours EA6300, Ecole d'Ingénieurs Polytechnique Universitaire de Tours, Université de Tours, 64 Avenue Portalis, 37200 Tours, France
| | - Ramy Samargandi
- Service de Chirurgie Orthopédique et Traumatologique, Centre Hospitalier Régional Universitaire (CHRU) de Tours, 1C Avenue de la République, 37170 Chambray-les-Tours, France
- Department of Orthopedic Surgery, Faculty of Medicine, University of Jeddah, Jeddah 23218, Saudi Arabia
| |
Collapse
|
5
|
Canton SP, Austin CN, Steuer F, Dadi S, Sharma N, Kass NM, Fogg D, Clayton E, Cunningham O, Scott D, LaBaze D, Andrews EG, Biehl JT, Hogan MV. Feasibility and Usability of Augmented Reality Technology in the Orthopaedic Operating Room. Curr Rev Musculoskelet Med 2024; 17:117-128. [PMID: 38607522 PMCID: PMC11068703 DOI: 10.1007/s12178-024-09888-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 02/06/2024] [Indexed: 04/13/2024]
Abstract
PURPOSE OF REVIEW Augmented reality (AR) has gained popularity in various sectors, including gaming, entertainment, and healthcare. The desire for improved surgical navigation within orthopaedic surgery has led to the evaluation of the feasibility and usability of AR in the operating room (OR). However, the safe and effective use of AR technology in the OR necessitates a proper understanding of its capabilities and limitations. This review aims to describe the fundamental elements of AR, highlight limitations for use within the field of orthopaedic surgery, and discuss potential areas for development. RECENT FINDINGS To date, studies have demonstrated evidence that AR technology can be used to enhance navigation and performance in orthopaedic procedures. General hardware and software limitations of the technology include the registration process, ergonomics, and battery life. Other limitations are related to the human response factors such as inattentional blindness, which may lead to the inability to see complications within the surgical field. Furthermore, the prolonged use of AR can cause eye strain and headache due to phenomena such as the vergence-convergence conflict. AR technology may prove to be a better alternative to current orthopaedic surgery navigation systems. However, the current limitations should be mitigated to further improve the feasibility and usability of AR in the OR setting. It is important for both non-clinicians and clinicians to work in conjunction to guide the development of future iterations of AR technology and its implementation into the OR workflow.
Collapse
Affiliation(s)
- Stephen P Canton
- Department of Orthopaedic Surgery, University of Pittsburgh, 3471 Fifth Ave, Pittsburgh, PA, 15213, USA.
| | | | - Fritz Steuer
- University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - Srujan Dadi
- Rowan-Virtua School of Osteopathic Medicine, Stratford, NJ, USA
| | - Nikhil Sharma
- University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - Nicolás M Kass
- University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - David Fogg
- Texas Tech University Health Sciences Center El Paso, El Paso, TX, USA
| | - Elizabeth Clayton
- Department of Orthopaedic Surgery, University of Pittsburgh, 3471 Fifth Ave, Pittsburgh, PA, 15213, USA
| | - Onaje Cunningham
- University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - Devon Scott
- Department of Orthopaedic Surgery, University of Pittsburgh, 3471 Fifth Ave, Pittsburgh, PA, 15213, USA
| | - Dukens LaBaze
- Department of Orthopaedic Surgery, University of Pittsburgh, 3471 Fifth Ave, Pittsburgh, PA, 15213, USA
| | - Edward G Andrews
- Department of Neurological Surgery University of Pittsburgh Medical Center, Pittsburgh, PA, USA
| | - Jacob T Biehl
- School of Computing and Information, University of Pittsburgh, Pittsburgh, PA, USA
| | - MaCalus V Hogan
- Department of Orthopaedic Surgery, University of Pittsburgh, 3471 Fifth Ave, Pittsburgh, PA, 15213, USA
| |
Collapse
|
6
|
Morita J, Ikumi A, Nakatani T, Noguchi H, Mishima H, Ishii T, Yoshii Y. Development of Augmented Reality Vision for Osteosynthesis Using a 3D Camera. Cureus 2024; 16:e60479. [PMID: 38882985 PMCID: PMC11180535 DOI: 10.7759/cureus.60479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/17/2024] [Indexed: 06/18/2024] Open
Abstract
BACKGROUND We developed a 3D camera system to track motion in a surgical field. This system has the potential to introduce augmented reality (AR) systems non-invasively, eliminating the need for the invasive AR markers conventionally required. The present study was performed to verify the real-time tracking accuracy of this system, assess the feasibility of integrating this system into the surgical workflow, and establish its potential to enhance the accuracy and efficiency of orthopedic procedures. METHODS To evaluate the accuracy of AR technology using a 3D camera, a forearm bone model was created. The forearm model was depicted using a 3D camera, and its accuracy was verified in terms of the positional relationship with a 3D bone model created from previously imaged CT data. Images of the surgical field (capturing the actual forearm) were taken and saved in nine poses by rotating the forearm from pronation to supination. The alignment of the reference points was computed at the three points of CT versus the three points of the 3D camera, yielding a 3D rotation matrix representing the positional relationship. In the original system, a stereo vision-based 3D camera, with a depth image resolution of 1280×720 pixels, 30 frames per second, and a lens field of view of 64 specifications, with a baseline of 3 cm, capable of optimally acquiring real-time 3D data at a distance of 40-60 cm from the subject was used. In the modified system, the following modifications were made to improve tracking performance: (1) color filter processing was changed from HSV to RGB, (2) positional detection accuracy was modified with supporting marker sizes of 8 mm in diameter, and (3) the detection of marker positions was stabilized by calculating the marker position for each frame. Tracking accuracy was examined with the original system and modified system for the following parameters: differences in the rotation matrix, maximum and minimum inter-reference point errors between CT-based and camera-based 3D data, and the average error for the three reference points. RESULTS In the original system, the average difference in rotation matrices was 5.51±2.68 mm. Average minimum and maximum errors were 1.10±0.61 and 15.53±12.51 mm, respectively. The average error of reference points was 6.26±4.49 mm. In the modified system, the average difference in rotation matrices was 4.22±1.73 mm. Average minimum and maximum errors were 0.79±0.49 and 1.94±0.87 mm, respectively. The average error of reference points was 1.41±0.58 mm. In the original system, once tracking failed, it was difficult to recover tracking accuracy. This resulted in a large maximum error in supination positions. These issues were resolved by the modified system. Significant improvements were achieved in maximum errors and average errors using the modified system (P<0.05). CONCLUSION AR technology using a 3D camera was developed. This system allows direct comparisons of 3D data from preoperative CT scans with 3D data acquired from the surgical field using a 3D camera. This method has the advantage of introducing AR into the surgical field without invasive markers.
Collapse
Affiliation(s)
- Junichiro Morita
- Graduate School of Medicine, University of Tsukuba, Tsukuba, JPN
| | - Akira Ikumi
- Department of Orthopaedic Surgery, University of Tsukuba, Tsukuba, JPN
| | - Takushi Nakatani
- Department of Orthopaedic Surgery, Showa General Hospital, Kodaira, JPN
| | - Hiroshi Noguchi
- Department of Orthopaedic Surgery, University of Tsukuba, Tsukuba, JPN
| | - Hajime Mishima
- Department of Orthopaedic Surgery, University of Tsukuba, Tsukuba, JPN
| | - Tomoo Ishii
- Department of Orthopaedic Surgery, Tokyo Medical University Ibaraki Medical Center, Ami, JPN
| | - Yuichi Yoshii
- Department of Orthopaedic Surgery, Tokyo Medical University Ibaraki Medical Center, Ami, JPN
| |
Collapse
|
7
|
Tong G, Xu J, Pfister M, Atoum J, Prasad K, Miller A, Topf M, Wu JY. Development of an augmented reality guidance system for head and neck cancer resection. Healthc Technol Lett 2024; 11:93-100. [PMID: 38638497 PMCID: PMC11022213 DOI: 10.1049/htl2.12062] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2023] [Accepted: 11/22/2023] [Indexed: 04/20/2024] Open
Abstract
The use of head-mounted augmented reality (AR) for surgeries has grown rapidly in recent years. AR aids in intraoperative surgical navigation through overlaying three-dimensional (3D) holographic reconstructions of medical data. However, performing AR surgeries on complex areas such as the head and neck region poses challenges in terms of accuracy and speed. This study explores the feasibility of an AR guidance system for resections of positive tumour margins in a cadaveric specimen. The authors present an intraoperative solution that enables surgeons to upload and visualize holographic reconstructions of resected cadaver tissues. The solution involves using a 3D scanner to capture detailed scans of the resected tissue, which are subsequently uploaded into our software. The software converts the scans of resected tissues into specimen holograms that are viewable through a head-mounted AR display. By re-aligning these holograms with cadavers with gestures or voice commands, surgeons can navigate the head and neck tumour site. This workflow can run concurrently with frozen section analysis. On average, the authors achieve an uploading time of 2.98 min, visualization time of 1.05 min, and re-alignment time of 4.39 min, compared to the 20 to 30 min typical for frozen section analysis. The authors achieve a mean re-alignment error of 3.1 mm. The authors' software provides a foundation for new research and product development for using AR to navigate complex 3D anatomy in surgery.
Collapse
Affiliation(s)
- Guansen Tong
- Computer Science DepartmentVanderbilt UniversityNashvilleTennesseeUSA
| | - Jiayi Xu
- Computer Science DepartmentVanderbilt UniversityNashvilleTennesseeUSA
| | - Michael Pfister
- Computer Science DepartmentVanderbilt UniversityNashvilleTennesseeUSA
| | - Jumanh Atoum
- Computer Science DepartmentVanderbilt UniversityNashvilleTennesseeUSA
| | - Kavita Prasad
- Vanderbilt University Medical CenterNashvilleTennesseeUSA
| | - Alexis Miller
- Vanderbilt University Medical CenterNashvilleTennesseeUSA
| | - Michael Topf
- Vanderbilt University Medical CenterNashvilleTennesseeUSA
| | - Jie Ying Wu
- Computer Science DepartmentVanderbilt UniversityNashvilleTennesseeUSA
| |
Collapse
|
8
|
Migliorini F, Feierabend M, Hofmann UK. Fostering Excellence in Knee Arthroplasty: Developing Optimal Patient Care Pathways and Inspiring Knowledge Transfer of Advanced Surgical Techniques. J Healthc Leadersh 2023; 15:327-338. [PMID: 38020721 PMCID: PMC10676205 DOI: 10.2147/jhl.s383916] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 11/13/2023] [Indexed: 12/01/2023] Open
Abstract
Osteoarthritis of the knee is common. Early sports trauma or cartilage defects are risk factors for osteoarthritis. If conservative treatment fails, partial or total joint replacement is often performed. A joint replacement aims to restore physiological biomechanics and the quality of life of affected patients. Total knee arthroplasty is one of the most performed surgeries in musculoskeletal medicine. Several developments have taken place over the last decades that have truly altered the way we look at knee arthroplasty today. Some of the fascinating aspects will be presented and discussed in the present narrative review.
Collapse
Affiliation(s)
- Filippo Migliorini
- Department of Orthopaedic, Trauma, and Reconstructive Surgery, RWTH University Medical Centre, Aachen, 52074, Germany
- Department of Orthopedics and Trauma Surgery, Academic Hospital of Bolzano (SABES-ASDAA), Teaching Hospital of Paracelsus Medical University, 39100 Bolzano, Italy
| | - Martina Feierabend
- Department of Orthopaedic, Trauma, and Reconstructive Surgery, RWTH University Medical Centre, Aachen, 52074, Germany
| | - Ulf Krister Hofmann
- Department of Orthopaedic, Trauma, and Reconstructive Surgery, RWTH University Medical Centre, Aachen, 52074, Germany
| |
Collapse
|
9
|
Moglia A, Marsilio L, Rossi M, Pinelli M, Lettieri E, Mainardi L, Manzotti A, Cerveri P. Mixed Reality and Artificial Intelligence: A Holistic Approach to Multimodal Visualization and Extended Interaction in Knee Osteotomy. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2023; 12:279-290. [PMID: 38410183 PMCID: PMC10896423 DOI: 10.1109/jtehm.2023.3335608] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 10/16/2023] [Accepted: 11/17/2023] [Indexed: 02/28/2024]
Abstract
OBJECTIVE Recent advancements in augmented reality led to planning and navigation systems for orthopedic surgery. However little is known about mixed reality (MR) in orthopedics. Furthermore, artificial intelligence (AI) has the potential to boost the capabilities of MR by enabling automation and personalization. The purpose of this work is to assess Holoknee prototype, based on AI and MR for multimodal data visualization and surgical planning in knee osteotomy, developed to run on the HoloLens 2 headset. METHODS Two preclinical test sessions were performed with 11 participants (eight surgeons, two residents, and one medical student) executing three times six tasks, corresponding to a number of holographic data interactions and preoperative planning steps. At the end of each session, participants answered a questionnaire on user perception and usability. RESULTS During the second trial, the participants were faster in all tasks than in the first one, while in the third one, the time of execution decreased only for two tasks ("Patient selection" and "Scrolling through radiograph") with respect to the second attempt, but without statistically significant difference (respectively [Formula: see text] = 0.14 and [Formula: see text] = 0.13, [Formula: see text]). All subjects strongly agreed that MR can be used effectively for surgical training, whereas 10 (90.9%) strongly agreed that it can be used effectively for preoperative planning. Six (54.5%) agreed and two of them (18.2%) strongly agreed that it can be used effectively for intraoperative guidance. DISCUSSION/CONCLUSION In this work, we presented Holoknee, the first holistic application of AI and MR for surgical planning for knee osteotomy. It reported promising results on its potential translation to surgical training, preoperative planning, and surgical guidance. Clinical and Translational Impact Statement - Holoknee can be helpful to support surgeons in the preoperative planning of knee osteotomy. It has the potential to impact positively the training of the future generation of residents and aid surgeons in the intraoperative stage.
Collapse
Affiliation(s)
- Andrea Moglia
- Department of ElectronicsInformation and BioengineeringPolitecnico di Milano20133MilanItaly
| | - Luca Marsilio
- Department of ElectronicsInformation and BioengineeringPolitecnico di Milano20133MilanItaly
| | - Matteo Rossi
- Department of ElectronicsInformation and BioengineeringPolitecnico di Milano20133MilanItaly
- Istituto Auxologico Italiano IRCCS20149MilanItaly
| | - Maria Pinelli
- Department of Management, Economics and Industrial EngineeringPolitecnico di Milano20133MilanItaly
| | - Emanuele Lettieri
- Department of Management, Economics and Industrial EngineeringPolitecnico di Milano20133MilanItaly
| | - Luca Mainardi
- Department of ElectronicsInformation and BioengineeringPolitecnico di Milano20133MilanItaly
| | | | - Pietro Cerveri
- Department of ElectronicsInformation and BioengineeringPolitecnico di Milano20133MilanItaly
- Istituto Auxologico Italiano IRCCS20149MilanItaly
| |
Collapse
|
10
|
Shaikh HJF, Hasan SS, Woo JJ, Lavoie-Gagne O, Long WJ, Ramkumar PN. Exposure to Extended Reality and Artificial Intelligence-Based Manifestations: A Primer on the Future of Hip and Knee Arthroplasty. J Arthroplasty 2023; 38:2096-2104. [PMID: 37196732 DOI: 10.1016/j.arth.2023.05.015] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Revised: 05/06/2023] [Accepted: 05/08/2023] [Indexed: 05/19/2023] Open
Abstract
BACKGROUND Software-infused services, from robot-assisted and wearable technologies to artificial intelligence (AI)-laden analytics, continue to augment clinical orthopaedics - namely hip and knee arthroplasty. Extended reality (XR) tools, which encompass augmented reality, virtual reality, and mixed reality technology, represent a new frontier for expanding surgical horizons to maximize technical education, expertise, and execution. The purpose of this review is to critically detail and evaluate the recent developments surrounding XR in the field of hip and knee arthroplasty and to address potential future applications as they relate to AI. METHODS In this narrative review surrounding XR, we discuss (1) definitions, (2) techniques, (3) studies, (4) current applications, and (5) future directions. We highlight XR subsets (augmented reality, virtual reality, and mixed reality) as they relate to AI in the increasingly digitized ecosystem within hip and knee arthroplasty. RESULTS A narrative review of the XR orthopaedic ecosystem with respect to XR developments is summarized with specific emphasis on hip and knee arthroplasty. The XR as a tool for education, preoperative planning, and surgical execution is discussed with future applications dependent upon AI to potentially obviate the need for robotic assistance and preoperative advanced imaging without sacrificing accuracy. CONCLUSION In a field where exposure is critical to clinical success, XR represents a novel stand-alone software-infused service that optimizes technical education, execution, and expertise but necessitates integration with AI and previously validated software solutions to offer opportunities that improve surgical precision with or without the use of robotics and computed tomography-based imaging.
Collapse
Affiliation(s)
| | - Sayyida S Hasan
- Donald and Barbara Zucker School of Medicine at Hofstra, Uniondale, New York
| | | | | | | | - Prem N Ramkumar
- Hospital for Special Surgery, New York, New York; Long Beach Orthopaedic Institute, Long Beach, California
| |
Collapse
|
11
|
León-Muñoz VJ, Santonja-Medina F, Lajara-Marco F, Lisón-Almagro AJ, Jiménez-Olivares J, Marín-Martínez C, Amor-Jiménez S, Galián-Muñoz E, López-López M, Moya-Angeler J. The Accuracy and Absolute Reliability of a Knee Surgery Assistance System Based on ArUco-Type Sensors. SENSORS (BASEL, SWITZERLAND) 2023; 23:8091. [PMID: 37836921 PMCID: PMC10575457 DOI: 10.3390/s23198091] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/05/2023] [Revised: 09/21/2023] [Accepted: 09/25/2023] [Indexed: 10/15/2023]
Abstract
Recent advances allow the use of Augmented Reality (AR) for many medical procedures. AR via optical navigators to aid various knee surgery techniques (e.g., femoral and tibial osteotomies, ligament reconstructions or menisci transplants) is becoming increasingly frequent. Accuracy in these procedures is essential, but evaluations of this technology still need to be made. Our study aimed to evaluate the system's accuracy using an in vitro protocol. We hypothesised that the system's accuracy was equal to or less than 1 mm and 1° for distance and angular measurements, respectively. Our research was an in vitro laboratory with a 316 L steel model. Absolute reliability was assessed according to the Hopkins criteria by seven independent evaluators. Each observer measured the thirty palpation points and the trademarks to acquire direct angular measurements on three occasions separated by at least two weeks. The system's accuracy in assessing distances had a mean error of 1.203 mm and an uncertainty of 2.062, and for the angular values, a mean error of 0.778° and an uncertainty of 1.438. The intraclass correlation coefficient was for all intra-observer and inter-observers, almost perfect or perfect. The mean error for the distance's determination was statistically larger than 1 mm (1.203 mm) but with a trivial effect size. The mean error assessing angular values was statistically less than 1°. Our results are similar to those published by other authors in accuracy analyses of AR systems.
Collapse
Affiliation(s)
- Vicente J. León-Muñoz
- Department of Orthopaedic Surgery and Traumatology, Hospital General Universitario Reina Sofía, 30003 Murcia, Spain; (F.L.-M.); (A.J.L.-A.); (C.M.-M.); (S.A.-J.); (E.G.-M.); (J.M.-A.)
- Instituto de Cirugía Avanzada de la Rodilla (ICAR), 30005 Murcia, Spain
| | - Fernando Santonja-Medina
- Department of Orthopaedic Surgery and Traumatology, Hospital Clínico Universitario Virgen de la Arrixaca, 30120 Murcia, Spain;
- Department of Surgery, Paediatrics and Obstetrics & Gynaecology, Faculty of Medicine, University of Murcia, 30120 Murcia, Spain
| | - Francisco Lajara-Marco
- Department of Orthopaedic Surgery and Traumatology, Hospital General Universitario Reina Sofía, 30003 Murcia, Spain; (F.L.-M.); (A.J.L.-A.); (C.M.-M.); (S.A.-J.); (E.G.-M.); (J.M.-A.)
| | - Alonso J. Lisón-Almagro
- Department of Orthopaedic Surgery and Traumatology, Hospital General Universitario Reina Sofía, 30003 Murcia, Spain; (F.L.-M.); (A.J.L.-A.); (C.M.-M.); (S.A.-J.); (E.G.-M.); (J.M.-A.)
| | - Jesús Jiménez-Olivares
- Department of Orthopaedic Surgery and Traumatology, Hospital Vega Baja, 03314 Orihuela, Spain;
| | - Carmelo Marín-Martínez
- Department of Orthopaedic Surgery and Traumatology, Hospital General Universitario Reina Sofía, 30003 Murcia, Spain; (F.L.-M.); (A.J.L.-A.); (C.M.-M.); (S.A.-J.); (E.G.-M.); (J.M.-A.)
| | - Salvador Amor-Jiménez
- Department of Orthopaedic Surgery and Traumatology, Hospital General Universitario Reina Sofía, 30003 Murcia, Spain; (F.L.-M.); (A.J.L.-A.); (C.M.-M.); (S.A.-J.); (E.G.-M.); (J.M.-A.)
| | - Elena Galián-Muñoz
- Department of Orthopaedic Surgery and Traumatology, Hospital General Universitario Reina Sofía, 30003 Murcia, Spain; (F.L.-M.); (A.J.L.-A.); (C.M.-M.); (S.A.-J.); (E.G.-M.); (J.M.-A.)
| | - Mirian López-López
- Department of Information Technologies, Subdirección General de Tecnologías de la Información, Servicio Murciano de Salud, 30100 Murcia, Spain;
| | - Joaquín Moya-Angeler
- Department of Orthopaedic Surgery and Traumatology, Hospital General Universitario Reina Sofía, 30003 Murcia, Spain; (F.L.-M.); (A.J.L.-A.); (C.M.-M.); (S.A.-J.); (E.G.-M.); (J.M.-A.)
- Instituto de Cirugía Avanzada de la Rodilla (ICAR), 30005 Murcia, Spain
| |
Collapse
|
12
|
León-Muñoz VJ, Moya-Angeler J, López-López M, Lisón-Almagro AJ, Martínez-Martínez F, Santonja-Medina F. Integration of Square Fiducial Markers in Patient-Specific Instrumentation and Their Applicability in Knee Surgery. J Pers Med 2023; 13:jpm13050727. [PMID: 37240897 DOI: 10.3390/jpm13050727] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Revised: 04/23/2023] [Accepted: 04/23/2023] [Indexed: 05/28/2023] Open
Abstract
Computer technologies play a crucial role in orthopaedic surgery and are essential in personalising different treatments. Recent advances allow the usage of augmented reality (AR) for many orthopaedic procedures, which include different types of knee surgery. AR assigns the interaction between virtual environments and the physical world, allowing both to intermingle (AR superimposes information on real objects in real-time) through an optical device and allows personalising different processes for each patient. This article aims to describe the integration of fiducial markers in planning knee surgeries and to perform a narrative description of the latest publications on AR applications in knee surgery. Augmented reality-assisted knee surgery is an emerging set of techniques that can increase accuracy, efficiency, and safety and decrease the radiation exposure (in some surgical procedures, such as osteotomies) of other conventional methods. Initial clinical experience with AR projection based on ArUco-type artificial marker sensors has shown promising results and received positive operator feedback. Once initial clinical safety and efficacy have been demonstrated, the continued experience should be studied to validate this technology and generate further innovation in this rapidly evolving field.
Collapse
Affiliation(s)
- Vicente J León-Muñoz
- Department of Orthopaedic Surgery and Traumatology, Hospital General Universitario Reina Sofía, 30003 Murcia, Spain
- Instituto de Cirugía Avanzada de la Rodilla (ICAR), 30005 Murcia, Spain
| | - Joaquín Moya-Angeler
- Department of Orthopaedic Surgery and Traumatology, Hospital General Universitario Reina Sofía, 30003 Murcia, Spain
- Instituto de Cirugía Avanzada de la Rodilla (ICAR), 30005 Murcia, Spain
| | - Mirian López-López
- Subdirección General de Tecnologías de la Información, Servicio Murciano de Salud, 30100 Murcia, Spain
| | - Alonso J Lisón-Almagro
- Department of Orthopaedic Surgery and Traumatology, Hospital General Universitario Reina Sofía, 30003 Murcia, Spain
| | - Francisco Martínez-Martínez
- Department of Orthopaedic Surgery and Traumatology, Hospital Clínico Universitario Virgen de la Arrixaca, 30120 Murcia, Spain
| | - Fernando Santonja-Medina
- Department of Orthopaedic Surgery and Traumatology, Hospital Clínico Universitario Virgen de la Arrixaca, 30120 Murcia, Spain
- Department of Surgery, Pediatrics and Obstetrics & Gynecology, Faculty of Medicine, University of Murcia, 30120 Murcia, Spain
| |
Collapse
|
13
|
Román-Belmonte JM, Rodríguez-Merchán EC, De la Corte-Rodríguez H. Metaverse applied to musculoskeletal pathology: Orthoverse and Rehabverse. Postgrad Med 2023:1-9. [PMID: 36786393 DOI: 10.1080/00325481.2023.2180953] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/15/2023]
Abstract
The Metaverse is 'an integrated network of 3D virtual worlds.' It incorporates digitally created realities into the real world, involves virtual copies of existing places and changes the physical reality by superimposing digital aspects, allowing its users to interact with these elements in an immersive, real-time experience. The applications of the Metaverse are numerous, with an increasing number of experiences in the field of musculoskeletal disease management. In the field of medical training, the Metaverse can help facilitate the learning experience and help develop complex clinical skills. In clinical care, the Metaverse can help clinicians perform orthopedic surgery more accurately and safely and can improve pain management, the performance of rehabilitation techniques and the promotion of healthy lifestyles. Virtualization can also optimize aspects of healthcare information and management, increasing the effectiveness of procedures and the functioning of organizations. This optimization can be especially relevant in departments that are under significant care provider pressure. However, we must not lose sight of the fundamental challenges that still need to be solved, such as ensuring patient privacy and fairness. Several studies are underway to assess the feasibility and safety of the Metaverse.
Collapse
Affiliation(s)
- Juan M Román-Belmonte
- Department of Physical Medicine and Rehabilitation, Cruz Roja San José y Santa Adela University Hospital, Madrid, Spain
| | - E Carlos Rodríguez-Merchán
- Department of Orthopedic Surgery, La Paz University Hospital, Madrid, Spain.,Osteoarticular Surgery Research, Hospital La Paz Institute for Health Research - IdiPAZ (La Paz University Hospital - Autonomous University of Madrid), Madrid, Spain
| | | |
Collapse
|
14
|
Zhang J, Wang C, Li X, Fu S, Gu W, Shi Z. Application of mixed reality technology in talocalcaneal coalition resection. Front Surg 2023; 9:1084365. [PMID: 36684274 PMCID: PMC9852772 DOI: 10.3389/fsurg.2022.1084365] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2022] [Accepted: 12/05/2022] [Indexed: 01/08/2023] Open
Abstract
Objectives With positive outcomes recorded, the mixed reality (MR) technology has lately become popular in orthopedic surgery. However, there are few studies that specifically address the utility of MR in talocalcaneal coalitions (TCC) resection. Our goal in this retrospective study is to assess certain data while examining the viability of using MR to treat TCC resection. Methods Six consecutive patients with TCC diagnosed by computed tomography (CT) for which nonoperative therapy had failed and MR system assisted TCC resection were included in this study from March 2021 to December 2021. The feasibility and accuracy of TCC resection were assessed by post-operation radiography. The American Orthopaedic Foot & Ankle Society (AOFAS) hindfoot score and visual analog scale (VAS) score were used to assess the recovery condition and pain level pre- and post-operation. Results The surgeon can accurately resect the TCC according to the preoperatively determined range by superimposing the holographic model with the actual anatomy of the TCC using an MR system. Additionally, no additional x-ray was necessary while operating. Mean follow-up was 10.3 months, with a minimum of 6 months. There is a significant difference between the preoperative AOFAS score of 53.4 ± 3.8 and the 6-month follow-up AOFAS score of 97.3 ± 2.2 (p < 0.05). There is also a significant difference between the preoperative VAS score of 8.1 ± 0.7 and the 6-month follow-up VAS score of 1.7 ± 0.4 (p < 0.05). All individuals had clinical subtalar mobility without stiffness following surgery. Conclusion While the TCC resection operation is being performed, the application of MR technology is practicable, effective, and radiation-free, giving surgeons satisfactory support.
Collapse
Affiliation(s)
- Jieyuan Zhang
- Department of Orthopedic Surgery, Shanghai Sixth People’s Hospital, Shanghai, China
| | - Cheng Wang
- Department of Orthopedic Surgery, Shanghai Sixth People’s Hospital, Shanghai, China
| | - Xueqian Li
- Department of Orthopedic Surgery, Shanghai Sixth People’s Hospital, Shanghai, China
| | - Shaoling Fu
- Department of Orthopedic Surgery, Shanghai Sixth People’s Hospital, Shanghai, China
| | - Wenqi Gu
- Department of Orthopedic Surgery, Shanghai Sixth People’s Hospital, Shanghai, China,Department of Orthopedic Surgery, Shanghai Sixth People’s Hospital East Campus, Shanghai, China,Correspondence: Zhongmin Shi Wenqi Gu
| | - Zhongmin Shi
- Department of Orthopedic Surgery, Shanghai Sixth People’s Hospital, Shanghai, China,Correspondence: Zhongmin Shi Wenqi Gu
| |
Collapse
|
15
|
Technology Behavior Model—Beyond Your Sight with Extended Reality in Surgery. APPLIED SYSTEM INNOVATION 2022. [DOI: 10.3390/asi5020035] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
Extended Reality Smart Glasses is a new pattern that uses extended reality technology to present a visual environment that combines the physical and virtual worlds. However, the surgical technique using Smart Glasses implementation is still unknown, to the infancy in clinical surgery, derived to the limits of existing technology. This study researched the acceptability and possibility of XRSG for medical experts. It combines human seen behavioral control with information technology research to construct a new “Extended Reality Technology Behavior Model” using method Technology Acceptance Model and Theory of Planned Behavior. To improve the accuracy of the study, statistical analysis, exploratory analysis, and cross-sectional research triangulation were used to collect data in five hospitals in Malaysia using a convenience sampling method and a questionnaire on behavioral influences. From the collected data, PLS-SEM analysis was used to reflect the relationship between variables. The strong positive results suggest that using XRSG by medical experts helps to improve the composition, interactivity, standardization, and clarity of medical images, resulting in increased efficiency and reduced procedure time and felt the usefulness and ease of use of XRSG through their behavior, providing a basis for technology acceptance in surgery.
Collapse
|