1
|
Asadi Z, Asadi M, Kazemipour N, Léger É, Kersten-Oertel M. A decade of progress: bringing mixed reality image-guided surgery systems in the operating room. Comput Assist Surg (Abingdon) 2024; 29:2355897. [PMID: 38794834 DOI: 10.1080/24699322.2024.2355897] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/26/2024] Open
Abstract
Advancements in mixed reality (MR) have led to innovative approaches in image-guided surgery (IGS). In this paper, we provide a comprehensive analysis of the current state of MR in image-guided procedures across various surgical domains. Using the Data Visualization View (DVV) Taxonomy, we analyze the progress made since a 2013 literature review paper on MR IGS systems. In addition to examining the current surgical domains using MR systems, we explore trends in types of MR hardware used, type of data visualized, visualizations of virtual elements, and interaction methods in use. Our analysis also covers the metrics used to evaluate these systems in the operating room (OR), both qualitative and quantitative assessments, and clinical studies that have demonstrated the potential of MR technologies to enhance surgical workflows and outcomes. We also address current challenges and future directions that would further establish the use of MR in IGS.
Collapse
Affiliation(s)
- Zahra Asadi
- Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada
| | - Mehrdad Asadi
- Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada
| | - Negar Kazemipour
- Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada
| | - Étienne Léger
- Montréal Neurological Institute & Hospital (MNI/H), Montréal, Canada
- McGill University, Montréal, Canada
| | - Marta Kersten-Oertel
- Department of Computer Science and Software Engineering, Concordia University, Montréal, Canada
| |
Collapse
|
2
|
Prasad K, Fassler C, Miller A, Aweeda M, Pruthi S, Fusco JC, Daniel B, Miga M, Wu JY, Topf MC. More than meets the eye: Augmented reality in surgical oncology. J Surg Oncol 2024. [PMID: 39155686 DOI: 10.1002/jso.27790] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2024] [Accepted: 07/09/2024] [Indexed: 08/20/2024]
Abstract
BACKGROUND AND OBJECTIVES In the field of surgical oncology, there has been a desire for innovative techniques to improve tumor visualization, resection, and patient outcomes. Augmented reality (AR) technology superimposes digital content onto the real-world environment, enhancing the user's experience by blending digital and physical elements. A thorough examination of AR technology in surgical oncology has yet to be performed. METHODS A scoping review of intraoperative AR in surgical oncology was conducted according to the guidelines and recommendations of The Preferred Reporting Items for Systematic Review and Meta-analyzes Extension for Scoping Reviews (PRISMA-ScR) framework. All original articles examining the use of intraoperative AR during surgical management of cancer were included. Exclusion criteria included virtual reality applications only, preoperative use only, fluorescence, AR not specific to surgical oncology, and study design (reviews, commentaries, abstracts). RESULTS A total of 2735 articles were identified of which 83 were included. Most studies (52) were performed on animals or phantom models, while the remaining included patients. A total of 1112 intraoperative AR surgical cases were performed across the studies. The most common anatomic site was brain (20 articles), followed by liver (16), renal (9), and head and neck (8). AR was most often used for intraoperative navigation or anatomic visualization of tumors or critical structures but was also used to identify osteotomy or craniotomy planes. CONCLUSIONS AR technology has been applied across the field of surgical oncology to aid in localization and resection of tumors.
Collapse
Affiliation(s)
- Kavita Prasad
- Department of Otolaryngology-Head & Neck Surgery, Beth Israel Deaconess Medical Center, Boston, Massachusetts, USA
| | - Carly Fassler
- Department of Otolaryngology-Head & Neck Surgery, Vanderbilt University Medical Center, Nashville, Tennessee, USA
| | - Alexis Miller
- Department of Otolaryngology-Head & Neck Surgery, University of Alabama at Birmingham, Birmingham, Alabama, USA
| | - Marina Aweeda
- Department of Otolaryngology-Head & Neck Surgery, Vanderbilt University Medical Center, Nashville, Tennessee, USA
| | - Sumit Pruthi
- Department of Radiology, Vanderbilt University Medical Center, Nashville, Tennessee, USA
| | - Joseph C Fusco
- Department of Pediatric Surgery, Vanderbilt University Medical Center, Nashville, Tennessee, USA
| | - Bruce Daniel
- Department of Radiology, Stanford Health Care, Palo Alto, California, USA
| | - Michael Miga
- Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, USA
| | - Jie Ying Wu
- Department of Computer Science, Vanderbilt University, Nashville, Tennessee, USA
| | - Michael C Topf
- Department of Otolaryngology-Head & Neck Surgery, Vanderbilt University Medical Center, Nashville, Tennessee, USA
| |
Collapse
|
3
|
Liu S, Yang J, Jin H, Liang A, Zhang Q, Xing J, Liu Y, Li S. Exploration of the application of augmented reality technology for teaching spinal tumor's anatomy and surgical techniques. Front Med (Lausanne) 2024; 11:1403423. [PMID: 39050543 PMCID: PMC11266009 DOI: 10.3389/fmed.2024.1403423] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2024] [Accepted: 06/19/2024] [Indexed: 07/27/2024] Open
Abstract
Background Augmented reality (AR) technology is gradually being applied in surgical teaching as an innovative teaching method. Developing innovative teaching methods to replicate clinical theory and practical teaching scenarios, simulate preoperative planning and training for bone tumor surgery, and offer enhanced training opportunities for young physicians to acquire and apply clinical knowledge is a crucial concern that impacts the advancement of the discipline and the educational standards for young orthopedic physicians. Objective This study explores the application effect of augmented reality technology in anatomy teaching and surgical clinical teaching for spinal tumor. Methods The method utilizes virtual reality and augmented reality technology to present a spinal tumor model and the surgical process of percutaneous vertebroplasty. We conducted a random selection of 12 students forming into the augmented reality teaching group and 13 students forming into the traditional teaching group among the 8-year medical students from Peking Union Medical College and Tsinghua University, ensuring that the age and learning stage of the students in both groups were similar. Two groups of students were taught using traditional teaching methods and augmented reality technology-assisted teaching methods, respectively. A questionnaire survey was conducted after class to assess the quality of course instruction, student motivation in learning, their proficiency in anatomical structures, their comprehension of spinal tumor growth and metastasis, and their understanding and proficiency in percutaneous vertebroplasty. Results This study was the first to apply augmented reality technology in teaching, using spinal tumors and percutaneous vertebroplasty as examples, a head-mounted augmented reality device was used to create learning scenarios, presenting the complex three-dimensional spatial structure intuitively. The two groups of students differ significantly in their rating of teaching quality, enthusiasm for learning, knowledge of anatomical features, understanding of spinal trabecular structure, and understanding of steps in percutaneous vertebroplasty. The augmented reality technology-assisted teaching system demonstrates outstanding advantages. Conclusion Augmented reality technology has great potential and broad prospects in teaching bone tumors, which can help improve the visualization, interactivity, and three-dimensional spatial sense of medical teaching in spinal tumor. The application and development prospects of using augmented reality technology for anatomy instruction, surgical teaching, and simulation training are extensive.
Collapse
Affiliation(s)
- Shuzhong Liu
- Department of Orthopedic Surgery, Peking Union Medical College Hospital, Peking Union Medical College and Chinese Academy of Medical Sciences, Beijing, China
| | - Jianxin Yang
- Fundamental Industry Training Center, Tsinghua University, Beijing, China
| | - Hui Jin
- Fundamental Industry Training Center, Tsinghua University, Beijing, China
| | - Annan Liang
- Department of Orthopedic Surgery, Peking Union Medical College Hospital, Peking Union Medical College and Chinese Academy of Medical Sciences, Beijing, China
| | - Qi Zhang
- Fundamental Industry Training Center, Tsinghua University, Beijing, China
| | - Jinyi Xing
- Department of Orthopedic Surgery, Peking Union Medical College Hospital, Peking Union Medical College and Chinese Academy of Medical Sciences, Beijing, China
| | - Yong Liu
- Department of Orthopedic Surgery, Peking Union Medical College Hospital, Peking Union Medical College and Chinese Academy of Medical Sciences, Beijing, China
| | - Shuangshou Li
- Fundamental Industry Training Center, Tsinghua University, Beijing, China
| |
Collapse
|
4
|
Ivanov VM, Krivtsov AM, Smirnov AY, Grebenkov VG, Surov DA, Korzhuk MS, Strelkov SV, Ivanova EG. Experience in the Application of Augmented Reality Technology in the Surgical Treatment of Patients Suffering Primary and Recurrent Pelvic Tumors. J Pers Med 2023; 14:19. [PMID: 38248720 PMCID: PMC10821072 DOI: 10.3390/jpm14010019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2023] [Revised: 12/11/2023] [Accepted: 12/14/2023] [Indexed: 01/23/2024] Open
Abstract
Surgical treatment of locally spread tumors in pelvic organs remains an urgent and complicated oncological problem. The recurrence rate after radical treatment ranges from 15.1% to 45.2%. The key to successful and safe surgical intervention lies in meticulous planning and intraoperative navigation, including the utilization of augmented reality (AR) technology. This paper presents the experience of clinically testing an AR technology application algorithm in the surgical treatment of 11 patients. The main stages of the algorithm are described. Radical operations incorporating intraoperative AR technology with favorable outcomes were performed on eight patients. One patient underwent a palliative intervention, while two patients did not undergo surgery. The testing of the algorithm for the application of AR technology in the surgical treatment of primary and recurrent pelvic tumors demonstrated both a technical possibility and reproducibility of this algorithm and the AR technology itself in clinical practice.
Collapse
Affiliation(s)
- Vladimir M. Ivanov
- Higher School of Theoretical Mechanics, Peter the Great St. Petersburg Polytechnic University, 195251 Saint Petersburg, Russia; (A.M.K.); (A.Y.S.); (E.G.I.)
| | - Anton M. Krivtsov
- Higher School of Theoretical Mechanics, Peter the Great St. Petersburg Polytechnic University, 195251 Saint Petersburg, Russia; (A.M.K.); (A.Y.S.); (E.G.I.)
| | - Anton Yu. Smirnov
- Higher School of Theoretical Mechanics, Peter the Great St. Petersburg Polytechnic University, 195251 Saint Petersburg, Russia; (A.M.K.); (A.Y.S.); (E.G.I.)
| | - Vladimir G. Grebenkov
- Naval Surgery Chair, S. M. Kirov Military Medical Academy, 194044 Saint Petersburg, Russia; (V.G.G.); (D.A.S.); (M.S.K.)
| | - Dmitry A. Surov
- Naval Surgery Chair, S. M. Kirov Military Medical Academy, 194044 Saint Petersburg, Russia; (V.G.G.); (D.A.S.); (M.S.K.)
- Coloproctology Department, Saint-Petersburg I. I. Dzhanelidze Research Institute of Emergency Medicine, 192242 Saint Petersburg, Russia
| | - Michail S. Korzhuk
- Naval Surgery Chair, S. M. Kirov Military Medical Academy, 194044 Saint Petersburg, Russia; (V.G.G.); (D.A.S.); (M.S.K.)
- N.N. Petrov National Medical Research Center of Oncology, 197758 Saint Petersburg, Russia
| | - Sergey V. Strelkov
- Flinders Street Campus, Torrens University, Melbourne, VIC 3000, Australia;
| | - Elena G. Ivanova
- Higher School of Theoretical Mechanics, Peter the Great St. Petersburg Polytechnic University, 195251 Saint Petersburg, Russia; (A.M.K.); (A.Y.S.); (E.G.I.)
| |
Collapse
|
5
|
Kim S, Jung T, Sohn DK, Chae Y, Kim YA, Kang SH, Park Y, Chang YJ. The Multidomain Metaverse Cancer Care Digital Platform: Development and Usability Study. JMIR Serious Games 2023; 11:e46242. [PMID: 38032697 PMCID: PMC10722376 DOI: 10.2196/46242] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Revised: 04/17/2023] [Accepted: 10/24/2023] [Indexed: 12/01/2023] Open
Abstract
BACKGROUND As cancer treatment methods have diversified and the importance of self-management, which lowers the dependence rate on direct hospital visits, has increased, effective cancer care education and management for health professionals and patients have become necessary. The metaverse is in the spotlight as a means of digital health that allows users to engage in cancer care education and management beyond physical constraints. However, it is difficult to find a multipurpose medical metaverse that can not only be used in the field but also complements current cancer care. OBJECTIVE This study aimed to develop an integrated metaverse cancer care platform, Dr. Meta, and examine its usability. METHODS We conducted a multicenter, cross-sectional survey between November and December 2021. A descriptive analysis was performed to examine users' experiences with Dr. Meta. In addition, a supplementary open-ended question was used to ask users for their suggestions and improvements regarding the platform. RESULTS Responses from 70 Korean participants (male: n=19, 27% and female: n=51, 73%) were analyzed. More than half (n=37, 54%) of the participants were satisfied with Dr. Meta; they responded that it was an interesting and immersive platform (n=50, 72%). Less than half perceived no discomfort when using Dr. Meta (n=34, 49%) and no difficulty in wearing and operating the device (n=30, 43%). Furthermore, more than half (n=50, 72%) of the participants reported that Dr. Meta would help provide non-face-to-face and noncontact services. More than half also wanted to continue using this platform in the future (n=41, 59%) and recommended it to others (n=42, 60%). CONCLUSIONS We developed a multidomain metaverse cancer care platform that can support both health professionals and patients in non-face-to-face cancer care. The platform was uniquely disseminated and implemented in multiple regional hospitals and showed the potential to perform successful cancer care.
Collapse
Affiliation(s)
- Sunghak Kim
- Division of Cancer Control and Policy, National Cancer Center, Goyang, Republic of Korea
| | - Timothy Jung
- Faculty of Business and Law, Manchester Metropolitan University, Manchester, United Kingdom
| | - Dae Kyung Sohn
- Center for Colorectal Cancer, National Cancer Center, Goyang, Republic of Korea
| | - Yoon Chae
- Division of Cancer Control and Policy, National Cancer Center, Goyang, Republic of Korea
| | - Young Ae Kim
- National Cancer Survivorship Center, National Cancer Center, Goyang, Republic of Korea
| | - Seung Hyun Kang
- Planning Division, Korea Smart Healthcare Association, Seoul, Republic of Korea
| | - Yujin Park
- Division of Cancer Control and Policy, National Cancer Center, Goyang, Republic of Korea
| | - Yoon Jung Chang
- Division of Cancer Control and Policy, National Cancer Center, Goyang, Republic of Korea
| |
Collapse
|
6
|
Bakır ÇN, Abbas SO, Sever E, Özcan Morey A, Aslan Genç H, Mutluer T. Use of augmented reality in mental health-related conditions: A systematic review. Digit Health 2023; 9:20552076231203649. [PMID: 37791140 PMCID: PMC10542245 DOI: 10.1177/20552076231203649] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2023] [Accepted: 09/08/2023] [Indexed: 10/05/2023] Open
Abstract
Objective Augmented reality (AR) is a relatively new technology that merges virtual and physical environments, augmenting one's perception of reality. AR creates a computer-generated environment that evokes a unique perception of reality, where real and virtual objects are registered with one another, which operates interactively and in real time. Recently, the medical application of AR technology has dramatically increased with other assisted technologies, from training to clinical practice. The ability to manipulate the real environment extensively has given AR interventions an advantage over traditional approaches. In this study, we aim to conduct a systematic review of the use of AR to have a better understanding of how the use of AR may affect patients with mental health-related conditions when combined with gamification. Method This systematic review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines by searching Pubmed and Web of Science databases. Results and Conclusion We identified 48 relevant studies that fulfill the criteria. The studies were grouped into four categories: Neurodevelopmental disorders, anxiety and phobia, psychoeducation & well-being, and procedural & pain management. Our results revealed the effectiveness of AR in mental health-related conditions. However, the heterogeneity and small sample sizes demonstrate the need for further research with larger sample sizes and high-quality study designs.
Collapse
Affiliation(s)
| | | | - Egemen Sever
- School of Medicine, Koç University, Istanbul, Turkey
| | | | - Herdem Aslan Genç
- Department of Psychiatry, Koç University School of Medicine, Istanbul, Turkey
| | - Tuba Mutluer
- Department of Psychiatry, Koç University School of Medicine, Istanbul, Turkey
| |
Collapse
|