1
|
Alkadri S, Del Maestro RF, Driscoll M. Unveiling surgical expertise through machine learning in a novel VR/AR spinal simulator: A multilayered approach using transfer learning and connection weights analysis. Comput Biol Med 2024; 179:108809. [PMID: 38944904 DOI: 10.1016/j.compbiomed.2024.108809] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2024] [Revised: 06/10/2024] [Accepted: 06/24/2024] [Indexed: 07/02/2024]
Abstract
BACKGROUND Virtual and augmented reality surgical simulators, integrated with machine learning, are becoming essential for training psychomotor skills, and analyzing surgical performance. Despite the promise of methods like the Connection Weights Algorithm, the small sample sizes (small number of participants (N)) typical of these trials challenge the generalizability and robustness of models. Approaches like data augmentation and transfer learning from models trained on similar surgical tasks address these limitations. OBJECTIVE To demonstrate the efficacy of artificial neural network and transfer learning algorithms in evaluating virtual surgical performances, applied to a simulated oblique lateral lumbar interbody fusion technique in an augmented and virtual reality simulator. DESIGN The study developed and integrated artificial neural network algorithms within a novel simulator platform, using data from the simulated tasks to generate 276 performance metrics across motion, safety, and efficiency. Innovatively, it applies transfer learning from a pre-trained ANN model developed for a similar spinal simulator, enhancing the training process, and addressing the challenge of small datasets. SETTING Musculoskeletal Biomechanics Research Lab; Neurosurgical Simulation and Artificial Intelligence Learning Centre, McGill University, Montreal, Canada. PARTICIPANTS Twenty-seven participants divided into 3 groups: 9 post-residents, 6 senior and 12 junior residents. RESULTS Two models, a stand-alone model trained from scratch and another leveraging transfer learning, were trained on nine selected surgical metrics achieving 75 % and 87.5 % testing accuracy respectively. CONCLUSIONS This study presents a novel blueprint for addressing limited datasets in surgical simulations through the strategic use of transfer learning and data augmentation. It also evaluates and reinforces the application of the Connection Weights Algorithm from our previous publication. Together, these methodologies not only enhance the precision of performance classification but also advance the validation of surgical training platforms.
Collapse
Affiliation(s)
- Sami Alkadri
- Musculoskeletal Biomechanics Research Lab, Department of Mechanical Engineering, McGill University, Macdonald Engineering Building, 815 Sherbrooke St W, Montreal, H3A 2K7, QC, Canada; Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 2200 Leo Pariseau, Suite, 2210, Montreal, H2X 4B3, Quebec, Canada
| | - Rolando F Del Maestro
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 2200 Leo Pariseau, Suite, 2210, Montreal, H2X 4B3, Quebec, Canada
| | - Mark Driscoll
- Musculoskeletal Biomechanics Research Lab, Department of Mechanical Engineering, McGill University, Macdonald Engineering Building, 815 Sherbrooke St W, Montreal, H3A 2K7, QC, Canada; Orthopaedic Research Lab, Montreal General Hospital, 1650 Cedar Ave (LS1.409), Montreal, H3G 1A4, Quebec, Canada.
| |
Collapse
|
2
|
Xu W, Rong Z, Ma W, Zhu B, Li N, Huang J, Liu Z, Yu Y, Zhang F, Zhang X, Ge M, Hou Y. Improving the classification of multiple sclerosis and cerebral small vessel disease with interpretable transfer attention neural network. Comput Biol Med 2024; 176:108530. [PMID: 38749324 DOI: 10.1016/j.compbiomed.2024.108530] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2024] [Revised: 04/14/2024] [Accepted: 04/28/2024] [Indexed: 05/31/2024]
Abstract
As an autoimmune-mediated inflammatory demyelinating disease of the central nervous system, multiple sclerosis (MS) is often confused with cerebral small vessel disease (cSVD), which is a regional pathological change in brain tissue with unknown pathogenesis. This is due to their similar clinical presentations and imaging manifestations. That misdiagnosis can significantly increase the occurrence of adverse events. Delayed or incorrect treatment is one of the most important causes of MS progression. Therefore, the development of a practical diagnostic imaging aid could significantly reduce the risk of misdiagnosis and improve patient prognosis. We propose an interpretable deep learning (DL) model that differentiates MS and cSVD using T2-weighted fluid-attenuated inversion recovery (FLAIR) images. Transfer learning (TL) was utilized to extract features from the ImageNet dataset. This pioneering model marks the first of its kind in neuroimaging, showing great potential in enhancing differential diagnostic capabilities within the field of neurological disorders. Our model extracts the texture features of the images and achieves more robust feature learning through two attention modules. The attention maps provided by the attention modules provide model interpretation to validate model learning and reveal more information to physicians. Finally, the proposed model is trained end-to-end using focal loss to reduce the influence of class imbalance. The model was validated using clinically diagnosed MS (n=112) and cSVD (n=321) patients from the Beijing Tiantan Hospital. The performance of the proposed model was better than that of two commonly used DL approaches, with a mean balanced accuracy of 86.06 % and a mean area under the receiver operating characteristic curve of 98.78 %. Moreover, the generated attention heat maps showed that the proposed model could focus on the lesion signatures in the image. The proposed model provides a practical diagnostic imaging aid for the use of routinely available imaging techniques such as magnetic resonance imaging to classify MS and cSVD by linking DL to human brain disease. We anticipate a substantial improvement in accurately distinguishing between various neurological conditions through this novel model.
Collapse
Affiliation(s)
- Wangshu Xu
- Department of Neurology, Beijing Tiantan Hospital, Capital Medical University, Beijing, 100070, China; China National Clinical Research Center for Neurological Diseases, Beijing, 100070, China
| | - Zhiwei Rong
- Department of Biostatistics, School of Public Health, Peking University, Beijing, 100191, China
| | - Wenping Ma
- Department of Neurosurgery, Beijing Children's Hospital, Capital Medical University, National Center for Children's Health, Beijing, 100045, China
| | - Bin Zhu
- Department of Pharmacy, Beijing Tiantan Hospital, Capital Medical University, Beijing, 100070, China
| | - Na Li
- Department of Neurology, Beijing Tiantan Hospital, Capital Medical University, Beijing, 100070, China
| | - Jiansong Huang
- Peking University Health Science Center, Beijing, 100191, China
| | - Zhilin Liu
- Department of Biostatistics, School of Public Health, Peking University, Beijing, 100191, China
| | - Yipei Yu
- Department of Biostatistics, School of Public Health, Peking University, Beijing, 100191, China
| | - Fa Zhang
- The School of Medical Technology, Beijing Institute of Technology, Beijing, 100081, China.
| | - Xinghu Zhang
- Department of Neurology, Beijing Tiantan Hospital, Capital Medical University, Beijing, 100070, China; China National Clinical Research Center for Neurological Diseases, Beijing, 100070, China.
| | - Ming Ge
- Department of Neurosurgery, Beijing Children's Hospital, Capital Medical University, National Center for Children's Health, Beijing, 100045, China.
| | - Yan Hou
- Department of Biostatistics, School of Public Health, Peking University, Beijing, 100191, China; Peking University Clinical Research Center, Beijing, 100191, China.
| |
Collapse
|
3
|
Jung Y, Muddaluru V, Gandhi P, Pahuta M, Guha D. The Development And Applications Of Augmented And Virtual Reality Technology In Spine Surgery Training: A Systematic Review. Can J Neurol Sci 2024; 51:255-264. [PMID: 37113079 DOI: 10.1017/cjn.2023.46] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/29/2023]
Abstract
BACKGROUND The COVID-19 pandemic has accelerated the growing global interest in the role of augmented and virtual reality in surgical training. While this technology grows at a rapid rate, its efficacy remains unclear. To that end, we offer a systematic review of the literature summarizing the role of virtual and augmented reality on spine surgery training. METHODS A systematic review of the literature was conducted on May 13th, 2022. PubMed, Web of Science, Medline, and Embase were reviewed for relevant studies. Studies from both orthopedic and neurosurgical spine programs were considered. There were no restrictions placed on the type of study, virtual/augmented reality modality, nor type of procedure. Qualitative data analysis was performed, and all studies were assigned a Medical Education Research Study Quality Instrument (MERSQI) score. RESULTS The initial review identified 6752 studies, of which 16 were deemed relevant and included in the final review, examining a total of nine unique augmented/virtual reality systems. These studies had a moderate methodological quality with a MERSQI score of 12.1 + 1.8; most studies were conducted at single-center institutions, and unclear response rates. Statistical pooling of the data was limited by the heterogeneity of the study designs. CONCLUSION This review examined the applications of augmented and virtual reality systems for training residents in various spine procedures. As this technology continues to advance, higher-quality, multi-center, and long-term studies are required to further the adaptation of VR/AR technologies in spine surgery training programs.
Collapse
Affiliation(s)
- Youngkyung Jung
- Department of Medicine, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada
| | | | - Pranjan Gandhi
- Department of Medicine, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada
| | - Markian Pahuta
- Division of Orthopedic Surgery, Hamilton General Hospital, McMaster University, Hamilton, ON, Canada
| | - Daipayan Guha
- Division of Neurosurgery, Hamilton General Hospital, McMaster University, Hamilton, ON, Canada
| |
Collapse
|
4
|
Yilmaz R, Fazlollahi AM, Winkler-Schwartz A, Wang A, Makhani HH, Alsayegh A, Bakhaidar M, Tran DH, Santaguida C, Del Maestro RF. Effect of Feedback Modality on Simulated Surgical Skills Learning Using Automated Educational Systems- A Four-Arm Randomized Control Trial. JOURNAL OF SURGICAL EDUCATION 2024; 81:275-287. [PMID: 38160107 DOI: 10.1016/j.jsurg.2023.11.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/03/2023] [Revised: 09/05/2023] [Accepted: 11/01/2023] [Indexed: 01/03/2024]
Abstract
OBJECTIVE To explore optimal feedback methodologies to enhance trainee skill acquisition in simulated surgical bimanual skills learning during brain tumor resections. HYPOTHESES (1) Providing feedback results in better learning outcomes in teaching surgical technical skill when compared to practice alone with no tailored performance feedback. (2) Providing more visual and visuospatial feedback results in better learning outcomes when compared to providing numerical feedback. DESIGN A prospective 4-parallel-arm randomized controlled trial. SETTING Neurosurgical Simulation and Artificial Intelligence Learning Centre, McGill University, Canada. PARTICIPANTS Medical students (n = 120) from 4 Quebec medical schools. RESULTS Participants completed a virtually simulated tumor resection task 5 times while receiving 1 of 4 feedback based on their group allocation: (1) practice-alone without feedback, (2) numerical feedback, (3) visual feedback, and (4) visuospatial feedback. Outcome measures were participants' scores on 14-performance metrics and the number of expert benchmarks achieved during each task. There were no significant differences in the first task which determined baseline performance. A statistically significant interaction between feedback allocation and task repetition was found on the number of benchmarks achieved, F (10.558, 408.257)=3.220, p < 0.001. Participants in all feedback groups significantly improved their performance compared to baseline. The visual feedback group achieved significantly higher number of benchmarks than the practice-alone group by the third repetition of the task, p = 0.005, 95%CI [0.42 3.25]. Visual feedback and visuospatial feedback improved performance significantly by the second repetition of the task, p = 0.016, 95%CI [0.19 2.71] and p = 0.003, 95%CI [0.4 2.57], respectively. CONCLUSION Simulations with autonomous visual computer assistance may be effective pedagogical tools in teaching bimanual operative skills via visual and visuospatial feedback information delivery.
Collapse
Affiliation(s)
- Recai Yilmaz
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada; Faculty of Medicine and Health Sciences, McGill University, Montreal, Canada.
| | - Ali M Fazlollahi
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada; Faculty of Medicine and Health Sciences, McGill University, Montreal, Canada
| | - Alexander Winkler-Schwartz
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada; Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
| | - Anna Wang
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
| | - Hafila Hassan Makhani
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
| | - Ahmad Alsayegh
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada; Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada; Division of Neurosurgery, Department of Surgery, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Mohamad Bakhaidar
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada; Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada; Division of Neurosurgery, Department of Surgery, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Dan Huy Tran
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
| | - Carlo Santaguida
- Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
| | - Rolando F Del Maestro
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada; Faculty of Medicine and Health Sciences, McGill University, Montreal, Canada; Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
| |
Collapse
|
5
|
Lo CM, Jiang JK, Lin CC. Detecting microsatellite instability in colorectal cancer using Transformer-based colonoscopy image classification and retrieval. PLoS One 2024; 19:e0292277. [PMID: 38271352 PMCID: PMC10810505 DOI: 10.1371/journal.pone.0292277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2023] [Accepted: 09/15/2023] [Indexed: 01/27/2024] Open
Abstract
Colorectal cancer (CRC) is a major global health concern, with microsatellite instability-high (MSI-H) being a defining characteristic of hereditary nonpolyposis colorectal cancer syndrome and affecting 15% of sporadic CRCs. Tumors with MSI-H have unique features and better prognosis compared to MSI-L and microsatellite stable (MSS) tumors. This study proposed establishing a MSI prediction model using more available and low-cost colonoscopy images instead of histopathology. The experiment utilized a database of 427 MSI-H and 1590 MSS colonoscopy images and vision Transformer (ViT) with different feature training approaches to establish the MSI prediction model. The accuracy of combining pre-trained ViT features was 84% with an area under the receiver operating characteristic curve of 0.86, which was better than that of DenseNet201 (80%, 0.80) in the experiment with support vector machine. The content-based image retrieval (CBIR) approach showed that ViT features can obtain a mean average precision of 0.81 compared to 0.79 of DenseNet201. ViT reduced the issues that occur in convolutional neural networks, including limited receptive field and gradient disappearance, and may be better at interpreting diagnostic information around tumors and surrounding tissues. By using CBIR, the presentation of similar images with the same MSI status would provide more convincing deep learning suggestions for clinical use.
Collapse
Affiliation(s)
- Chung-Ming Lo
- Graduate Institute of Library, Information and Archival Studies, National Chengchi University, Taipei, Taiwan
| | - Jeng-Kai Jiang
- Department of Surgery, Division of Colon and Rectal Surgery, Taipei Veterans General Hospital, Taipei, Taiwan
- Department of Surgery, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Chun-Chi Lin
- Department of Surgery, Division of Colon and Rectal Surgery, Taipei Veterans General Hospital, Taipei, Taiwan
- Department of Surgery, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| |
Collapse
|
6
|
Bakhaidar M, Alsayegh A, Yilmaz R, Fazlollahi AM, Ledwos N, Mirchi N, Winkler-Schwartz A, Luo L, Del Maestro RF. Performance in a Simulated Virtual Reality Anterior Cervical Discectomy and Fusion Task: Disc Residual, Rate of Removal, and Efficiency Analyses. Oper Neurosurg (Hagerstown) 2023; 25:e196-e205. [PMID: 37441799 DOI: 10.1227/ons.0000000000000813] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2023] [Accepted: 05/05/2023] [Indexed: 07/15/2023] Open
Abstract
BACKGROUND AND OBJECTIVES Anterior cervical discectomy and fusion (ACDF) is among the most common spine procedures. The Sim-Ortho virtual reality simulator platform contains a validated ACDF simulated task for performance assessment. This study aims to develop a methodology to extract three-dimensional data and reconstruct and quantitate specific simulated disc tissues to generate novel metrics to analyze performance metrics of skilled and less skilled participants. METHODS We used open-source platforms to develop a methodology to extract three-dimensional information from ACDF simulation data. Metrics generated included, efficiency index, disc volumes removed from defined regions, and rate of tissue removal from superficial, central, and deep disc regions. A pilot study was performed to assess the utility of this methodology to assess expertise during the ACDF simulated procedure. RESULTS The system outlined, extracts data allowing the development of a methodology which accurately reconstructs and quantitates 3-dimensional disc volumes. In the pilot study, data sets from 27 participants, divided into postresident, resident, and medical student groups, allowed assessment of multiple novel metrics, including efficiency index (surgical time spent in actively removing disc), where the postresident group spent 61.8% of their time compared with 53% and 30.2% for the resident and medical student groups, respectively ( P = .01). During the annulotomy component, the postresident group removed 47.4% more disc than the resident groups and 102% more than the medical student groups ( P = .03). CONCLUSION The methodology developed in this study generates novel surgical procedural metrics from 3-dimensional data generated by virtual reality simulators and can be used to assess surgical performance.
Collapse
Affiliation(s)
- Mohamad Bakhaidar
- Department of Neurology and Neurosurgery, Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
- Department of Neurology and Neurosurgery, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
- Division of Neurosurgery, Department of Surgery, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Ahmad Alsayegh
- Department of Neurology and Neurosurgery, Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
- Department of Neurology and Neurosurgery, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
- Division of Neurosurgery, Department of Surgery, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Recai Yilmaz
- Department of Neurology and Neurosurgery, Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
| | - Ali M Fazlollahi
- Department of Neurology and Neurosurgery, Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
| | - Nicole Ledwos
- Department of Neurology and Neurosurgery, Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
| | - Nykan Mirchi
- Department of Neurology and Neurosurgery, Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
| | - Alexander Winkler-Schwartz
- Department of Neurology and Neurosurgery, Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
- Department of Neurology and Neurosurgery, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
| | - Lucy Luo
- Department of Neurology and Neurosurgery, Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
- Department of Orthopedic Surgery, McGill University Health Centre, Montreal, Quebec, Canada
| | - Rolando F Del Maestro
- Department of Neurology and Neurosurgery, Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
- Department of Neurology and Neurosurgery, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
| |
Collapse
|
7
|
Fazlollahi AM, Yilmaz R, Winkler-Schwartz A, Mirchi N, Ledwos N, Bakhaidar M, Alsayegh A, Del Maestro RF. AI in Surgical Curriculum Design and Unintended Outcomes for Technical Competencies in Simulation Training. JAMA Netw Open 2023; 6:e2334658. [PMID: 37725373 PMCID: PMC10509729 DOI: 10.1001/jamanetworkopen.2023.34658] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Accepted: 08/06/2023] [Indexed: 09/21/2023] Open
Abstract
Importance To better elucidate the role of artificial intelligence (AI) in surgical skills training requires investigations in the potential existence of a hidden curriculum. Objective To assess the pedagogical value of AI-selected technical competencies and their extended effects in surgical simulation training. Design, Setting, and Participants This cohort study was a follow-up of a randomized clinical trial conducted at the Neurosurgical Simulation and Artificial Intelligence Learning Centre at the Montreal Neurological Institute, McGill University, Montreal, Canada. Surgical performance metrics of medical students exposed to an AI-enhanced training curriculum were compared with a control group of participants who received no feedback and with expert benchmarks. Cross-sectional data were collected from January to April 2021 from medical students and from March 2015 to May 2016 from experts. This follow-up secondary analysis was conducted from June to September 2022. Participants included medical students (undergraduate year 0-2) in the intervention cohorts and neurosurgeons to establish expertise benchmarks. Exposure Performance assessment and personalized feedback by an intelligent tutor on 4 AI-selected learning objectives during simulation training. Main Outcomes and Measures Outcomes of interest were unintended performance outcomes, measured by significant within-participant difference from baseline in 270 performance metrics in the intervention cohort that was not observed in the control cohort. Results A total of 46 medical students (median [range] age, 22 [18-27] years; 27 [59%] women) and 14 surgeons (median [range] age, 45 [35-59] years; 14 [100%] men) were included in this study, and no participant was lost to follow-up. Feedback on 4 AI-selected technical competencies was associated with additional performance change in 32 metrics over the entire procedure and 20 metrics during tumor removal that was not observed in the control group. Participants exposed to the AI-enhanced curriculum demonstrated significant improvement in safety metrics, such as reducing the rate of healthy tissue removal (mean difference, -7.05 × 10-5 [95% CI, -1.09 × 10-4 to -3.14 × 10-5] mm3 per 20 ms; P < .001) and maintaining a focused bimanual control of the operative field (mean difference in maximum instrument divergence, -4.99 [95% CI, -8.48 to -1.49] mm, P = .006) compared with the control group. However, negative unintended effects were also observed. These included a significantly lower velocity and acceleration in the dominant hand (velocity: mean difference, -0.13 [95% CI, -0.17 to -0.09] mm per 20 ms; P < .001; acceleration: mean difference, -2.25 × 10-2 [95% CI, -3.20 × 10-2 to -1.31 × 10-2] mm per 20 ms2; P < .001) and a significant reduction in the rate of tumor removal (mean difference, -4.85 × 10-5 [95% CI, -7.22 × 10-5 to -2.48 × 10-5] mm3 per 20 ms; P < .001) compared with control. These unintended outcomes diverged students' movement and efficiency performance metrics away from the expertise benchmarks. Conclusions and Relevance In this cohort study of medical students, an AI-enhanced curriculum for bimanual surgical skills resulted in unintended changes that improved performance in safety but negatively affected some efficiency metrics. Incorporating AI in course design requires ongoing assessment to maintain transparency and foster evidence-based learning objectives.
Collapse
Affiliation(s)
- Ali M. Fazlollahi
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
- Faculty of Medicine and Health Sciences, McGill University, Montreal, Quebec, Canada
| | - Recai Yilmaz
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
- Faculty of Medicine and Health Sciences, McGill University, Montreal, Quebec, Canada
| | - Alexander Winkler-Schwartz
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
| | - Nykan Mirchi
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
| | - Nicole Ledwos
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
| | - Mohamad Bakhaidar
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
- Division of Neurosurgery, Department of Surgery, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Ahmad Alsayegh
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
- Division of Neurosurgery, Department of Surgery, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Rolando F. Del Maestro
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
- Faculty of Medicine and Health Sciences, McGill University, Montreal, Quebec, Canada
| |
Collapse
|
8
|
Chorney HV, Forbes JR, Driscoll M. System identification and simulation of soft tissue force feedback in a spine surgical simulator. Comput Biol Med 2023; 164:107267. [PMID: 37536093 DOI: 10.1016/j.compbiomed.2023.107267] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Revised: 06/21/2023] [Accepted: 07/16/2023] [Indexed: 08/05/2023]
Abstract
Surgical simulators are being introduced as training modalities for surgeons. This paper aims to evaluate dynamic models used to convey force feedback from puncturing the soft tissue during a spine surgical simulation. The force feedback of the tissue is treated as a dynamic system. This is done by performing classical system identification across a bandwidth of frequencies on a tissue analogue and fitting that behaviour to dynamic viscoelastic models. The models that are tested are an inverted linear model, the Maxwell model, the Kelvin-Boltzmann (KB) model, and a higher-order blackbox (HO) model. Several error metrics such as percent variance accounted for (%VAF) are determined to measure solution accuracy. The force feedback models are programmed into a surgical simulator and tested with study participants who rated them based on how well the identified models match the behaviour of the rubber tissue analogue. The highest %VAF is 82.64% when the tissue is modelled as the HO model. Statistically significant differences (p < 0.05) are found between all model ratings from participants except between the HO model and the KB model. However, the HO model has the highest percentage (37.8%) of participants who rank its performance as the closest to the tissue analogue compared to the other force feedback models. The more accurately the dynamic behaviour resembles the tissue analogue, the higher the model was rated by study participants. This study highlights the importance of utilizing dynamic signals to generate dynamic models of soft tissue for spine surgical simulators.
Collapse
Affiliation(s)
- Harriet Violet Chorney
- The Musculoskeletal Biomechanics Research (MBR) Lab, Department of Mechanical Engineering, McGill University, Montreal, Quebec, Canada; Orthopaedic Research Laboratory (ORL), Research Institute MUHC, Montreal General Hospital, Montreal, Quebec, Canada; The Dynamics, Estimation, and Control in Aerospace and Robotics (DECAR) Group, Department of Mechanical Engineering, McGill University, Montreal, Quebec, Canada
| | - James Richard Forbes
- The Dynamics, Estimation, and Control in Aerospace and Robotics (DECAR) Group, Department of Mechanical Engineering, McGill University, Montreal, Quebec, Canada
| | - Mark Driscoll
- The Musculoskeletal Biomechanics Research (MBR) Lab, Department of Mechanical Engineering, McGill University, Montreal, Quebec, Canada; Orthopaedic Research Laboratory (ORL), Research Institute MUHC, Montreal General Hospital, Montreal, Quebec, Canada.
| |
Collapse
|
9
|
Wu Y, Mo Q, Xie Y, Zhang J, Jiang S, Guan J, Qu C, Wu R, Mo C. A retrospective study using machine learning to develop predictive model to identify urinary infection stones in vivo. Urolithiasis 2023; 51:84. [PMID: 37256418 PMCID: PMC10232574 DOI: 10.1007/s00240-023-01457-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Accepted: 05/21/2023] [Indexed: 06/01/2023]
Abstract
Preoperative diagnosis of urinary infection stones is difficult, and accurate detection of stone composition can only be performed ex vivo. To provide guidance for better perioperative management and postoperative prevention of infection stones, we developed a machine learning model for preoperative identification of infection stones in vivo. The clinical data of patients with urolithiasis who underwent surgery in our hospital from January 2011 to December 2015 and January 2017 to December 2021 were retrospectively analyzed. A total of 2565 patients were included in the study, and 1168 eligible patients with urinary calculi were randomly divided into training set (70%) and test set (30%). Five machine learning algorithms (Support Vector Machine (SVM), Multilayer Perceptron (MLP), Decision Tree (DT), Random Forest Classifier (RFC), and Adaptive Boost (AdaBoost)) and 14 preoperative variables were used to construct the prediction model. The performance measure was the area under the receiver operating characteristic curve (AUC) of the validation set. The importance of 14 features in each prediction model for predicting infection stones was analyzed. A total of 89 patients (5.34%) with infection stones were included in the validation set. All the five prediction models showed strong discrimination in the validation set (AUC: 0.689-0.772). AdaBoost model was selected as the final model (AUC: 0.772(95% confidence interval, 0.657-0.887); Sensitivity: 0.522; Specificity: 0.902), UC positivity, and urine pH value were two important predictors of infection stones. We developed a predictive model through machine learning that can quickly identify infection stones in vivo with good predictive performance. It can be used for risk assessment and decision support of infection stones, optimize the disease management of urinary calculi and improve the prognosis of patients.
Collapse
Affiliation(s)
- Yukun Wu
- Department of Urology, The First Affiliated Hospital of Sun Yat-sen University, No. 58, Zhongshan 2nd Road, Guangzhou, 510080, Guangdong, China
| | - Qishan Mo
- Department of Urology, Guangzhou Panyu Central Hospital, Guangzhou, 510080, Guangdong, China
| | - Yun Xie
- Department of Urology, The First Affiliated Hospital of Sun Yat-sen University, No. 58, Zhongshan 2nd Road, Guangzhou, 510080, Guangdong, China
| | - Junlong Zhang
- Department of Urology, The First Affiliated Hospital of Sun Yat-sen University, No. 58, Zhongshan 2nd Road, Guangzhou, 510080, Guangdong, China
| | - Shuangjian Jiang
- Department of Urology, The First Affiliated Hospital of Sun Yat-sen University, No. 58, Zhongshan 2nd Road, Guangzhou, 510080, Guangdong, China
| | - Jianfeng Guan
- Department of Urology, The First Affiliated Hospital of Sun Yat-sen University, No. 58, Zhongshan 2nd Road, Guangzhou, 510080, Guangdong, China
| | - Canhui Qu
- Department of Urology, The First Affiliated Hospital of Sun Yat-sen University, No. 58, Zhongshan 2nd Road, Guangzhou, 510080, Guangdong, China
| | - Rongpei Wu
- Department of Urology, The First Affiliated Hospital of Sun Yat-sen University, No. 58, Zhongshan 2nd Road, Guangzhou, 510080, Guangdong, China
| | - Chengqiang Mo
- Department of Urology, The First Affiliated Hospital of Sun Yat-sen University, No. 58, Zhongshan 2nd Road, Guangzhou, 510080, Guangdong, China.
| |
Collapse
|
10
|
Titov O, Bykanov A, Pitskhelauri D. Neurosurgical skills analysis by machine learning models: systematic review. Neurosurg Rev 2023; 46:121. [PMID: 37191734 DOI: 10.1007/s10143-023-02028-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2023] [Revised: 04/16/2023] [Accepted: 05/06/2023] [Indexed: 05/17/2023]
Abstract
Machine learning (ML) models are being actively used in modern medicine, including neurosurgery. This study aimed to summarize the current applications of ML in the analysis and assessment of neurosurgical skills. We conducted this systematic review in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. We searched the PubMed and Google Scholar databases for eligible studies published until November 15, 2022, and used the Medical Education Research Study Quality Instrument (MERSQI) to assess the quality of the included articles. Of the 261 studies identified, we included 17 in the final analysis. Studies were most commonly related to oncological, spinal, and vascular neurosurgery using microsurgical and endoscopic techniques. Machine learning-evaluated tasks included subpial brain tumor resection, anterior cervical discectomy and fusion, hemostasis of the lacerated internal carotid artery, brain vessel dissection and suturing, glove microsuturing, lumbar hemilaminectomy, and bone drilling. The data sources included files extracted from VR simulators and microscopic and endoscopic videos. The ML application was aimed at classifying participants into several expertise levels, analysis of differences between experts and novices, surgical instrument recognition, division of operation into phases, and prediction of blood loss. In two articles, ML models were compared with those of human experts. The machines outperformed humans in all tasks. The most popular algorithms used to classify surgeons by skill level were the support vector machine and k-nearest neighbors, and their accuracy exceeded 90%. The "you only look once" detector and RetinaNet usually solved the problem of detecting surgical instruments - their accuracy was approximately 70%. The experts differed by more confident contact with tissues, higher bimanuality, smaller distance between the instrument tips, and relaxed and focused state of the mind. The average MERSQI score was 13.9 (from 18). There is growing interest in the use of ML in neurosurgical training. Most studies have focused on the evaluation of microsurgical skills in oncological neurosurgery and on the use of virtual simulators; however, other subspecialties, skills, and simulators are being investigated. Machine learning models effectively solve different neurosurgical tasks related to skill classification, object detection, and outcome prediction. Properly trained ML models outperform human efficacy. Further research on ML application in neurosurgery is needed.
Collapse
Affiliation(s)
- Oleg Titov
- Burdenko Neurosurgery Center, Moscow, Russia.
- OPEN BRAIN, Laboratory of Neurosurgical Innovations, Moscow, Russia.
| | | | | |
Collapse
|
11
|
Lo CM, Yang YW, Lin JK, Lin TC, Chen WS, Yang SH, Chang SC, Wang HS, Lan YT, Lin HH, Huang SC, Cheng HH, Jiang JK, Lin CC. Modeling the survival of colorectal cancer patients based on colonoscopic features in a feature ensemble vision transformer. Comput Med Imaging Graph 2023; 107:102242. [PMID: 37172354 DOI: 10.1016/j.compmedimag.2023.102242] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Revised: 05/05/2023] [Accepted: 05/07/2023] [Indexed: 05/14/2023]
Abstract
The prognosis of patients with colorectal cancer (CRC) mostly relies on the classic tumor node metastasis (TNM) staging classification. A more accurate and convenient prediction model would provide a better prognosis and assist in treatment. From May 2014 to December 2017, patients who underwent an operation for CRC were enrolled. The proposed feature ensemble vision transformer (FEViT) used ensemble classifiers to benefit the combinations of relevant colonoscopy features from the pretrained vision transformer and clinical features, including sex, age, family history of CRC, and tumor location, to establish the prognostic model. A total of 1729 colonoscopy images were enrolled in the current retrospective study. For the prediction of patient survival, FEViT achieved an accuracy of 94 % with an area under the receiver operating characteristic curve of 0.93, which was better than the TNM staging classification (90 %, 0.83) in the experiment. FEViT reduced the limited receptive field and gradient disappearance in the conventional convolutional neural network and was a relatively effective and efficient procedure. The promising accuracy of FEViT in modeling survival makes the prognosis of CRC patients more predictable and practical.
Collapse
Affiliation(s)
- Chung-Ming Lo
- Graduate Institute of Library, Information and Archival Studies, National Chengchi University, Taipei, Taiwan
| | - Yi-Wen Yang
- Division of Colon and Rectal Surgery, Department of Surgery, Taipei Veterans General Hospital, Taipei, Taiwan; Department of Surgery, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Jen-Kou Lin
- Division of Colon and Rectal Surgery, Department of Surgery, Taipei Veterans General Hospital, Taipei, Taiwan; Department of Surgery, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Tzu-Chen Lin
- Division of Colon and Rectal Surgery, Department of Surgery, Taipei Veterans General Hospital, Taipei, Taiwan; Department of Surgery, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Wei-Shone Chen
- Division of Colon and Rectal Surgery, Department of Surgery, Taipei Veterans General Hospital, Taipei, Taiwan; Department of Surgery, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Shung-Haur Yang
- Division of Colon and Rectal Surgery, Department of Surgery, Taipei Veterans General Hospital, Taipei, Taiwan; Department of Surgery, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan; Department of Surgery, National Yang Ming Chiao Tung University Hospital, Yilan, Taiwan
| | - Shih-Ching Chang
- Division of Colon and Rectal Surgery, Department of Surgery, Taipei Veterans General Hospital, Taipei, Taiwan; Department of Surgery, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Huann-Sheng Wang
- Division of Colon and Rectal Surgery, Department of Surgery, Taipei Veterans General Hospital, Taipei, Taiwan; Department of Surgery, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Yuan-Tzu Lan
- Division of Colon and Rectal Surgery, Department of Surgery, Taipei Veterans General Hospital, Taipei, Taiwan; Department of Surgery, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Hung-Hsin Lin
- Division of Colon and Rectal Surgery, Department of Surgery, Taipei Veterans General Hospital, Taipei, Taiwan; Department of Surgery, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Sheng-Chieh Huang
- Division of Colon and Rectal Surgery, Department of Surgery, Taipei Veterans General Hospital, Taipei, Taiwan; Department of Surgery, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Hou-Hsuan Cheng
- Division of Colon and Rectal Surgery, Department of Surgery, Taipei Veterans General Hospital, Taipei, Taiwan; Department of Surgery, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Jeng-Kai Jiang
- Division of Colon and Rectal Surgery, Department of Surgery, Taipei Veterans General Hospital, Taipei, Taiwan; Department of Surgery, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Chun-Chi Lin
- Division of Colon and Rectal Surgery, Department of Surgery, Taipei Veterans General Hospital, Taipei, Taiwan; Department of Surgery, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan.
| |
Collapse
|
12
|
Gonzalez-Romo NI, Hanalioglu S, Mignucci-Jiménez G, Abramov I, Xu Y, Preul MC. Anatomic Depth Estimation and 3-Dimensional Reconstruction of Microsurgical Anatomy Using Monoscopic High-Definition Photogrammetry and Machine Learning. Oper Neurosurg (Hagerstown) 2023; 24:432-444. [PMID: 36701667 DOI: 10.1227/ons.0000000000000544] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2022] [Accepted: 09/17/2022] [Indexed: 01/27/2023] Open
Abstract
BACKGROUND Immersive anatomic environments offer an alternative when anatomic laboratory access is limited, but current three-dimensional (3D) renderings are not able to simulate the anatomic detail and surgical perspectives needed for microsurgical education. OBJECTIVE To perform a proof-of-concept study of a novel photogrammetry 3D reconstruction technique, converting high-definition (monoscopic) microsurgical images into a navigable, interactive, immersive anatomy simulation. METHODS Images were acquired from cadaveric dissections and from an open-access comprehensive online microsurgical anatomic image database. A pretrained neural network capable of depth estimation from a single image was used to create depth maps (pixelated images containing distance information that could be used for spatial reprojection and 3D rendering). Virtual reality (VR) experience was assessed using a VR headset, and augmented reality was assessed using a quick response code-based application and a tablet camera. RESULTS Significant correlation was found between processed image depth estimations and neuronavigation-defined coordinates at different levels of magnification. Immersive anatomic models were created from dissection images captured in the authors' laboratory and from images retrieved from the Rhoton Collection. Interactive visualization and magnification allowed multiple perspectives for an enhanced experience in VR. The quick response code offered a convenient method for importing anatomic models into the real world for rehearsal and for comparing other anatomic preparations side by side. CONCLUSION This proof-of-concept study validated the use of machine learning to render 3D reconstructions from 2-dimensional microsurgical images through depth estimation. This spatial information can be used to develop convenient, realistic, and immersive anatomy image models.
Collapse
Affiliation(s)
- Nicolas I Gonzalez-Romo
- Department of Neurosurgery, The Loyal and Edith Davis Neurosurgical Research Laboratory, Barrow Neurological Institute, St. Joseph's Hospital and Medical Center, Phoenix, AZ, USA
| | | | | | | | | | | |
Collapse
|
13
|
Gonzalez-Romo NI, Mignucci-Jiménez G, Hanalioglu S, Gurses ME, Bahadir S, Xu Y, Koskay G, Lawton MT, Preul MC. Virtual neurosurgery anatomy laboratory: A collaborative and remote education experience in the metaverse. Surg Neurol Int 2023; 14:90. [PMID: 37025523 PMCID: PMC10070459 DOI: 10.25259/sni_162_2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2023] [Accepted: 02/28/2023] [Indexed: 03/19/2023] Open
Abstract
Background:
Advances in computer sciences, including novel 3-dimensional rendering techniques, have enabled the creation of cloud-based virtual reality (VR) interfaces, making real-time peer-to-peer interaction possible even from remote locations. This study addresses the potential use of this technology for microsurgery anatomy education.
Methods:
Digital specimens were created using multiple photogrammetry techniques and imported into a virtual simulated neuroanatomy dissection laboratory. A VR educational program using a multiuser virtual anatomy laboratory experience was developed. Internal validation was performed by five multinational neurosurgery visiting scholars testing and assessing the digital VR models. For external validation, 20 neurosurgery residents tested and assessed the same models and virtual space.
Results:
Each participant responded to 14 statements assessing the virtual models, categorized under realism (n = 3), usefulness (n = 2), practicality (n = 3), enjoyment (n = 3), and recommendation (n = 3). Most responses expressed agreement or strong agreement with the assessment statements (internal validation, 94% [66/70] total responses; external validation, 91.4% [256/280] total responses). Notably, most participants strongly agreed that this system should be part of neurosurgery residency training and that virtual cadaver courses through this platform could be effective for education.
Conclusion:
Cloud-based VR interfaces are a novel resource for neurosurgery education. Interactive and remote collaboration between instructors and trainees is possible in virtual environments using volumetric models created with photogrammetry. We believe that this technology could be part of a hybrid anatomy curriculum for neurosurgery education. More studies are needed to assess the educational value of this type of innovative educational resource.
Collapse
Affiliation(s)
| | | | - Sahin Hanalioglu
- Department of Neurosurgery, Barrow Neurological Institute, Phoenix, Arizona, United States,
- Department of Neurosurgery, Hacettepe University, Ankara, Turkey
| | - Muhammet Enes Gurses
- Department of Neurosurgery, Barrow Neurological Institute, Phoenix, Arizona, United States,
- Department of Neurosurgery, Hacettepe University, Ankara, Turkey
| | - Siyar Bahadir
- Department of Neurosurgery, Hacettepe University, Ankara, Turkey
| | - Yuan Xu
- Department of Neurosurgery, Barrow Neurological Institute, Phoenix, Arizona, United States,
| | - Grant Koskay
- Department of Neurosurgery, Barrow Neurological Institute, Phoenix, Arizona, United States,
| | - Michael T. Lawton
- Department of Neurosurgery, Barrow Neurological Institute, Phoenix, Arizona, United States,
| | - Mark C. Preul
- Department of Neurosurgery, Barrow Neurological Institute, Phoenix, Arizona, United States,
| |
Collapse
|
14
|
Xu D, Chen R, Jiang Y, Wang S, Liu Z, Chen X, Fan X, Zhu J, Li J. Application of machine learning in the prediction of deficient mismatch repair in patients with colorectal cancer based on routine preoperative characterization. Front Oncol 2022; 12:1049305. [PMID: 36620593 PMCID: PMC9814116 DOI: 10.3389/fonc.2022.1049305] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2022] [Accepted: 12/07/2022] [Indexed: 12/24/2022] Open
Abstract
Simple summary Detecting deficient mismatch repair (dMMR) in patients with colorectal cancer is essential for clinical decision-making, including evaluation of prognosis, guidance of adjuvant chemotherapy and immunotherapy, and primary screening for Lynch syndrome. However, outside of tertiary care centers, existing detection methods are not widely disseminated and highly depend on the experienced pathologist. Therefore, it is of great clinical significance to develop a broadly accessible and low-cost tool for dMMR prediction, particularly prior to surgery. In this study, we developed a convenient and reliable model for predicting dMMR status in CRC patients on routine preoperative characterization utilizing multiple machine learning algorithms. This model will work as an automated screening tool for identifying patients suitable for mismatch repair testing and consequently for improving the detection rate of dMMR, while reducing unnecessary labor and cost in patients with proficient mismatch repair. Background Deficient mismatch repair (dMMR) indicates a sustained anti-tumor immune response and has a favorable prognosis in patients with colorectal cancer (CRC). Although all CRC patients are recommended to undergo dMMR testing after surgery, current diagnostic approaches are not available for all country hospitals and patients. Therefore, efficient and low-cost predictive models for dMMR, especially for preoperative evaluations, are warranted. Methods A large scale of 5596 CRC patients who underwent surgical resection and mismatch repair testing were enrolled and randomly divided into training and validation cohorts. The clinical features exploited for predicting dMMR comprised the demographic characteristics, preoperative laboratory data, and tumor burden information. Machine learning (ML) methods involving eight basic algorithms, ensemble learning methods, and fusion algorithms were adopted with 10-fold cross-validation, and their performance was evaluated based on the area under the receiver operating characteristic curve (AUC) and calibration curves. The clinical net benefits were assessed using a decision curve analysis (DCA), and a nomogram was developed to facilitate model clinical practicality. Results All models achieved an AUC of nearly 0.80 in the validation cohort, with the stacking model exhibiting the best performance (AUC = 0.832). Logistical DCA revealed that the stacking model yielded more clinical net benefits than the conventional regression models. In the subgroup analysis, the stacking model also predicted dMMR regardless of the clinical stage. The nomogram showed a favorable consistence with the actual outcome in the calibration curve. Conclusion With the aid of ML algorithms, we developed a novel and robust model for predicting dMMR in CRC patients with satisfactory discriminative performance and designed a user-friendly and convenient nomogram.
Collapse
Affiliation(s)
- Dong Xu
- Division of Digestive Surgery, Xijing Hospital of Digestive Diseases, Air force Medical University, Xi’an, China,School of Clinical Medicine, Xi’an Medical University, Xi’an, China
| | - Rujie Chen
- Division of Digestive Surgery, Xijing Hospital of Digestive Diseases, Air force Medical University, Xi’an, China,Department of Neurosurgery, Xijing Hospital, Air Force Medical University, Xi’an, China,State Key Laboratory of Cancer Biology, Institute of Digestive Diseases, Xijing Hospital, The Fourth Military Medical University, Xi’an, China
| | - Yu Jiang
- Division of Digestive Surgery, Xijing Hospital of Digestive Diseases, Air force Medical University, Xi’an, China,School of Clinical Medicine, Xi’an Medical University, Xi’an, China
| | - Shuai Wang
- Xi’an Institute of Flight of the Air Force, Ming Gang Station Hospital, Minggang, China
| | - Zhiyu Liu
- Division of Digestive Surgery, Xijing Hospital of Digestive Diseases, Air force Medical University, Xi’an, China,School of Clinical Medicine, Xi’an Medical University, Xi’an, China
| | - Xihao Chen
- Division of Digestive Surgery, Xijing Hospital of Digestive Diseases, Air force Medical University, Xi’an, China,School of Clinical Medicine, Xi’an Medical University, Xi’an, China
| | - Xiaoyan Fan
- Department of Experiment Surgery, Xijing Hospital, Fourth Military Medical University, Xi’an, China
| | - Jun Zhu
- Department of General Surgery, The Southern Theater Air Force Hospital, Guangzhou, China,*Correspondence: Jipeng Li, ; Jun Zhu,
| | - Jipeng Li
- Division of Digestive Surgery, Xijing Hospital of Digestive Diseases, Air force Medical University, Xi’an, China,State Key Laboratory of Cancer Biology, Institute of Digestive Diseases, Xijing Hospital, The Fourth Military Medical University, Xi’an, China,Department of Experiment Surgery, Xijing Hospital, Fourth Military Medical University, Xi’an, China,*Correspondence: Jipeng Li, ; Jun Zhu,
| |
Collapse
|
15
|
Ji L, Zhang W, Huang J, Tian J, Zhong X, Luo J, Zhu S, He Z, Tong Y, Meng X, Kang Y, Bi Q. Bone metastasis risk and prognosis assessment models for kidney cancer based on machine learning. Front Public Health 2022; 10:1015952. [PMID: 36466509 PMCID: PMC9714267 DOI: 10.3389/fpubh.2022.1015952] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2022] [Accepted: 11/02/2022] [Indexed: 11/19/2022] Open
Abstract
Background Bone metastasis is a common adverse event in kidney cancer, often resulting in poor survival. However, tools for predicting KCBM and assessing survival after KCBM have not performed well. Methods The study uses machine learning to build models for assessing kidney cancer bone metastasis risk, prognosis, and performance evaluation. We selected 71,414 kidney cancer patients from SEER database between 2010 and 2016. Additionally, 963 patients with kidney cancer from an independent medical center were chosen to validate the performance. In the next step, eight different machine learning methods were applied to develop KCBM diagnosis and prognosis models while the risk factors were identified from univariate and multivariate logistic regression and the prognosis factors were analyzed through Kaplan-Meier survival curve and Cox proportional hazards regression. The performance of the models was compared with current models, including the logistic regression model and the AJCC TNM staging model, applying receiver operating characteristics, decision curve analysis, and the calculation of accuracy and sensitivity in both internal and independent external cohorts. Results Our prognosis model achieved an AUC of 0.8269 (95%CI: 0.8083-0.8425) in the internal validation cohort and 0.9123 (95%CI: 0.8979-0.9261) in the external validation cohort. In addition, we tested the performance of the extreme gradient boosting model through decision curve analysis curve, Precision-Recall curve, and Brier score and two models exhibited excellent performance. Conclusion Our developed models can accurately predict the risk and prognosis of KCBM and contribute to helping improve decision-making.
Collapse
Affiliation(s)
- Lichen Ji
- Cancer Center, Department of Orthopedics, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Department of Laboratory Medicine, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Center for Rehabilitation Medicine, Osteoporosis Center, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, Zhejiang, China,Department of Orthopedics, The Second Affiliated Hospital and Yuying Children's Hospital of Wenzhou Medical University, Wenzhou, China
| | - Wei Zhang
- Department of Laboratory Medicine, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Center for Rehabilitation Medicine, Osteoporosis Center, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, Zhejiang, China,Department of Orthopedics, Zhejiang Provincial People's Hospital, Qingdao University, Qingdao, China
| | - Jiaqing Huang
- Department of Laboratory Medicine, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,The Second Clinic Medical College, Zhejiang Chinese Medicine University, Hangzhou, China
| | - Jinlong Tian
- Cancer Center, Department of Orthopedics, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Department of Laboratory Medicine, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Center for Rehabilitation Medicine, Osteoporosis Center, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, Zhejiang, China,The First Affiliated Hospital of Bengbu Medical University, Bengbu, Anhui, China
| | - Xugang Zhong
- Department of Laboratory Medicine, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Center for Rehabilitation Medicine, Osteoporosis Center, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, Zhejiang, China,Department of Orthopedics, Zhejiang Provincial People's Hospital, Qingdao University, Qingdao, China
| | - Junchao Luo
- Cancer Center, Department of Orthopedics, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Department of Laboratory Medicine, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Center for Rehabilitation Medicine, Osteoporosis Center, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, Zhejiang, China,Department of Orthopedics, The Second Affiliated Hospital and Yuying Children's Hospital of Wenzhou Medical University, Wenzhou, China
| | - Senbo Zhu
- Cancer Center, Department of Orthopedics, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Department of Laboratory Medicine, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Center for Rehabilitation Medicine, Osteoporosis Center, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, Zhejiang, China,Department of Orthopedics, The Second Affiliated Hospital and Yuying Children's Hospital of Wenzhou Medical University, Wenzhou, China
| | - Zeju He
- Cancer Center, Department of Orthopedics, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Department of Laboratory Medicine, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Center for Rehabilitation Medicine, Osteoporosis Center, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, Zhejiang, China,Department of Orthopedics, The Second Affiliated Hospital and Yuying Children's Hospital of Wenzhou Medical University, Wenzhou, China
| | - Yu Tong
- Cancer Center, Department of Orthopedics, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Department of Laboratory Medicine, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Center for Rehabilitation Medicine, Osteoporosis Center, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, Zhejiang, China
| | - Xiang Meng
- Cancer Center, Department of Orthopedics, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Department of Laboratory Medicine, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Center for Rehabilitation Medicine, Osteoporosis Center, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, Zhejiang, China,The First Affiliated Hospital of Bengbu Medical University, Bengbu, Anhui, China
| | - Yao Kang
- Cancer Center, Department of Orthopedics, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Department of Laboratory Medicine, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Center for Rehabilitation Medicine, Osteoporosis Center, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, Zhejiang, China,Yao Kang
| | - Qing Bi
- Cancer Center, Department of Orthopedics, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Department of Laboratory Medicine, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China,Center for Rehabilitation Medicine, Osteoporosis Center, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, Zhejiang, China,*Correspondence: Qing Bi
| |
Collapse
|
16
|
Reich A, Mirchi N, Yilmaz R, Ledwos N, Bissonnette V, Tran DH, Winkler-Schwartz A, Karlik B, Del Maestro RF. Artificial Neural Network Approach to Competency-Based Training Using a Virtual Reality Neurosurgical Simulation. Oper Neurosurg (Hagerstown) 2022; 23:31-39. [PMID: 35726927 DOI: 10.1227/ons.0000000000000173] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Accepted: 11/08/2021] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND The methodology of assessment and training of surgical skills is evolving to deal with the emergence of competency-based training. Artificial neural networks (ANNs), a branch of artificial intelligence, can use newly generated metrics not only for assessment performance but also to quantitate individual metric importance and provide new insights into surgical expertise. OBJECTIVE To outline the educational utility of using an ANN in the assessment and quantitation of surgical expertise. A virtual reality vertebral osteophyte removal during a simulated surgical spine procedure is used as a model to outline this methodology. METHODS Twenty-one participants performed a simulated anterior cervical diskectomy and fusion on the Sim-Ortho virtual reality simulator. Participants were divided into 3 groups, including 9 postresidents, 5 senior residents, and 7 junior residents. Data were retrieved from the osteophyte removal component of the scenario, which involved using a simulated burr. The data were manipulated to initially generate 83 performance metrics spanning 3 categories (safety, efficiency, and motion) of which only the most relevant metrics were used to train and test the ANN. RESULTS The ANN model was trained on 6 safety metrics to a testing accuracy of 83.3%. The contributions of these performance metrics to expertise were revealed through connection weight products and outlined 2 identifiable learning patterns of technical skills. CONCLUSION This study outlines the potential utility of ANNs which allows a deeper understanding of the composites of surgical expertise and may contribute to the paradigm shift toward competency-based surgical training.
Collapse
Affiliation(s)
- Aiden Reich
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
| | | | | | | | | | | | | | | | | |
Collapse
|
17
|
De Jesus KLM, Senoro DB, Dela Cruz JC, Chan EB. Neuro-Particle Swarm Optimization Based In-Situ Prediction Model for Heavy Metals Concentration in Groundwater and Surface Water. TOXICS 2022; 10:toxics10020095. [PMID: 35202281 PMCID: PMC8879014 DOI: 10.3390/toxics10020095] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/16/2022] [Revised: 02/12/2022] [Accepted: 02/16/2022] [Indexed: 11/22/2022]
Abstract
Limited monitoring activities to assess data on heavy metal (HM) concentration contribute to worldwide concern for the environmental quality and the degree of toxicants in areas where there are elevated metals concentrations. Hence, this study used in-situ physicochemical parameters to the limited data on HM concentration in SW and GW. The site of the study was Marinduque Island Province in the Philippines, which experienced two mining disasters. Prediction model results showed that the SW models during the dry and wet seasons recorded a mean squared error (MSE) ranging from 6 × 10−7 to 0.070276. The GW models recorded a range from 5 × 10−8 to 0.045373, all of which were approaching the ideal MSE value of 0. Kling–Gupta efficiency values of developed models were all greater than 0.95. The developed neural network-particle swarm optimization (NN-PSO) models for SW and GW were compared to linear and support vector machine (SVM) models and previously published deterministic and artificial intelligence (AI) models. The findings indicated that the developed NN-PSO models are superior to the developed linear and SVM models, up to 1.60 and 1.40 times greater than the best model observed created by linear and SVM models for SW and GW, respectively. The developed models were also on par with previously published deterministic and AI-based models considering their prediction capability. Sensitivity analysis using Olden’s connection weights approach showed that pH influenced the concentration of HM significantly. Established on the research findings, it can be stated that the NN-PSO is an effective and practical approach in the prediction of HM concentration in water resources that contributes a solution to the limited HM concentration monitored data.
Collapse
Affiliation(s)
- Kevin Lawrence M. De Jesus
- School of Graduate Studies, Mapua University, Manila 1002, Philippines; (K.L.M.D.J.); (J.C.D.C.)
- School of Chemical, Biological, Materials Engineering and Sciences, Mapua University, Manila 1002, Philippines
- Resiliency and Sustainable Development Center, Yuchengco Innovation Center, Mapua University, Manila 1002, Philippines
| | - Delia B. Senoro
- School of Graduate Studies, Mapua University, Manila 1002, Philippines; (K.L.M.D.J.); (J.C.D.C.)
- School of Chemical, Biological, Materials Engineering and Sciences, Mapua University, Manila 1002, Philippines
- Resiliency and Sustainable Development Center, Yuchengco Innovation Center, Mapua University, Manila 1002, Philippines
- School of Civil, Environmental and Geological Engineering, Mapua University, Manila 1002, Philippines
- Correspondence: ; Tel.: +63-2-8251-6622
| | - Jennifer C. Dela Cruz
- School of Graduate Studies, Mapua University, Manila 1002, Philippines; (K.L.M.D.J.); (J.C.D.C.)
- School of Electrical, Electronics and Computer Engineering, Mapua University, Manila 1002, Philippines
| | - Eduardo B. Chan
- Dyson College of Arts and Science, Pace University, New York, NY 10038, USA;
| |
Collapse
|
18
|
Ayyildiz E, Erdogan M, Taskin A. Forecasting COVID-19 recovered cases with Artificial Neural Networks to enable designing an effective blood supply chain. Comput Biol Med 2021; 139:105029. [PMID: 34794082 PMCID: PMC8590479 DOI: 10.1016/j.compbiomed.2021.105029] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Revised: 11/08/2021] [Accepted: 11/10/2021] [Indexed: 12/23/2022]
Abstract
This study introduces a forecasting model to help design an effective blood supply chain mechanism for tackling the COVID-19 pandemic. In doing so, first, the number of people recovered from COVID-19 is forecasted using the Artificial Neural Networks (ANNs) to determine potential donors for convalescent (immune) plasma (CIP) treatment of COVID-19. This is performed explicitly to show the applicability of ANNs in forecasting the daily number of patients recovered from COVID-19. Second, the ANNs-based approach is further applied to the data from Italy to confirm its robustness in other geographical contexts. Finally, to evaluate its forecasting accuracy, the proposed Multi-Layer Perceptron (MLP) approach is compared with other traditional models, including Autoregressive Integrated Moving Average (ARIMA), Long Short-term Memory (LSTM), and Nonlinear Autoregressive Network with Exogenous Inputs (NARX). Compared to the ARIMA, LSTM, and NARX, the MLP-based model is found to perform better in forecasting the number of people recovered from COVID-19. Overall, the findings suggest that the proposed model is robust and can be widely applied in other parts of the world in forecasting the patients recovered from COVID-19.
Collapse
Affiliation(s)
- Ertugrul Ayyildiz
- Department of Industrial Engineering, Karadeniz Technical University, Ortahisar, 61080, Trabzon, Turkey; Department of Industrial Engineering, Yildiz Technical University, Beşiktaş, 34349, İstanbul, Turkey.
| | - Melike Erdogan
- Department of Industrial Engineering, Duzce University, Konuralp, 81620, Duzce, Turkey
| | - Alev Taskin
- Department of Industrial Engineering, Yildiz Technical University, Beşiktaş, 34349, İstanbul, Turkey
| |
Collapse
|