1
|
Mulvaney G, Sowah MN, DeCarlo R, Drossopoulos P, Holland CM, Bohl MA. Biomechanical Analysis of Pedicle Screw Reinsertion Along the Same Trajectory in a Validated 3D-Printed Synthetic Bone Model. World Neurosurg 2024; 190:e675-e683. [PMID: 39103047 DOI: 10.1016/j.wneu.2024.08.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2024] [Revised: 07/31/2024] [Accepted: 08/01/2024] [Indexed: 08/07/2024]
Abstract
OBJECTIVE To investigate the biomechanical properties of pedicle screw reinsertion along the same trajectory in a previously validated synthetic bone model. METHODS Twenty identical acrylonitrile butadiene styrene models of lumbar vertebrae were three-dimensional-printed. Screws were placed in the standard fashion into each pedicle. Models were separated into 2 equal groups, control and experimental. Experimental group screws were completely removed from their testing block and reinserted once. All screws in both groups were then forcibly removed. Continuous torque monitoring was collected on screw insertion torque (IT), removal torque, and reinsertion torque. Pullout strength (PO), screw stiffness (STI), and strain energy (STR) were calculated. RESULTS There was no significant difference between control and experimental groups for PO (P = 0.26), STI (P = 0.55), STR (P = 0.50), or IT (P = 0.24). There was a significant decrease in reinsertion torque (54.5 N-cm ± 8.2 N-cm) from control IT (62.9 N-cm ± 8.4 N-cm, P = 0.045) and experimental IT (67.5 N-cm ± 7.6 N-cm, P = 0.0026). Strong correlations (Pearson's r > 0.80) were seen between control IT against STR and PO, between each of the experimental torque measurements, and between experimental PO and STI. CONCLUSIONS Despite a significant decrease in insertion torque, there is no significant loss of pedicle screw performance when a screw is removed and reinserted along the same trajectory.
Collapse
Affiliation(s)
- Graham Mulvaney
- Department of Neurosurgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA.
| | - Mareshah N Sowah
- University of South Carolina School of Medicine Greenville, Greenville, South Carolina, USA
| | - Rebecca DeCarlo
- Department of Neurosurgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA
| | - Peter Drossopoulos
- University of North Carolina School of Medicine, Chapel Hill, North Carolina, USA
| | | | - Michael A Bohl
- Carolina Neurosurgery and Spine Associates, Charlotte, North Carolina, USA
| |
Collapse
|
2
|
Huerta Osnaya JR, Gonzalez Carranza V, Chico-Ponce de León F, Pérez-Escamirosa F, Lorias-Espinoza D. Image Guided Interpedicular Screw Placement Simulation System for Training and Skill Evaluation. Proof of Concept. World Neurosurg 2024; 188:e213-e222. [PMID: 38768749 DOI: 10.1016/j.wneu.2024.05.087] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2024] [Revised: 05/13/2024] [Accepted: 05/14/2024] [Indexed: 05/22/2024]
Abstract
BACKGROUND The SpineST-01 system is an image-guided vertebrae cannulation training system. During task execution, the computer calculates performance-based metrics displaying different visual perspectives (lateral view, axial view, anteroposterior view) with the position of the instrument inside the vertebra. Finally, a report with the metrics is generated as performance feedback. METHODS A training box holds a 3D printed spine section. The computer works with 2 orthogonally disposed cameras, tracking passive markers placed on the instrument. Eight metrics were proposed to evaluate the execution of the surgical task. A preliminary study with 25 participants divided into 3 groups (12 novices, 10 intermediates, and 3 expert) was conducted to determine the feasibility of the system and to evaluate and assess the performance differences of each group using Kruskal-Wallis analysis and Mann-Whitney U analysis. In both analyses, a P value ≤ 0.05 was considered statistically significant. RESULTS When comparing experts versus novices and all 3 groups, statistical analysis showed significant differences in 6 of the 8 metrics: axial angle error (°), lateral angle error (°), average speed (mm/second), progress between shots (mm), Time (seconds), and shots. The metrics that did not show any statistically significant difference were time between shots (seconds), and speed between shots (mm/second). Also, the average result comparison placed the experts as the best performance group. CONCLUSIONS Initial testing of the SpineST-01 demonstrated potential for the system to practice image-guided cannulation tasks on lumbar vertebrae. Results showed objective differences between experts, intermediates, and novices in the proposed metrics, making this system a feasible option for developing basic navigation system skills without the risk of radiation exposure and objectively evaluating task performance.
Collapse
Affiliation(s)
- José Rubén Huerta Osnaya
- Departamento de Ingeniería Eléctrica, Sección de Bioelectrónica, Centro de Investigación y de Estudios Avanzados del Instituto Politécnico Nacional (Cinvestav), México, Mexico
| | | | | | - Fernando Pérez-Escamirosa
- Instituto de Ciencias Aplicadas y Tecnología (ICAT), Universidad Nacional Autónoma de México (UNAM), México, Mexico
| | - Daniel Lorias-Espinoza
- Departamento de Ingeniería Eléctrica, Sección de Bioelectrónica, Centro de Investigación y de Estudios Avanzados del Instituto Politécnico Nacional (Cinvestav), México, Mexico.
| |
Collapse
|
3
|
Levy HA, Pinter ZW, Honig R, Salmons HI, Hobson SL, Karamian BA, Freedman BA, Elder BD, Fogelson JL, Nassr AN, Sebastian AS. A Standardized Curriculum Improves Trainee Rod Bending Proficiency in Spinal Deformity Surgery. Results of a Prospective Randomized Controlled Educational Study. J Am Acad Orthop Surg 2024; 32:e17-e25. [PMID: 37494716 DOI: 10.5435/jaaos-d-23-00294] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Accepted: 06/19/2023] [Indexed: 07/28/2023] Open
Abstract
INTRODUCTION Surgical simulation is increasingly being accepted as a training platform to promote skill development and a safe surgical technique. Preliminary investigations in spine surgery show that simulation paired with educational intervention can markedly improve trainee performance. This study used a newly developed thoracolumbar fusion rod bending model to assess the effect of a novel educational curriculum and simulator training on surgical trainee rod bending speed and proficiency. METHODS Junior (PGY1 to 2) and senior (PGY3-fellow) surgical trainees at a single academic institution were prospectively enrolled in a rod bending simulation using a T7-pelvis spinal fusion model. Participants completed two simulations, with 1 month between first and second attempts. Fifty percent of surgeons in each training level were randomized to receive an educational curriculum (rod bending technique videos and unlimited simulator practice) between simulation attempts. Rod bending simulation proficiency was determined by the percentage of participants who completed the task (conclusion at 20 minutes), time to task completion or conclusion, and number of incomplete set screws at task conclusion. Participants completed a preparticipation and postparticipation survey. Univariate analysis compared rod bending proficiency and survey results between education and control cohorts. RESULTS Forty trainees (20 junior and 20 senior) were enrolled, with 20 participants randomized to the education and control cohorts. No notable differences were observed in the first simulation rod bending proficiency or preparticipation survey results between the education and control cohorts. In the second simulation, the education versus the control cohort demonstrated a significantly higher completion rate ( P = 0.01), shorter task time ( P = 0.009), fewer incomplete screws ( P = 0.003), and greater experience level ( P = 0.008) and comfort level ( P = 0.002) on postparticipation survey. DISCUSSION Trainees who participated in a novel educational curriculum and simulator training relative to the control cohort improved markedly in rod bending proficiency and comfort level. Rod bending simulation could be incorporated in existing residency and fellowship surgical skills curricula. LEVEL OF EVIDENCE I.
Collapse
Affiliation(s)
- Hannah A Levy
- From the Department of Orthopedic Surgery, Mayo Clinic, Rochester, MN (Levy, Pinter, Honig, Salmons, Freedman, Nassr, and Sebastian), the Department of Neurologic Surgery, Mayo Clinic, Rochester, MN (Elder and Fogelson), the Department of Orthopaedic Surgery, Emory University, Atlanta, GA (Hobson), and the Department of Orthopaedic Surgery, University of Utah, Salt Lake City, UT (Karamian)
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
4
|
Carbone M, Viglialoro RM, Stagnari S, Condino S, Gesi M, Scaglione M, Parchi PD. Design, Fabrication, and Preliminary Validation of Patient-Specific Spine Section Phantoms for Use in Training Spine Surgeons Outside the Operating Room/Theatre. Bioengineering (Basel) 2023; 10:1345. [PMID: 38135936 PMCID: PMC10740604 DOI: 10.3390/bioengineering10121345] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Revised: 11/13/2023] [Accepted: 11/21/2023] [Indexed: 12/24/2023] Open
Abstract
Pedicle screw fixation (PSF) demands rigorous training to mitigate the risk of severe neurovascular complications arising from screw misplacement. This paper introduces a patient-specific phantom designed for PSF training, extending a portion of the learning process beyond the confines of the surgical room. Six phantoms of the thoracolumbar region were fabricated from radiological datasets, combining 3D printing and casting techniques. The phantoms were employed in three training sessions by a fifth-year resident who performed full training on all six phantoms; he/she placed a total of 57 pedicle screws. Analysis of the learning curve, focusing on time per screw and positioning accuracy, revealed attainment of an asymptotic performance level (around 3 min per screw) after 40 screws. The phantom's efficacy was evaluated by three experts and six residents, each inserting a minimum of four screws. Initial assessments confirmed face, content, and construct validity, affirming the patient-specific phantoms as a valuable training resource. These proposed phantoms exhibit great promise as an essential tool in surgical training as they exhibited a demonstrable learning effect on the PSF technique. This study lays the foundation for further exploration and underscores the potential impact of these patient-specific phantoms on the future of spinal surgical education.
Collapse
Affiliation(s)
- Marina Carbone
- Department of Information Engineering, University of Pisa, 56126 Pisa, Italy;
- EndoCAS Center, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, 56126 Pisa, Italy;
| | - Rosanna Maria Viglialoro
- EndoCAS Center, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, 56126 Pisa, Italy;
| | - Sara Stagnari
- Department of Orthopaedics and Trauma Surgery, University of Pisa, 56100 Pisa, Italy; (S.S.); (M.S.); (P.D.P.)
| | - Sara Condino
- Department of Information Engineering, University of Pisa, 56126 Pisa, Italy;
- EndoCAS Center, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, 56126 Pisa, Italy;
| | - Marco Gesi
- Center for Rehabilitative Medicine “Sport and Anatomy”, University of Pisa, 56121 Pisa, Italy;
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, 56126 Pisa, Italy
| | - Michelangelo Scaglione
- Department of Orthopaedics and Trauma Surgery, University of Pisa, 56100 Pisa, Italy; (S.S.); (M.S.); (P.D.P.)
| | - Paolo Domenico Parchi
- Department of Orthopaedics and Trauma Surgery, University of Pisa, 56100 Pisa, Italy; (S.S.); (M.S.); (P.D.P.)
| |
Collapse
|
5
|
Farah GJ, Rogers JL, Lopez AM, Brown NJ, Pennington Z, Kuo C, Gold J, Bui NE, Koester SW, Gendreau JL, Diaz-Aguilar LD, Oh MY, Pham MH. Resident Training in Spine Surgery: A Systematic Review of Simulation-Based Educational Models. World Neurosurg 2023; 174:81-115. [PMID: 36921712 DOI: 10.1016/j.wneu.2023.03.032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Revised: 03/06/2023] [Accepted: 03/07/2023] [Indexed: 03/14/2023]
Abstract
OBJECTIVE With the increasing prevalence of spine surgery, ensuring effective resident training is becoming of increasing importance. Training safe, competent surgeons relies heavily on effective teaching of surgical indications and adequate practice to achieve a minimum level of technical proficiency before independent practice. American Council of Graduate Medical Education work-hour restrictions have complicated the latter, forcing programs to identify novel methods of surgical resident training. Simulation-based training is one such method that can be used to complement traditional training. The present review aims to evaluate the educational success of simulation-based models in the spine surgical training of residents. METHODS Using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, the PubMed, Web of Science, and Google Scholar databases were systematically screened for English full-text studies examining simulation-based spine training curricula. Studies were categorized based on simulation model class, including animal-cadaveric, human-cadaveric, physical/3-dimensional, and computer-based/virtual reality. Outcomes studied included participant feedback regarding the simulator and competency metrics used to evaluate participant performance. RESULTS Seventy-two studies were identified. Simulators displayed high face validity and were useful for spine surgery training. Objective measures used to evaluate procedural performance included implant placement evaluation, procedural time, and technical skill assessment, with numerous simulators demonstrating a learning effect. CONCLUSIONS While simulation-based educational models are one potential means of training residents to perform spine surgery, traditional in-person operating room training remains pivotal. To establish the efficacy of simulators, future research should focus on improving study quality by leveraging longitudinal study designs and correlating simulation-based training with clinical outcome measures.
Collapse
Affiliation(s)
- Ghassan J Farah
- Department of Neurosurgery, University of California San Diego School of Medicine, San Diego, California, USA
| | - James L Rogers
- Vanderbilt University School of Medicine, Nashville, Tennessee, USA
| | - Alexander M Lopez
- Department of Neurosurgery, University of California, Irvine, Orange, California, USA
| | - Nolan J Brown
- Department of Neurosurgery, University of California, Irvine, Orange, California, USA
| | - Zach Pennington
- Department of Neurological Surgery, Mayo Clinic, Rochester, Minnesota, USA
| | - Cathleen Kuo
- Department of Neurological Surgery, University at Buffalo Jacobs SOM, Buffalo, New York, USA
| | - Justin Gold
- Department of Neurological Surgery, Cooper Medical of Rowan University, Camden, New Jersey, USA
| | - Nicholas E Bui
- Department of Neurosurgery, Loma Linda University Medical Center, Loma Linda, California, USA
| | - Stefan W Koester
- Vanderbilt University School of Medicine, Nashville, Tennessee, USA
| | - Julian L Gendreau
- Department of Biomedical Engineering, Johns Hopkins Whiting School of Engineering, Baltimore, Maryland, USA
| | - Luis Daniel Diaz-Aguilar
- Department of Neurosurgery, University of California San Diego School of Medicine, San Diego, California, USA
| | - Michael Y Oh
- Department of Neurosurgery, University of California, Irvine, Orange, California, USA
| | - Martin H Pham
- Department of Neurosurgery, University of California San Diego School of Medicine, San Diego, California, USA.
| |
Collapse
|
6
|
Hani U, Chewning S, Bohl M. Expanding Clinician Access to High-Quality, Low-Cost Biomechanical Research: A Technical Report on the Carolina Neurosurgery and Spine Biomechanics Laboratory. Cureus 2023; 15:e37367. [PMID: 37182033 PMCID: PMC10171874 DOI: 10.7759/cureus.37367] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/10/2023] [Indexed: 05/16/2023] Open
Abstract
Spine biomechanical research helps us better understand the spine in physiologic and pathologic states and gives us a mechanism by which to evaluate surgical interventions, generate and evaluate models of spine pathologies, and develop novel, data-driven surgical strategies and devices. Access to a biomechanical testing laboratory is therefore potentially invaluable to those who specialize in treating spine pathologies. A number of barriers to access have precluded many clinicians from pursuing their biomechanical research interests, foremost among these is cost. The Carolina Neurosurgery and Spine Biomechanics Research Laboratory (CNSBL) was developed as a model of a low-cost, easy-to-access laboratory capable of generating high-quality data in tests of axial load, tension, torque, displacement, and pathological model testing. Our experience in developing this laboratory suggests that a large number of basic biomechanical research inquiries can be studied in a laboratory composed of less than $7500 USD of hardware. We hope that this model serves as a roadmap for any like-minded practitioners seeking broader access to biomechanical testing facilities.
Collapse
Affiliation(s)
- Ummey Hani
- Neurological Surgery, Carolina Neurosurgery and Spine Associates, Charlotte, USA
| | - Sam Chewning
- Neurological Surgery, Carolina Neurosurgery and Spine Associates, Charlotte, USA
| | - Michael Bohl
- Neurological Surgery, Carolina Neurosurgery and Spine Associates, Charlotte, USA
| |
Collapse
|
7
|
Damon A, Lee SJ, Pichelmann M, Nottmeier E, CreveCoeur TS, Clifton W. International Learner Perceptions, Educational Value, and Cost Associated With the Use of Start-to-Finish Surgical Simulation Compared With Cadaveric Models. Oper Neurosurg (Hagerstown) 2023; 24:201-208. [PMID: 36637305 DOI: 10.1227/ons.0000000000000475] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 08/20/2022] [Indexed: 01/14/2023] Open
Abstract
BACKGROUND Graduate surgical education is highly variable across regions and institutions regarding case volume and degree of trainee participation in each case. Dedicated educational curriculum using cadaveric tissue has been shown to enhance graduate surgical training, however with associated financial and utility burden to the institution. OBJECTIVE To investigate the utility of educational and cost applications of a novel method of combining mixed organic hydrogel polymers and 3-dimensional printed anatomic structures to create a complete "start-to-finish" simulation for resident education in spinal anatomy, instrumentation, and surgical techniques. METHODS This qualitative pilot study investigated 14 international participants on achievement of objective and personal learning goals in a standardized curriculum using biomimetic simulation compared with cadaveric tissue. A questionnaire was developed to examine trainee evaluation of individual anatomic components of the biomimetic simulators compared with previous experience with cadaveric tissue. RESULTS A total of 210 responses were acquired from 14 participants. Six participants originated from US residency education programs and 8 from transcontinental residency programs. Survey results for the simulation session revealed high user satisfaction. Score averages for each portion of the simulation session indicated learner validation of anatomic features for the simulation compared with previous cadaveric experience. Cost analysis resulted in an estimated savings of $10 833.00 for this single simulation session compared with previous cadaveric tissue sessions. CONCLUSION The results of this study indicate a strong potential of establishing biomimetic simulation as a cost-effective and high-quality alternative to cadaveric tissue for the instruction of fundamental spine surgical techniques.
Collapse
Affiliation(s)
- Aaron Damon
- Department of Education, Mayo Clinic Florida, Jacksonville, Florida, USA
| | - Seung Jin Lee
- Department of Neurosurgery, Mayo Clinic Florida, Jacksonville, Florida, USA
| | - Mark Pichelmann
- Department of Neurosurgery, Mayo Clinic Health Systems, Eau ClaiSre, Wisconsin, USA
| | - Eric Nottmeier
- Department of Neurosurgery, Mayo Clinic Florida, Jacksonville, Florida, USA
| | - Travis S CreveCoeur
- Department of Neurologic Surgery, Columbia University Irving Medical Center, New York, New York, USA
| | - William Clifton
- Department of Neurologic Surgery, Columbia University Irving Medical Center, New York, New York, USA
| |
Collapse
|
8
|
Suzuki M, Miyaji K, Matoba K, Abe T, Nakamaru Y, Watanabe R, Suzuki T, Nakazono A, Konno A, Hinder D, Psaltis AJ, Wormald PJ, Homma A. Mental workload during endoscopic sinus surgery is associated with surgeons' skill levels. Front Med (Lausanne) 2023; 10:1090743. [PMID: 37168266 PMCID: PMC10165102 DOI: 10.3389/fmed.2023.1090743] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2022] [Accepted: 04/04/2023] [Indexed: 05/13/2023] Open
Abstract
Introduction Surgeons' mental workload during endoscopic sinus surgery (ESS) has not been fully evaluated. The assessment was challenging due to the great diversity of each patient's anatomy and the consequence variety of surgical difficulties. In this study, we examined the mental workload of surgeons with various surgical skill levels during ESS under the standardized condition provided by novel-designed 3D sinus models. Materials and methods Forty-seven participants performed a high-fidelity ESS simulation with 3D-printed sinus models. Surgeons' mental workload was assessed with the national aeronautics and space administration-task load index (NASA-TLX). Associations between the total and subscales score of NASA-TLX and surgical skill index, including the board certification status, the number of experienced ESS cases, and the objective structured assessment of technical skills (OSATS), were analyzed. In addition, 10 registrars repeated the simulation surgery, and their NASA-TLX score was compared before and after the repetitive training. Results The total NASA-TLX score was significantly associated with OSATS score (p = 0.0001). Primary component analysis classified the surgeons' mental burden into three different categories: (1) the skill-level-dependent factors (temporal demand, effort, and performance), (2) the skill-level-independent factors (mental and physical demand), and (3) frustration. After the repetitive training, the skill-level-dependent factors were alleviated (temporal demand; z = -2.3664, p = 0.0091, effort; z = -2.1704, p = 0.0346, and performance; z = -2.5992, p = 0.0017), the independent factors were increased (mental demand; z = -2.5992, p = 0.0023 and physical demand; z = -2.2509, p = 0.0213), and frustration did not change (p = 0.3625). Conclusion Some of the mental workload during ESS is associated with surgical skill level and alleviated with repetitive training. However, other aspects remain a burden or could worsen even when surgeons have gained surgical experience. Routine assessment of registrars' mental burdens would be necessary during surgical training to sustain their mental health.
Collapse
Affiliation(s)
- Masanobu Suzuki
- Department of Otolaryngology-Head and Neck Surgery, Faculty of Medicine and Graduate School of Medicine, Hokkaido University, Sapporo, Hokkaido, Japan
- *Correspondence: Masanobu Suzuki,
| | - Kou Miyaji
- Graduate School of Information Science and Technology, Hokkaido University, Sapporo, Japan
| | - Kotaro Matoba
- Department of Forensic Medicine, Faculty of Medicine and Graduate School of Medicine, Hokkaido University, Sapporo, Hokkaido, Japan
| | - Takashige Abe
- Department of Urology, Hokkaido University Graduate School of Medicine, Hokkaido University, Sapporo, Hokkaido, Japan
| | - Yuji Nakamaru
- Department of Otolaryngology-Head and Neck Surgery, Faculty of Medicine and Graduate School of Medicine, Hokkaido University, Sapporo, Hokkaido, Japan
| | - Ryosuke Watanabe
- Department of Otolaryngology-Head and Neck Surgery, Faculty of Medicine and Graduate School of Medicine, Hokkaido University, Sapporo, Hokkaido, Japan
| | - Takayoshi Suzuki
- Department of Otolaryngology-Head and Neck Surgery, Faculty of Medicine and Graduate School of Medicine, Hokkaido University, Sapporo, Hokkaido, Japan
| | - Akira Nakazono
- Department of Otolaryngology-Head and Neck Surgery, Faculty of Medicine and Graduate School of Medicine, Hokkaido University, Sapporo, Hokkaido, Japan
| | - Atsushi Konno
- Graduate School of Information Science and Technology, Hokkaido University, Sapporo, Japan
| | - Dominik Hinder
- Department of Surgery–Otorhinolaryngology Head and Neck Surgery, Central Adelaide Local Health Network and the University of Adelaide, Adelaide, SA, Australia
| | - A. J. Psaltis
- Department of Surgery–Otorhinolaryngology Head and Neck Surgery, Central Adelaide Local Health Network and the University of Adelaide, Adelaide, SA, Australia
| | - P. J. Wormald
- Department of Surgery–Otorhinolaryngology Head and Neck Surgery, Central Adelaide Local Health Network and the University of Adelaide, Adelaide, SA, Australia
| | - Akihiro Homma
- Department of Otolaryngology-Head and Neck Surgery, Faculty of Medicine and Graduate School of Medicine, Hokkaido University, Sapporo, Hokkaido, Japan
| |
Collapse
|
9
|
Entezami P, Spurgas MP, O'Brien MW, Newman LC, Adamo MA. Utility of 3-dimensionally printed models for parent education in pediatric plagiocephaly. PEC INNOVATION 2022; 1:100077. [PMID: 37213734 PMCID: PMC10194339 DOI: 10.1016/j.pecinn.2022.100077] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/10/2022] [Revised: 08/11/2022] [Accepted: 08/18/2022] [Indexed: 05/23/2023]
Abstract
Objectives Demonstrate the benefits of using 3D printed skull models when counseling families regarding disorders of the cranial vault (namely plagiocephaly and craniosynostosis), as traditional imaging review and discussion is often insufficient. Methods 3D printed skull models of a patient with plagiocephaly were used during clinic appointments to aid in the counseling of parents. Surveys were distributed following the appointment to evaluate the utility of these models during the discussion. Results Fifty surveys were distributed (with a 98% response rate). 3D models were both empirically and anecdotally helpful for parents in understanding their child's diagnosis. Conclusion Advances in 3D printing technology and software have made producing models more accessible. Incorporating physical, disorder-specific models into our discussions has led to improvements in our ability to communicate with our patients and their families. Innovation Disorders of the cranial can be challenging to describe to the parents and guardians of affected children; using 3D printed models is a useful adjunct in patient-centered discussions. The subject response to the use of these emerging technologies in this setting suggests a major role for 3D models in patient education and counseling for cranial vault disorders.
Collapse
Affiliation(s)
- Pouya Entezami
- Department of Neurosurgery, Albany Medical Center, Albany, NY, United States of America
| | - Morgan P. Spurgas
- Department of Neurosurgery, Albany Medical Center, Albany, NY, United States of America
| | - Michael W. O'Brien
- Department of Neurosurgery, Albany Medical Center, Albany, NY, United States of America
| | - Lisa C. Newman
- Department of Neurosurgery, Albany Medical Center, Albany, NY, United States of America
| | - Matthew A. Adamo
- Department of Neurosurgery, Albany Medical Center, Albany, NY, United States of America
| |
Collapse
|
10
|
Kabra A, Mehta N, Garg B. 3D printing in spine care: A review of current applications. J Clin Orthop Trauma 2022; 35:102044. [PMID: 36340962 PMCID: PMC9633990 DOI: 10.1016/j.jcot.2022.102044] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/01/2022] [Revised: 09/10/2022] [Accepted: 10/18/2022] [Indexed: 12/14/2022] Open
Abstract
3D printing (3DP) has been brought to medical use since the early part of this century- but it has been widely researched on and publicized only in the last few years. Amongst patients with spinal disorders, 3DP has been utilized in various facets of patient care. These include pre-operative aspects - such as patient education, resident training, pre-operative planning and simulations, intra-operative assistance in the form of customized jigs for pedicle screw insertion, patient specific interbody cages and vertebral body substitutes in complex malignancies and spinal infections. It has also been utilized in deformity surgeries and has opened new avenues in minimally invasive spine care. Guidelines have now been drafted by various organizations including the FDA with a prime focus on quality control measures applicable to this new technology. There has been a recent surge in publications supporting the use of 3DP in spinal disorders, reporting an improvement in various aspects of patient care. As the technology spreads out its wings further, more innovations and applications are expected to unfold in the coming years. Considering the rapid advances that 3DP has made, having a basic understanding of this technology is imperative for all spine surgeons. Despite promising preliminary results, there still exist a few pitfalls of the technology which have hindered the universal application of 3DP. Most importantly, there is a dearth of data related to long term outcomes supporting its clinical use. The prohibitive cost of 3D models, the specialized manpower it necessitates and the need for specific instrumentation are major deterrents to widespread use of this technology, particularly in small-scale healthcare setups. With further advancements in technology, the goal must be to make it more accurate and affordable to hospitals and patients so that the benefits of the technology can reach a wider patient population.
Collapse
Affiliation(s)
- Apoorva Kabra
- Department of Orthopaedics, All India Institute of Medical Sciences, New Delhi, India
| | - Nishank Mehta
- Department of Orthopaedics, All India Institute of Medical Sciences, New Delhi, India
| | - Bhavuk Garg
- Department of Orthopaedics, All India Institute of Medical Sciences, New Delhi, India
| |
Collapse
|
11
|
Virtual Scoliosis Surgery Using a 3D-Printed Model Based on Biplanar Radiographs. Bioengineering (Basel) 2022; 9:bioengineering9090469. [PMID: 36135015 PMCID: PMC9495694 DOI: 10.3390/bioengineering9090469] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2022] [Revised: 09/07/2022] [Accepted: 09/09/2022] [Indexed: 11/16/2022] Open
Abstract
The aim of this paper is to describe a protocol that simulates the spinal surgery undergone by adolescents with idiopathic scoliosis (AIS) by using a 3D-printed spine model. Patients with AIS underwent pre- and postoperative bi-planar low-dose X-rays from which a numerical 3D model of their spine was generated. The preoperative numerical spine model was subsequently 3D printed to virtually reproduce the spine surgery. Special consideration was given to the printing materials for the 3D-printed elements in order to reflect the radiopaque and mechanical properties of typical bones most accurately. Two patients with AIS were recruited and operated. During the virtual surgery, both pre- and postoperative images of the 3D-printed spine model were acquired. The proposed 3D-printing workflow used to create a realistic 3D-printed spine suitable for virtual surgery appears to be feasible and reliable. This method could be used for virtual-reality scoliosis surgery training incorporating 3D-printed models, and to test surgical instruments and implants.
Collapse
|
12
|
Patchana T, Ramnot A, Farr S, Ku A, Ghauri M, Crouch A, Miulli DE. Thoracic Pedicle Screw Placement Utilizing Hands-On Training Session on Three-Dimensional Models. Cureus 2022; 14:e28544. [PMID: 36185942 PMCID: PMC9514153 DOI: 10.7759/cureus.28544] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Accepted: 08/28/2022] [Indexed: 11/05/2022] Open
Abstract
The utilization of three-dimensional (3D) models has been an important element of medical education. We demonstrate a three-dimensionally-printed (3DP) thoracic spine model for use in the teaching of freehand pedicle screw placement. Neurosurgical residents with varying years of experience practiced screw placement on these models. Residents were timed, and models were evaluated for medial and lateral breaches. Overall, this technical report describes the utility of 3D spine models in the training of thoracic pedicle screw placement. The tactile feedback from the 3D models was designed to represent both cortical and cancellous bones.
Collapse
|
13
|
Mantica G, Leonardi R, Diaz R, Malinaric R, Parodi S, Tappero S, Paraboschi I, Álvarez-Maestro M, Yuen-Chun Teoh J, Garriboli M, Ortega Polledo LE, Soriero D, Pertile D, De Marchi D, Pini GL, Rigatti L, Ghosh SK, Akanji Onigbinde O, Tafuri A, M Carrion D, Nikles S, Antoni A, Fransvea P, Esperto F, Herbella FA, Oxley da Rocha A, Vanaclocha V, Sánchez-Guillén L, Wainman B, Quiroga-Garza A, Fregatti P, Murelli F, Van der Merwe A, Rivas JG, Terrone C. Reporting ChAracteristics of cadaver training and sUrgical studies: The CACTUS guidelines. Int J Surg 2022; 101:106619. [PMID: 35429658 DOI: 10.1016/j.ijsu.2022.106619] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2022] [Revised: 03/17/2022] [Accepted: 04/08/2022] [Indexed: 11/10/2022]
|
14
|
Patel S, Alkadri S, Driscoll M. Development and Validation of a Mixed Reality Configuration of a Simulator for a Minimally Invasive Spine Surgery Using the Workspace of a Haptic Device and Simulator Users. BIOMED RESEARCH INTERNATIONAL 2021; 2021:2435126. [PMID: 35005014 PMCID: PMC8741356 DOI: 10.1155/2021/2435126] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/28/2021] [Accepted: 12/07/2021] [Indexed: 11/18/2022]
Abstract
Most surgical simulators leverage virtual or bench models to simulate reality. This study proposes and validates a method for workspace configuration of a surgical simulator which utilizes a haptic device for interaction with a virtual model and a bench model to provide additional tactile feedback based on planned surgical manoeuvers. Numerical analyses were completed to determine the workspace and position of a haptic device, relative to the bench model, used in the surgical simulator, and the determined configuration was validated using device limitations and user data from surgical and nonsurgical users. For the validation, surgeons performed an identical surgery on a cadaver prior to using the simulator, and their trajectories were then compared to the determined workspace for the haptic device. The configuration of the simulator was determined appropriate through workspace analysis and the collected user trajectories. Statistical analyses suggest differences in trajectories between the participating surgeons which were not affected by the imposed haptic workspace. This study, therefore, demonstrates a method to optimally position a haptic device with respect to a bench model while meeting the manoeuverability needs of a surgical procedure. The validation method identified workspace position and user trajectory towards ideal configuration of a mixed reality simulator.
Collapse
Affiliation(s)
- Sneha Patel
- Department of Mechanical Engineering, McGill University, MacDonald Engineering Building, 817 Rue Sherbrooke Ouest #270, Montréal, Québec, Canada H3A 0C3
| | - Sami Alkadri
- Department of Mechanical Engineering, McGill University, MacDonald Engineering Building, 817 Rue Sherbrooke Ouest #270, Montréal, Québec, Canada H3A 0C3
| | - Mark Driscoll
- Department of Mechanical Engineering, McGill University, MacDonald Engineering Building, 817 Rue Sherbrooke Ouest #270, Montréal, Québec, Canada H3A 0C3
| |
Collapse
|
15
|
Blohm JE, Salinas PA, Avila MJ, Barber SR, Weinand ME, Dumont TM. 3D Printing in Neurosurgery Residency Training: A Systematic Review of the Literature. World Neurosurg 2021; 161:111-122. [PMID: 34648984 DOI: 10.1016/j.wneu.2021.10.069] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2021] [Revised: 10/02/2021] [Accepted: 10/04/2021] [Indexed: 11/17/2022]
Abstract
BACKGROUND The use of 3-dimensional (3D) printing in neurosurgery has become more prominent in recent years for surgical training, preoperative planning and patient-education. Several smaller studies are available using 3D printing however there is a lack of a concise review. This article provides a systematic review of current 3D models in use by neurosurgical residents with emphasis on training, learning, and simulation. METHODS A structured literature search of PubMed and Embase was conducted using PRISMA guidelines to identify publications specific to 3D models trialed on neurosurgical residents. Criteria for eligibility included articles discussing only neurosurgery, 3D models in neurosurgery, and models specifically tested or trialed on residents. RESULTS Overall a total of 40 articles were identified that met inclusion criteria. These studies encompassed different neurosurgical areas including aneurysm, spine, craniosynostosis, transsphenoidal, craniotomy, skull base, and tumor. The majority of the articles were related to brain surgery. Of these studies, vascular surgery had the highest overall with 13 out of 40 articles which include aneurysm clipping and other neurovascular surgeries. Twenty-two discussed cranial plus tumor surgeries which included skull base, craniotomy, craniosynostosis and transsphenoidal. Lastly, 5 studies were specific to spine surgeries. Subjective outcome measures of neurosurgical residents were most commonly implemented, of which results were almost unanimously positive. CONCLUSION 3D printing technology is rapidly expanding in healthcare and neurosurgery in particular. The technology is quickly improving, and several studies have demonstrated the effectiveness of 3D printing for neurosurgical residency education and training.
Collapse
Affiliation(s)
- Jonathan E Blohm
- University of Arizona College of Medicine-Tucson, Tucson, Arizona, USA
| | | | - Mauricio J Avila
- Department of Neurosurgery, University of Arizona, Tucson, Arizona, USA
| | - Samuel R Barber
- Department of Otolaryngology-Head and Neck Surgery, University of Arizona, Tucson, Arizona, USA
| | - Martin E Weinand
- Department of Neurosurgery, University of Arizona, Tucson, Arizona, USA
| | - Travis M Dumont
- Department of Neurosurgery, University of Arizona, Tucson, Arizona, USA.
| |
Collapse
|
16
|
Liu PR, Lu L, Zhang JY, Huo TT, Liu SX, Ye ZW. Application of Artificial Intelligence in Medicine: An Overview. Curr Med Sci 2021; 41:1105-1115. [PMID: 34874486 PMCID: PMC8648557 DOI: 10.1007/s11596-021-2474-3] [Citation(s) in RCA: 65] [Impact Index Per Article: 21.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2020] [Accepted: 12/01/2020] [Indexed: 02/06/2023]
Abstract
Artificial intelligence (AI) is a new technical discipline that uses computer technology to research and develop the theory, method, technique, and application system for the simulation, extension, and expansion of human intelligence. With the assistance of new AI technology, the traditional medical environment has changed a lot. For example, a patient's diagnosis based on radiological, pathological, endoscopic, ultrasonographic, and biochemical examinations has been effectively promoted with a higher accuracy and a lower human workload. The medical treatments during the perioperative period, including the preoperative preparation, surgical period, and postoperative recovery period, have been significantly enhanced with better surgical effects. In addition, AI technology has also played a crucial role in medical drug production, medical management, and medical education, taking them into a new direction. The purpose of this review is to introduce the application of AI in medicine and to provide an outlook of future trends.
Collapse
Affiliation(s)
- Peng-ran Liu
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022 China
| | - Lin Lu
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022 China
| | - Jia-yao Zhang
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022 China
| | - Tong-tong Huo
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022 China
| | - Song-xiang Liu
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022 China
| | - Zhe-wei Ye
- Department of Orthopedics, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022 China
| |
Collapse
|
17
|
Scullen T, Mathkour M, Dumont A. Commentary: Virtual Reality Anterior Cervical Discectomy and Fusion Simulation on the Novel Sim-Ortho Platform: Validation Studies. Oper Neurosurg (Hagerstown) 2020; 20:E17-E19. [PMID: 32970133 DOI: 10.1093/ons/opaa285] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2020] [Accepted: 07/11/2020] [Indexed: 11/13/2022] Open
|
18
|
Bohl MA, Kakarla UK. In Reply: The Living Spine Model: A Biomimetic Surgical Training and Education Tool. Oper Neurosurg (Hagerstown) 2020; 19:E332. [DOI: 10.1093/ons/opaa166] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
|
19
|
Clifton W, Damon A, Nottmeier E. Letter: The Living Spine Model: A Biomimetic Surgical Training and Education Tool. Oper Neurosurg (Hagerstown) 2020; 19:E331. [PMID: 32503044 DOI: 10.1093/ons/opaa164] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022] Open
Affiliation(s)
- William Clifton
- Department of Neurological Surgery Mayo Clinic Florida Jacksonville, Florida
| | - Aaron Damon
- Department of Neurological Surgery Mayo Clinic Florida Jacksonville, Florida
| | - Eric Nottmeier
- Department of Neurological Surgery Mayo Clinic Florida Jacksonville, Florida
| |
Collapse
|
20
|
Clifton W, Damon A, Valero-Moreno F, Marenco-Hillembrand L, Nottmeier E, Tubbs RS, Fox WC, Pichelmann M. Investigation of the "Superior Facet Rule" Using 3D-Printed Thoracic Vertebrae With Simulated Corticocancellous Interface. World Neurosurg 2020; 143:e51-e59. [PMID: 32585384 DOI: 10.1016/j.wneu.2020.06.097] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2020] [Revised: 06/10/2020] [Accepted: 06/12/2020] [Indexed: 11/29/2022]
Abstract
BACKGROUND Pedicle screw placement is the most common method of fixation in the thoracic spine. Use of the "superior facet rule" allows the operator to locate the borders of the pedicle reliably using posterior landmarks alone. This study investigated the ability of 3-dimensionally (3D)-printed thoracic vertebrae, made from combined thermoplastic polymers, to demonstrate pedicle screw cannulation accurately using the superior facet as a reliable landmark. METHODS An anonymized computed tomography scan of the thoracic spine was obtained. The T1-T12 thoracic vertebrae were anatomically segmented and 3D-printed. The pedicle diameters and distance from the midpoint of the superior facet to the ventral lamina were recorded. A total of 120 thoracic pedicles in 60 thoracic vertebral models were instrumented using a freehand technique based only on posterior landmarks. The vertebral models were then coronally cut and examined for medial or lateral violations of the pedicle after screw placement. RESULTS A total of 120 pedicle screws were placed successfully within the 3D-printed thoracic vertebral models. Average measurements fell within 1 standard deviation of previous population studies. There were no pedicle wall violations using standard posterior element landmarks for instrumentation. There were 3 lateral violations of the vertebral body wall during screw placement, all attributable to the insertion technique. CONCLUSIONS 3D-printed thoracic vertebral models using combined thermoplastic polymers can accurately demonstrate the anatomical ultrastructure and posterior element relationships of the superior facet rule for safe thoracic pedicle screw placement. This method of vertebral model prototyping could prove useful for surgical education and demonstrating spinal anatomy.
Collapse
Affiliation(s)
- William Clifton
- Department of Neurological Surgery, Mayo Clinic Florida, Jacksonville, Florida, USA.
| | - Aaron Damon
- Department of Neurological Surgery, Mayo Clinic Florida, Jacksonville, Florida, USA
| | - Fidel Valero-Moreno
- Department of Neurological Surgery, Mayo Clinic Florida, Jacksonville, Florida, USA
| | | | - Eric Nottmeier
- Department of Neurological Surgery, Mayo Clinic Florida, Jacksonville, Florida, USA
| | - R Shane Tubbs
- Department of Neurosurgery and Structural and Cellular Biology, Tulane University School of Medicine, New Orleans, Louisiana, USA
| | - W Christopher Fox
- Department of Neurological Surgery, Mayo Clinic Florida, Jacksonville, Florida, USA
| | - Mark Pichelmann
- Department of Neurosurgery, Mayo Clinic Health Systems, Eau Claire, Wisconsin, USA
| |
Collapse
|
21
|
Clifton W, Damon A, Valero-Moreno F, Nottmeier E, Pichelmann M. The SpineBox: A Freely Available, Open-access, 3D-printed Simulator Design for Lumbar Pedicle Screw Placement. Cureus 2020; 12:e7738. [PMID: 32455058 PMCID: PMC7241219 DOI: 10.7759/cureus.7738] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
Abstract
Background The recent COVID-19 pandemic has demonstrated the need for innovation in cost-effective and easily produced surgical simulations for trainee education that are not limited by physical confines of location. This can be accomplished with the use of desktop three-dimensional (3D) printing technology. This study describes the creation of a low-cost and open-access simulation for anatomical learning and pedicle screw placement in the lumbar spine, which is termed the SpineBox. Materials and methods An anonymized CT scan of the lumbar spine was obtained and converted into 3D software files of the L1-L5 vertebral bodies. A computer-assisted design (CAD) software was used to assemble the vertebral models into a simulator unit in anatomical order to produce an easily prototyped simulator. The printed simulator was layered with foam in order to replicate soft tissue structures. The models were instrumented with pedicle screws using standard operative technique and examined under fluoroscopy. Results Ten SpineBoxes were created using a single desktop 3D printer, with accurate replication of the cortico-cancellous interface using previously validated techniques. The models were able to be instrumented with pedicle screws successfully and demonstrated quality representation of bony structures under fluoroscopy. The total cost of model production was under $10. Conclusion The SpineBox represents the first open-access simulator for the instruction of spinal anatomy and pedicle screw placement. This study aims to provide institutions across the world with an economical and feasible means of spine surgical simulation for neurosurgical trainees and to encourage other rapid prototyping laboratories to investigate innovative means of creating educational surgical platforms in the modern era.
Collapse
Affiliation(s)
| | - Aaron Damon
- Neurological Surgery, Mayo Clinic, Jacksonville, USA
| | | | | | | |
Collapse
|
22
|
Clifton W, Damon A. The three‐dimensional printing renaissance of individualized anatomical modeling: Are we repeating history? Clin Anat 2020; 33:428-430. [DOI: 10.1002/ca.23545] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2019] [Accepted: 12/12/2019] [Indexed: 12/12/2022]
Affiliation(s)
- William Clifton
- Department of Neurological SurgeryMayo Clinic Florida Jacksonville Florida
| | - Aaron Damon
- Department of Neurological SurgeryMayo Clinic Florida Jacksonville Florida
| |
Collapse
|