1
|
La Raja C, Carvello M, Patti R, Siragusa L, Foppa C, Spinelli A. Immersive reality for robotic surgical training: a pilot study using 3D visors for immersive view of the operating field. J Robot Surg 2024; 18:267. [PMID: 38916774 DOI: 10.1007/s11701-024-02018-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2024] [Accepted: 06/12/2024] [Indexed: 06/26/2024]
Abstract
Immersive intracorporeal vision is a key feature of robotic surgery, limited today to only one trainee per operation when the dual console is available. We developed a tool that provides a virtually unlimited number of surgeons with the operator's view, with the possibility to also watch the surgeon's hand movements and the operating table. In this study, we aim to assess trainees' reaction to this innovative training method. Medical students and surgery residents were offered an immersive experience with head-mounted devices, showing a didactic video in a 360° virtual space with 3D intracorporeal robotic vision, the surgeon's hand movements and the surrounding operating room during a robotic rectal resection with total mesorectal excision. Subsequently, participants were asked to fill a questionnaire evaluating the user's reaction to the new training tool including the validated System Usability Scale (SUS) and Simulator Sickness Questionnaire (SSQ), and non-validated questions. 102 participants took part in the training and the assessment questionnaires, 94 (92%) medical students and 8 (8%) surgery residents. Users' feedback was overall positive. In the engagement and intention to use items, almost 90% of the respondents voted for a complete or near complete agreement. The median SUS score was 80 [IQR 70-90]. The median SSQ score was 44.88 [IQR 22.44-82.28]. Exposing trainees to immersive robotic vision of the surgical field had a positive reaction from our audience. Our initial results encourage further implementing this technology in surgical training of medical students and residents to prove its efficacy.
Collapse
Affiliation(s)
- Carlotta La Raja
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, 20072, Pieve Emanuele, Milan, Italy
- Division of Colon and Rectal Surgery, IRCCS Humanitas Research Hospital, Via Manzoni 56, 20089, Rozzano, Milan, Italy
| | - Michele Carvello
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, 20072, Pieve Emanuele, Milan, Italy
- Division of Colon and Rectal Surgery, IRCCS Humanitas Research Hospital, Via Manzoni 56, 20089, Rozzano, Milan, Italy
| | - Riccardo Patti
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, 20072, Pieve Emanuele, Milan, Italy
| | - Leandro Siragusa
- Division of Colon and Rectal Surgery, IRCCS Humanitas Research Hospital, Via Manzoni 56, 20089, Rozzano, Milan, Italy
| | - Caterina Foppa
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, 20072, Pieve Emanuele, Milan, Italy
- Division of Colon and Rectal Surgery, IRCCS Humanitas Research Hospital, Via Manzoni 56, 20089, Rozzano, Milan, Italy
| | - Antonino Spinelli
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, 20072, Pieve Emanuele, Milan, Italy.
- Division of Colon and Rectal Surgery, IRCCS Humanitas Research Hospital, Via Manzoni 56, 20089, Rozzano, Milan, Italy.
| |
Collapse
|
2
|
Behera K, McKenna M, Smith L, McKnight G, Horwood J, Davies MM, Torkington J, Ansell J. Transferring laparoscopic skills to robotic-assisted surgery: a systematic review. J Robot Surg 2024; 18:11. [PMID: 38214801 DOI: 10.1007/s11701-023-01757-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2023] [Accepted: 11/15/2023] [Indexed: 01/13/2024]
Abstract
Robotic-Assisted Surgery (RAS) is experiencing rapid expansion, prompting the integration of robotic technical skills training into surgical education programs. As access to robotic training platforms remains limited, it is important to investigate the transferability of laparoscopic skills to RAS. This could potentially support the inclusion of early years laparoscopic training to mitigate the learning curve associated with robotic surgery. This study aims to assess the transferability of laparoscopic skills to robotic surgery. A systematic search was conducted using the PRISMA checklist to identify relevant articles. PubMed, MEDLINE, Embase, and Cochrane databases were searched, and inclusion and exclusion criteria were applied to collate eligible articles. Included were original articles comparing the performance of comparable tasks on both laparoscopic and robotic platforms written in English. Non-peer reviewed papers, conference abstracts, reviews, and case series were excluded. Seventeen articles met the inclusion criteria. Among these, 10 studies (59%) demonstrated skill transferability from laparoscopic surgery (LS) to robotic surgery (RS); while one study (5.8%) showed no significant transferability. Four studies highlighted the positive impact of prior laparoscopic training on robotic skill, whereas six papers suggested no significant difference between laparoscopic novices and experienced laparoscopists when utilizing a robotic simulator. Five studies evaluated advanced surgical skills such as intracorporeal knot tying and suturing, revealing superior robotic performance among experienced laparoscopists compared to novice learners. Laparoscopic skills appear to be transferrable to robotic surgery, particularly in complex surgical techniques. Robotic simulators demonstrate a significant reduction in the learning curve for surgical novices, albeit to a lesser extent for experienced laparoscopists.
Collapse
Affiliation(s)
- Karishma Behera
- NHS Lothian, Waverley Gate, 2-4 Waterloo Place, Edinburgh, EH1 3EG, UK
| | - Matthew McKenna
- University Hospital of Wales, Heath Park, Cardiff, CF14 4XN, Wales, UK
| | - Laurie Smith
- University Hospital of Wales, Heath Park, Cardiff, CF14 4XN, Wales, UK
| | - Gerard McKnight
- Health Education and Improvement Wales (HEIW), Cardiff, Wales, UK
| | - James Horwood
- University Hospital of Wales, Heath Park, Cardiff, CF14 4XN, Wales, UK
| | - Michael M Davies
- University Hospital of Wales, Heath Park, Cardiff, CF14 4XN, Wales, UK
| | - Jared Torkington
- University Hospital of Wales, Heath Park, Cardiff, CF14 4XN, Wales, UK
| | - James Ansell
- University Hospital of Wales, Heath Park, Cardiff, CF14 4XN, Wales, UK.
| |
Collapse
|
3
|
Pietersen PI, Hertz P, Olsen RG, Møller LB, Konge L, Bjerrum F. Transfer of skills between laparoscopic and robot-assisted surgery: a systematic review. Surg Endosc 2023; 37:9030-9042. [PMID: 37875694 DOI: 10.1007/s00464-023-10472-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Accepted: 09/17/2023] [Indexed: 10/26/2023]
Abstract
BACKGROUND Robot-assisted surgery is today well-implemented in many surgical specialties, but requires another skill set than laparoscopy. Most often, robot-assisted surgery is considered add-on to laparoscopic skills but very little is known about the transfer of skills. The aim of the study was to examine to what extent surgical skills are transferable between laparoscopic and robot-assisted surgery. METHODS A systematic search was conducted in three databases (Ovid Medline, Embase, and Web of Science). Studies investigating transfer of skills between laparoscopy and robot-assisted surgery in either a phantom-based, simulation-based, animal model, or clinical setting were eligible for inclusion. Quality assessment was done using the Medical education research study quality instrument and educational New Ottawa Scale. RESULTS Of 15,610 studies identified, 89 studies continued to full-text reading, and 37 studies were included. Four studies were found non-comparable and were left out of the results for the primary outcome. All 33 studies explored transfer from laparoscopy to robot-assisted surgery and 17 found a positive transfer whereas 15 did not. Only 11 studies explored transfer from robot-assisted surgery to laparoscopy, of which only three found a positive transfer. CONCLUSION An almost equal number of publications found a positive transfer and no transfer from laparoscopic to robot-assisted surgery. Fewer studies explored the transfer from robot-assisted surgery to laparoscopy. Very little evidence supports that surgeons trained solely in robot-assisted surgery can perform laparoscopy. This must be considered in future training programs as robot-assisted surgery is expected to become the first-in-line modality for many future surgeons.
Collapse
Affiliation(s)
- Pia Iben Pietersen
- Department of Radiology, Odense University Hospital, Kløvervænget 10, Entrance 112, 2nd floor, 5000, Odense C, Denmark.
- Simulation Center (SimC), Odense University Hospital, Odense, Denmark.
| | - Peter Hertz
- Department of Surgery, Hospital Lillebaelt, University of Southern Denmark, Kolding, Denmark
| | - Rikke Groth Olsen
- Copenhagen Prostate Cancer Center, Rigshospitalet, Copenhagen, Denmark
- Center for HR & Education, The Capital Region of Denmark, Copenhagen Academy for Medical Education and Simulation (CAMES), Copenhagen, Denmark
| | - Louise Birch Møller
- Center for HR & Education, The Capital Region of Denmark, Copenhagen Academy for Medical Education and Simulation (CAMES), Copenhagen, Denmark
| | - Lars Konge
- Center for HR & Education, The Capital Region of Denmark, Copenhagen Academy for Medical Education and Simulation (CAMES), Copenhagen, Denmark
- University of Copenhagen, Copenhagen, Denmark
| | - Flemming Bjerrum
- Center for HR & Education, The Capital Region of Denmark, Copenhagen Academy for Medical Education and Simulation (CAMES), Copenhagen, Denmark
- Department of Gastrointestinal and Hepatic Diseases, Copenhagen University Hospital - Herlev and Gentofte, Herlev, Denmark
| |
Collapse
|
4
|
Tonbul G, Topalli D, Cagiltay NE. A systematic review on classification and assessment of surgical skill levels for simulation-based training programs. Int J Med Inform 2023; 177:105121. [PMID: 37290214 DOI: 10.1016/j.ijmedinf.2023.105121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Revised: 05/29/2023] [Accepted: 06/02/2023] [Indexed: 06/10/2023]
Abstract
BACKGROUND Nowadays, advances in medical informatics have made minimally invasive surgery (MIS) procedures the preferred choice. However, there are several problems with the education programs in terms of surgical skill acquisition. For instance, defining and objectively measuring surgical skill levels is a challenging process. Accordingly, the aim of this study is to conduct a literature review for an investigation of the current approaches for classifying the surgical skill levels and for identifying the skill training tools and measurement methods. MATERIALS AND METHODS In this research, a search is conducted and a corpus is created. Exclusion and inclusion criteria are applied by limiting the number of articles based on surgical education, training approximations, hand movements, and endoscopic or laparoscopic operations. To satisfy these criteria, 57 articles are included in the corpus of this study. RESULTS Currently used surgical skill assessment approaches have been summarized. Results show that various classification approaches for the surgical skill level definitions are being used. Besides, many studies are conducted by omitting particularly important skill levels in between. Additionally, some inconsistencies are also identified across the skill level classification studies. CONCLUSION In order to improve the benefits of simulation-based training programs, a standardized interdisciplinary approach should be developed. For this reason, specific to each surgical procedure, the required skills should be identified. Additionally, appropriate measures for assessing these skills, which can be defined in simulation-based MIS training environments, should be refined. Finally, the skill levels gained during the developmental stages of these skills, with their threshold values referencing the identified measures, should be redefined in a standardized manner.
Collapse
Affiliation(s)
- Gokcen Tonbul
- Graduate School of Natural and Applied Sciences, Atilim University, Ankara, Turkey; Strategy and Technology Research Center, Baskent University, Ankara, Turkey.
| | - Damla Topalli
- Department of Computer Engineering, Atilim University, Ankara, Turkey
| | | |
Collapse
|
5
|
Rahimi AO, Ho K, Chang M, Gasper D, Ashouri Y, Dearmon-Moore D, Hsu CH, Ghaderi I. A systematic review of robotic surgery curricula using a contemporary educational framework. Surg Endosc 2022; 37:2833-2841. [PMID: 36481821 DOI: 10.1007/s00464-022-09788-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2022] [Accepted: 11/27/2022] [Indexed: 12/13/2022]
Abstract
BACKGROUND There has been a rising trend in robotic surgery. Thus, there is demand for a robotic surgery curriculum (RSC) for training surgical trainees and practicing surgeons. There are limited data available about current curricular designs and the extent to which they have incorporated educational frameworks. Our aim was to study the existing robotic surgery curricula using Kern's 6-step approach in curriculum development. METHODS A systematic review was conducted using PubMed, PubMed Central, Cochrane, Embase, and Scopus (we searched studies from 2001 to 2021). PRISMA Guidelines was used to guide the search. Curriculum designed for general surgery and its subspecialties were included. Urology and gynecology were excluded. The articles were reviewed by five reviewers. RESULTS Our review yielded 71 articles, including 39 curricula at 9 different settings. Using Kern's framework, we demonstrated that the majority of robotic surgery curricula contained all the elements of Kern's curricular design. However, there were significant deficiencies in important aspects of these curricula i.e., implementation, the quality of assessment tools for measurement of performance and evaluation of the educational value of these interventions. Most institutions used commercial virtual reality simulators (VRS) as the main component of their RSC and 23% of curricula only used VRS. CONCLUSIONS Although majority of these studies contained all the elements of Kern's framework, there are critical deficiencies in the components of existing curricula. Future curricula should be designed using established educational frameworks to improve the quality of robotic surgery training.
Collapse
|
6
|
Transfer of open and laparoscopic skills to robotic surgery: a systematic review. J Robot Surg 2022:10.1007/s11701-022-01492-9. [PMID: 36418717 PMCID: PMC10374669 DOI: 10.1007/s11701-022-01492-9] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2022] [Accepted: 11/12/2022] [Indexed: 11/25/2022]
Abstract
AbstractDue to its advantages over open surgery and conventional laparoscopy, uptake of robot-assisted surgery has rapidly increased. It is important to know whether the existing open or laparoscopic skills of robotic novices shorten the robotic surgery learning curve, potentially reducing the amount of training required. This systematic review aims to assess psychomotor skill transfer to the robot in clinical and simulated settings. PubMed, EMBASE, Cochrane Library and Scopus databases were systematically searched in accordance with PRISMA guidelines from inception to August 2021 alongside website searching and citation chaining. Article screening, data extraction and quality assessment were undertaken by two independent reviewers. Outcomes included simulator performance metrics or in the case of clinical studies, peri- and post-operative metrics. Twenty-nine studies met the eligibility criteria. All studies were judged to be at high or moderate overall risk of bias. Results were narratively synthesised due to heterogeneity in study designs and outcome measures. Two of the three studies assessing open surgical skill transfer found evidence of successful skill transfer while nine of twenty-seven studies evaluating laparoscopic skill transfer found no evidence. Skill transfer from both modalities is most apparent when advanced robotic tasks are performed in the initial phase of the learning curve but quality and methodological limitations of the existing literature prevent definitive conclusions. The impact of incorporating laparoscopic simulation into robotic training curricula and on the cost effectiveness of training should be investigated.
Collapse
|
7
|
Madion MP, Kastenmeier A, Goldblatt MI, Higgins RM. Robotic surgery training curricula: prevalence, perceptions, and educational experiences in general surgery residency programs. Surg Endosc 2022; 36:6638-6646. [PMID: 35001224 DOI: 10.1007/s00464-021-08930-z] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2021] [Accepted: 11/22/2021] [Indexed: 10/19/2022]
Abstract
BACKGROUND Utilization of robotics in general surgery has increased exponentially in the past decade. The purpose of this study was to provide an updated analysis of the prevalence of robotic training curricula among general surgery residency programs across the United States. METHODS A 19-item survey was distributed to program directors of the Association of Program Directors in Surgery email list. The survey focused on the programs' demographics, program directors' opinions of robotic surgery, and status of robotic surgery curricula. Data was compiled and analyzed using Qualtrics Survey Software, Microsoft Excel and IBM SPSS. Chi-Squared statistical significance was defined as a p value of < 0.05. RESULTS Of the 280 program directors, 107 (38.2%) responded. Overall, 75 (70%) residency programs provided a formal robotic surgery curriculum. Regarding the importance of robotics to general surgery training, 67 (89%) programs that provided a formal robotic surgery curriculum stated it was either 'Very important' or 'Probably important' as opposed to 23 (72%) programs that did not offer a formal robotic surgery curriculum (p = 0.017). 73 of the 75 residency programs with a formal robotic surgery training curriculum answered the curriculum specific questions. 58 (79%) had been present for 3 years or less. Bedside assisting began in 62 (85%) programs as a post-graduate year (PGY) 1 or PGY2 and residents began operating on the console as a PGY2 or PGY3 in 53 (72%) programs. However, there was variability regarding the percentage of the case a senior resident actually operated on the robotic console. CONCLUSIONS A majority of general surgery residency programs offer formal robotic surgery curricula and have been present for 3 years or less. Most residencies begin their curricula in PGY1 or PGY2 year, with an opportunity to bedside assist and operate on the robotic console in the first 3 years of residency. Operative barriers and defined milestones for general surgery trainees need to be identified.
Collapse
Affiliation(s)
- Matthew P Madion
- Medical College of Wisconsin, 8701 W Watertown Plank Rd, Wauwatosa, WI, 53226, USA
| | - Andrew Kastenmeier
- Medical College of Wisconsin, 8701 W Watertown Plank Rd, Wauwatosa, WI, 53226, USA
| | - Matthew I Goldblatt
- Medical College of Wisconsin, 8701 W Watertown Plank Rd, Wauwatosa, WI, 53226, USA
| | - Rana M Higgins
- Medical College of Wisconsin, 8701 W Watertown Plank Rd, Wauwatosa, WI, 53226, USA.
| |
Collapse
|
8
|
Green CA, Lin J, Higgins R, O'Sullivan PS, Huang E. Expertise in perception during robotic surgery (ExPeRtS): What we see and what we say. Am J Surg 2022; 224:908-913. [DOI: 10.1016/j.amjsurg.2022.05.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Revised: 03/23/2022] [Accepted: 05/06/2022] [Indexed: 11/01/2022]
|
9
|
Kanitra JJ, Khogali-Jakary N, Gambhir SB, Davis AT, Hollis M, Moon C, Gupta R, Haan PS, Anderson C, Collier D, Henry D, Kavuturu S. Transference of skills in robotic vs. laparoscopic simulation: a randomized controlled trial. BMC Surg 2021; 21:379. [PMID: 34711220 PMCID: PMC8554974 DOI: 10.1186/s12893-021-01385-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Accepted: 10/18/2021] [Indexed: 11/15/2022] Open
Abstract
BACKGROUND Elucidating how robotic skills are best obtained will enable surgeons to best develop future robotic training programs. We perform a randomized controlled trial to assess the performance of robotic compared to laparoscopic surgery, transference of pre-existing skills between the two modalities, and to assess the learning curve between the two using novice medical students. METHODS Forty students were randomized into either Group A or B. Students practiced and were tested on a peg transfer task in either a laparoscopic simulator (LS) and robotic simulator (RS) in a pre-defined order. Performance, transference of skills and learning curve were assessed for each modality. Additionally, a fatigue questionnaire was issued. RESULTS There was no significant difference between overall laparoscopic scores (219 ± 19) and robotic scores (227 ± 23) (p = 0.065). Prior laparoscopic skills performed significantly better on robotic testing (236 ± 12) than without laparoscopic skills (216 ± 28) (p = 0.008). There was no significant difference in scores between students with prior robotic skills (223 ± 16) than without robotic skills (215 ± 22) (p = 0.162). Students reported no difference in fatigue between RS and LS. The learning curve plateaus at similar times between both modalities. CONCLUSION Novice medical students with laparoscopic skills performed better on a RS test than students without laparoscopic training, suggesting a transference of skills from laparoscopic to robotic surgery. These results suggest laparoscopic training may be sufficient in general surgery residencies as the skills transfer to robotic if used post-residency.
Collapse
Affiliation(s)
- John J Kanitra
- Department of Surgery, Ascension St. John Hospital, Detroit, MI, 48236, USA
| | - Nashwa Khogali-Jakary
- Department of Surgery, Michigan State University College of Human Medicine, 1200 E. Michigan Ave, Suite 655, Lansing, MI, 48912, USA
| | - Sahil B Gambhir
- Department of General Surgery, University of California, Irvine Medical Center, Orange, CA, 92868, USA
| | - Alan T Davis
- Department of Surgery, Michigan State University College of Human Medicine, 1200 E. Michigan Ave, Suite 655, Lansing, MI, 48912, USA
| | - Michael Hollis
- Department of Surgery, Michigan State University College of Human Medicine, 1200 E. Michigan Ave, Suite 655, Lansing, MI, 48912, USA
| | - Caroline Moon
- Department of Surgery, Michigan State University College of Human Medicine, 1200 E. Michigan Ave, Suite 655, Lansing, MI, 48912, USA
| | - Rama Gupta
- Department of Surgery, Michigan State University College of Human Medicine, 1200 E. Michigan Ave, Suite 655, Lansing, MI, 48912, USA
| | - Pamela S Haan
- Department of Surgery, Michigan State University College of Human Medicine, 1200 E. Michigan Ave, Suite 655, Lansing, MI, 48912, USA
| | - Cheryl Anderson
- Department of Surgery, Michigan State University College of Human Medicine, 1200 E. Michigan Ave, Suite 655, Lansing, MI, 48912, USA
| | - Deborah Collier
- Department of Surgery, Michigan State University College of Human Medicine, 1200 E. Michigan Ave, Suite 655, Lansing, MI, 48912, USA
| | - David Henry
- Montefiore Medical Center, Bronx, NY, 10467, USA
| | - Srinivas Kavuturu
- Department of Surgery, Michigan State University College of Human Medicine, 1200 E. Michigan Ave, Suite 655, Lansing, MI, 48912, USA.
| |
Collapse
|
10
|
Türkay S, Letheren K, Crawford R, Roberts J, Jaiprakash AT. The effects of gender, age, and videogame experience on performance and experiences with a surgical robotic arm: an exploratory study with general public. J Robot Surg 2021; 16:621-629. [PMID: 34312804 DOI: 10.1007/s11701-021-01287-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2021] [Accepted: 07/20/2021] [Indexed: 11/24/2022]
Abstract
Robotic surgery is increasing in prevalence, thanks to its potential benefits for patients (e.g., reduced blood loss) and surgeons (e.g., ergonomics). It is important to know what inherent characteristics of potential surgeons may facilitate robotic surgery training and performance. Findings from previous studies indicate videogames can be inexpensive tools that help improve hand-eye coordination, coordination of 3-D movements with 2-D images, and spatial orientation. In the context of robotic-assisted knee arthroscopy using a MAKO robotic arm, this study explored performance and subjective experiences of novices (N = 104) with a fake bone shaving task at a public event. Participants' performance was measured based on how much of the bone they successfully shaved. Findings showed that duration of videogame play per week was negatively related to performance with the robotic arm. Male and female participants performed similarly on the bone shaving task, and reported similar difficulty with and enjoyment of the task. However, female participants who played videogames performed better than those who did not play videogames. Participants who were younger than 11 had the worst performance and the most difficulty with the robotic arm. Overall, the findings indicate that the effect of videogame experience on the performance with the robotic arm may differ based on gender and age. This has implications on the length of training for surgeons of different gender using videogames and other emerging technologies.
Collapse
Affiliation(s)
- Selen Türkay
- School of Computer Science, Queensland University of Technology, Brisbane, QLD, Australia
| | - Kate Letheren
- Centre for Behavioural Economics, Society and Technology, Queensland University of Technology, Brisbane, QLD, Australia
| | - Ross Crawford
- Centre for Biomedical Technologies (CBT), Queensland University of Technology, Brisbane, QLD, Australia
| | - Jonathan Roberts
- School of Electrical Engineering and Robotics, Queensland University of Technology, Brisbane, QLD, Australia
| | - Anjali Tumkur Jaiprakash
- Centre for Biomedical Technologies (CBT), Queensland University of Technology, Brisbane, QLD, Australia.
- Faculty of Health, School of Clinical Sciences, Queensland University of Technology, Brisbane, QLD, Australia.
| |
Collapse
|
11
|
Introduction of robotic surgery does not negatively affect cardiothoracic surgery resident experience. J Robot Surg 2021; 16:393-400. [PMID: 34024007 DOI: 10.1007/s11701-021-01255-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2021] [Accepted: 05/17/2021] [Indexed: 10/21/2022]
Abstract
The objective of this study was to evaluate the educational impact following the implementation of a robotic thoracic surgery program on cardiothoracic (CT) surgery trainees. We hypothesized that the introduction of a robotic thoracic surgery program would adversely affect the CT surgery resident experience, decreasing operative involvement and subsequent competency of surgical procedures. CT surgery residents and thoracic surgery attendings from a single academic institution were administered a recurring, electronic survey from September 2019 to September 2020 following each robotic thoracic surgery case. Surveys evaluated resident involvement and operative performance. This study was exempt from review by our Institutional Review Board. Attendings and residents completed surveys for 86 and 75 cases, respectively. Residents performed > 50% of the operation independently at the surgeon console in 66.2 and 73.3% of cases according to attending and resident responses, respectively. The proportion of trainees able to perform > 75% of the operation increased with each increasing year in training (p = 0.002). Based on the Global Evaluative Assessment of Robotic Skills grading tool, third-year residents averaged higher scores compared to first-year residents (22.9 versus 17.4 out of 30 possible points, p < 0.001), indicating that more extensive prior operative experience could shorten the learning curve of robotic thoracic surgery. CT surgery residents remain actively involved in an operative role during the establishment of a robotic thoracic surgery program. The transition to a robotic thoracic surgery platform appears feasible in a large academic setting without jeopardizing the educational experience of resident trainees.
Collapse
|
12
|
Urdiales AIA, Struck GT, Guetter CR, Yaegashi CH, Temperly KS, Abreu P, Tomasich FS, Campos ACL. Surgical cricothyroidostomy. Analysis and comparison between teaching and validation models of simulator models. ACTA ACUST UNITED AC 2020; 47:e20202522. [PMID: 32520132 DOI: 10.1590/0100-6991e-20202522] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2020] [Accepted: 03/26/2020] [Indexed: 12/18/2022]
Abstract
OBJECTIVE to compare the acquisition and retention of knowledge about surgical cricothyroidostomy by the rapid four-step technique (RFST), when taught by expository lecture, low fidelity and high-fidelity simulation models. METHODS ninety medical students at UFPR in the first years of training were randomized assigned into 3 groups, submitted to different teaching methods: 1) expository lectures, 2) low-fidelity simulator model, developed by the research team or 3) high-fidelity simulator model (commercial). The procedure chosen was surgical cricothyroidostomy using the RFST. Soon after lectures, the groups were submitted to a multiple-choice test with 20 questions (P1). Four months later, they underwent another test (P2) with similar content. Analysis of Variance was used to compare the grades of each group in P1 with their grades in P2, and the grades of the 3 groups 2 by 2 in P1 and P2. A multiple comparisons test (post-hoc) was used to check differences within each factor (test and group). Statistical significance was considered when p<0.05. Statistical analysis was performed in the statistical software R version 3.6.1. RESULTS each group was composed of 30 medical students, without demographic differences between them. The mean scores of the groups of the expositive lecture, of the simulator of low fidelity model and of high-fidelity simulator model in P1 were, respectively, 75.00, 76.09, and 68.79, (p<0.05). In P2 the grades were 69.84, 75.32, 69.46, respectively, (p>0.05). CONCLUSIONS the simulation of low fidelity model was more effective in learning and knowledge retention, being feasible for RFST cricothyroidostomy training in inexperienced students.
Collapse
Affiliation(s)
- Akihito Inca Atahualpa Urdiales
- - Hospital do Trabalhador/Federal University of Paraná, Department of Integrated Medicine - Curitiba - PR - Brazil.,- Hospital do Trabalhador/Federal University of Paraná, Department of Surgery - Curitiba - PR - Brazil.,- Federal University of Paraná, Postgraduate Program in Surgical Clinic - Curitiba - PR - Brazil
| | | | | | - Cecilia Hissai Yaegashi
- - Cajuru University Hospital- Pontifical Catholic University of Paraná, Department of Surgery - Curitiba - PR - Brazil
| | - Kassio Silva Temperly
- - Pontifical Catholic University of Paraná, Course of Medicina - Curitiba - PR - Brazil
| | - Phillipe Abreu
- - Hospital do Trabalhador/Federal University of Paraná, Department of Surgery - Curitiba - PR - Brazil
| | - Flavio Saavedra Tomasich
- - Hospital do Trabalhador/Federal University of Paraná, Department of Surgery - Curitiba - PR - Brazil.,- Federal University of Paraná, Department of Surgery - Curitiba - PR - Brazil
| | - Antônio Carlos Ligocki Campos
- - Federal University of Paraná, Postgraduate Program in Surgical Clinic - Curitiba - PR - Brazil.,- Federal University of Paraná, Department of Surgery - Curitiba - PR - Brazil
| |
Collapse
|
13
|
Higgins RM, O'Sullivan P. The Robotic Surgery Learning Experience Through the Eyes of the Medical Student: What Do They See? JOURNAL OF SURGICAL EDUCATION 2020; 77:549-556. [PMID: 31959582 DOI: 10.1016/j.jsurg.2019.12.011] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/17/2019] [Revised: 09/16/2019] [Accepted: 12/21/2019] [Indexed: 05/24/2023]
Abstract
INTRODUCTION Robotic technology has an increasing prevalence in the operating room across various specialties. How this technology influences the learning of medical students has yet to be identified. The purpose of this study is to identify the impact of robotic surgery on medical student learning in the operating room. METHODS Medical students at the Medical College of Wisconsin who had completed their core clinical clerkships and were exposed to robotic surgery qualified for the study. An email survey was sent to all fourth year medical students requesting volunteers to be interviewed. During the 30-minute interviews, students responded to open-ended questions about their experiences with robotic surgery. The interviews were transcribed, codes were identified using an inductive approach, and themes were generated. RESULTS Overall 10 interviews were conducted: 4 females and 6 males. No new themes were identified after the seventh interview. Through the medical student interviews, 4 themes emerged regarding the influence of robotic surgery on medical student learning: the robot itself, enhanced learning through the robotic technology, the medical student learning experience, and how others influence the medical student learning environment. CONCLUSIONS The robotic operating room is not currently a motivating learning environment for medical students. However, by providing a more effective curriculum for students, incorporating elements of orientation, legitimate roles of participation, and simulation, students may gain a learning benefit from this technology versus avoiding the technology altogether. Additionally, it is important to educate faculty and residents on better ways to incorporate students into the robotic operating room environment to ensure an optimal learning experience.
Collapse
Affiliation(s)
- Rana M Higgins
- Division of General Surgery, Department of Surgery, Medical College of Wisconsin, Milwaukee, Wisconsin.
| | - Patricia O'Sullivan
- Center for Faculty Educators, School of Medicine and Department of Surgery, University of California at San Francisco, San Francisco, California
| |
Collapse
|
14
|
The impact of tiredness on virtual reality robotic surgical skills. Wideochir Inne Tech Maloinwazyjne 2020; 15:298-304. [PMID: 32489490 PMCID: PMC7233167 DOI: 10.5114/wiitm.2020.93201] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2020] [Accepted: 01/27/2020] [Indexed: 12/19/2022] Open
Abstract
Introduction The effect of tiredness has been proved for the surgeons’ musculature performing laparoscopic or robotic procedures (physical stress). Mental stress after robotic surgery has been reported as well. It is still unclear how much the surgical skills are altered and which types of skills are more affected at the final steps of long, complex robotic surgical procedures. Aim To evaluate to what extent the surgeon’s skills are influenced by long procedures, using the objective assessment of different surgical skills by a virtual reality robotic simulator. Material and methods Fifteen surgeons were asked to perform a continuous 4 h virtual robotic surgical simulator training session. At the beginning of simulator training and at the end of each of the 4 h of training, three exercises of increasing difficulty were selected to be performed in order to assess the surgeons’ skills. Results There were statistically significant differences between the initial and final overall scores for all the three exercises, the final outcomes being inferior. The specific metrics for each exercise slightly improved within 1 h from the beginning and thereafter decreased to a statistically significantly inferior value. Conclusions The specific metrics on the virtual reality robotic surgical simulator were altered after a 4-hour console training period. Further larger and more complex studies are necessary to evaluate the translation from the simulator to real-life robotic surgery.
Collapse
|
15
|
Cho NJ, Lee SH, Suh IH, Kim HS. Relationship Between the Order for Motor Skill Transfer and Motion Complexity in Reinforcement Learning. IEEE Robot Autom Lett 2019. [DOI: 10.1109/lra.2018.2889026] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
16
|
Lee C, Wong GKC. Virtual reality and augmented reality in the management of intracranial tumors: A review. J Clin Neurosci 2019; 62:14-20. [PMID: 30642663 DOI: 10.1016/j.jocn.2018.12.036] [Citation(s) in RCA: 34] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2018] [Accepted: 12/22/2018] [Indexed: 01/19/2023]
Abstract
Neurosurgeons are faced with the challenge of planning, performing, and learning complex surgical procedures. With improvements in computational power and advances in visual and haptic display technologies, augmented and virtual surgical environments can offer potential benefits for tests in a safe and simulated setting, as well as improve management of real-life procedures. This systematic literature review is conducted in order to investigate the roles of such advanced computing technology in neurosurgery subspecialization of intracranial tumor removal. The study would focus on an in-depth discussion on the role of virtual reality and augmented reality in the management of intracranial tumors: the current status, foreseeable challenges, and future developments.
Collapse
Affiliation(s)
- Chester Lee
- Division of Neurosurgery, Department of Surgery, The Chinese University of Hong Kong, Hong Kong Special Administrative Region
| | - George Kwok Chu Wong
- Division of Neurosurgery, Department of Surgery, The Chinese University of Hong Kong, Hong Kong Special Administrative Region.
| |
Collapse
|
17
|
Pimentel M, Cabral RD, Costa MM, Neto BS, Cavazzola LT. Does Previous Laparoscopic Experience Influence Basic Robotic Surgical Skills? JOURNAL OF SURGICAL EDUCATION 2018; 75:1075-1081. [PMID: 29191757 DOI: 10.1016/j.jsurg.2017.11.005] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/18/2017] [Revised: 10/19/2017] [Accepted: 11/16/2017] [Indexed: 06/07/2023]
Abstract
OBJECTIVE Studies addressing the effect of laparoscopic experience on robotic skills have produced conflicting results. This study aimed to compare simulated robotic surgical tasks using the virtual reality simulator dV-Trainer between laparoscopically experienced surgeons and first-year surgical residents. DESIGN A cross-sectional study. Participants completed 4 trials of the following tasks on the dV-Trainer: Peg Board 2, Ring and Rail 1, and Suture Sponge 1. Performance was recorded using a computerized built-in scoring algorithm. Scores and metrics were compared between groups 1 and 2 and between the first and subsequent trials. SETTING Hospital de Clínicas, Porto Alegre, Brazil, a tertiary care teaching hospital. PARTICIPANTS Twenty laparoscopically experienced surgeons (group 1) and 20 first-year surgical residents (group 2). All participants completed the study. RESULTS The overall scores for Peg Board 2 (738.04 ± 267.83 vs 730.39 ± 225.31; p = 0.57), Ring and Rail 1 (919.03 ± 242.69 vs 965.84 ± 222.96; p = 0.13), and Suture Sponge 1 (563.62 ± 185.50 vs 560.99 ± 152.71; p = 0.67) did not differ significantly between groups 1 and 2. Group 1 had better results for master workspace range in Peg Board 2 and Ring and Rail 1. Group 2 had higher scores for economy of motion in Peg Board 2 and Ring and Rail 1 and for excessive instrument force in Ring and Rail 1. In both groups, the overall scores in the third and fourth trials were significantly higher than those in the first trial. CONCLUSIONS There are no significant differences in the performance of simulated robotic surgical tasks between laparoscopically experienced surgeons and laparoscopically naïve surgical residents. Some slight differences were observed in specific metrics, but these differences were not sufficient to change the final results. We may assume that laparoscopic experience should not be an essential step in the initial learning curve of robotic surgery.
Collapse
Affiliation(s)
- Marcelo Pimentel
- Postgraduate Program in Surgical Sciences, Medical School, Universidade Federal do Rio Grande do Sul (UFRGS), Porto Alegre, Rio Grande do Sul, Brazil; Medical School, Universidade de Passo Fundo (UPF), Passo Fundo, Rio Grande do Sul, Brazil.
| | - Renan Desimon Cabral
- Service of Urology, Hospital de Clínicas de Porto Alegre (HCPA), Porto Alegre, Rio Grande do Sul, Brazil
| | - Márcio Machado Costa
- Medical School, Universidade de Passo Fundo (UPF), Passo Fundo, Rio Grande do Sul, Brazil
| | - Brasil Silva Neto
- Postgraduate Program in Surgical Sciences, Medical School, Universidade Federal do Rio Grande do Sul (UFRGS), Porto Alegre, Rio Grande do Sul, Brazil; Service of Urology, Hospital de Clínicas de Porto Alegre (HCPA), Porto Alegre, Rio Grande do Sul, Brazil
| | - Leandro Totti Cavazzola
- Postgraduate Program in Surgical Sciences, Medical School, Universidade Federal do Rio Grande do Sul (UFRGS), Porto Alegre, Rio Grande do Sul, Brazil; Service of General Surgery, Hospital de Clínicas de Porto Alegre (HCPA), Porto Alegre, Rio Grande do Sul, Brazil
| |
Collapse
|
18
|
Does previous open surgical experience have any influence on robotic surgery simulation exercises? Wideochir Inne Tech Maloinwazyjne 2017; 12:366-371. [PMID: 29362651 PMCID: PMC5776487 DOI: 10.5114/wiitm.2017.72320] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2017] [Accepted: 10/17/2017] [Indexed: 02/04/2023] Open
Abstract
Introduction Within the last years, there has been a trend in many hospitals to switch their surgical activity from open/laparoscopic procedures to robotic surgery. Some open surgeons have been shifting their activity to robotic surgery. It is still unclear whether there is a transfer of open surgical skills to robotic ones. Aim To evaluate whether such transfer of skills occurs and to identify which specific skills are more significantly transferred from the operative table to the console. Material and methods Twenty-five volunteers were included in the study, divided into 2 groups: group A (15 participants) – medical students (without any surgical experience in open, laparoscopic or robotic surgery); and group B (10 participants) – surgeons with exclusively open surgical experience, without any previous laparoscopic or robotic experience. Participants were asked to complete 3 robotic simulator console exercises structured from the easiest one (Peg Board) to the toughest one (Sponge Suture). Overall scores for each exercise as well as specific metrics were compared between the two groups. Results There were no significant differences between overall scores of the two groups for the easiest task. Overall scores were better for group B as the exercises got more complex. For the intermediate and high-difficulty level exercises, most of the specific metrics were better for group B, with the exception of the working master space item. Conclusions Our results suggest that the open surgical skills transfer to robotic skills, at least for the very beginning of the training process.
Collapse
|
19
|
Development of a surgical training model for bilateral axillo-breast approach robotic thyroidectomy. Surg Endosc 2017; 32:1360-1367. [DOI: 10.1007/s00464-017-5816-2] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2017] [Accepted: 08/03/2017] [Indexed: 12/11/2022]
|
20
|
Mehta A, Patel S, Robison W, Senkowski T, Allen J, Shaw E, Senkowski C. Can teenage novel users perform as well as General Surgery residents upon initial exposure to a robotic surgical system simulator? J Robot Surg 2017; 12:165-171. [PMID: 28585104 DOI: 10.1007/s11701-017-0715-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2017] [Accepted: 05/16/2017] [Indexed: 02/02/2023]
Abstract
New techniques in minimally invasive and robotic surgical platforms require staged curricula to insure proficiency. Scant literature exists as to how much simulation should play a role in training those who have skills in advanced surgical technology. The abilities of novel users may help discriminate if surgically experienced users should start at a higher simulation level or if the tasks are too rudimentary. The study's purpose is to explore the ability of General Surgery residents to gain proficiency on the dVSS as compared to novel users. The hypothesis is that Surgery residents will have increased proficiency in skills acquisition as compared to naive users. Six General Surgery residents at a single institution were compared with six teenagers using metrics measured by the dVSS. Participants were given two 1-h sessions to achieve an MScoreTM in the 90th percentile on each of the five simulations. MScoreTM software compiles a variety of metrics including total time, number of attempts, and high score. Statistical analysis was run using Student's t test. Significance was set at p value <0.05. Total time, attempts, and high score were compared between the two groups. The General Surgery residents took significantly less Total Time to complete Pegboard 1 (PB1) (p = 0.043). No significant difference was evident between the two groups in the other four simulations across the same MScoreTM metrics. A focused look at the energy dissection task revealed that overall score might not be discriminant enough. Our findings indicate that prior medical knowledge or surgical experience does not significantly impact one's ability to acquire new skills on the dVSS. It is recommended that residency-training programs begin to include exposure to robotic technology.
Collapse
Affiliation(s)
- A Mehta
- Department of Surgery, Memorial Health University Medical Center, Savannah, GA, USA
- Mercer University School of Medicine, Savannah, Georgia
| | - S Patel
- Department of Surgery, Memorial Health University Medical Center, Savannah, GA, USA.
| | - W Robison
- Department of Surgery, Memorial Health University Medical Center, Savannah, GA, USA
- Mercer University School of Medicine, Savannah, Georgia
| | - T Senkowski
- Department of Surgery, Memorial Health University Medical Center, Savannah, GA, USA
| | - J Allen
- Department of Surgery, Memorial Health University Medical Center, Savannah, GA, USA
| | - E Shaw
- Department of Surgery, Memorial Health University Medical Center, Savannah, GA, USA
- Mercer University School of Medicine, Savannah, Georgia
| | - C Senkowski
- Department of Surgery, Memorial Health University Medical Center, Savannah, GA, USA
- Mercer University School of Medicine, Savannah, Georgia
| |
Collapse
|
21
|
Moglia A, Perrone V, Ferrari V, Morelli L, Boggi U, Ferrari M, Mosca F, Cuschieri A. Influence of videogames and musical instruments on performances at a simulator for robotic surgery. MINIM INVASIV THER 2016; 26:129-134. [PMID: 27981866 DOI: 10.1080/13645706.2016.1267018] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2023]
Abstract
OBJECTIVE To assess if exposure to videogames, musical instrument playing, or both influence the psychomotor skills level, assessed by a virtual reality simulator for robot-assisted surgery (RAS). MATERIALS AND METHODS A cohort of 57 medical students were recruited: playing musical instruments (group 1), videogames (group 2), both (group 3), and no activity (group 4); all students executed four exercises on a virtual simulator for RAS. RESULTS Subjects from group 3 achieved the best performances on overall score: 527.09 ± 130.54 vs. 493.73 ± 108.88 (group 2), 472.72 ± 85.31 (group 1), and 403.13 ± 99.83 (group 4). Statistically significant differences (p < .05) between group 3 and group 4 were found for overall score (p = .009) and for time of completion (p = .044). As regards experience with the piano, subjects from group 3 outperformed those from group 1 on overall score (496.98 ± 122.71 vs. 470.25 ± 92.31), but without statistically significant difference (p = .646). CONCLUSIONS The present study suggests that the level of psychomotor skills in subjects exposed to both musical instrument playing and videogames is higher than that in those practicing either one alone. The effect of videogames appears negligible in individuals playing the piano.
Collapse
Affiliation(s)
- Andrea Moglia
- a EndoCAS, Center for Computer Assisted Surgery , University of Pisa , Pisa , Italy
| | - Vittorio Perrone
- b Cisanello Teaching Hospital of Pisa , Pisa , Italy.,c Multidisciplinary Center of Robotic Surgery , University Hospital of Pisa , Pisa , Italy
| | - Vincenzo Ferrari
- a EndoCAS, Center for Computer Assisted Surgery , University of Pisa , Pisa , Italy.,d Information Engineering Department , University of Pisa , Pisa , Italy
| | - Luca Morelli
- b Cisanello Teaching Hospital of Pisa , Pisa , Italy.,c Multidisciplinary Center of Robotic Surgery , University Hospital of Pisa , Pisa , Italy
| | - Ugo Boggi
- b Cisanello Teaching Hospital of Pisa , Pisa , Italy.,c Multidisciplinary Center of Robotic Surgery , University Hospital of Pisa , Pisa , Italy
| | - Mauro Ferrari
- a EndoCAS, Center for Computer Assisted Surgery , University of Pisa , Pisa , Italy.,b Cisanello Teaching Hospital of Pisa , Pisa , Italy
| | - Franco Mosca
- a EndoCAS, Center for Computer Assisted Surgery , University of Pisa , Pisa , Italy.,b Cisanello Teaching Hospital of Pisa , Pisa , Italy
| | - Alfred Cuschieri
- e Scuola Superiore Sant'Anna of Pisa , Pisa , Italy.,f Institute for Medical Science and Technology, University of Dundee , Dundee , UK
| |
Collapse
|