1
|
Motaharifar M, Norouzzadeh A, Abdi P, Iranfar A, Lotfi F, Moshiri B, Lashay A, Mohammadi SF, Taghirad HD. Applications of Haptic Technology, Virtual Reality, and Artificial Intelligence in Medical Training During the COVID-19 Pandemic. Front Robot AI 2021; 8:612949. [PMID: 34476241 PMCID: PMC8407078 DOI: 10.3389/frobt.2021.612949] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2020] [Accepted: 07/29/2021] [Indexed: 12/15/2022] Open
Abstract
This paper examines how haptic technology, virtual reality, and artificial intelligence help to reduce the physical contact in medical training during the COVID-19 Pandemic. Notably, any mistake made by the trainees during the education process might lead to undesired complications for the patient. Therefore, training of the medical skills to the trainees have always been a challenging issue for the expert surgeons, and this is even more challenging in pandemics. The current method of surgery training needs the novice surgeons to attend some courses, watch some procedure, and conduct their initial operations under the direct supervision of an expert surgeon. Owing to the requirement of physical contact in this method of medical training, the involved people including the novice and expert surgeons confront a potential risk of infection to the virus. This survey paper reviews recent technological breakthroughs along with new areas in which assistive technologies might provide a viable solution to reduce the physical contact in the medical institutes during the COVID-19 pandemic and similar crises.
Collapse
Affiliation(s)
- Mohammad Motaharifar
- Advanced Robotics and Automated Systems (ARAS), Industrial Control Center of Excellence, Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran
- Department of Electrical Engineering, University of Isfahan, Isfahan, Iran
| | - Alireza Norouzzadeh
- Advanced Robotics and Automated Systems (ARAS), Industrial Control Center of Excellence, Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Parisa Abdi
- Translational Ophthalmology Research Center, Farabi Eye Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Arash Iranfar
- School of Electrical and Computer Engineering, University College of Engineering, University of Tehran, Tehran, Iran
| | - Faraz Lotfi
- Advanced Robotics and Automated Systems (ARAS), Industrial Control Center of Excellence, Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Behzad Moshiri
- School of Electrical and Computer Engineering, University College of Engineering, University of Tehran, Tehran, Iran
- Department of Electrical and Computer Engineering, University of Waterloo, Waterloo, ON, Canada
| | - Alireza Lashay
- Translational Ophthalmology Research Center, Farabi Eye Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Seyed Farzad Mohammadi
- Translational Ophthalmology Research Center, Farabi Eye Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Hamid D. Taghirad
- Advanced Robotics and Automated Systems (ARAS), Industrial Control Center of Excellence, Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| |
Collapse
|
2
|
Caccianiga G, Mariani A, de Paratesi CG, Menciassi A, De Momi E. Multi-Sensory Guidance and Feedback for Simulation-Based Training in Robot Assisted Surgery: A Preliminary Comparison of Visual, Haptic, and Visuo-Haptic. IEEE Robot Autom Lett 2021. [DOI: 10.1109/lra.2021.3063967] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
|
3
|
Jiménez-Grande D, Farokh Atashzar S, Martinez-Valdes E, Marco De Nunzio A, Falla D. Kinematic biomarkers of chronic neck pain measured during gait: A data-driven classification approach. J Biomech 2021; 118:110190. [PMID: 33581443 DOI: 10.1016/j.jbiomech.2020.110190] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2020] [Revised: 11/27/2020] [Accepted: 12/11/2020] [Indexed: 12/30/2022]
Abstract
People with chronic neck pain (CNP) often present with altered gait kinematics. This paper investigates, combines, and compares the kinematic features from linear and nonlinear walking trajectories to design supervised machine learning models which differentiate asymptomatic individuals from those with CNP. For this, 126 features were extracted from seven body segments of 20 asymptomatic subjects and 20 individuals with non-specific CNP. Neighbourhood Component Analysis (NCA) was used to identify body segments and the corresponding significant features which have the maximum discriminative power for conducting classification. We assessed the efficacy of NCA combined with K- Nearest Neighbour (K-NN), Support Vector Machine and Linear Discriminant Analysis. By applying NCA, all classifiers increased their performance for both linear and nonlinear walking trajectories. Notably, features selected by NCA which magnify the classification power of the computational model were solely from the head, trunk and pelvis kinematics. Our results revealed that the nonlinear trajectory provides the best classification performance through the NCA-K-NN algorithms with an accuracy of 90%, specificity of 100% and sensitivity of 83.3%. The selected features by NCA are introduced as key biomarkers of gait kinematics for classifying non-specific CNP. This paper provides insight into changes in gait kinematics which are present in people with non-specific CNP which can be exploited for classification purposes. The result highlights the importance of curvilinear gait kinematic features which potentially could be utilized in future research to predict recurrent episodes of neck pain.
Collapse
Affiliation(s)
- David Jiménez-Grande
- Centre of Precision Rehabilitation for Spinal Pain (CPR Spine), School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, UK
| | - S Farokh Atashzar
- Electrical & Computer Engineering, as well as Mechanical & Aerospace Engineering at New York University (NYU), USA
| | - Eduardo Martinez-Valdes
- Centre of Precision Rehabilitation for Spinal Pain (CPR Spine), School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, UK
| | | | - Deborah Falla
- Centre of Precision Rehabilitation for Spinal Pain (CPR Spine), School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, UK.
| |
Collapse
|
4
|
Abstract
The advent of telerobotic systems has revolutionized various aspects of the industry and human life. This technology is designed to augment human sensorimotor capabilities to extend them beyond natural competence. Classic examples are space and underwater applications when distance and access are the two major physical barriers to be combated with this technology. In modern examples, telerobotic systems have been used in several clinical applications, including teleoperated surgery and telerehabilitation. In this regard, there has been a significant amount of research and development due to the major benefits in terms of medical outcomes. Recently telerobotic systems are combined with advanced artificial intelligence modules to better share the agency with the operator and open new doors of medical automation. In this review paper, we have provided a comprehensive analysis of the literature considering various topologies of telerobotic systems in the medical domain while shedding light on different levels of autonomy for this technology, starting from direct control, going up to command-tracking autonomous telerobots. Existing challenges, including instrumentation, transparency, autonomy, stochastic communication delays, and stability, in addition to the current direction of research related to benefit in telemedicine and medical automation, and future vision of this technology, are discussed in this review paper.
Collapse
|
5
|
Cheng L, Tavakoli M. COVID-19 Pandemic Spurs Medical Telerobotic Systems: A Survey of Applications Requiring Physiological Organ Motion Compensation. Front Robot AI 2020; 7:594673. [PMID: 33501355 PMCID: PMC7805782 DOI: 10.3389/frobt.2020.594673] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2020] [Accepted: 10/14/2020] [Indexed: 12/25/2022] Open
Abstract
The coronavirus disease 2019 (COVID-19) pandemic has resulted in public health interventions such as physical distancing restrictions to limit the spread and transmission of the novel coronavirus, causing significant effects on the delivery of physical healthcare procedures worldwide. The unprecedented pandemic spurs strong demand for intelligent robotic systems in healthcare. In particular, medical telerobotic systems can play a positive role in the provision of telemedicine to both COVID-19 and non-COVID-19 patients. Different from typical studies on medical teleoperation that consider problems such as time delay and information loss in long-distance communication, this survey addresses the consequences of physiological organ motion when using teleoperation systems to create physical distancing between clinicians and patients in the COVID-19 era. We focus on the control-theoretic approaches that have been developed to address inherent robot control issues associated with organ motion. The state-of-the-art telerobotic systems and their applications in COVID-19 healthcare delivery are reviewed, and possible future directions are outlined.
Collapse
Affiliation(s)
- Lingbo Cheng
- College of Control Science and Engineering, Zhejiang University, Hangzhou, China
- Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB, Canada
| | - Mahdi Tavakoli
- Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB, Canada
| |
Collapse
|
6
|
Sun D, Liao Q, Loutfi A. Single Master Bimanual Teleoperation System With Efficient Regulation. IEEE T ROBOT 2020. [DOI: 10.1109/tro.2020.2973099] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
7
|
Jimenez-Grande D, Atashzar SF, Martinez-Valdes E, De Nunzio AM, Falla D. Kinematic Biomarkers of Chronic Neck Pain During Curvilinear Walking: A Data-driven Differential Diagnosis Approach . ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:5162-5166. [PMID: 33019148 DOI: 10.1109/embc44109.2020.9176457] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Chronic Neck Pain (CNP) can be associated with biomechanical changes. This paper investigates the changes in patterns of walking kinematics along a curvilinear trajectory and uses a specially designed feature space, coupled with a machine learning framework to conduct a data-driven differential diagnosis, between asymptomatic individuals and those with CNP. For this, 126 kinematic features were collected from seven body segments of 40 participants (20 asymptomatic, 20 individuals with CNP). The features space was processed through a Neighbourhood Component Analysis (NCA) algorithm to systematically select the most significant features which have the maximum discriminative power for conducting the differential diagnosis. The selected features were then processed by a K-Nearest Neighbors (K-NN) classifier to conduct the task. Our results show that, through a systematic selection of feature space, we can significantly increase the classification accuracy. In this regard, a 35% increase is reported after applying the NCA. Thus, we have shown that using only 13 features (of which 61% belong to kinematic features and 39% to statistical features) from five body segments (Head, Trunk, Pelvic, Hip and Knee) we can achieve an accuracy, sensitivity and specificity of 82.50%, 80.95% and 84.21% respectively. This promising result highlights the importance of curvilinear kinematic features through the proposed information processing pipeline for conducting differential diagnosis and could be tested in future studies to predict the likelihood of people developing recurrent neck pain.
Collapse
|
8
|
Li Z, Shahbazi M, Patel N, O' Sullivan E, Zhang H, Vyas K, Chalasani P, Deguet A, Gehlbach PL, Iordachita I, Yang GZ, Taylor RH. Hybrid Robot-assisted Frameworks for Endomicroscopy Scanning in Retinal Surgeries. IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS 2020; 2:176-187. [PMID: 32699833 PMCID: PMC7375438 DOI: 10.1109/tmrb.2020.2988312] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/30/2023]
Abstract
High-resolution real-time intraocular imaging of retina at the cellular level is very challenging due to the vulnerable and confined space within the eyeball as well as the limited availability of appropriate modalities. A probe-based confocal laser endomicroscopy (pCLE) system, can be a potential imaging modality for improved diagnosis. The ability to visualize the retina at the cellular level could provide information that may predict surgical outcomes. The adoption of intraocular pCLE scanning is currently limited due to the narrow field of view and the micron-scale range of focus. In the absence of motion compensation, physiological tremors of the surgeons' hand and patient movements also contribute to the deterioration of the image quality. Therefore, an image-based hybrid control strategy is proposed to mitigate the above challenges. The proposed hybrid control strategy enables a shared control of the pCLE probe between surgeons and robots to scan the retina precisely, with the absence of hand tremors and with the advantages of an image-based auto-focus algorithm that optimizes the quality of pCLE images. The hybrid control strategy is deployed on two frameworks - cooperative and teleoperated. Better image quality, smoother motion, and reduced workload are all achieved in a statistically significant manner with the hybrid control frameworks.
Collapse
Affiliation(s)
- Zhaoshuo Li
- Authors with the Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, Maryland 21218, USA
| | - Mahya Shahbazi
- Authors with the Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, Maryland 21218, USA
| | - Niravkumar Patel
- Authors with the Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, Maryland 21218, USA
| | - Eimear O' Sullivan
- Authors with the Hamlyn Centre for Robotic Surgery, Imperial College London, SW7 2AZ, London, UK
| | - Haojie Zhang
- Authors with the Hamlyn Centre for Robotic Surgery, Imperial College London, SW7 2AZ, London, UK
| | - Khushi Vyas
- Authors with the Hamlyn Centre for Robotic Surgery, Imperial College London, SW7 2AZ, London, UK
| | - Preetham Chalasani
- Authors with the Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, Maryland 21218, USA
| | - Anton Deguet
- Authors with the Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, Maryland 21218, USA
| | - Peter L Gehlbach
- Author with the Johns Hopkins Wilmer Eye Institute, Johns Hopkins Hospital, 600 N. Wolfe Street, Maryland 21287, USA
| | - Iulian Iordachita
- Authors with the Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, Maryland 21218, USA
| | - Guang-Zhong Yang
- Authors with the Hamlyn Centre for Robotic Surgery, Imperial College London, SW7 2AZ, London, UK
| | - Russell H Taylor
- Authors with the Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, Maryland 21218, USA
| |
Collapse
|
9
|
Cheng L, Tavakoli M. A multilateral impedance-controlled system for haptics-enabled surgical training and cooperation in beating-heart surgery. INTERNATIONAL JOURNAL OF INTELLIGENT ROBOTICS AND APPLICATIONS 2019. [DOI: 10.1007/s41315-019-00099-y] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|