1
|
Tamadon I, Sadati SMH, Mamone V, Ferrari V, Bergeles C, Menciassi A. Semiautonomous Robotic Manipulator for Minimally Invasive Aortic Valve Replacement. IEEE T ROBOT 2023; 39:4500-4519. [PMID: 38249319 PMCID: PMC7615540 DOI: 10.1109/tro.2023.3315966] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2024]
Abstract
Aortic valve surgery is the preferred procedure for replacing a damaged valve with an artificial one. The ValveTech robotic platform comprises a flexible articulated manipulator and surgical interface supporting the effective delivery of an artificial valve by teleoperation and endoscopic vision. This article presents our recent work on force-perceptive, safe, semiautonomous navigation of the ValveTech platform prior to valve implantation. First, we present a force observer that transfers forces from the manipulator body and tip to a haptic interface. Second, we demonstrate how hybrid forward/inverse mechanics, together with endoscopic visual servoing, lead to autonomous valve positioning. Benchtop experiments and an artificial phantom quantify the performance of the developed robot controller and navigator. Valves can be autonomously delivered with a 2.0±0.5 mm position error and a minimal misalignment of 3.4±0.9°. The hybrid force/shape observer (FSO) algorithm was able to predict distributed external forces on the articulated manipulator body with an average error of 0.09 N. FSO can also estimate loads on the tip with an average accuracy of 3.3%. The presented system can lead to better patient care, delivery outcome, and surgeon comfort during aortic valve surgery, without requiring sensorization of the robot tip, and therefore obviating miniaturization constraints.
Collapse
Affiliation(s)
- Izadyar Tamadon
- Faculty of Engineering Technology, University of Twente, 7522 NB Enschede, The Netherlands, and also with the BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pontedera, Italy
| | - S. M. Hadi Sadati
- Robotics and Vision Department in Medicine Lab, School of Biomedical Engineering & Imaging Sciences, King’s College London, SE17EU London, U.K
| | - Virginia Mamone
- Department of Computer Science and the EndoCAS Center for Computer-Assisted Surgery, University of Pisa, 56124 Pisa, Italy
| | - Vincenzo Ferrari
- Department of Computer Science and the EndoCAS Center for Computer-Assisted Surgery, University of Pisa, 56124 Pisa, Italy
| | - Christos Bergeles
- Robotics and Vision Department in Medicine Lab, School of Biomedical Engineering & Imaging Sciences, King’s College London, SE17EU London, U.K
| | - Arianna Menciassi
- BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pontedera, Italy
| |
Collapse
|
2
|
Tamadon I, Mamone V, Huan Y, Condino S, Quaglia C, Ferrari V, Ferrari M, Menciassi A. ValveTech: A Novel Robotic Approach for Minimally Invasive Aortic Valve Replacement. IEEE Trans Biomed Eng 2020; 68:1238-1249. [PMID: 32931426 DOI: 10.1109/tbme.2020.3024184] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
OBJECTIVE Aortic valve disease is the most common heart disease in the elderly calling for replacement with an artificial valve. The presented surgical robot aims to provide a highly controllable instrument for efficient delivery of an artificial valve by the help of integrated endoscopic vision. METHODS A robot (called ValveTech), intended for minimally invasive surgery (MIS) and consisting of a flexible cable driven manipulator, a passive arm, and a control unit has been designed and prototyped. The flexible manipulator has several features (e.g., stabilizing flaps, tiny cameras, dexterous introducer and custom cartridge) to help the proper valve placement. It provides 5 degrees of freedom for reaching the operative site via mini-thoracotomy; it adjusts the valve and expands it at the optimal position. The robot was evaluated by ten cardiac surgeons following a real surgical scenario in artificial chest simulator with an aortic mockup. Moreover, after each delivery, the expanded valve was evaluated objectively in comparison with the ideal position. RESULTS The robot performances were evaluated positively by surgeons. The trials resulted in faster delivery and an average misalignment distance of 3.8 mm along the aorta axis; 16.3 degrees rotational angle around aorta axis and 8.8 degrees misalignment of the valve commissure plane to the ideal plane were measured. CONCLUSION The trials successfully proved the proposed system for valve delivery under endoscopic vision. SIGNIFICANCE The ValveTech robot can be an alternative solution for minimally invasive aortic valve surgery and improve the quality of the operation both for surgeons and patients.
Collapse
|
3
|
Mendoza E, Whitney JP. A Testbed for Haptic and Magnetic Resonance Imaging-Guided Percutaneous Needle Biopsy. IEEE Robot Autom Lett 2019. [DOI: 10.1109/lra.2019.2925558] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
4
|
Su H, Shang W, Li G, Patel N, Fischer GS. An MRI-Guided Telesurgery System Using a Fabry-Perot Interferometry Force Sensor and a Pneumatic Haptic Device. Ann Biomed Eng 2017; 45:1917-1928. [PMID: 28447178 PMCID: PMC5529224 DOI: 10.1007/s10439-017-1839-z] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2016] [Accepted: 04/20/2017] [Indexed: 12/23/2022]
Abstract
This paper presents a surgical master-slave teleoperation system for percutaneous interventional procedures under continuous magnetic resonance imaging (MRI) guidance. The slave robot consists of a piezoelectrically actuated 6-degree-of-freedom (DOF) robot for needle placement with an integrated fiber optic force sensor (1-DOF axial force measurement) using the Fabry-Perot interferometry (FPI) sensing principle; it is configured to operate inside the bore of the MRI scanner during imaging. By leveraging the advantages of pneumatic and piezoelectric actuation in force and position control respectively, we have designed a pneumatically actuated master robot (haptic device) with strain gauge based force sensing that is configured to operate the slave from within the scanner room during imaging. The slave robot follows the insertion motion of the haptic device while the haptic device displays the needle insertion force as measured by the FPI sensor. Image interference evaluation demonstrates that the telesurgery system presents a signal to noise ratio reduction of less than 17% and less than 1% geometric distortion during simultaneous robot motion and imaging. Teleoperated needle insertion and rotation experiments were performed to reach 10 targets in a soft tissue-mimicking phantom with 0.70 ± 0.35 mm Cartesian space error.
Collapse
Affiliation(s)
- Hao Su
- Wyss Institute for Biologically Inspired Engineering and the John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, 02138, USA.
| | - Weijian Shang
- Automation and Interventional Medicine Robotics Laboratory, Department of Mechanical Engineering, Worcester Polytechnic Institute, 100 Institute Road, Worcester, MA, 01609, USA
| | - Gang Li
- Automation and Interventional Medicine Robotics Laboratory, Department of Mechanical Engineering, Worcester Polytechnic Institute, 100 Institute Road, Worcester, MA, 01609, USA
| | - Niravkumar Patel
- Automation and Interventional Medicine Robotics Laboratory, Department of Mechanical Engineering, Worcester Polytechnic Institute, 100 Institute Road, Worcester, MA, 01609, USA
| | - Gregory S Fischer
- Automation and Interventional Medicine Robotics Laboratory, Department of Mechanical Engineering, Worcester Polytechnic Institute, 100 Institute Road, Worcester, MA, 01609, USA
| |
Collapse
|
5
|
Wartenberg M, Patel N, Fischer GS. Towards synergistic control of hands-on needle insertion with automated needle steering for MRI-guided prostate interventions. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2017; 2016:5116-5119. [PMID: 28269418 DOI: 10.1109/embc.2016.7591878] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
A significant hurdle of accurate needle tip placement in percutaneous needle-based prostate interventions is unmodeled needle deflection and tissue deformation during insertion. This paper introduces a robotic platform for developing synergistic, cooperatively controlled needle insertion algorithms decoupled from closed-loop image-guided needle steering. Shared control of the surgical workspace through human-robot synergy creates a balance between the accuracy of robotic autonomy while still providing ultimate control of the procedure to the physician. Validation tests were performed using camera-based image-guided feedback control of needle steering with cooperative hands-on needle insertion. Locations were targeted inside a transparent gelatin phantom with an average total error of 2.68 ± 0.34mm and in-plane error of 2.59 ± 0.30mm.
Collapse
|
6
|
Yang Y, Jiang S, Yang Z, Yuan W, Dou H, Wang W, Zhang D, Bian Y. Design and analysis of a tendon-based computed tomography-compatible robot with remote center of motion for lung biopsy. Proc Inst Mech Eng H 2017; 231:286-298. [PMID: 28195001 DOI: 10.1177/0954411917690763] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Nowadays, biopsy is a decisive method of lung cancer diagnosis, whereas lung biopsy is time-consuming, complex and inaccurate. So a computed tomography-compatible robot for rapid and precise lung biopsy is developed in this article. According to the actual operation process, the robot is divided into two modules: 4-degree-of-freedom position module for location of puncture point is appropriate for patient's almost all positions and 3-degree-of-freedom tendon-based orientation module with remote center of motion is compact and computed tomography-compatible to orientate and insert needle automatically inside computed tomography bore. The workspace of the robot surrounds patient's thorax, and the needle tip forms a cone under patient's skin. A new error model of the robot based on screw theory is proposed in view of structure error and actuation error, which are regarded as screw motions. Simulation is carried out to verify the precision of the error model contrasted with compensation via inverse kinematics. The results of insertion experiment on specific phantom prove the feasibility of the robot with mean error of 1.373 mm in laboratory environment, which is accurate enough to replace manual operation.
Collapse
Affiliation(s)
- Yunpeng Yang
- 1 School of Mechanical Engineering, Tianjin University, Tianjin, China
| | - Shan Jiang
- 1 School of Mechanical Engineering, Tianjin University, Tianjin, China.,2 Centre for Advanced Mechanisms and Robotics, Tianjin University, Tianjin, China
| | - Zhiyong Yang
- 1 School of Mechanical Engineering, Tianjin University, Tianjin, China
| | - Wei Yuan
- 1 School of Mechanical Engineering, Tianjin University, Tianjin, China
| | - Huaisu Dou
- 1 School of Mechanical Engineering, Tianjin University, Tianjin, China
| | - Wei Wang
- 3 Department of Radiation Oncology, Tianjin Medical University Cancer Institute and Hospital, Tianjin, China
| | - Daguang Zhang
- 3 Department of Radiation Oncology, Tianjin Medical University Cancer Institute and Hospital, Tianjin, China
| | - Yuan Bian
- 1 School of Mechanical Engineering, Tianjin University, Tianjin, China
| |
Collapse
|
7
|
Park SB, Kim JG, Lim KW, Yoon CH, Kim DJ, Kang HS, Jo YH. A magnetic resonance image-guided breast needle intervention robot system: overview and design considerations. Int J Comput Assist Radiol Surg 2017; 12:1319-1331. [PMID: 28168682 DOI: 10.1007/s11548-017-1528-2] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2016] [Accepted: 01/17/2017] [Indexed: 10/20/2022]
Abstract
PURPOSE We developed an image-guided intervention robot system that can be operated in a magnetic resonance (MR) imaging gantry. The system incorporates a bendable needle intervention robot for breast cancer patients that overcomes the space limitations of the MR gantry. METHODS Most breast coil designs for breast MR imaging have side openings to allow manual localization. However, for many intervention procedures, the patient must be removed from the gantry. A robotic manipulation system with integrated image guidance software was developed. Our robotic manipulator was designed to be slim, so as to fit between the patient's side and the MR gantry wall. Only non-magnetic materials were used, and an electromagnetic shield was employed for cables and circuits. The image guidance software was built using open source libraries. In situ feasibility tests were performed in a 3-T MR system. One target point in the breast phantom was chosen by the clinician for each experiment, and our robot moved the needle close to the target point. RESULTS Without image-guided feedback control, the needle end could not hit the target point (distance = 5 mm) in the first experiment. Using our robotic system, the needle hits the target lesion of the breast phantom at a distance of 2.3 mm from the same target point using image-guided feedback. The second experiment was performed using other target points, and the distance between the final needle end point and the target point was 0.8 mm. CONCLUSIONS We successfully developed an MR-guided needle intervention robot for breast cancer patients. Further research will allow the expansion of these interventions.
Collapse
Affiliation(s)
- Samuel Byeongjun Park
- Department of Biomedical Engineering, National Cancer Center, 323 Ilsanro, Ilsandong-gu, Goyang-si, 10408, Gyeonggi-do, Republic of Korea
| | - Jung-Gun Kim
- Department of Biomedical Engineering, National Cancer Center, 323 Ilsanro, Ilsandong-gu, Goyang-si, 10408, Gyeonggi-do, Republic of Korea
| | - Ki-Woong Lim
- Department of Biomedical Engineering, National Cancer Center, 323 Ilsanro, Ilsandong-gu, Goyang-si, 10408, Gyeonggi-do, Republic of Korea
| | - Chae-Hyun Yoon
- Department of Biomedical Engineering, National Cancer Center, 323 Ilsanro, Ilsandong-gu, Goyang-si, 10408, Gyeonggi-do, Republic of Korea
| | - Dong-Jun Kim
- Department of Biomedical Engineering, National Cancer Center, 323 Ilsanro, Ilsandong-gu, Goyang-si, 10408, Gyeonggi-do, Republic of Korea
| | - Han-Sung Kang
- Center for Breast Cancer, National Cancer Center, 323 Ilsanro, Ilsandong-gu, Goyang-si, 10408, Gyeonggi-do, Republic of Korea
| | - Yung-Ho Jo
- Department of Biomedical Engineering, National Cancer Center, 323 Ilsanro, Ilsandong-gu, Goyang-si, 10408, Gyeonggi-do, Republic of Korea.
| |
Collapse
|
8
|
Chan JL, Mazilu D, Miller JG, Hunt T, Horvath KA, Li M. Robotic-assisted real-time MRI-guided TAVR: from system deployment to in vivo experiment in swine model. Int J Comput Assist Radiol Surg 2016; 11:1905-18. [PMID: 27246950 DOI: 10.1007/s11548-016-1421-4] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2015] [Accepted: 05/10/2016] [Indexed: 11/26/2022]
Abstract
PURPOSE Real-time magnetic resonance imaging (rtMRI) guidance provides significant advantages during transcatheter aortic valve replacement (TAVR) as it provides superior real-time visualization and accurate device delivery tracking. However, performing a TAVR within an MRI scanner remains difficult due to a constrained procedural environment. To address these concerns, a magnetic resonance (MR)-compatible robotic system to assist in TAVR deployments was developed. This study evaluates the technical design and interface considerations of an MR-compatible robotic-assisted TAVR system with the purpose of demonstrating that such a system can be developed and executed safely and precisely in a preclinical model. METHODS An MR-compatible robotic surgical assistant system was built for TAVR deployment. This system integrates a 5-degrees of freedom (DoF) robotic arm with a 3-DoF robotic valve delivery module. A user interface system was designed for procedural planning and real-time intraoperative manipulation of the robot. The robotic device was constructed of plastic materials, pneumatic actuators, and fiber-optical encoders. RESULTS The mechanical profile and MR compatibility of the robotic system were evaluated. The system-level error based on a phantom model was 1.14 ± 0.33 mm. A self-expanding prosthesis was successfully deployed in eight Yorkshire swine under rtMRI guidance. Post-deployment imaging and necropsy confirmed placement of the stent within 3 mm of the aortic valve annulus. CONCLUSIONS These phantom and in vivo studies demonstrate the feasibility and advantages of robotic-assisted TAVR under rtMRI guidance. This robotic system increases the precision of valve deployments, diminishes environmental constraints, and improves the overall success of TAVR.
Collapse
Affiliation(s)
- Joshua L Chan
- Cardiothoracic Surgery Research Program, National Heart, Lung and Blood Institute, National Institutes of Health, Building 10, Room B1D47, MSC 1550, 10 Center Drive, Bethesda, MD, 20892, USA
| | - Dumitru Mazilu
- Cardiothoracic Surgery Research Program, National Heart, Lung and Blood Institute, National Institutes of Health, Building 10, Room B1D47, MSC 1550, 10 Center Drive, Bethesda, MD, 20892, USA
| | - Justin G Miller
- Cardiothoracic Surgery Research Program, National Heart, Lung and Blood Institute, National Institutes of Health, Building 10, Room B1D47, MSC 1550, 10 Center Drive, Bethesda, MD, 20892, USA
| | - Timothy Hunt
- Cardiothoracic Surgery Research Program, National Heart, Lung and Blood Institute, National Institutes of Health, Building 10, Room B1D47, MSC 1550, 10 Center Drive, Bethesda, MD, 20892, USA
| | - Keith A Horvath
- Cardiothoracic Surgery Research Program, National Heart, Lung and Blood Institute, National Institutes of Health, Building 10, Room B1D47, MSC 1550, 10 Center Drive, Bethesda, MD, 20892, USA
| | - Ming Li
- Cardiothoracic Surgery Research Program, National Heart, Lung and Blood Institute, National Institutes of Health, Building 10, Room B1D47, MSC 1550, 10 Center Drive, Bethesda, MD, 20892, USA.
| |
Collapse
|
9
|
Miller JG, Li M, Mazilu D, Hunt T, Horvath KA. Robot-assisted real-time magnetic resonance image-guided transcatheter aortic valve replacement. J Thorac Cardiovasc Surg 2015; 151:1407-12. [PMID: 26778373 DOI: 10.1016/j.jtcvs.2015.11.047] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/23/2015] [Revised: 11/23/2015] [Accepted: 11/25/2015] [Indexed: 12/31/2022]
Abstract
BACKGROUND Real-time magnetic resonance imaging (rtMRI)-guided transcatheter aortic valve replacement (TAVR) offers improved visualization, real-time imaging, and pinpoint accuracy with device delivery. Unfortunately, performing a TAVR in a MRI scanner can be a difficult task owing to limited space and an awkward working environment. Our solution was to design a MRI-compatible robot-assisted device to insert and deploy a self-expanding valve from a remote computer console. We present our preliminary results in a swine model. METHODS We used an MRI-compatible robotic arm and developed a valve delivery module. A 12-mm trocar was inserted in the apex of the heart via a subxiphoid incision. The delivery device and nitinol stented prosthesis were mounted on the robot. Two continuous real-time imaging planes provided a virtual real-time 3-dimensional reconstruction. The valve was deployed remotely by the surgeon via a graphic user interface. RESULTS In this acute nonsurvival study, 8 swine underwent robot-assisted rtMRI TAVR for evaluation of feasibility. Device deployment took a mean of 61 ± 5 seconds. Postdeployment necropsy was performed to confirm correlations between imaging and actual valve positions. CONCLUSIONS These results demonstrate the feasibility of robotic-assisted TAVR using rtMRI guidance. This approach may eliminate some of the challenges of performing a procedure while working inside of an MRI scanner, and may improve the success of TAVR. It provides superior visualization during the insertion process, pinpoint accuracy of deployment, and, potentially, communication between the imaging device and the robotic module to prevent incorrect or misaligned deployment.
Collapse
Affiliation(s)
- Justin G Miller
- Cardiothoracic Surgery Research Program, National Heart, Lung and Blood Institute, National Institutes of Health, Bethesda, Md
| | - Ming Li
- Cardiothoracic Surgery Research Program, National Heart, Lung and Blood Institute, National Institutes of Health, Bethesda, Md
| | - Dumitru Mazilu
- Cardiothoracic Surgery Research Program, National Heart, Lung and Blood Institute, National Institutes of Health, Bethesda, Md
| | - Tim Hunt
- Cardiothoracic Surgery Research Program, National Heart, Lung and Blood Institute, National Institutes of Health, Bethesda, Md
| | - Keith A Horvath
- Cardiothoracic Surgery Research Program, National Heart, Lung and Blood Institute, National Institutes of Health, Bethesda, Md.
| |
Collapse
|
10
|
A simple and accurate method for computer-aided transapical aortic valve replacement. Comput Med Imaging Graph 2014; 50:31-41. [PMID: 25306532 DOI: 10.1016/j.compmedimag.2014.09.005] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2014] [Revised: 07/21/2014] [Accepted: 09/12/2014] [Indexed: 11/22/2022]
Abstract
BACKGROUND AND PURPOSE Transapical aortic valve replacement (TAVR) is a recent minimally invasive surgical treatment technique for elderly and high-risk patients with severe aortic stenosis. In this paper, a simple and accurate image-based method is introduced to aid the intra-operative guidance of TAVR procedure under 2-D X-ray fluoroscopy. METHODS The proposed method fuses a 3-D aortic mesh model and anatomical valve landmarks with live 2-D fluoroscopic images. The 3-D aortic mesh model and landmarks are reconstructed from interventional X-ray C-arm CT system, and a target area for valve implantation is automatically estimated using these aortic mesh models. Based on template-based tracking approach, the overlay of visualized 3-D aortic mesh model, landmarks and target area of implantation is updated onto fluoroscopic images by approximating the aortic root motion from a pigtail catheter motion without contrast agent. Also, a rigid intensity-based registration algorithm is used to track continuously the aortic root motion in the presence of contrast agent. Furthermore, a sensorless tracking of the aortic valve prosthesis is provided to guide the physician to perform the appropriate placement of prosthesis into the estimated target area of implantation. RESULTS Retrospective experiments were carried out on fifteen patient datasets from the clinical routine of the TAVR. The maximum displacement errors were less than 2.0mm for both the dynamic overlay of aortic mesh models and image-based tracking of the prosthesis, and within the clinically accepted ranges. Moreover, high success rates of the proposed method were obtained above 91.0% for all tested patient datasets. CONCLUSION The results showed that the proposed method for computer-aided TAVR is potentially a helpful tool for physicians by automatically defining the accurate placement position of the prosthesis during the surgical procedure.
Collapse
|
11
|
Shang W, Su H, Li G, Fischer GS. Teleoperation System with Hybrid Pneumatic-Piezoelectric Actuation for MRI-Guided Needle Insertion with Haptic Feedback. PROCEEDINGS OF THE ... IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS. IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS 2013; 2013:4092-4098. [PMID: 25126446 DOI: 10.1109/iros.2013.6696942] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
This paper presents a surgical master-slave tele-operation system for percutaneous interventional procedures under continuous magnetic resonance imaging (MRI) guidance. This system consists of a piezoelectrically actuated slave robot for needle placement with integrated fiber optic force sensor utilizing Fabry-Perot interferometry (FPI) sensing principle. The sensor flexure is optimized and embedded to the slave robot for measuring needle insertion force. A novel, compact opto-mechanical FPI sensor interface is integrated into an MRI robot control system. By leveraging the complementary features of pneumatic and piezoelectric actuation, a pneumatically actuated haptic master robot is also developed to render force associated with needle placement interventions to the clinician. An aluminum load cell is implemented and calibrated to close the impedance control loop of the master robot. A force-position control algorithm is developed to control the hybrid actuated system. Teleoperated needle insertion is demonstrated under live MR imaging, where the slave robot resides in the scanner bore and the user manipulates the master beside the patient outside the bore. Force and position tracking results of the master-slave robot are demonstrated to validate the tracking performance of the integrated system. It has a position tracking error of 0.318mm and sine wave force tracking error of 2.227N.
Collapse
Affiliation(s)
- Weijian Shang
- Automation and Interventional Medicine (AIM) Robotics Laboratory, Department of Mechanical Engineering, Worcester Polytechnic Institute, 100 Institute Road, Worcester, MA 01609, USA
| | - Hao Su
- Automation and Interventional Medicine (AIM) Robotics Laboratory, Department of Mechanical Engineering, Worcester Polytechnic Institute, 100 Institute Road, Worcester, MA 01609, USA
| | - Gang Li
- Automation and Interventional Medicine (AIM) Robotics Laboratory, Department of Mechanical Engineering, Worcester Polytechnic Institute, 100 Institute Road, Worcester, MA 01609, USA
| | - Gregory S Fischer
- Automation and Interventional Medicine (AIM) Robotics Laboratory, Department of Mechanical Engineering, Worcester Polytechnic Institute, 100 Institute Road, Worcester, MA 01609, USA
| |
Collapse
|
12
|
Vartholomeos P, Bergeles C, Qin L, Dupont PE. An MRI-powered and controlled actuator technology for tetherless robotic interventions. Int J Rob Res 2013. [DOI: 10.1177/0278364913500362] [Citation(s) in RCA: 41] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
This paper presents a novel actuation technology for robotically assisted MRI-guided interventional procedures. In the proposed approach, the MRI scanner is used to deliver power, estimate actuator state and perform closed-loop control. The actuators themselves are compact, inexpensive and wireless. Using needle driving as an example application, actuation principles and force production capabilities are examined. Actuator stability and performance are analyzed for the two cases of state estimation at the input versus the output of the actuator transmission. Closed-loop needle position control is achieved by interleaving imaging pulse sequences to estimate needle position (transmission output estimation) and propulsion pulse sequences to drive the actuator. A prototype needle driving robot is used to validate the proposed approach in a clinical MRI scanner.
Collapse
Affiliation(s)
- Panagiotis Vartholomeos
- Department of Cardiovascular Surgery, Boston Children’s Hospital, Harvard Medical School, Boston, MA, USA
| | - Christos Bergeles
- Department of Cardiovascular Surgery, Boston Children’s Hospital, Harvard Medical School, Boston, MA, USA
| | - Lei Qin
- Dana Farber Cancer Institute, Boston, MA, USA
| | - Pierre E. Dupont
- Department of Cardiovascular Surgery, Boston Children’s Hospital, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
13
|
Jiang S, Feng W, Lou J, Yang Z, Liu J, Yang J. Modelling and control of a five-degrees-of-freedom pneumatically actuated magnetic resonance-compatible robot. Int J Med Robot 2013; 10:170-9. [PMID: 23893561 DOI: 10.1002/rcs.1524] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2012] [Revised: 06/21/2013] [Accepted: 07/05/2013] [Indexed: 11/11/2022]
Abstract
BACKGROUND Magnetic resonance imaging (MRI) combined with robotic assistance has the potential to improve on clinical outcomes of biopsy and local treatment of prostate cancer. This paper introduces a pneumatically actuated surgical robotic system for prostatic interventions under MRI guidance. METHODS A mechanical dynamics model was established using the Lagrange method and simulated using MATLAB software. A pneumatic actuator model was built through the use of system identification, and stability analysis was proposed based on the Nyquist criterion. In addition, a proportional-integral-derivative controller was implemented on the robot for accurate position control. RESULTS Simulation results showed that the steady-state error of a step response was 0.3 mm and the tracking error of a 1.0 Hz sinusoidal response was 1.5 mm. Experimental results showed that the insertion precision was 0.72 mm in the general laboratory environment. CONCLUSIONS The results demonstrated that the robotic system with the designed controller was effective in both position control and trajectory tracking.
Collapse
Affiliation(s)
- Shan Jiang
- Key Laboratory of Mechanism and Equipment Design of the Ministry of Education, Tianjin University, People's Republic of China
| | | | | | | | | | | |
Collapse
|
14
|
Navkar NV, Zhigang Deng, Shah DJ, Tsekos NV. A Framework for Integrating Real-Time MRI With Robot Control: Application to Simulated Transapical Cardiac Interventions. IEEE Trans Biomed Eng 2013; 60:1023-33. [DOI: 10.1109/tbme.2012.2230398] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
15
|
Minimally invasive cardiac surgery: transapical aortic valve replacement. Minim Invasive Surg 2012; 2012:145381. [PMID: 23125924 PMCID: PMC3480029 DOI: 10.1155/2012/145381] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2012] [Accepted: 09/21/2012] [Indexed: 11/19/2022] Open
Abstract
Minimally invasive cardiac surgery is less traumatic and therefore leads to quicker recovery. With the assistance of engineering technologies on devices, imaging, and robotics, in conjunction with surgical technique, minimally invasive cardiac surgery will improve clinical outcomes and expand the cohort of patients that can be treated. We used transapical aortic valve implantation as an example to demonstrate that minimally invasive cardiac surgery can be implemented with the integration of surgical techniques and engineering technologies. Feasibility studies and long-term evaluation results prove that transapical aortic valve implantation under MRI guidance is feasible and practical. We are investigating an MRI compatible robotic surgical system to further assist the surgeon to precisely deliver aortic valve prostheses via a transapical approach. Ex vivo experimentation results indicate that a robotic system can also be employed in in vivo models.
Collapse
|
16
|
Image-guided transapical aortic valve implantation: sensorless tracking of stenotic valve landmarks in live fluoroscopic images. INNOVATIONS-TECHNOLOGY AND TECHNIQUES IN CARDIOTHORACIC AND VASCULAR SURGERY 2012; 6:231-6. [PMID: 22437980 DOI: 10.1097/imi.0b013e31822c6a77] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
OBJECTIVE Aortic valve stenosis is one of the most frequently acquired valvular heart diseases, accounting for almost 70% of valvular cardiac surgery. Transapical transcatheter aortic valve implantation has recently become a suitable minimally invasive technique for high-risk and elderly patients with severe aortic stenosis. In this article, we aim to automatically define a target area of valve implantation, namely, the area between the coronary ostia and the lowest points of two aortic valve cusps. Therefore, we present a new image-based tracking method of these aortic landmarks to assist in the placement of aortic valve prosthesis under live 2D fluoroscopy guidance. METHODS We propose a rigid intensity-based image registration technique for tracking valve landmarks in 2D fluoroscopic image sequences, based on a real-time alignment of a contrast image including the initialized manual valve landmarks to each image of sequence. The contrast image is automatically detected to visualize aortic valve features when the aortic root is filled with a contrast agent. RESULTS Our registration-based tracking method has been retrospectively applied to 10 fluoroscopic image sequences from routine transapical aortic valve implantation procedures. Most of all tested fluoroscopic images showed a successful tracking of valve landmarks, especially for the images without contrast agent injections. CONCLUSIONS A new intraoperative image-based method has been developed for tracking aortic valve landmarks in live 2D fluoroscopic images to assist transapical aortic valve implantations and to increase the overall safety of surgery as well.
Collapse
|
17
|
Abstract
First used medically in 1985, robots now make an impact in laparoscopy, neurosurgery, orthopedic surgery, emergency response, and various other medical disciplines. This paper provides a review of medical robot history and surveys the capabilities of current medical robot systems, primarily focusing on commercially available systems while covering a few prominent research projects. By examining robotic systems across time and disciplines, trends are discernible that imply future capabilities of medical robots, for example, increased usage of intraoperative images, improved robot arm design, and haptic feedback to guide the surgeon.
Collapse
|
18
|
Abstract
Real-time image-guided cardiac procedures (manual or robot-assisted) are emerging due to potential improvement in patient management and reduction in the overall cost. These minimally invasive procedures require both real-time visualization and guidance for maneuvering an interventional tool safely inside the dynamic environment of a heart. In this work, we propose an approach to generate dynamic 4D access corridors from the apex to the aortic annulus for performing real-time MRI guided transapical valvuloplasties. Ultrafast MR images (collected every 49.3 ms) are processed on-the-fly using projections to extract a conservative dynamic trace in form of a three-dimensional access corridor. Our experimental results show that the reconstructed corridors can be refreshed with a delay of less than 0.5ms to reflect the changes inside the left ventricle caused by breathing motion and the heartbeat.
Collapse
|
19
|
Merk DR, Karar ME, Chalopin C, Holzhey D, Falk V, Mohr FW, Burgert O. Image-Guided Transapical Aortic Valve Implantation Sensorless Tracking of Stenotic Valve Landmarks in Live Fluoroscopic Images. INNOVATIONS-TECHNOLOGY AND TECHNIQUES IN CARDIOTHORACIC AND VASCULAR SURGERY 2011. [DOI: 10.1177/155698451100600404] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Affiliation(s)
- Denis R. Merk
- Department of Cardiothoracic Surgery, School of Medicine, Stanford University, Stanford, CA USA
- Department of Cardiothoracic Surgery, Heart Center Leipzig, University of Leipzig, Leipzig, Germany
| | - Mohamed Esmail Karar
- Innovation Center Computer Assisted Surgery (ICCAS), University of Leipzig, Leipzig, Germany
| | - Claire Chalopin
- Innovation Center Computer Assisted Surgery (ICCAS), University of Leipzig, Leipzig, Germany
| | - David Holzhey
- Department of Cardiothoracic Surgery, Heart Center Leipzig, University of Leipzig, Leipzig, Germany
| | - Volkmar Falk
- Division of Heart and Vascular Surgery, University Hospital Zurich, Zurich, Switzerland
| | - Friedrich W. Mohr
- Department of Cardiothoracic Surgery, Heart Center Leipzig, University of Leipzig, Leipzig, Germany
| | - Oliver Burgert
- Innovation Center Computer Assisted Surgery (ICCAS), University of Leipzig, Leipzig, Germany
| |
Collapse
|
20
|
Karar ME, John M, Holzhey D, Falk V, Mohr FW, Burger O. Model-updated image-guided minimally invasive off-pump transcatheter aortic valve implantation. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2011; 14:275-282. [PMID: 22003627 DOI: 10.1007/978-3-642-23623-5_35] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
This paper presents a method for assisting the placement of stented aortic valve prosthesis during minimally invasive off-pump transcatheter aortic valve implantation (TAVI) under live 2-D X-ray fluoroscopy guidance. The proposed method includes a dynamic overlay of an intra-operative 3-D aortic root mesh model and an estimated target area of valve implantation onto live 2-D fluoroscopic images. This is based on a template-based tracking procedure of a pigtail catheter without further injections of contrast agent. Minimal user-interaction is required to initialize the algorithm and to correct fluoroscopy overlay errors if needed. Retrospective experiments were carried out on ten patient datasets from the clinical routine of the TAVI. The mean displacement errors of the updated aortic root mesh model overlays are less than 2.0 mm without manual overlay corrections. The results show that the guidance performance of live 2-D fluoroscopy is potentially improved when using our proposed method for the TAVIs.
Collapse
Affiliation(s)
- Mohamed Esmail Karar
- Innovation Center Computer Assisted Surgery (ICCAS), University of Leipzig, Germany.
| | | | | | | | | | | |
Collapse
|