1
|
de Boutray M, Cuau L, Ohayon M, Garrel R, Poignet P, Zemiti N. Robot-guided osteotomy in fibula free flap mandibular reconstruction: a preclinical study. Int J Oral Maxillofac Surg 2024; 53:343-346. [PMID: 37604757 DOI: 10.1016/j.ijom.2023.07.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2023] [Revised: 07/19/2023] [Accepted: 07/25/2023] [Indexed: 08/23/2023]
Abstract
Various methods currently exist to guide fibular osteotomy positioning in fibula free flap mandibular reconstruction, but patient-specific navigation methods and cutting guides require experience, and may be time-consuming and/or expensive. This study describes a robot-guided osteotomy technique for mandible reconstruction using a fibula free flap according to virtual preoperative planning. The method was assessed on five 3D-printed models and a cadaveric model. The precision of the robot-guided osteotomy was evaluated by measuring the deviations between the lengths and angles of the fragments obtained and those of the virtual planning. The average deviation of the anterior and posterior crest lengths was 0.42 ± 0.29 mm for the 3D-printed models and 1.00 ± 0.53 mm for the cadaveric model. The average angle deviation was 1.90 ± 1.22° and 1.94 ± 0.69° for the 3D-printed and cadaveric models, respectively. The results of this preclinical study revealed that fibular osteotomy positioning guidance using a robot-positioned cutting guide may be a precise, easy-to-use technique that could be tailored for fibula free flap mandibular reconstruction.
Collapse
Affiliation(s)
- M de Boutray
- ENT Department, Neck Surgery and Maxillofacial Surgery, Gui de Chauliac University Hospital, Montpellier University School of Medicine, Montpellier, France; LIRMM, University of Montpellier, CNRS, Montpellier, France.
| | - L Cuau
- LIRMM, University of Montpellier, CNRS, Montpellier, France
| | - M Ohayon
- LIRMM, University of Montpellier, CNRS, Montpellier, France
| | - R Garrel
- ENT Department, Neck Surgery and Maxillofacial Surgery, Gui de Chauliac University Hospital, Montpellier University School of Medicine, Montpellier, France
| | - P Poignet
- LIRMM, University of Montpellier, CNRS, Montpellier, France
| | - N Zemiti
- LIRMM, University of Montpellier, CNRS, Montpellier, France
| |
Collapse
|
2
|
Ríos-Hernández M, Jacinto-Villegas JM, Zemiti N, Vilchis-González AH, Padilla-Castañeda MA, Debien B. Development of a lumbar puncture virtual simulator for medical students training: A preliminary evaluation. Int J Med Robot 2023; 19:e2572. [PMID: 37671968 DOI: 10.1002/rcs.2572] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2023] [Revised: 08/21/2023] [Accepted: 08/24/2023] [Indexed: 09/07/2023]
Abstract
BACKGROUND Lumbar puncture is an essential medical procedure whose objective is to obtain cerebrospinal fluid. Lumbar puncture is considered a complex procedure, mainly for novice residents who suffer from stress and low confidence, which may result in harm to the patient. METHODS The LPVirSim, has been developed in four stages: i) requirements analysis through user-centred design; ii) prototyping of the virtual environment and the haptic component; iii) preliminary tests with Ph.D. students and physicians using two haptic devices (Omega.7 and Sigma.7); iv) a user study where physicians evaluated the usability and user experience. RESULTS The LPVirSim integrates non-technical skills and the possibility of representing different patients for training. Usability increased from 61.76 to 68.75 in the preliminary tests to 71.43 in the user study. CONCLUSIONS All the results showed good usability and demonstrated that the simulator arouses interest and realistically represents a Lumbar puncture, through the force and visual feedback.
Collapse
Affiliation(s)
| | - Juan Manuel Jacinto-Villegas
- Faculty of Engineering, Universidad Autónoma Del Estado de México, Toluca, Mexico
- "Investigadoras e Investigadores por México" del CONAHCYT, Mexico City, Mexico
| | - Nabil Zemiti
- Laboratory of Informatics, Robotics and Microelectronics of Montpellier (LIRMM), University of Montpellier, Montpellier, France
| | | | | | - Blaise Debien
- Montpellier Emergency Training Center (CESU), Montpellier, France
- University of Montpellier, Montpellier, France
| |
Collapse
|
3
|
Cuau L, De Boutray M, Cavalcanti Santos J, Zemiti N, Poignet P. Contactless surface registration of featureless anatomy using structured light camera: application to fibula navigation in mandible reconstruction. Int J Comput Assist Radiol Surg 2023; 18:2073-2082. [PMID: 37270743 DOI: 10.1007/s11548-023-02966-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2023] [Accepted: 05/16/2023] [Indexed: 06/05/2023]
Abstract
PURPOSE Mandibular reconstruction using fibula free flap is a challenging surgical procedure. To assist osteotomies, computer-assisted surgery (CAS) can be used. Nevertheless, precise registration is required and often necessitates anchored markers that disturb the patient and clinical flow. This work proposes a new contactless surface-based method adapted to featureless anatomies such as fibula to achieve a fast, precise, and reproducible registration. METHODS Preoperatively, a CT-scan of the patient is realized and osteotomies are virtually planned. During surgery, a structured light camera digitizes the fibula. The obtained intraoperative point cloud is coarsely registered with the preoperative model using 3 points defined in the CT-scan and located on the patient's bone with a laser beam. Then, a fine registration is performed using an ICP algorithm. The registration accuracy was evaluated comparing the position of points engraved in a 3D-printed fibula with their position in the registered model and evaluating resulting osteotomies. Accuracy and execution time were compared to a conventional stylus-based registration method. The work was validated in vivo. RESULTS The experiment performed on a 3D-printed model showed that execution time is equivalent to surface-based registration using a stylus, with a better accuracy (mean TRE of 0.9 mm vs 1.3 mm using stylus) and guarantee good osteotomies. The preliminary in vivo study proved the feasibility of the method. CONCLUSION The proposed contactless surface-based registration method using structured light camera gave promising results in terms of accuracy and execution speed and should be useful to implement CAS for mandibular reconstruction.
Collapse
Affiliation(s)
- Lénaïc Cuau
- LIRMM, University of Montpellier, CNRS, Montpellier, France.
| | - Marie De Boutray
- LIRMM, University of Montpellier, CNRS, Montpellier, France
- Department of Maxillofacial Surgery, Gui de Chauliac University Hospital, Montpellier, France
| | | | - Nabil Zemiti
- LIRMM, University of Montpellier, CNRS, Montpellier, France
| | | |
Collapse
|
4
|
Lavenir L, Santos JC, Zemiti N, Kaderbay A, Venail F, Poignet P. Miniaturized Endoscopic 2D US Transducer for Volumetric Ultrasound Imaging of the Auditory System. IEEE Trans Biomed Eng 2023; 70:2624-2635. [PMID: 37027277 DOI: 10.1109/tbme.2023.3260683] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/08/2023]
Abstract
OBJECTIVE In this paper, we focus on the carrying out and validation of minimally invasive three-dimensional (3D) ultrasound (US) imaging of the auditory system, which is based on a new miniaturized endoscopic 2D US transducer. METHODS This unique probe consists of a 18 MHz 24 elements curved array transducer with a distal diameter of 4 mm so it can be inserted into the external auditory canal. Typical acquisition is achieved by rotating such a transducer around its own axis using a robotic platform. Reconstruction of a US volume from the set of acquired B-scans during the rotation is then performed using scan-conversion. The accuracy of the reconstruction procedure is evaluated using a dedicated phantom that includes a set of wires as reference geometry. RESULTS Twelve acquisitions obtained from different probe poses are compared to a micro-computed tomographic model of the phantom, leading to a maximum error of 0.20 mm. Additionally, acquisitions with a cadaveric head highlight the clinical applicability of this set up. Structures of the auditory system such as the ossicles and the round window can be identified from the obtained 3D volumes. CONCLUSION These results confirm that our technique enables the accurate imaging of the middle and inner ears without having to deteriorate the surrounding bone. SIGNIFICANCE Since US is a real-time, wide available and non-ionizing imaging modality, our acquisition setup could facilitate the minimally invasive diagnosis and surgical navigation for otology in a fast, cost-effective and safe way.
Collapse
|
5
|
Li C, Liu C, Huaulme A, Zemiti N, Jannin P, Poignet P. sEMG-based Motion Recognition for Robotic Surgery Training - A Preliminary Study. Annu Int Conf IEEE Eng Med Biol Soc 2023; 2023:1-4. [PMID: 38083107 DOI: 10.1109/embc40787.2023.10340047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Robotic surgery represents a major breakthrough in the evolution of medical technology. Accordingly, efficient skill training and assessment methods should be developed to meet the surgeon's need of acquiring such robotic skills over a relatively short learning curve in a safe manner. Different from conventional training and assessment methods, we aim to explore the surface electromyography (sEMG) signal during the training process in order to obtain semantic and interpretable information to help the trainee better understand and improve his/her training performance. As a preliminary study, motion primitive recognition based on sEMG signal is studied in this work. Using machine learning (ML) technique, it is shown that the sEMG-based motion recognition method is feasible and promising for hand motions along 3 Cartesian axes in the virtual reality (VR) environment of a commercial robotic surgery training platform, which will hence serve as the basis for new robotic surgical skill assessment criterion and training guidance based on muscle activity information. Considering certain motion patterns were less accurately recognized than others, more data collection and deep learning-based analysis will be carried out to further improve the recognition accuracy in future research.
Collapse
|
6
|
Santos JC, Cuau L, Poignet P, Zemiti N. Decoupled Model Predictive Control for Path Following on Complex Surfaces. IEEE Robot Autom Lett 2023. [DOI: 10.1109/lra.2023.3246393] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/19/2023]
Affiliation(s)
| | - Lenaic Cuau
- The authors are with the LIRMM, Univ Montpellier, CNRS, France
| | | | - Nabil Zemiti
- The authors are with the LIRMM, Univ Montpellier, CNRS, France
| |
Collapse
|
7
|
de Boutray M, Cavalcanti Santos J, Bourgeade A, Ohayon M, Chammas PE, Garrel R, Poignet P, Zemiti N. Fibular registration using surface matching in navigation-guided osteotomies: a proof of concept study on 3D-printed models. Int J Comput Assist Radiol Surg 2022; 17:1321-1331. [DOI: 10.1007/s11548-022-02608-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2021] [Accepted: 03/10/2022] [Indexed: 01/17/2023]
|
8
|
Abstract
Electrical Impedance Tomography (EIT) is a powerful imaging tool for investigating electrical properties of tissues such as that of human bodies. The cheap, harmless and portable nature of this tool has made EIT a popular choice in many biomedical applications. However, performing EIT requires strong development at both hardware and software levels. In particular, performing in-lab experiences remains a challenge due to the cost of commercially available devices or the complexity of systems proposed in scientific literature. In this paper, an efficient and easily replicable EIT hardware is presented. This hardware was developed with the objective of making EIT accessible to as many people as possible. It has been designed for operating frequencies between 1 kHz and 50 kHz, and can be used for in-lab validation of proof of concept. Special care has been paid to the choice of components in order to optimize the performance versus cost ratio. Also, the overall footprint has been reduced by using recent and up-to-date integrated circuits. In particular, the use of a lock-in amplifier is a compact solution that allows both narrow-band filtering of the signal and provides an easily quantifiable DC signal at the output. Circuit schematics as well as manufacturing files are shared so that understanding, replication and improvement of circuits are facilitated. Fabrication and usage procedures are given as well. At last, the proposed hardware is experimentally tested and validated first by comparing experimental data to simulations, then by reconstructing an inclusion in biological tissues.
Collapse
Affiliation(s)
- B. Brazey
- LIRMM, Univ Montpellier, CNRS, Montpellier, France
| | - Y. Haddab
- LIRMM, Univ Montpellier, CNRS, Montpellier, France
| | - N. Zemiti
- LIRMM, Univ Montpellier, CNRS, Montpellier, France
| | - F. Mailly
- LIRMM, Univ Montpellier, CNRS, Montpellier, France
| | - P. Nouet
- LIRMM, Univ Montpellier, CNRS, Montpellier, France
| |
Collapse
|
9
|
Brazey B, Haddab Y, Zemiti N. Robust imaging using electrical impedance tomography: review of current tools. Proc Math Phys Eng Sci 2022; 478:20210713. [PMID: 35197802 PMCID: PMC8808710 DOI: 10.1098/rspa.2021.0713] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2021] [Accepted: 12/13/2021] [Indexed: 01/26/2023] Open
Abstract
Electrical impedance tomography (EIT) is a medical imaging technique with many advantages and great potential for development in the coming years. Currently, some limitations of EIT are related to the ill-posed nature of the problem. These limitations are translated on a practical level by a lack of genericity of the developed tools. In this paper, the main robust data acquisition and processing tools for EIT proposed in the scientific literature are presented. Their relevance and potential to improve the robustness of EIT are analysed, in order to conclude on the feasibility of a robust EIT tool capable of providing resistivity or difference of resistivity mapping in a wide range of applications. In particular, it is shown that certain measurement acquisition tools and algorithms, such as faulty electrode detection algorithm or particular electrode designs, can ensure the quality of the acquisition in many circumstances. Many algorithms, aiming at processing acquired data, are also described and allow to overcome certain difficulties such as an error in the knowledge of the position of the boundaries or the poor conditioning of the inverse problem. They have a strong potential to faithfully reconstruct a quality image in the presence of disturbances such as noise or boundary modelling error.
Collapse
Affiliation(s)
| | | | - Nabil Zemiti
- LIRMM, Univ Montpellier, CNRS, Montpellier, France
| |
Collapse
|
10
|
Brazey B, Haddab Y, Koebel L, Zemiti N. Electrical impedance tomography: a potential tool for intraoperative imaging of the tongue base. Physiol Meas 2022; 43. [PMID: 35021162 DOI: 10.1088/1361-6579/ac4a87] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2021] [Accepted: 01/12/2022] [Indexed: 11/12/2022]
Abstract
The presence of a tumor in the tongue is a pathology that requires surgical intervention from a certain stage. This type of surgery is difficult to perform because of the limited space available around the base of the tongue for the insertion of surgical tools. During the procedure, the surgeon has to stretch and then fix the tongue firmly in order to optimize the available space and prevent tissue movement. As a result, the preoperative images of the inside of the tongue no longer give a reliable indication of the position and shape of the cancerous tissue due to the deformation of the overall tissue in the area. Thus, new images are needed during the operation, but are very difficult to obtain using conventional techniques due to the presence of surgical tools. Electrical Impedance Tomography (EIT) is an imaging technique that maps the resistivity or difference of resistivity of biological tissues from electrical signals. The small size of the electrodes makes it a potentially interesting tool to obtain intraoperative images of the inside of the tongue. In this paper, the possibility of using EIT for this purpose is investigated. A detection method is proposed, including an original configuration of the electrodes, consistent with the anatomical specificities of the tongue. The proposed method is studied in simulation and then a proof of concept is obtained experimentally on a 3D printed test tank filled with saline solution and plant fibres.
Collapse
Affiliation(s)
- Benoit Brazey
- Robotics, LIRMM, 161 Rue Ada, Montpellier, Montpellier, 34000, FRANCE
| | - Yassine Haddab
- Robotics, LIRMM, 161 rue Ada, Montpellier, 34000, FRANCE
| | - Laure Koebel
- FEMTO-ST, 15B Av. des Montboucons, Besancon, Bourgogne-Franche-Comté, 25000, FRANCE
| | - Nabil Zemiti
- Robotics, LIRMM, 161 rue Ada, Montpellier, 34000, FRANCE
| |
Collapse
|
11
|
Lavenir L, Zemiti N, Akkari M, Subsol G, Venail F, Poignet P. HFUS Imaging of the Cochlea: A Feasibility Study for Anatomical Identification by Registration with MicroCT. Ann Biomed Eng 2020; 49:1308-1317. [PMID: 33128180 DOI: 10.1007/s10439-020-02671-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2020] [Accepted: 10/21/2020] [Indexed: 11/25/2022]
Abstract
Cochlear implantation consists in electrically stimulating the auditory nerve by inserting an electrode array inside the cochlea, a bony structure of the inner ear. In the absence of any visual feedback, the insertion results in many cases of damages of the internal structures. This paper presents a feasibility study on intraoperative imaging and identification of cochlear structures with high-frequency ultrasound (HFUS). 6 ex-vivo guinea pig cochleae were subjected to both US and microcomputed tomography (µCT) we respectively referred as intraoperative and preoperative modalities. For each sample, registration based on simulating US from the scanner was performed to allow a precise matching between the visible structures. According to two otologists, the procedure led to a target registration error of 0.32 mm ± 0.05. Thanks to referring to a better preoperative anatomical representation, we were able to intraoperatively identify the modiolus, both scalae vestibuli and tympani and deduce the location of the basilar membrane, all of which is of great interest for cochlear implantation. Our main objective is to extend this procedure to the human case and thus provide a new tool for inner ear surgery.
Collapse
Affiliation(s)
- Lucas Lavenir
- LIRMM, University of Montpellier, CNRS, Montpellier, France
| | - Nabil Zemiti
- LIRMM, University of Montpellier, CNRS, Montpellier, France.
| | - Mohamed Akkari
- Department of ENT and Head and Neck Surgery, University Hospital Gui de Chauliac, University of Montpellier, Montpellier, France
| | - Gérard Subsol
- LIRMM, University of Montpellier, CNRS, Montpellier, France
| | - Frédéric Venail
- Department of ENT and Head and Neck Surgery, University Hospital Gui de Chauliac, University of Montpellier, Montpellier, France.,Institute for Neurosciences of Montpellier, INSERM U105, Montpellier, France
| | | |
Collapse
|
12
|
Shen J, Zemiti N, Taoum C, Aiche G, Dillenseger JL, Rouanet P, Poignet P. Transrectal ultrasound image-based real-time augmented reality guidance in robot-assisted laparoscopic rectal surgery: a proof-of-concept study. Int J Comput Assist Radiol Surg 2019; 15:531-543. [DOI: 10.1007/s11548-019-02100-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2019] [Accepted: 11/27/2019] [Indexed: 12/21/2022]
|
13
|
Shen J, Zemiti N, Dillenseger JL, Poignet P. Fast And Simple Automatic 3D Ultrasound Probe Calibration Based On 3D Printed Phantom And An Untracked Marker. Annu Int Conf IEEE Eng Med Biol Soc 2018; 2018:878-882. [PMID: 30440531 DOI: 10.1109/embc.2018.8512406] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Tracking the pose of an ultrasound (US) probe is essential for an intraoperative US-based navigation system. The tracking requires mounting a marker on the US probe and calibrating the probe. The goal of the US probe calibration is to determine the rigid transformation between the coordinate system (CS) of the image and the CS of the marker mounted on the probe. We present a fast and automatic calibration method based on a 3D printed phantom and an untracked marker for three-dimensional (3D) US probe calibration. To simplify the conventional calibration procedures using and tracking at least two markers, we used only one marker and did not track it in the whole calibration process. Our automatic calibration method is fast, simple and does not require any experience from the user. The performance of our calibration method was evaluated by point reconstruction tests. The root mean square (RMS) of the point reconstruction errors was 1.39 mm.
Collapse
|
14
|
Favier V, Zemiti N, Caravaca Mora O, Subsol G, Captier G, Lebrun R, Crampette L, Mondain M, Gilles B. Geometric and mechanical evaluation of 3D-printing materials for skull base anatomical education and endoscopic surgery simulation - A first step to create reliable customized simulators. PLoS One 2017; 12:e0189486. [PMID: 29252993 PMCID: PMC5734742 DOI: 10.1371/journal.pone.0189486] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2017] [Accepted: 11/27/2017] [Indexed: 11/18/2022] Open
Abstract
INTRODUCTION Endoscopic skull base surgery allows minimal invasive therapy through the nostrils to treat infectious or tumorous diseases. Surgical and anatomical education in this field is limited by the lack of validated training models in terms of geometric and mechanical accuracy. We choose to evaluate several consumer-grade materials to create a patient-specific 3D-printed skull base model for anatomical learning and surgical training. METHODS Four 3D-printed consumer-grade materials were compared to human cadaver bone: calcium sulfate hemihydrate (named Multicolor), polyamide, resin and polycarbonate. We compared the geometric accuracy, forces required to break thin walls of materials and forces required during drilling. RESULTS All materials had an acceptable global geometric accuracy (from 0.083mm to 0.203mm of global error). Local accuracy was better in polycarbonate (0.09mm) and polyamide (0.15mm) than in Multicolor (0.90mm) and resin (0.86mm). Resin and polyamide thin walls were not broken at 200N. Forces needed to break Multicolor thin walls were 1.6-3.5 times higher than in bone. For polycarbonate, forces applied were 1.6-2.5 times higher. Polycarbonate had a mode of fracture similar to the cadaver bone. Forces applied on materials during drilling followed a normal distribution except for the polyamide which was melted. Energy spent during drilling was respectively 1.6 and 2.6 times higher on bone than on PC and Multicolor. CONCLUSION Polycarbonate is a good substitute of human cadaver bone for skull base surgery simulation. Thanks to short lead times and reasonable production costs, patient-specific 3D printed models can be used in clinical practice for pre-operative training, improving patient safety.
Collapse
Affiliation(s)
- Valentin Favier
- Montpellier Laboratory of Informatics, Robotics and Microelectonics (LIRMM), ICAR team, French National Centre for Scientific Research (CNRS), Montpellier University, Montpellier, France
- ENT department, University Hospital of Montpellier, Gui de Chauliac Hospital, Montpellier, France
| | - Nabil Zemiti
- LIRMM, DEXTER team, CNRS, Montpellier University, Montpellier, France
| | | | - Gérard Subsol
- Montpellier Laboratory of Informatics, Robotics and Microelectonics (LIRMM), ICAR team, French National Centre for Scientific Research (CNRS), Montpellier University, Montpellier, France
| | - Guillaume Captier
- Anatomy laboratory, School of Medicine, Montpellier University, Montpellier, France
| | - Renaud Lebrun
- Evolutionary Sciences Institute of Montpellier, MRI-ISEM, University of Montpellier, Montpellier, France
| | - Louis Crampette
- ENT department, University Hospital of Montpellier, Gui de Chauliac Hospital, Montpellier, France
| | - Michel Mondain
- ENT department, University Hospital of Montpellier, Gui de Chauliac Hospital, Montpellier, France
| | - Benjamin Gilles
- Montpellier Laboratory of Informatics, Robotics and Microelectonics (LIRMM), ICAR team, French National Centre for Scientific Research (CNRS), Montpellier University, Montpellier, France
- AnatoScope SA, Montpellier, France
| |
Collapse
|
15
|
Despinoy F, Bouget D, Forestier G, Penet C, Zemiti N, Poignet P, Jannin P. Unsupervised Trajectory Segmentation for Surgical Gesture Recognition in Robotic Training. IEEE Trans Biomed Eng 2015; 63:1280-91. [PMID: 26513773 DOI: 10.1109/tbme.2015.2493100] [Citation(s) in RCA: 64] [Impact Index Per Article: 7.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Dexterity and procedural knowledge are two critical skills that surgeons need to master to perform accurate and safe surgical interventions. However, current training systems do not allow us to provide an in-depth analysis of surgical gestures to precisely assess these skills. Our objective is to develop a method for the automatic and quantitative assessment of surgical gestures. To reach this goal, we propose a new unsupervised algorithm that can automatically segment kinematic data from robotic training sessions. Without relying on any prior information or model, this algorithm detects critical points in the kinematic data that define relevant spatio-temporal segments. Based on the association of these segments, we obtain an accurate recognition of the gestures involved in the surgical training task. We, then, perform an advanced analysis and assess our algorithm using datasets recorded during real expert training sessions. After comparing our approach with the manual annotations of the surgical gestures, we observe 97.4% accuracy for the learning purpose and an average matching score of 81.9% for the fully automated gesture recognition process. Our results show that trainees workflow can be followed and surgical gestures may be automatically evaluated according to an expert database. This approach tends toward improving training efficiency by minimizing the learning curve.
Collapse
|
16
|
Moreira P, Zemiti N, Liu C, Poignet P. Viscoelastic model based force control for soft tissue interaction and its application in physiological motion compensation. Comput Methods Programs Biomed 2014; 116:52-67. [PMID: 24612709 DOI: 10.1016/j.cmpb.2014.01.017] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/29/2013] [Revised: 10/14/2013] [Accepted: 01/27/2014] [Indexed: 06/03/2023]
Abstract
Controlling the interaction between robots and living soft tissues has become an important issue as the number of robotic systems inside the operating room increases. Many researches have been done on force control to help surgeons during medical procedures, such as physiological motion compensation and tele-operation systems with haptic feedback. In order to increase the performance of such controllers, this work presents a novel force control scheme using Active Observer (AOB) based on a viscoelastic interaction model. The control scheme has shown to be stable through theoretical analysis and its performance was evaluated by in vitro experiments. In order to evaluate how the force control scheme behaves under the presence of physiological motion, experiments considering breathing and beating heart disturbances are presented. The proposed control scheme presented a stable behavior in both static and moving environment. The viscoelastic AOB presented a compensation ratio of 87% for the breathing motion and 79% for the beating heart motion.
Collapse
Affiliation(s)
- Pedro Moreira
- LIRMM, UMR 5506, CNRS-Université Montpellier 2, 161 Rue Ada, 34095 Montpellier Cedex 05, France.
| | - Nabil Zemiti
- LIRMM, UMR 5506, CNRS-Université Montpellier 2, 161 Rue Ada, 34095 Montpellier Cedex 05, France
| | - Chao Liu
- LIRMM, UMR 5506, CNRS-Université Montpellier 2, 161 Rue Ada, 34095 Montpellier Cedex 05, France
| | - Philippe Poignet
- LIRMM, UMR 5506, CNRS-Université Montpellier 2, 161 Rue Ada, 34095 Montpellier Cedex 05, France
| |
Collapse
|
17
|
Despinoy F, Sánchez A, Zemiti N, Jannin P, Poignet P. Comparative Assessment of a Novel Optical Human-Machine Interface for Laparoscopic Telesurgery. ACTA ACUST UNITED AC 2014. [DOI: 10.1007/978-3-319-07521-1_3] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/22/2023]
|
18
|
Sánchez LA, Petroni G, Piccigallo M, Scarfogliero U, Niccolini M, Liu C, Stefanini C, Zemiti N, Menciassi A, Poignet P, Dario P. Real-time control and evaluation of a teleoperated miniature arm for Single Port Laparoscopy. Annu Int Conf IEEE Eng Med Biol Soc 2012; 2011:7049-53. [PMID: 22255962 DOI: 10.1109/iembs.2011.6091782] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
This paper presents the control architecture and the first performance evaluation results of a novel and highly-dexterous 18 degrees of freedom (DOF) miniature master/slave teleoperated robotic system called SPRINT (Single-Port la-paRoscopy bimaNual roboT). The system was evaluated in terms of positioning accuracy, repeatability, tracking error during local teleoperation and end-effector payload. Moreover, it was experimentally verified that the control architecture is real-time compliant at an operating frequency of 1 kHz and it is also reliable in terms of safety. The architecture accounts for cases when the robot is lead through singularities, and includes other safety mechanisms, such as supervision tasks and watchdog timers. Peliminary tests that were performed by surgeons in-vitro suggest that the SPRINT robot, along with its real-time control architecture, could become in the near future a reliable system in the field of Single Port Laparoscopy.
Collapse
|
19
|
Liu C, Moreira P, Zemiti N, Poignet P. 3D force control for robotic-assisted beating heart surgery based on viscoelastic tissue model. Annu Int Conf IEEE Eng Med Biol Soc 2012; 2011:7054-8. [PMID: 22255963 DOI: 10.1109/iembs.2011.6091783] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Current cardiac surgery faces the challenging problem of heart beating motion even with the help of mechanical stabilizer which makes delicate operation on the heart surface difficult. Motion compensation methods for robotic-assisted beating heart surgery have been proposed recently in literature, but research on force control for such kind of surgery has hardly been reported. Moreover, the viscoelasticity property of the interaction between organ tissue and robotic instrument further complicates the force control design which is much easier in other applications by assuming the interaction model to be elastic (industry, stiff object manipulation, etc.). In this work, we present a three-dimensional force control method for robotic-assisted beating heart surgery taking into consideration of the viscoelastic interaction property. Performance studies based on our D2M2 robot and 3D heart beating motion information obtained through Da Vinci™ system are provided.
Collapse
Affiliation(s)
- Chao Liu
- Robotics Department, LIRMM - CNRS, Montpellier, France.
| | | | | | | |
Collapse
|
20
|
|
21
|
|
22
|
|
23
|
Kobayashi Y, Moreira P, Liu C, Poignet P, Zemiti N, Fujie MG. Haptic feedback control in medical robots through fractional viscoelastic tissue model. Annu Int Conf IEEE Eng Med Biol Soc 2011; 2011:6704-6708. [PMID: 22255877 DOI: 10.1109/iembs.2011.6091653] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
In this paper, we discuss the design of an adaptive control system for robot-assisted surgery with haptic feedback. Through a haptic device, the surgeon teleoperates the medical instrument in free space, fixed on a remote robot or in contact. In free space, the surgeon feels the motion of the robot. In the present paper, we evaluated the performance of the controller on viscoelastic tissue, modeled by a fractional derivative equation. In addition, we propose a novel controller using an integer formalization process that is suitable for these tissue properties. The simulation results suggested that performance, in terms of force control and telepresence, became poorer when the conventional controller, which was designed for elastic target object, was applied to the viscoelastic tissues. In contrast, the results suggested that our proposed controller maintained its performance on the viscoelastic tissues.
Collapse
Affiliation(s)
- Yo Kobayashi
- Faculty of Science and Engineering, Waseda University, Japan.
| | | | | | | | | | | |
Collapse
|
24
|
Poignet P, Chemori A, Zemiti N, Liu C. Some control-related issues in mini-robotics for endoluminal surgery. Annu Int Conf IEEE Eng Med Biol Soc 2009; 2009:6850-6855. [PMID: 19964182 DOI: 10.1109/iembs.2009.5333117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Abstract
This paper introduces some issues related to the development of robotics for endoluminal surgery from control point of view. Endoluminal surgery are incisionless procedures performed through natural orifices within the natural pathways. New devices are then required to achieve these new surgical procedures. Besides the development of new devices, control issues arise in both technological and theoretical aspects. The paper presents some of them and we propose a teleoperation architecture that has already been tested for needle insertion that could be used for teleoperated endoluminal surgery especially for instance for biopsies or anastomoses.
Collapse
Affiliation(s)
- Philippe Poignet
- LIRMM, UMR 5506, Univ. Montpellier 2-CNRS, 161 Rue Ada, 34392 Montpellier, France.
| | | | | | | |
Collapse
|
25
|
Hungr N, Troccaz J, Zemiti N, Tripodi N. Design of an ultrasound-guided robotic brachytherapy needle-insertion system. Annu Int Conf IEEE Eng Med Biol Soc 2009; 2009:250-253. [PMID: 19964212 DOI: 10.1109/iembs.2009.5333801] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Abstract
In this paper we describe a new robotic brachytherapy needle-insertion system that is designed to replace the template used in the manual technique. After a brief review of existing robotic systems, we describe the requirements that we based our design upon. A detailed description of the proposed system follows. Our design is capable of positioning and inclining a needle within the same workspace as the manual template. To help improve accuracy, the needle can be rotated about its axis during insertion into the prostate. The system can be mounted on existing steppers and also easily accommodates existing seed dispensers, such as the Mick Applicator.
Collapse
|
26
|
Bricault I, Zemiti N, Jouniaux E, Fouard C, Taillant E, Dorandeu F, Cinquin P. Light Puncture Robot for CT and MRI Interventions. ACTA ACUST UNITED AC 2008; 27:42-50. [DOI: 10.1109/emb.2007.910262] [Citation(s) in RCA: 57] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|