1
|
Grezmak J, Daltorio KA. Probing with Each Step: How a Walking Crab-like Robot Classifies Buried Cylinders in Sand with Hall-Effect Sensors. SENSORS (BASEL, SWITZERLAND) 2024; 24:1579. [PMID: 38475115 DOI: 10.3390/s24051579] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/21/2024] [Revised: 02/24/2024] [Accepted: 02/27/2024] [Indexed: 03/14/2024]
Abstract
Shallow underwater environments around the world are contaminated with unexploded ordnances (UXOs). Current state-of-the-art methods for UXO detection and localization use remote sensing systems. Furthermore, human divers are often tasked with confirming UXO existence and retrieval which poses health and safety hazards. In this paper, we describe the application of a crab robot with leg-embedded Hall effect-based sensors to detect and distinguish between UXOs and non-magnetic objects partially buried in sand. The sensors consist of Hall-effect magnetometers and permanent magnets embedded in load bearing compliant segments. The magnetometers are sensitive to magnetic objects in close proximity to the legs and their movement relative to embedded magnets, allowing for both proximity and force-related feedback in dynamically obtained measurements. A dataset of three-axis measurements is collected as the robot steps near and over different UXOs and UXO-like objects, and a convolutional neural network is trained on time domain inputs and evaluated by 5-fold cross validation. Additionally, we propose a novel method for interpreting the importance of measurements in the time domain for the trained classifier. The results demonstrate the potential for accurate and efficient UXO and non-UXO discrimination in the field.
Collapse
Affiliation(s)
- John Grezmak
- Department of Mechanical and Aerospace Engineering, Case Western Reserve University, Cleveland, OH 44106, USA
| | - Kathryn A Daltorio
- Department of Mechanical and Aerospace Engineering, Case Western Reserve University, Cleveland, OH 44106, USA
| |
Collapse
|
2
|
Mandil W, Rajendran V, Nazari K, Ghalamzan-Esfahani A. Tactile-Sensing Technologies: Trends, Challenges and Outlook in Agri-Food Manipulation. SENSORS (BASEL, SWITZERLAND) 2023; 23:7362. [PMID: 37687818 PMCID: PMC10490130 DOI: 10.3390/s23177362] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Revised: 08/01/2023] [Accepted: 08/15/2023] [Indexed: 09/10/2023]
Abstract
Tactile sensing plays a pivotal role in achieving precise physical manipulation tasks and extracting vital physical features. This comprehensive review paper presents an in-depth overview of the growing research on tactile-sensing technologies, encompassing state-of-the-art techniques, future prospects, and current limitations. The paper focuses on tactile hardware, algorithmic complexities, and the distinct features offered by each sensor. This paper has a special emphasis on agri-food manipulation and relevant tactile-sensing technologies. It highlights key areas in agri-food manipulation, including robotic harvesting, food item manipulation, and feature evaluation, such as fruit ripeness assessment, along with the emerging field of kitchen robotics. Through this interdisciplinary exploration, we aim to inspire researchers, engineers, and practitioners to harness the power of tactile-sensing technology for transformative advancements in agri-food robotics. By providing a comprehensive understanding of the current landscape and future prospects, this review paper serves as a valuable resource for driving progress in the field of tactile sensing and its application in agri-food systems.
Collapse
Affiliation(s)
- Willow Mandil
- School of Computer Science, University of Lincoln, Lincoln LN6 7TS, UK
| | - Vishnu Rajendran
- Lincoln Institute for Agri-Food Technology, University of Lincoln, Lincoln LN6 7TS, UK
| | - Kiyanoush Nazari
- School of Computer Science, University of Lincoln, Lincoln LN6 7TS, UK
| | | |
Collapse
|
3
|
Kim G, Hwang D. BaroTac: Barometric Three-Axis Tactile Sensor with Slip Detection Capability. SENSORS (BASEL, SWITZERLAND) 2022; 23:428. [PMID: 36617029 PMCID: PMC9823802 DOI: 10.3390/s23010428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/29/2022] [Revised: 12/15/2022] [Accepted: 12/26/2022] [Indexed: 06/17/2023]
Abstract
Tactile sensors for robotic applications enhance the performance of robotic end-effectors as they ca n provide tactile information to operate various tasks. In particular, tactile sensors can measure multi-axial force and detect slip can aid the end-effectors in grasping diverse objects in an unstructured environment. We propose BaroTac, which measures three-axial forces and detects slip with a barometric pressure sensor chip (BPSC) for robotic applications. A BPSC is an off-the-shelf commercial sensor that is inexpensive, easy to customize, robust, and simple to use. While a single BPSC-based tactile sensor can measure pressure, an array of BPSC-based tactile sensors can measure multi-axial force through the reactivity of each sensor and detect slip by observing high frequency due to slip vibration. We first experiment with defining the fundamental characteristics of a single-cell BPSC-based sensor to set the design parameters of our proposed sensor. Thereafter, we suggest the sensing method of BaroTac: calibration matrix for three-axis force measurement and discrete wavelet transform (DWT) for slip detection. Subsequently, we validate the three-axis force measuring ability and slip detectability of the fabricated multi-cell BPSC-based tactile sensor. The sensor measures three-axis force with low error (0.14, 0.18, and 0.3% in the X-, Y- and Z-axis, respectively) and discriminates slip in the high-frequency range (75-150 Hz). We finally show the practical applicability of BaroTac by installing them on the commercial robotic gripper and controlling the gripper to grasp common objects based on our sensor feedback.
Collapse
Affiliation(s)
- Gyuwon Kim
- Korea Institute of Science and Technology, Seoul 02792, Republic of Korea
- School of Mechanical Engineering, Korea University, Seoul 02841, Republic of Korea
| | - Donghyun Hwang
- Korea Institute of Science and Technology, Seoul 02792, Republic of Korea
| |
Collapse
|
4
|
Man J, Chen G, Chen J. Recent Progress of Biomimetic Tactile Sensing Technology Based on Magnetic Sensors. BIOSENSORS 2022; 12:1054. [PMID: 36421172 PMCID: PMC9688171 DOI: 10.3390/bios12111054] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/20/2022] [Revised: 11/08/2022] [Accepted: 11/17/2022] [Indexed: 05/14/2023]
Abstract
In the past two decades, biomimetic tactile sensing technology has been a hot spot in academia. It has prospective applications in many fields such as medical treatment, health monitoring, robot tactile feedback, and human-machine interaction. With the rapid development of magnetic sensors, biomimetic tactile sensing technology based on magnetic sensors (which are called magnetic tactile sensors below) has been widely studied in recent years. In order to clarify the development status and application characteristics of magnetic tactile sensors, this paper firstly reviews the magnetic tactile sensors from three aspects: the types of magnetic sensors, the sources of magnetic field, and the structures of sensitive bodies used in magnetic tactile sensors. Secondly, the development of magnetic tactile sensors in four applications of robot precision grasping, texture characterization, flow velocity measurement, and medical treatment is introduced in detail. Finally, this paper analyzes technical difficulties and proposes prospective research directions for magnetic tactile sensors.
Collapse
Affiliation(s)
- Jiandong Man
- State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China
- School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Guangyuan Chen
- State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China
| | - Jiamin Chen
- State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China
- School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
| |
Collapse
|
5
|
Bozkurt E, Sijberden JP, Hilal MA. What Is the Current Role and What Are the Prospects of the Robotic Approach in Liver Surgery? Cancers (Basel) 2022; 14:4268. [PMID: 36077803 PMCID: PMC9454668 DOI: 10.3390/cancers14174268] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2022] [Revised: 08/24/2022] [Accepted: 08/29/2022] [Indexed: 12/15/2022] Open
Abstract
In parallel with the historical development of minimally invasive surgery, the laparoscopic and robotic approaches are now frequently utilized to perform major abdominal surgical procedures. Nevertheless, the role of the robotic approach in liver surgery is still controversial, and a standardized, safe technique has not been defined yet. This review aims to summarize the currently available evidence and prospects of robotic liver surgery. Minimally invasive liver surgery has been extensively associated with benefits, in terms of less blood loss, and lower complication rates, including liver-specific complications such as clinically relevant bile leakage and post hepatectomy liver failure, when compared to open liver surgery. Furthermore, comparable R0 resection rates to open liver surgery have been reported, thus, demonstrating the safety and oncological efficiency of the minimally invasive approach. However, whether robotic liver surgery has merits over laparoscopic liver surgery is still a matter of debate. In the current literature, robotic liver surgery has mainly been associated with non-inferior outcomes compared to laparoscopy, although it is suggested that the robotic approach has a shorter learning curve, lower conversion rates, and less intraoperative blood loss. Robotic surgical systems offer a more realistic image with integrated 3D systems. In addition, the improved dexterity offered by robotic surgical systems can lead to improved intra and postoperative outcomes. In the future, integrated and improved haptic feedback mechanisms, artificial intelligence, and the introduction of more liver-specific dissectors will likely be implemented, further enhancing the robots' abilities.
Collapse
Affiliation(s)
- Emre Bozkurt
- Department of Surgery, Poliambulanza Foundation Hospital, 25124 Brescia, Italy
- Department of Surgery, Hepatopancreatobiliary Surgery Division, Koç University Hospital, Istanbul 34010, Turkey
| | - Jasper P. Sijberden
- Department of Surgery, Poliambulanza Foundation Hospital, 25124 Brescia, Italy
- Department of Surgery, Amsterdam UMC Location University of Amsterdam, Meibergdreef 9, 1105 AZ Amsterdam, The Netherlands
| | - Mohammed Abu Hilal
- Department of Surgery, Poliambulanza Foundation Hospital, 25124 Brescia, Italy
- Department of Surgery, University Hospital Southampton NHS Foundation Trust, Southampton SO16 6YD, UK
| |
Collapse
|
6
|
Coupling Effect Suppressed Compact Surgical Robot with 7-Axis Multi-Joint Using Wire-Driven Method. MATHEMATICS 2022. [DOI: 10.3390/math10101698] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
Currently, the most prevalent surgical treatment method is laparoscopic surgery. Robotic surgery has many advantages over laparoscopic surgery. Therefore, robotic surgery technology is currently constantly evolving. The advantages of robotic surgery are that it can minimize incision, bleeding, and sequelae. Other advantages of robotic surgery are that it can reduce hospitalization, recovery period, and side effects. The appeal of robotic surgery is that it requires fewer surgical personnel compared to laparoscopic surgery. This paper proposes an ultra-compact 7-axis vertical multi-joint robot that employs the wire-driven method for minimally invasive surgery. The proposed robot analyzes the degree of freedom and motion coupling for control. The robot joint is composed of a total of seven joints, and among them, the 7-axis joint operates the forceps. At this time, the forceps joint (#7 axis) can only operate open and close functions, while the link is bent and rotatable, regardless of position change. This phenomenon can be analyzed by Forward Kinematics. Also, when the DOF rotates, the passing wires become twisted, and the wire is generated through length change and coupling phenomenon. The maximum rotation angle of DOF is 90° and the rotating passing wire is wound by the rotation of the wire pulley. If the DOF is rotated to the full range of 120°, the second DOF will be rotated to 90°, and at this time, the coupling phenomenon caused by the first DOF rotation can be eliminated. The length change and the robot joint angle change related to the motor drive, based on the surgical robot control using the wire-driven method, are correlated, and the values for the position and direction of the end effector of the robot can be obtained through a forward kinematic analysis. The coupling problem occurring in the wire connecting the robot driving part can be solved through a kinematic analysis. Therefore, it was possible to test the position of the slave robot and the performance of the surgical forceps movement using the master system.
Collapse
|