A Natural Interface for Remote Operation of Underwater Robots

Development of Second Prototype of Twin-Driven Magnetorheological Fluid Actuator for Haptic Device

Magnetorheological fluids (MRFs) are functional fluids that exhibit rapid and reproducible rheological responses to external magnetic fields. An MRF has been utilized to develop a haptic device with precise haptic feedback for teleoperative surgical systems. To achieve this, we developed several types of compact MRF clutches for haptics (H-MRCs) and integrated them into a twin-driven MRF actuator (TD-MRA). The first TD-MRA prototype was successfully used to generate fine haptic feedback for operators. However, undesirable torque ripples were observed due to shaft misalignment and the low rigidity of the structure. Additionally, the detailed torque control performance was not evaluated from both static and dynamic current inputs. The objective of this study is to develop a second prototype to reduce torque ripple by improving the structure and evaluating its static and dynamic torque performance. Torque performance was measured using both constant and stepwise current inputs. The coefficient of variance of the torque was successfully reduced by half due to the structural redesign. Although the time constants of the H-MRC were less than 10 ms, those of the TD-MRA were less than 20 ms under all conditions. To address the slower downward output response, we implemented an improved input method, which successfully halved the response time.

Telepresence Social Robotics towards Co-Presence: A Review

Telepresence robots are becoming popular in social interactions involving health care, elderly assistance, guidance, or office meetings. There are two types of human psychological experiences to consider in robot-mediated interactions: (1) telepresence, in which a user develops a sense of being present near the remote interlocutor, and (2) co-presence, in which a user perceives the other person as being present locally with him or her. This work presents a literature review on developments supporting robotic social interactions, contributing to improving the sense of presence and co-presence via robot mediation. This survey aims to define social presence, co-presence, identify autonomous “user-adaptive systems” for social robots, and propose a taxonomy for “co-presence” mechanisms. It presents an overview of social robotics systems, applications areas, and technical methods and provides directions for telepresence and co-presence robot design given the actual and future challenges. Finally, we suggest evaluation guidelines for these systems, having as reference face-to-face interaction.

Multimodal Warnings in Remote Operation: The Case Study on Remote Driving

Developments in sensor technology, artificial intelligence, and network technologies like 5G has made remote operation a valuable method of controlling various types of machinery. The benefits of remote operations come with an opportunity to access hazardous environments. The major limitation of remote operation is the lack of proper sensory feedback from the machine, which in turn negatively affects situational awareness and, consequently, may risk remote operations. This article explores how to improve situational awareness via multimodal feedback (visual, auditory, and haptic) and studies how it can be utilized to communicate warnings to remote operators. To reach our goals, we conducted a controlled, within-subjects experiment in eight conditions with twenty-four participants on a simulated remote driving system. Additionally, we gathered further insights with a UX questionnaire and semi-structured interviews. Gathered data showed that the use of multimodal feedback positively affected situational awareness when driving remotely. Our findings indicate that the combination of added haptic and visual feedback was considered the best feedback combination to communicate the slipperiness of the road. We also found that the feeling of presence is an important aspect of remote driving tasks, and a requested one, especially by those with more experience in operating real heavy machinery.

Preliminary Work on a Virtual Reality Interface for the Guidance of Underwater Robots

The need for intervention in underwater environments has increased in recent years but there is still a long way to go before AUVs (Autonomous Underwater Vehicleswill be able to cope with really challenging missions. Nowadays, the solution adopted is mainly based on remote operated vehicle (ROV) technology. These ROVs are controlled from support vessels by using unnecessarily complex human–robot interfaces (HRI). Therefore, it is necessary to reduce the complexity of these systems to make them easier to use and to reduce the stress on the operator. In this paper, and as part of the TWIN roBOTs for the cooperative underwater intervention missions (TWINBOT) project, we present an HRI (Human-Robot Interface) module which includes virtual reality (VR) technology. In fact, this contribution is an improvement on a preliminary study in this field also carried out, by our laboratory. Hence, having made a concerted effort to improve usability, the HRI system designed for robot control tasks presented in this paper is substantially easier to use. In summary, reliability and feasibility of this HRI module have been demonstrated thanks to the usability tests, which include a very complete pilot study, and guarantee much more friendly and intuitive properties in the final HRI-developed module presented here.

Interface Transparency Issues in Teleoperation

Transferring skills and expertise to remote places, without being present, is a new challenge for our digitally interconnected society. People can experience and perform actions in distant places through a robotic agent wearing immersive interfaces to feel physically there. However, technological contingencies can affect human perception, compromising skill-based performances. Considering the results from studies on human factors, a set of recommendations for the construction of immersive teleoperation systems is provided, followed by an example of the evaluation methodology. We developed a testbed to study perceptual issues that affect task performance while users manipulated the environment either through traditional or immersive interfaces. The analysis of its effect on perception, navigation, and manipulation relies on performances measures and subjective answers. The goal is to mitigate the effect of factors such as system latency, field of view, frame of reference, or frame rate to achieve the sense of telepresence. By decoupling the flows of an immersive teleoperation system, we aim to understand how vision and interaction fidelity affects spatial cognition. Results show that misalignments between the frame of reference for vision and motor-action or the use of tools affecting the sense of body position or movement have a higher effect on mental workload and spatial cognition.

Actinomycete-Derived Polyketides as a Source of Antibiotics and Lead Structures for the Development of New Antimicrobial Drugs

Actinomycetes are remarkable producers of compounds essential for human and veterinary medicine as well as for agriculture. The genomes of those microorganisms possess several sets of genes (biosynthetic gene cluster (BGC)) encoding pathways for the production of the valuable secondary metabolites. A significant proportion of the identified BGCs in actinomycetes encode pathways for the biosynthesis of polyketide compounds, nonribosomal peptides, or hybrid products resulting from the combination of both polyketide synthases (PKSs) and nonribosomal peptide synthetases (NRPSs). The potency of these molecules, in terms of bioactivity, was recognized in the 1940s, and started the "Golden Age" of antimicrobial drug discovery. Since then, several valuable polyketide drugs, such as erythromycin A, tylosin, monensin A, rifamycin, tetracyclines, amphotericin B, and many others were isolated from actinomycetes. This review covers the most relevant actinomycetes-derived polyketide drugs with antimicrobial activity, including anti-fungal agents. We provide an overview of the source of the compounds, structure of the molecules, the biosynthetic principle, bioactivity and mechanisms of action, and the current stage of development. This review emphasizes the importance of actinomycetes-derived antimicrobial polyketides and should serve as a "lexicon", not only to scientists from the Natural Products field, but also to clinicians and others interested in this topic.

Design of a Wearable Fingertip Haptic Device for Remote Palpation: Characterisation and Interface with a Virtual Environment

This paper presents the development of a wearable Fingertip Haptic Device (FHD) that can provide cutaneous feedback via a Variable Compliance Platform (VCP). The FHD includes an inertial measurement unit, which tracks the motion of the user’s finger while its haptic functionality relies on two parameters: pressure in the VCP and its linear displacement towards the fingertip. The combination of these two features results in various conditions of the FHD, which emulate the remote object or surface stiffness properties. Such a device can be used in tele-operation, including virtual reality applications, where rendering the level of stiffness of different physical or virtual materials could provide a more realistic haptic perception to the user. The FHD stiffness representation is characterised in terms of resulting pressure and force applied to the fingertip created through the relationship of the two functional parameters – pressure and displacement of the VCP. The FHD was tested in a series of user studies to assess its potential to create a user perception of the object’s variable stiffness. The viability of the FHD as a haptic device has been further confirmed by interfacing the users with a virtual environment. The developed virtual environment task required the users to follow a virtual path, identify objects of different hardness on the path and navigate away from “no-go” zones. The task was performed with and without the use of the variable compliance on the FHD. The results showed improved performance with the presence of the variable compliance provided by the FHD in all assessed categories and particularly in the ability to identify correctly between objects of different hardness.