A Novel Framework for Mixed Reality-Based Control of Collaborative Robot: Development Study

BACKGROUND

Applications of robotics in daily life are becoming essential by creating new possibilities in different fields, especially in the collaborative environment. The potentials of collaborative robots are tremendous as they can work in the same workspace as humans. A framework employing a top-notch technology for collaborative robots will surely be worthwhile for further research.

OBJECTIVE

This study aims to present the development of a novel framework for the collaborative robot using mixed reality.

METHODS

The framework uses Unity and Unity Hub as a cross-platform gaming engine and project management tool to design the mixed reality interface and digital twin. It also uses the Windows Mixed Reality platform to show digital materials on holographic display and the Azure mixed reality services to capture and expose digital information. Eventually, it uses a holographic device (HoloLens 2) to execute the mixed reality-based collaborative system.

RESULTS

A thorough experiment was conducted to validate the novel framework for mixed reality-based control of a collaborative robot. This framework was successfully applied to implement a collaborative system using a 5-degree of freedom robot (xArm-5) in a mixed reality environment. The framework was stable and worked smoothly throughout the collaborative session. Due to the distributed nature of cloud applications, there is a negligible latency between giving a command and the execution of the physical collaborative robot.

CONCLUSIONS

Opportunities for collaborative robots in telerehabilitation and teleoperation are vital as in any other field. The proposed framework was successfully applied in a collaborative session, and it can also be applied in other similar potential applications for robust and more promising performance.

Analysing Factory Workers’ Acceptance of Collaborative Robots: A Web-Based Tool for Company Representatives

Collaborative robots are a new type of lightweight robots that are especially suitable for small and medium-sized enterprises. They offer new interaction opportunities and thereby pose new challenges with regard to technology acceptance. Despite acknowledging the importance of acceptance issues, small and medium-sized enterprises often lack coherent strategies to identify barriers and foster acceptance. Therefore, in this article, we present a collection of crucial acceptance factors with regard to collaborative robot use at the industrial workplace. Based on these factors, we present a web-based tool to estimate employee acceptance, to provide company representatives with practical recommendations and to stimulate reflection on acceptance issues. An evaluation with three German small and medium-sized enterprises reveals that the tool’s concept meets the demands of small and medium-sized enterprises and is perceived as beneficial as it raises awareness and deepens knowledge on this topic. In order to realise economic potentials, further low-threshold usable tools are needed to transfer research findings into the daily practice of small and medium-sized enterprises.