1
|
Fertl E, Nguyen DDT, Krueger M, Stettinger G, Padial-Allué R, Castillo E, Cuéllar MP. End-to-End Ultrasonic Hand Gesture Recognition. Sensors (Basel) 2024; 24:2740. [PMID: 38732843 PMCID: PMC11086334 DOI: 10.3390/s24092740] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/03/2024] [Revised: 04/18/2024] [Accepted: 04/23/2024] [Indexed: 05/13/2024]
Abstract
As the number of electronic gadgets in our daily lives is increasing and most of them require some kind of human interaction, this demands innovative, convenient input methods. There are limitations to state-of-the-art (SotA) ultrasound-based hand gesture recognition (HGR) systems in terms of robustness and accuracy. This research presents a novel machine learning (ML)-based end-to-end solution for hand gesture recognition with low-cost micro-electromechanical (MEMS) system ultrasonic transducers. In contrast to prior methods, our ML model processes the raw echo samples directly instead of using pre-processed data. Consequently, the processing flow presented in this work leaves it to the ML model to extract the important information from the echo data. The success of this approach is demonstrated as follows. Four MEMS ultrasonic transducers are placed in three different geometrical arrangements. For each arrangement, different types of ML models are optimized and benchmarked on datasets acquired with the presented custom hardware (HW): convolutional neural networks (CNNs), gated recurrent units (GRUs), long short-term memory (LSTM), vision transformer (ViT), and cross-attention multi-scale vision transformer (CrossViT). The three last-mentioned ML models reached more than 88% accuracy. The most important innovation described in this research paper is that we were able to demonstrate that little pre-processing is necessary to obtain high accuracy in ultrasonic HGR for several arrangements of cost-effective and low-power MEMS ultrasonic transducer arrays. Even the computationally intensive Fourier transform can be omitted. The presented approach is further compared to HGR systems using other sensor types such as vision, WiFi, radar, and state-of-the-art ultrasound-based HGR systems. Direct processing of the sensor signals by a compact model makes ultrasonic hand gesture recognition a true low-cost and power-efficient input method.
Collapse
Affiliation(s)
- Elfi Fertl
- Infineon Technologies AG, 85579 Neubiberg, Germany; (E.F.); (D.D.T.N.); (M.K.); (G.S.)
- Department of Electronics and Computer Technology, University of Granada, 18071 Granada, Spain;
| | - Do Dinh Tan Nguyen
- Infineon Technologies AG, 85579 Neubiberg, Germany; (E.F.); (D.D.T.N.); (M.K.); (G.S.)
| | - Martin Krueger
- Infineon Technologies AG, 85579 Neubiberg, Germany; (E.F.); (D.D.T.N.); (M.K.); (G.S.)
| | - Georg Stettinger
- Infineon Technologies AG, 85579 Neubiberg, Germany; (E.F.); (D.D.T.N.); (M.K.); (G.S.)
| | - Rubén Padial-Allué
- Department of Electronics and Computer Technology, University of Granada, 18071 Granada, Spain;
| | - Encarnación Castillo
- Department of Electronics and Computer Technology, University of Granada, 18071 Granada, Spain;
| | - Manuel P. Cuéllar
- Department of Computer Science and Artificial Intelligence, University of Granada, 18071 Granada, Spain;
| |
Collapse
|
2
|
Rodríguez-Alonso C, Pena-Regueiro I, García Ó. Digital Twin Platform for Water Treatment Plants Using Microservices Architecture. Sensors (Basel) 2024; 24:1568. [PMID: 38475104 DOI: 10.3390/s24051568] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/04/2024] [Revised: 02/18/2024] [Accepted: 02/22/2024] [Indexed: 03/14/2024]
Abstract
The effects of climate change and the rapid growth of societies often lead to water scarcity and inadequate water quality, resulting in a significant number of diseases. The digitalization of infrastructure and the use of Digital Twins are presented as alternatives for optimizing resources and the necessary infrastructure in the water cycle. This paper presents a framework for the development of a Digital Twin platform for a wastewater treatment plant, based on a microservices architecture which optimized its design for edge computing implementation. The platform aims to optimize the operation and maintenance processes of the plant's systems, by employing machine learning techniques, process modeling and simulation, as well as leveraging the information contained in BIM models to support decision-making.
Collapse
Affiliation(s)
- Carlos Rodríguez-Alonso
- ESIT-Escuela Superior de Ingeniería y Tecnología, UNIR-International University of La Rioja, Av. de la Paz 137, 26006 Logroño, Spain
- Ayesa Ingeniería y Arquitectura, Calle Marie Curie 2, 41092 Sevilla, Spain
| | - Iván Pena-Regueiro
- ESIT-Escuela Superior de Ingeniería y Tecnología, UNIR-International University of La Rioja, Av. de la Paz 137, 26006 Logroño, Spain
| | - Óscar García
- ESIT-Escuela Superior de Ingeniería y Tecnología, UNIR-International University of La Rioja, Av. de la Paz 137, 26006 Logroño, Spain
| |
Collapse
|
3
|
Swain R, Kaye SA, Rakotonirainy A. Is my AV crashing? An online photo-based experiment assessing whether shared intended pathway can help AV drivers anticipate silent failures. Ergonomics 2023; 66:1984-1998. [PMID: 36756954 DOI: 10.1080/00140139.2023.2176551] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Accepted: 01/30/2023] [Indexed: 06/18/2023]
Abstract
The shared responsibility between conditional AVs drivers demands shared understanding. Thus, a shared intended pathway (SIP)-a graphical display of the AV's planned manoeuvres in a head-up display to help drivers anticipate silent failures is proposed. An online, randomised photo experiment was conducted with 394 drivers in Australia. The photos presented traffic scenarios where the SIP forecast either safe or unsafe manoeuvres (silent failures). Participants were required to respond by selecting whether driver intervention was necessary or not. Additionally, the effects of presented object recognition bounding boxes which indicated whether a road user was recognised or not were also tested in the experiment. The SIP led to correct intervention choices 87% of the time, and to calibrating self-reported trust, perceived ease of use and usefulness. The bounding boxes found no significant effects. Results suggest SIPs can assist in monitoring conditional automation. Future research in simulator studies is recommended. Practitioner summary: Conditional AV drivers are expected to take-over control during failures. However, drivers are not informed about the AV's planned manoeuvres. A visual display that presents the shared intended pathway is proposed to help drivers mitigate silent failures. This online photo experiment found the display helped anticipate failures with 87% accuracy.
Collapse
Affiliation(s)
- Ritwik Swain
- Queensland University of Technology (QUT), Centre for Accident Research and Road Safety (CARRS-Q), Brisbane, Australia
- University of the Sunshine Coast (USC), Road Safety Research Collaboration (RSRC), Sippy Downs, Australia
| | - Sherrie-Anne Kaye
- Queensland University of Technology (QUT), Centre for Accident Research and Road Safety (CARRS-Q), Brisbane, Australia
| | - Andry Rakotonirainy
- Queensland University of Technology (QUT), Centre for Accident Research and Road Safety (CARRS-Q), Brisbane, Australia
| |
Collapse
|
4
|
Fu R, Liu W, Zhang H, Liu X, Yuan W. Adopting an HMI for overtaking assistance - Impact of distance display, advice, and guidance information on driver gaze and performance. Accid Anal Prev 2023; 191:107204. [PMID: 37454562 DOI: 10.1016/j.aap.2023.107204] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 04/16/2023] [Accepted: 06/30/2023] [Indexed: 07/18/2023]
Abstract
Conveying supporting information by an in-vehicle human-machine interface (HMI) overtaking assistance system represents a promising approach to facilitate safe overtaking maneuvers. Although various researchers have attempted to examine the safety of systems, numerous HMI concepts are not validated and the impacts of systems on driver behavior following exposure to a connected environment remain unclear. Thus, the objective of this study is to assess the effectiveness of various HMI concepts and their effects on drivers' gaze behavior and driving performance in the connected environment. Three types of supporting information, namely distance, advice and guidance, were designed based on implicit and explicit concepts and displayed on the HMI. The guidance information provides more detailed maneuver instructions. A driving simulator experiment was conducted to imitate a connected environment and included an overtaking scenario on a two-lane highway under three distance gaps (short, middle and long) of oncoming vehicles and four HMI conditions including baseline (3*4). 39 participants (mean = 28.3 years, SD = 8.2 years) drove the simulator. Visual attention, driving maneuver, and subjective evaluation data were collected. The results indicated that the supporting information was valid in facilitating overtaking behavior compared without HMI, particularly under the middle distance gap scenario. Advice information was the most effective, required the least attention, exhibited the best performance, and was accepted by drivers. Detailed maneuver instructions were perceived as helpful, although no effect on acceptance was found. The findings of the study provide valuable insights into the development of user-friendly overtaking assistance systems.
Collapse
Affiliation(s)
- Rui Fu
- School of Automobile, Chang'an University, Xi'an 710018, China
| | - Wenxiao Liu
- School of Automobile, Chang'an University, Xi'an 710018, China.
| | - Hailun Zhang
- School of Vehicle and Mobility, Tsinghua University, Beijing 100084, China
| | - Xue Liu
- SAIC Motor R&D Innovation Headquarters, Shanghai, China
| | - Wei Yuan
- School of Automobile, Chang'an University, Xi'an 710018, China.
| |
Collapse
|
5
|
el Jouhri A, el Sharkawy A, Paksoy H, Youssif O, He X, Kim S, Happee R. The influence of a color themed HMI on trust and take-over performance in automated vehicles. Front Psychol 2023; 14:1128285. [PMID: 37519355 PMCID: PMC10382069 DOI: 10.3389/fpsyg.2023.1128285] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2022] [Accepted: 06/14/2023] [Indexed: 08/01/2023] Open
Abstract
Introduction SAE Level 3 is known as conditional driving automation. As long as certain conditions are met, there is no need to supervise the technology and the driver can engage in non-driving related tasks (NDRTs). However, a human driver must be present and alert to take over when the automation is facing its system limits. When such an emergency takes place, the automation uses the human machine interface (HMI) to send a take-over request (TOR) to the driver. Methods We investigated the influence of a color themed HMI on the trust and take-over performance in automated vehicles. Using a driving simulator, we tested 45 participants divided in three groups with a baseline auditory HMI and two advanced color themed HMIs consisting of a display and ambient lighting with the colors red and blue. Trust in automation was assessed using questionnaires while take-over performance was assessed through response time and success rate. Results Compared to the baseline HMI, the color themed HMI is more trustworthy, and participants understood their driving tasks better. Results show that the color themed HMI is perceived as more pleasant compared to the baseline HMI and leads to shorter reaction times. Red ambient lighting is seen as more urging than blue, but HMI color did not significantly affect the general HMI perception and TOR performance. Discussion Further research can explore the use of color and other modalities to express varying urgency levels and validate findings in complex on road driving conditions.
Collapse
Affiliation(s)
- Aboubakr el Jouhri
- Department of Cognitive Robotics, Faculty of Mechanical, Maritime and Materials Engineering, Delft University of Technology, Delft, Netherlands
| | - Ashraf el Sharkawy
- Department of Cognitive Robotics, Faculty of Mechanical, Maritime and Materials Engineering, Delft University of Technology, Delft, Netherlands
| | - Hakan Paksoy
- Department of Cognitive Robotics, Faculty of Mechanical, Maritime and Materials Engineering, Delft University of Technology, Delft, Netherlands
| | - Omar Youssif
- Department of Cognitive Robotics, Faculty of Mechanical, Maritime and Materials Engineering, Delft University of Technology, Delft, Netherlands
| | - Xiaolin He
- Department of Cognitive Robotics, Faculty of Mechanical, Maritime and Materials Engineering, Delft University of Technology, Delft, Netherlands
| | - Soyeon Kim
- Department of Human Centered Design, Faculty of Industrial Design Engineering, Delft University of Technology, Delft, Netherlands
| | - Riender Happee
- Department of Cognitive Robotics, Faculty of Mechanical, Maritime and Materials Engineering, Delft University of Technology, Delft, Netherlands
| |
Collapse
|
6
|
Budzan S, Wyżgolik R, Kciuk M, Kulik K, Masłowski R, Ptasiński W, Szkurłat O, Szwedka M, Woźniak Ł. Using Gesture Recognition for AGV Control: Preliminary Research. Sensors (Basel) 2023; 23:3109. [PMID: 36991821 PMCID: PMC10055711 DOI: 10.3390/s23063109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/30/2022] [Revised: 02/22/2023] [Accepted: 03/10/2023] [Indexed: 06/19/2023]
Abstract
In this paper, we present our investigation of the 2D Hand Gesture Recognition (HGR) which may be suitable for the control of the Automated Guided Vehicle (AGV). In real conditions, we deal with, among others, a complex background, changing lighting conditions, and different distances of the operator from the AGV. For this reason, in the article, we describe the database of 2D images created during the research. We tested classic algorithms and modified them by us ResNet50 and MobileNetV2 which were retrained partially using the transfer learning approach, as well as proposed a simple and effective Convolutional Neural Network (CNN). As part of our work, we used a closed engineering environment for rapid prototyping of vision algorithms, i.e., Adaptive Vision Studio (AVS), currently Zebra Aurora Vision, as well as an open Python programming environment. In addition, we shortly discuss the results of preliminary work on 3D HGR, which seems to be very promising for future work. The results show that, in our case, from the point of view of implementing the gesture recognition methods in AGVs, better results may be expected for RGB images than grayscale ones. Also using 3D imaging and a depth map may give better results.
Collapse
Affiliation(s)
- Sebastian Budzan
- Department of Measurements and Control Systems, Silesian University of Technology, Akademicka 10A, 44-100 Gliwice, Poland
| | - Roman Wyżgolik
- Department of Measurements and Control Systems, Silesian University of Technology, Akademicka 10A, 44-100 Gliwice, Poland
| | - Marek Kciuk
- Department of Mechatronics, Silesian University of Technology, Akademicka 10A, 44-100 Gliwice, Poland
| | - Krystian Kulik
- Department of Measurements and Control Systems, Silesian University of Technology, Akademicka 10A, 44-100 Gliwice, Poland
| | - Radosław Masłowski
- Department of Mechatronics, Silesian University of Technology, Akademicka 10A, 44-100 Gliwice, Poland
| | - Wojciech Ptasiński
- Department of Measurements and Control Systems, Silesian University of Technology, Akademicka 10A, 44-100 Gliwice, Poland
| | - Oskar Szkurłat
- Department of Mechatronics, Silesian University of Technology, Akademicka 10A, 44-100 Gliwice, Poland
| | - Mateusz Szwedka
- Department of Measurements and Control Systems, Silesian University of Technology, Akademicka 10A, 44-100 Gliwice, Poland
| | - Łukasz Woźniak
- Department of Measurements and Control Systems, Silesian University of Technology, Akademicka 10A, 44-100 Gliwice, Poland
| |
Collapse
|
7
|
Xu J, Pan J, Cui T, Zhang S, Yang Y, Ren TL. Recent Progress of Tactile and Force Sensors for Human-Machine Interaction. Sensors (Basel) 2023; 23:1868. [PMID: 36850470 PMCID: PMC9961639 DOI: 10.3390/s23041868] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Revised: 01/23/2023] [Accepted: 02/01/2023] [Indexed: 06/18/2023]
Abstract
Human-Machine Interface (HMI) plays a key role in the interaction between people and machines, which allows people to easily and intuitively control the machine and immersively experience the virtual world of the meta-universe by virtual reality/augmented reality (VR/AR) technology. Currently, wearable skin-integrated tactile and force sensors are widely used in immersive human-machine interactions due to their ultra-thin, ultra-soft, conformal characteristics. In this paper, the recent progress of tactile and force sensors used in HMI are reviewed, including piezoresistive, capacitive, piezoelectric, triboelectric, and other sensors. Then, this paper discusses how to improve the performance of tactile and force sensors for HMI. Next, this paper summarizes the HMI for dexterous robotic manipulation and VR/AR applications. Finally, this paper summarizes and proposes the future development trend of HMI.
Collapse
Affiliation(s)
- Jiandong Xu
- School of Integrated Circuits and Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing 100084, China
| | - Jiong Pan
- School of Integrated Circuits and Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing 100084, China
| | - Tianrui Cui
- School of Integrated Circuits and Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing 100084, China
| | - Sheng Zhang
- Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China
| | - Yi Yang
- School of Integrated Circuits and Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing 100084, China
| | - Tian-Ling Ren
- School of Integrated Circuits and Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing 100084, China
- Center for Flexible Electronics Technology, Tsinghua University, Beijing 100084, China
| |
Collapse
|
8
|
Chung CK, Huang YJ, Wang TK, Lo YL. Fiber-Based Triboelectric Nanogenerator for Mechanical Energy Harvesting and Its Application to a Human-Machine Interface. Sensors (Basel) 2022; 22:s22249632. [PMID: 36560001 PMCID: PMC9783752 DOI: 10.3390/s22249632] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Revised: 12/05/2022] [Accepted: 12/05/2022] [Indexed: 06/01/2023]
Abstract
Mechanical energy harvesters including piezoelectric nanogenerators, electromagnetic generators and triboelectric nanogenerators (TENG) used to convert the mechanical motion into electricity are more and more important in the recent decades. Specifically, the fiber-based TENG (FTENG) has gained considerable favors due to its flexibility, light weight, and high environmental tolerance for the wearable devices. The traditional FTENGs made of Teflon result in better performance but are not suitable for long-term wear in person. Here, we propose a novel FTENG using a flexible micro-needle-structured polydimethylsiloxane (MN-PDMS) together with the comfortable commercially available 2D-polyester fibers, and electroless nickel-plated cotton cloth of which two are widely used in human daily life. The MN-PDMS is formed by a laser engraved mold for improving its output performance of FTENG compared to the flat-PDMS. The open-circuit voltage (Voc) and the short-circuit current (Isc) of MN-FTENG increased to 73.6 V and 36 μA, respectively, which are 34% and 37% higher than the flat-FTENG. In terms of power, the performance of MN-FTENG reaches 1.296 mW which is 89% higher than that of flat-TENG and it can also light up 90 LEDs. For application, human motion at the joints can be detected and collected with various signals that are used for the human-machine interface (HMI) through the cooperation of components for the Internet of Things (IoT). It can light up the LED bulb through MN-FTENG to potentially develop IoT HMI systems for human motion control of robot in the future.
Collapse
|
9
|
Langari MM, Antxustegi MM, Labidi J. Nanocellulose-based sensing platforms for heavy metal ions detection: A comprehensive review. Chemosphere 2022; 302:134823. [PMID: 35525457 DOI: 10.1016/j.chemosphere.2022.134823] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Revised: 04/27/2022] [Accepted: 04/29/2022] [Indexed: 06/14/2023]
Abstract
Increase in industrial activities has been arising a severe concern about water pollution caused by heavy metal ions (HMIs), such us lead (Pb2+), cadmium (Cd2+) or mercury (Hg2+). The presence of substantial amounts of these ions in the human body is harmful and can cause serious diseases. Hence, the detection of HMIs in water is of great importance. As technological advances have developed, some conventional methods have become obsolete due to some methodological disadvantages, giving way to a second generation that uses novel sensors. Recently, nanocellulose, as a biocompatible material, has drawn a remarkable attraction for developing sensors owing to its extraordinary physical and chemical properties. This review pays a special attention to the different dimensional nanocellulose-based sensors devised for HMIs recognition. What is more, different sensing techniques (optical and electrochemical), sensing mechanisms and the roles of nanocellulose in such sensors are discussed.
Collapse
Affiliation(s)
- Mahsa Mousavi Langari
- Biorefinery Processes Research Group, Chemical and Environmental Engineering Department, Faculty of Engineering, Gipuzkoa, University of the Basque Country UPV/EHU, Plaza Europa 1, 20018, Donostia, Spain
| | - M Mirari Antxustegi
- Biorefinery Processes Research Group, Chemical and Environmental Engineering Department, Faculty of Engineering, Gipuzkoa, University of the Basque Country UPV/EHU, Avenida Otaola 29, 20600, Eibar, Spain
| | - Jalel Labidi
- Biorefinery Processes Research Group, Chemical and Environmental Engineering Department, Faculty of Engineering, Gipuzkoa, University of the Basque Country UPV/EHU, Plaza Europa 1, 20018, Donostia, Spain.
| |
Collapse
|
10
|
Pospisil O, Blazek P, Kuchar K, Fujdiak R, Misurec J. Application Perspective on Cybersecurity Testbed for Industrial Control Systems. Sensors (Basel) 2021; 21:s21238119. [PMID: 34884123 PMCID: PMC8662443 DOI: 10.3390/s21238119] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/21/2021] [Revised: 11/30/2021] [Accepted: 12/02/2021] [Indexed: 11/16/2022]
Abstract
In recent years, the Industry 4.0 paradigm has accelerated the digitalization process of the industry, and it slowly diminishes the line between information technologies (IT) and operational technologies (OT). Among the advantages, this brings up the convergence issue between IT and OT, especially in the cybersecurity-related topics, including new attack vectors, threats, security imperfections, and much more. This cause raised new topics for methods focused on protecting the industrial infrastructure, including monitoring and detection systems, which should help overcome these new challenges. However, those methods require high quality and a large number of datasets with different conditions to adapt to the specific systems effectively. Unfortunately, revealing field factory setups and infrastructure would be costly and challenging due to the privacy and sensitivity causes. From the lack of data emerges the new topic of industrial testbeds, including sub-real physical laboratory environments, virtual factories, honeynets, honeypots, and other areas, which helps to deliver sufficient datasets for mentioned research and development. This paper summarizes related works in the area of industrial testbeds. Moreover, it describes best practices and lessons learned for assembling physical, simulated, virtual, and hybrid testbeds. Additionally, a comparison of the essential parameters of those testbeds is presented. Finally, the findings and provided information reveal research and development challenges, which must be surpassed.
Collapse
|
11
|
Méndez JI, Meza-Sánchez AV, Ponce P, McDaniel T, Peffer T, Meier A, Molina A. Smart Homes as Enablers for Depression Pre-Diagnosis Using PHQ-9 on HMI through Fuzzy Logic Decision System. Sensors (Basel) 2021; 21:s21237864. [PMID: 34883868 PMCID: PMC8659873 DOI: 10.3390/s21237864] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/25/2021] [Revised: 11/22/2021] [Accepted: 11/23/2021] [Indexed: 01/30/2023]
Abstract
Depression is a common mental illness characterized by sadness, lack of interest, or pleasure. According to the DSM-5, there are nine symptoms, from which an individual must present 4 or 5 in the last two weeks to fulfill the diagnosis criteria of depression. Nevertheless, the common methods that health care professionals use to assess and monitor depression symptoms are face-to-face questionnaires leading to time-consuming or expensive methods. On the other hand, smart homes can monitor householders’ health through smart devices such as smartphones, wearables, cameras, or voice assistants connected to the home. Although the depression disorders at smart homes are commonly oriented to the senior sector, depression affects all of us. Therefore, even though an expert needs to diagnose the depression disorder, questionnaires as the PHQ-9 help spot any depressive symptomatology as a pre-diagnosis. Thus, this paper proposes a three-step framework; the first step assesses the nine questions to the end-user through ALEXA or a gamified HMI. Then, a fuzzy logic decision system considers three actions based on the nine responses. Finally, the last step considers these three actions: continue monitoring through Alexa and the HMI, suggest specialist referral, and mandatory specialist referral.
Collapse
Affiliation(s)
- Juana Isabel Méndez
- School of Engineering and Sciences, Tecnologico de Monterrey, Mexico City 14380, Mexico; (J.I.M.); (A.M.)
| | | | - Pedro Ponce
- School of Engineering and Sciences, Tecnologico de Monterrey, Mexico City 14380, Mexico; (J.I.M.); (A.M.)
- Correspondence:
| | - Troy McDaniel
- The Polytechnic School, Arizona State University, Mesa, AZ 85212, USA;
| | - Therese Peffer
- Institute for Energy and Environment, University of California, Berkeley, CA 94720, USA;
| | - Alan Meier
- Energy and Efficiency Institute, University of California, Davis, CA 95616, USA;
| | - Arturo Molina
- School of Engineering and Sciences, Tecnologico de Monterrey, Mexico City 14380, Mexico; (J.I.M.); (A.M.)
| |
Collapse
|
12
|
Stateczny K, Miądlicki K. An Interactive Haptic Guidance System for Intuitive Programming CNC Machine Tool. Sensors (Basel) 2021; 21:s21113860. [PMID: 34204937 PMCID: PMC8199766 DOI: 10.3390/s21113860] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/15/2021] [Revised: 05/31/2021] [Accepted: 06/01/2021] [Indexed: 11/16/2022]
Abstract
The human-machine interfaces in modern CNC machine tools are not very intuitive and still based on archaic input systems, i.e., switches, handwheels, and buttons. This type of solution has two major drawbacks. The pushed button activates the movement only in one direction and is insensitive to the amount of the force exerted by the operator, which makes it difficult to move the machine axes at variable speeds. The paper proposes a novel and intuitive system of manual programming of a CNC machine tool based on a control lever with strain-gauge sensors. The presented idea of manual programming is aimed at eliminating the need to create a machining program and at making it possible to move the machine intuitively, eliminating mistakes in selecting directions and speeds. The article describes the concept of the system and the principle of operation of the control levers with force sensors. The final part of the work presents the experimental validation of the proposed system and a functionality comparison with the traditional CNC control.
Collapse
|
13
|
Mallam SC, Nordby K, Haavardtun P, Nordland H, Viveka Westerberg T. Shifting Participatory Design Approaches for Increased Resilience. IISE Trans Occup Ergon Hum Factors 2021. [PMID: 34402413 DOI: 10.1080/24725838.2021.1966131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
OCCUPATIONAL APPLICATIONSSocial distancing restrictions imposed by the global outbreak of COVID-19 exposed vulnerabilities in traditional User-Centered Design processes. This paper presents a shift in methodological thinking and deployment of participatory processes toward a more dynamic and resilient approach of user-centered design in a multi-year joint academia-industry design project. We moved beyond an overreliance on resource-intensive formal discrete events - such as in-person design workshops, focus groups, or traditional field studies and observations - toward including more continuous inputs to create a more sustainable and fluid approach within a living lab ecosystem. User-centered data collection methods were organized in a framework across three dimensions of interaction: 1) Communication; 2) Timing; and 3) Presence. Expanding methodological options along these differing dimensions increased opportunities for more diversified inputs and sample recruitment, while increasing overall data and design feedback collected. Lowering participation and knowledge sharing thresholds enabled more continuous, inclusive involvement of key stakeholders throughout design processes.
Collapse
Affiliation(s)
- Steven C Mallam
- Faculty of Technology, Natural Sciences and Maritime Sciences, University of South-Eastern Norway, Borre, Norway
| | - Kjetil Nordby
- Institute of Design, The Oslo School of Architecture and Design, Oslo, Norway
| | - Per Haavardtun
- Faculty of Technology, Natural Sciences and Maritime Sciences, University of South-Eastern Norway, Borre, Norway
| | - Hanna Nordland
- Institute of Design, The Oslo School of Architecture and Design, Oslo, Norway
| | - Tine Viveka Westerberg
- Faculty of Technology, Natural Sciences and Maritime Sciences, University of South-Eastern Norway, Borre, Norway
| |
Collapse
|
14
|
McGarry MDJ, Campo A, Payen T, Han Y, Konofagou EE. An analytical model of full-field displacement and strain induced by amplitude-modulated focused ultrasound in harmonic motion imaging. Phys Med Biol 2021; 66. [PMID: 33472178 DOI: 10.1088/1361-6560/abddd1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2019] [Accepted: 01/20/2021] [Indexed: 11/12/2022]
Abstract
The majority of disease processes involves changes in the micro-structure of the affected tissue, which can translate to changes in the mechanical properties of the corresponding tissue. Harmonic motion imaging (HMI) is an elasticity imaging technique that allows the study of the mechanical parameters of tissue by detecting the tissue response by a harmonic motion field, which is generated by oscillatory acoustic radiation force (ARF). HMI has been demonstrated in tumor detection and characterization as well as monitoring of ablation procedures. In this study, an analytical HMI model is demonstrated and compared with a finite element model (FEM), allowing rapid and accurate computation of the displacement, strain, and shear wave velocity (SWV) at any location in a homogeneous linear elastic material. Average absolute differences between the analytical model and the FEM were respectively 1.2 % for the displacements and 0.5 % for the strains for 41940 force voxels at 0.22 seconds per displacement evaluation. A convergence study showed that the average difference could be further decreased to 1.0 % and 0.15 % for the displacements and strains, respectively, if force resolution is increased. SWV fields, as calculated with the FEM and the analytical model, have regional differences in velocities up to 0.57 m/s with an average absolute difference of 0.11±0.07 m/s, primarily due to imperfections in the non-reflecting FEM boundary conditions. The apparent SWV differed from the commonly used plane-wave approximation by up to 1.2 m/s due to near and intermediate field effects. Maximum displacement amplitudes for a model with an inclusion stabilize within 10 % of the homogeneous model at an inclusion radius of 10 mm while the maximum strain reacts faster, stabilizing at an inclusion radius of 3 mm. In conclusion, an analytical model for HMI stiffness estimation is presented in this paper. The analytical model has advantages over FEM as the full-field displacements do not need to be calculated to evaluate the model at a single measurement point. This advantage, together with the computational speed, makes the analytical model useful for real-time imaging applications. However, the analytical model was found to have restrictive assumptions on tissue homogeneity and infinite dimensions, while the FEM approaches were shown adaptable to variable geometry and non-homogeneous properties.
Collapse
Affiliation(s)
- Matthew D J McGarry
- Biomedical Engineering, Columbia University, New York, New York, 10027-6902, UNITED STATES
| | - Adriaan Campo
- Faculty of Science, Universiteit Antwerpen, Groenenborgerlaan 171, 2020 Antwerp, antwerpen, BELGIUM
| | - Thomas Payen
- Biomedical engineering, Columbia University, 630 w 168th street, New York, New York, 10032, UNITED STATES
| | - Yang Han
- Biomedical Engineering, Columbia Univerisity, 630 West 168th Street Physicians & Surgeons 19-418, New York, New York, 10032, UNITED STATES
| | - Elisa E Konofagou
- Department of Biomedical Engineering, Columbia University, MC 8904, 351 Engineering Terrace, 1210 Amsterdam Avenue, New York, NY 10027, USA, New York, New York, UNITED STATES
| |
Collapse
|
15
|
Ma RHY, Morris A, Herriotts P, Birrell S. Investigating what level of visual information inspires trust in a user of a highly automated vehicle. Appl Ergon 2021; 90:103272. [PMID: 33022475 DOI: 10.1016/j.apergo.2020.103272] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/05/2019] [Revised: 06/19/2020] [Accepted: 09/10/2020] [Indexed: 06/11/2023]
Abstract
The aim of this research is to investigate whether visual feedback alone can affect a driver's trust in an autonomous vehicle, and in particular, what level of feedback (no feedback vs. moderate feedback vs. high feedback) will evoke the appropriate level of trust. Before conducting the experiment, the Human Machine Interfaces (HMI) were piloted with two sets of six participants (before and after iterations), to ensure the meaning of the displays can be understood by all. A static driving simulator experiment was conducted with a sample of 30 participants (between 18 and 55). Participants completed two pre-study questionnaires to evaluate previous driving experience, and attitude to trust in automation. During the study, participants completed a trust questionnaire after each simulated scenario to assess their trust level in the autonomous vehicle and HMI displays, and on intention to use and acceptance. The participants were shown 10 different driving scenarios that lasted approximately 2 minutes each. Results indicated that the 'high visual feedback' group recorded the highest trust ratings, with this difference significantly higher than for the 'no visual feedback' group (U = .000; p = <0.001 < α) and the 'moderate visual feedback' group (U = .000; p = <0.001 < α). There is an upward inclination of trust in all groups due to familiarity to both the interfaces and driving simulator over time. Participants' trust level was also influenced by the driving scenario, with trust reducing in all displays during safety verses non-safety-critical situations.
Collapse
Affiliation(s)
- Rachel H Y Ma
- Loughborough Design School, Loughborough University, Loughborough, LE11 3TU, United Kingdom.
| | - Andrew Morris
- Loughborough Design School, Loughborough University, Loughborough, LE11 3TU, United Kingdom.
| | - Paul Herriotts
- National Transport Design Centre, Coventry University, Coventry, CV1 2TT, United Kingdom.
| | - Stewart Birrell
- National Transport Design Centre, Coventry University, Coventry, CV1 2TT, United Kingdom.
| |
Collapse
|
16
|
Perez Reynoso FD, Niño Suarez PA, Aviles Sanchez OF, Calva Yañez MB, Vega Alvarado E, Portilla Flores EA. A Custom EOG-Based HMI Using Neural Network Modeling to Real-Time for the Trajectory Tracking of a Manipulator Robot. Front Neurorobot 2020; 14:578834. [PMID: 33117141 PMCID: PMC7550784 DOI: 10.3389/fnbot.2020.578834] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2020] [Accepted: 08/18/2020] [Indexed: 11/25/2022] Open
Abstract
Although different physiological signals, such as electrooculography (EOG) have been widely used in the control of assistance systems for people with disabilities, customizing the signal classification system remains a challenge. In most interfaces, the user must adapt to the classification parameters, although ideally the systems must adapt to the user parameters. Therefore, in this work the use of a multilayer neural network (MNN) to model the EOG signal as a mathematical function is presented, which is optimized using genetic algorithms, in order to obtain the maximum and minimum amplitude threshold of the EOG signal of each person to calibrate the designed interface. The problem of the variation of the voltage threshold of the physiological signals is addressed by means of an intelligent calibration performed every 3 min; if an assistance system is not calibrated, it loses functionality. Artificial intelligence techniques, such as machine learning and fuzzy logic are used for classification of the EOG signal, but they need calibration parameters that are obtained through databases generated through prior user training, depending on the effectiveness of the algorithm, the learning curve, and the response time of the system. In this work, by optimizing the parameters of the EOG signal, the classification is customized and the domain time of the system is reduced without the need for a database and the training time of the user is minimized, significantly reducing the time of the learning curve. The results are implemented in an HMI for the generation of points in a Cartesian space (X, Y, Z) in order to control a manipulator robot that follows a desired trajectory by means of the movement of the user's eyeball.
Collapse
Affiliation(s)
- Francisco D Perez Reynoso
- Instituto Politécnico Nacional, Escuela Superior de Ingeniería Mecánica y Eléctrica, Mexico City, Mexico
| | - Paola A Niño Suarez
- Instituto Politécnico Nacional, Escuela Superior de Ingeniería Mecánica y Eléctrica, Mexico City, Mexico
| | - Oscar F Aviles Sanchez
- Departamento de Ingeniería Mecatrónica, Universidad Militar Nueva Granada, Bogotá, Colombia
| | - María B Calva Yañez
- Centro de Innovación Tecnológica en Computo, Instituto Politécnico Nacional, Mexico City, Mexico
| | - Eduardo Vega Alvarado
- Centro de Innovación Tecnológica en Computo, Instituto Politécnico Nacional, Mexico City, Mexico
| | - Edgar A Portilla Flores
- Centro de Innovación Tecnológica en Computo, Instituto Politécnico Nacional, Mexico City, Mexico
| |
Collapse
|
17
|
Tognoli E, Zhang M, Fuchs A, Beetle C, Kelso JAS. Coordination Dynamics: A Foundation for Understanding Social Behavior. Front Hum Neurosci 2020; 14:317. [PMID: 32922277 PMCID: PMC7457017 DOI: 10.3389/fnhum.2020.00317] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2020] [Accepted: 07/17/2020] [Indexed: 11/13/2022] Open
Abstract
Humans' interactions with each other or with socially competent machines exhibit lawful coordination patterns at multiple levels of description. According to Coordination Dynamics, such laws specify the flow of coordination states produced by functional synergies of elements (e.g., cells, body parts, brain areas, people…) that are temporarily organized as single, coherent units. These coordinative structures or synergies may be mathematically characterized as informationally coupled self-organizing dynamical systems (Coordination Dynamics). In this paper, we start from a simple foundation, an elemental model system for social interactions, whose behavior has been captured in the Haken-Kelso-Bunz (HKB) model. We follow a tried and tested scientific method that tightly interweaves experimental neurobehavioral studies and mathematical models. We use this method to further develop a body of empirical research that advances the theory toward more generalized forms. In concordance with this interdisciplinary spirit, the present paper is written both as an overview of relevant advances and as an introduction to its mathematical underpinnings. We demonstrate HKB's evolution in the context of social coordination along several directions, with its applicability growing to increasingly complex scenarios. In particular, we show that accommodating for symmetry breaking in intrinsic dynamics and coupling, multiscale generalization and adaptation are principal evolutions. We conclude that a general framework for social coordination dynamics is on the horizon, in which models support experiments with hypothesis generation and mechanistic insights.
Collapse
Affiliation(s)
- Emmanuelle Tognoli
- Human Brain and Behavior Laboratory, Center for Complex Systems and Brain Sciences, Florida Atlantic University, Boca Raton, FL, United States
- Department of Biological Sciences, Florida Atlantic University, Boca Raton, FL, United States
| | - Mengsen Zhang
- Human Brain and Behavior Laboratory, Center for Complex Systems and Brain Sciences, Florida Atlantic University, Boca Raton, FL, United States
- Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, United States
| | - Armin Fuchs
- Human Brain and Behavior Laboratory, Center for Complex Systems and Brain Sciences, Florida Atlantic University, Boca Raton, FL, United States
- Department of Physics, Florida Atlantic University, Boca Raton, FL, United States
| | - Christopher Beetle
- Department of Physics, Florida Atlantic University, Boca Raton, FL, United States
| | - J. A. Scott Kelso
- Human Brain and Behavior Laboratory, Center for Complex Systems and Brain Sciences, Florida Atlantic University, Boca Raton, FL, United States
- Intelligent Systems Research Centre, Ulster University, Londonderry, United Kingdom
| |
Collapse
|
18
|
Guven-Maiorov E, Hakouz A, Valjevac S, Keskin O, Tsai CJ, Gursoy A, Nussinov R. HMI-PRED: A Web Server for Structural Prediction of Host-Microbe Interactions Based on Interface Mimicry. J Mol Biol 2020; 432:3395-3403. [PMID: 32061934 PMCID: PMC7261632 DOI: 10.1016/j.jmb.2020.01.025] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2019] [Revised: 11/28/2019] [Accepted: 01/14/2020] [Indexed: 02/07/2023]
Abstract
Microbes, commensals, and pathogens, control the numerous functions in the host cells. They can alter host signaling and modulate immune surveillance by interacting with the host proteins. For shedding light on the contribution of microbes to health and disease, it is vital to discern how microbial proteins rewire host signaling and through which host proteins they do this. Host-Microbe Interaction PREDictor (HMI-PRED) is a user-friendly web server for structural prediction of protein-protein interactions (PPIs) between the host and a microbial species, including bacteria, viruses, fungi, and protozoa. HMI-PRED relies on "interface mimicry" through which the microbial proteins hijack host binding surfaces. Given the structure of a microbial protein of interest, HMI-PRED will return structural models of potential host-microbe interaction (HMI) complexes, the list of host endogenous and exogenous PPIs that can be disrupted, and tissue expression of the microbe-targeted host proteins. The server also allows users to upload homology models of microbial proteins. Broadly, it aims at large-scale, efficient identification of HMIs. The prediction results are stored in a repository for community access. HMI-PRED is free and available at https://interactome.ku.edu.tr/hmi.
Collapse
Affiliation(s)
- Emine Guven-Maiorov
- Computational Structural Biology Section, Basic Science Program, Frederick National Laboratory for Cancer Research, Frederick, MD, 21702, USA.
| | - Asma Hakouz
- Department of Computer Engineering, Koc University, Istanbul, 34450, Turkey.
| | - Sukejna Valjevac
- Department of Computer Engineering, Koc University, Istanbul, 34450, Turkey.
| | - Ozlem Keskin
- Department of Chemical and Biological Engineering, Koc University, Istanbul, 34450, Turkey.
| | - Chung-Jung Tsai
- Computational Structural Biology Section, Basic Science Program, Frederick National Laboratory for Cancer Research, Frederick, MD, 21702, USA.
| | - Attila Gursoy
- Department of Computer Engineering, Koc University, Istanbul, 34450, Turkey.
| | - Ruth Nussinov
- Computational Structural Biology Section, Basic Science Program, Frederick National Laboratory for Cancer Research, Frederick, MD, 21702, USA; Sackler Inst. of Molecular Medicine, Department of Human Genetics and Molecular Medicine, Sackler School of Medicine, Tel Aviv University, Tel Aviv, 69978, Israel.
| |
Collapse
|
19
|
Ulahannan A, Cain R, Thompson S, Skrypchuk L, Mouzakitis A, Jennings P, Birrell S. User expectations of partial driving automation capabilities and their effect on information design preferences in the vehicle. Appl Ergon 2020; 82:102969. [PMID: 31600714 DOI: 10.1016/j.apergo.2019.102969] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/06/2019] [Revised: 08/20/2019] [Accepted: 09/30/2019] [Indexed: 06/10/2023]
Abstract
Partially automated vehicles present interface design challenges in ensuring the driver remains alert should the vehicle need to hand back control at short notice, but without exposing the driver to cognitive overload. To date, little is known about driver expectations of partial driving automation and whether this affects the information they require inside the vehicle. Twenty-five participants were presented with five partially automated driving events in a driving simulator. After each event, a semi-structured interview was conducted. The interview data was coded and analysed using grounded theory. From the results, two groupings of driver expectations were identified: High Information Preference (HIP) and Low Information Preference (LIP) drivers; between these two groups the information preferences differed. LIP drivers did not want detailed information about the vehicle presented to them, but the definition of partial automation means that this kind of information is required for safe use. Hence, the results suggest careful thought as to how information is presented to them is required in order for LIP drivers to safely using partial driving automation. Conversely, HIP drivers wanted detailed information about the system's status and driving and were found to be more willing to work with the partial automation and its current limitations. It was evident that the drivers' expectations of the partial automation capability differed, and this affected their information preferences. Hence this study suggests that HMI designers must account for these differing expectations and preferences to create a safe, usable system that works for everyone.
Collapse
Affiliation(s)
| | - Rebecca Cain
- Loughborough University, Loughborough, United Kingdom
| | | | | | | | - Paul Jennings
- WMG, University of Warwick, Coventry, United Kingdom
| | | |
Collapse
|
20
|
de Clercq K, Dietrich A, Núñez Velasco JP, de Winter J, Happee R. External Human-Machine Interfaces on Automated Vehicles: Effects on Pedestrian Crossing Decisions. Hum Factors 2019; 61:1353-1370. [PMID: 30912985 PMCID: PMC6820125 DOI: 10.1177/0018720819836343] [Citation(s) in RCA: 42] [Impact Index Per Article: 8.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/10/2018] [Accepted: 02/13/2019] [Indexed: 05/27/2023]
Abstract
OBJECTIVE In this article, we investigated the effects of external human-machine interfaces (eHMIs) on pedestrians' crossing intentions. BACKGROUND Literature suggests that the safety (i.e., not crossing when unsafe) and efficiency (i.e., crossing when safe) of pedestrians' interactions with automated vehicles could increase if automated vehicles display their intention via an eHMI. METHODS Twenty-eight participants experienced an urban road environment from a pedestrian's perspective using a head-mounted display. The behavior of approaching vehicles (yielding, nonyielding), vehicle size (small, medium, large), eHMI type (1. baseline without eHMI, 2. front brake lights, 3. Knightrider animation, 4. smiley, 5. text [WALK]), and eHMI timing (early, intermediate, late) were varied. For yielding vehicles, the eHMI changed from a nonyielding to a yielding state, and for nonyielding vehicles, the eHMI remained in its nonyielding state. Participants continuously indicated whether they felt safe to cross using a handheld button, and "feel-safe" percentages were calculated. RESULTS For yielding vehicles, the feel-safe percentages were higher for the front brake lights, Knightrider, smiley, and text, as compared with baseline. For nonyielding vehicles, the feel-safe percentages were equivalent regardless of the presence or type of eHMI, but larger vehicles yielded lower feel-safe percentages. The Text eHMI appeared to require no learning, contrary to the three other eHMIs. CONCLUSION An eHMI increases the efficiency of pedestrian-AV interactions, and a textual display is regarded as the least ambiguous. APPLICATION This research supports the development of automated vehicles that communicate with other road users.
Collapse
Affiliation(s)
| | | | | | - Joost de Winter
- Joost de Winter, Faculty of Mechanical, Maritime and Materials Engineering, Delft University of Technology, Mekelweg 2, Delft, 2628 CD, the Netherlands; e-mail:
| | | |
Collapse
|
21
|
Jasiewicz M, Miądlicki K. Implementation of an Algorithm to Prevent Chatter Vibration in a CNC System. Materials (Basel) 2019; 12:E3193. [PMID: 31569461 DOI: 10.3390/ma12193193] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/18/2019] [Revised: 09/25/2019] [Accepted: 09/26/2019] [Indexed: 11/17/2022]
Abstract
Machining of shafts characterized by a high compliance is difficult due to the occurrence of self-excited chatter vibrations. It is possible to limit their occurrence through the appropriate selection of technological parameters. For a proper selection of these parameters it is necessary to know the dynamic properties of the machine-tool-workpiece. This study proposes an approach through which these properties can be determined as a result of the synthesis of the dynamic properties of the system, using the receptance coupling method. Knowledge of these properties allows us to select the technological parameters of the lathe using the assistance system integrated into the CNC (Computerized Numerical Control). The final section of this work presents the experimental validation of the assistant and proposed procedures.
Collapse
|
22
|
Large DR, Burnett G, Crundall E, Lawson G, Skrypchuk L, Mouzakitis A. Evaluating secondary input devices to support an automotive touchscreen HMI: A cross-cultural simulator study conducted in the UK and China. Appl Ergon 2019; 78:184-196. [PMID: 31046950 DOI: 10.1016/j.apergo.2019.03.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/28/2018] [Revised: 02/14/2019] [Accepted: 03/13/2019] [Indexed: 06/09/2023]
Abstract
Touchscreen Human-Machine Interfaces (HMIs) are a well-established and popular choice to provide the primary control interface between driver and vehicle, yet inherently demand some visual attention. Employing a secondary device with the touchscreen may reduce the demand but there is some debate about which device is most suitable, with current manufacturers favouring different solutions and applying these internationally. We present an empirical driving simulator study, conducted in the UK and China, in which 48 participants undertook typical in-vehicle tasks utilising either a touchscreen, rotary-controller, steering-wheel-controls or touchpad. In both the UK and China, the touchscreen was the most preferred/least demanding to use, and the touchpad least preferred/most demanding, whereas the rotary-controller was generally favoured by UK drivers and steering-wheel-controls were more popular in China. Chinese drivers were more excited by the novelty of the technology, and spent more time attending to the devices while driving, leading to an increase in off-road glance time and a corresponding detriment to vehicle control. Even so, Chinese drivers rated devices as easier-to-use while driving, and felt that they interfered less with their driving performance, compared to their UK counterparts. Results suggest that the most effective solution (to maximise performance/acceptance, while minimising visual demand) is to maintain the touchscreen as the primary control interface (e.g. for top-level tasks), and supplement this with a secondary device that is only enabled for certain actions; moreover, different devices may be employed in different cultural markets. Further work is required to explore these recommendations in greater depth (e.g. during extended or real-world testing), and to validate the findings and approach in other cultural contexts.
Collapse
Affiliation(s)
- David R Large
- Human Factors Research Group, Faculty of Engineering, University of Nottingham, UK.
| | - Gary Burnett
- Human Factors Research Group, Faculty of Engineering, University of Nottingham, UK
| | - Elizabeth Crundall
- Human Factors Research Group, Faculty of Engineering, University of Nottingham, UK
| | - Glyn Lawson
- Human Factors Research Group, Faculty of Engineering, University of Nottingham, UK
| | - Lee Skrypchuk
- Jaguar Land Rover Research, International Digital Laboratory, Coventry, UK
| | - Alex Mouzakitis
- Jaguar Land Rover Research, International Digital Laboratory, Coventry, UK
| |
Collapse
|
23
|
Sahaï A, Pacherie E, Grynszpan O, Berberian B. Corrigendum: Predictive Mechanisms Are Not Involved the Same Way during Human-Human vs. Human-Machine Interactions: A Review. Front Neurorobot 2018; 12:8. [PMID: 29546885 PMCID: PMC5850776 DOI: 10.3389/fnbot.2018.00008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2018] [Accepted: 02/13/2018] [Indexed: 11/13/2022] Open
Affiliation(s)
- Aïsha Sahaï
- Département d'Etudes Cognitives, ENS, EHESS, Centre National de la Recherche Scientifique, Institut Jean-Nicod, PSL Research University, Paris, France.,ONERA, The French Aerospace Laboratory, Département Traitement de l'Information et Systèmes, Salon-de-Provence, France
| | - Elisabeth Pacherie
- Département d'Etudes Cognitives, ENS, EHESS, Centre National de la Recherche Scientifique, Institut Jean-Nicod, PSL Research University, Paris, France
| | - Ouriel Grynszpan
- Institut des Systèmes Intelligents et de Robotique, Université Pierre et Marie Curie, Paris, France
| | - Bruno Berberian
- ONERA, The French Aerospace Laboratory, Département Traitement de l'Information et Systèmes, Salon-de-Provence, France
| |
Collapse
|
24
|
Barros AI, Pinheiro FC, Amaral CDB, Lorençatto R, Nóbrega JA. Aerosol dilution as a simple strategy for analysis of complex samples by ICP-MS. Talanta 2017; 178:805-810. [PMID: 29136898 DOI: 10.1016/j.talanta.2017.10.024] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2017] [Revised: 10/13/2017] [Accepted: 10/15/2017] [Indexed: 11/25/2022]
Abstract
This study investigated the capability of High Matrix Introduction (HMI) strategy for analysis of dialysis solution and urine samples using inductively coupled plasma mass spectrometry. The use of HMI enables the direct introduction of urine samples and dialysis solutions 2-fold diluted with 0.14molL-1 HNO3. Bismuth, Ge, Ir, Li, Pt, Rh, Sc and Tl were evaluated as internal standards for Al, Ag, As, Be, Cd, Cr, Pb, Sb, Se, Tl, and Hg determination in dialysis solution and As, Cd, Hg and Pb determination in urine samples. Helium collision cell mode (4.5mLmin-1) was efficient to overcome polyatomic interferences in As, Se and Cr determinations. Mercury memory effects were evaluated by washing with 0.12molL-1 HCl or an alkaline diluent solution prepared with n-butanol, NH4OH, EDTA, and Triton X-100. This later solution was efficient for avoiding Hg memory effects in 6h of analysis. Linear calibration curves were obtained for all analytes and detection limits were lower than maximum amounts allowed by Brazilian legislations. Recoveries for all analytes in dialysis solutions and urine samples ranged from 82% to 125% and relative standard deviations for all elements and samples were lower than 7%. Analysis of control internal urine samples was in agreement with certified values at 95% confidence level (t-test; p < 0.05).
Collapse
Affiliation(s)
- Ariane I Barros
- Group for Applied Instrumental Analysis, Department of Chemistry, Federal University of São Carlos, P.O. Box 676, São Carlos, SP 13560-270, Brazil.
| | - Fernanda C Pinheiro
- Group for Applied Instrumental Analysis, Department of Chemistry, Federal University of São Carlos, P.O. Box 676, São Carlos, SP 13560-270, Brazil
| | - Clarice D B Amaral
- Department of Chemistry, Federal University of Paraná, Curitiba, PR, Brazil
| | | | - Joaquim A Nóbrega
- Group for Applied Instrumental Analysis, Department of Chemistry, Federal University of São Carlos, P.O. Box 676, São Carlos, SP 13560-270, Brazil
| |
Collapse
|
25
|
Sahaï A, Pacherie E, Grynszpan O, Berberian B. Predictive Mechanisms Are Not Involved the Same Way during Human-Human vs. Human-Machine Interactions: A Review. Front Neurorobot 2017; 11:52. [PMID: 29081744 PMCID: PMC5645494 DOI: 10.3389/fnbot.2017.00052] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2017] [Accepted: 09/19/2017] [Indexed: 11/13/2022] Open
Abstract
Nowadays, interactions with others do not only involve human peers but also automated systems. Many studies suggest that the motor predictive systems that are engaged during action execution are also involved during joint actions with peers and during other human generated action observation. Indeed, the comparator model hypothesis suggests that the comparison between a predicted state and an estimated real state enables motor control, and by a similar functioning, understanding and anticipating observed actions. Such a mechanism allows making predictions about an ongoing action, and is essential to action regulation, especially during joint actions with peers. Interestingly, the same comparison process has been shown to be involved in the construction of an individual's sense of agency, both for self-generated and observed other human generated actions. However, the implication of such predictive mechanisms during interactions with machines is not consensual, probably due to the high heterogeneousness of the automata used in the experimentations, from very simplistic devices to full humanoid robots. The discrepancies that are observed during human/machine interactions could arise from the absence of action/observation matching abilities when interacting with traditional low-level automata. Consistently, the difficulties to build a joint agency with this kind of machines could stem from the same problem. In this context, we aim to review the studies investigating predictive mechanisms during social interactions with humans and with automated artificial systems. We will start by presenting human data that show the involvement of predictions in action control and in the sense of agency during social interactions. Thereafter, we will confront this literature with data from the robotic field. Finally, we will address the upcoming issues in the field of robotics related to automated systems aimed at acting as collaborative agents.
Collapse
Affiliation(s)
- Aïsha Sahaï
- Département d'Etudes Cognitives, ENS, EHESS, Centre National de la Recherche Scientifique, Institut Jean-Nicod, PSL Research University, Paris, France.,ONERA, The French Aerospace Lab, Département Traitement de l'Information et Systèmes, Salon-de-Provence, France
| | - Elisabeth Pacherie
- Département d'Etudes Cognitives, ENS, EHESS, Centre National de la Recherche Scientifique, Institut Jean-Nicod, PSL Research University, Paris, France
| | - Ouriel Grynszpan
- Institut des Systèmes Intelligents et de Robotique, Université Pierre et Marie Curie, Paris, France
| | - Bruno Berberian
- ONERA, The French Aerospace Lab, Département Traitement de l'Information et Systèmes, Salon-de-Provence, France
| |
Collapse
|
26
|
Abstract
SSVEP is a kind of BCI technology with advantage of high information transfer rate. However, due to its nature, frequencies could be used as stimuli are scarce. To solve such problem, a stimuli encoding method which encodes SSVEP signal using Frequency Shift–Keying (FSK) method is developed. In this method, each stimulus is controlled by a FSK signal which contains three different frequencies that represent “Bit 0,” “Bit 1” and “Bit 2” respectively. Different to common BFSK in digital communication, “Bit 0” and “Bit 1” composited the unique identifier of stimuli in binary bit stream form, while “Bit 2” indicates the ending of a stimuli encoding. EEG signal is acquired on channel Oz, O1, O2, Pz, P3, and P4, using ADS1299 at the sample rate of 250 SPS. Before original EEG signal is quadrature demodulated, it is detrended and then band-pass filtered using FFT-based FIR filtering to remove interference. Valid peak of the processed signal is acquired by calculating its derivative and converted into bit stream using window method. Theoretically, this coding method could implement at least 2n−1 (n is the length of bit command) stimulus while keeping the ITR the same. This method is suitable to implement stimuli on a monitor and where the frequency and phase could be used to code stimuli is limited as well as implementing portable BCI devices which is not capable of performing complex calculations.
Collapse
Affiliation(s)
- Xing Zhao
- Department of Biomedical Engineering, School of Bioinformatics, Chongqing University of Post and TelecommunicationsChongqing, China
| | - Dechun Zhao
- Department of Biomedical Engineering, School of Bioinformatics, Chongqing University of Post and TelecommunicationsChongqing, China
| | - Xia Wang
- Department of Biomedical Engineering, School of Bioinformatics, Chongqing University of Post and TelecommunicationsChongqing, China
| | - Xiaorong Hou
- Department of Health Information Management and Decision Making, College of Medical Informatics, Chongqing Medical UniversityChongqing, China
| |
Collapse
|
27
|
Mejías A, Herrera RS, Márquez MA, Calderón AJ, González I, Andújar JM. Easy Handling of Sensors and Actuators over TCP/IP Networks by Open Source Hardware/Software. Sensors (Basel) 2017; 17:E94. [PMID: 28067801 DOI: 10.3390/s17010094] [Citation(s) in RCA: 36] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/14/2016] [Revised: 12/29/2016] [Accepted: 12/30/2016] [Indexed: 11/30/2022]
Abstract
There are several specific solutions for accessing sensors and actuators present in any process or system through a TCP/IP network, either local or a wide area type like the Internet. The usage of sensors and actuators of different nature and diverse interfaces (SPI, I2C, analogue, etc.) makes access to them from a network in a homogeneous and secure way more complex. A framework, including both software and hardware resources, is necessary to simplify and unify networked access to these devices. In this paper, a set of open-source software tools, specifically designed to cover the different issues concerning the access to sensors and actuators, and two proposed low-cost hardware architectures to operate with the abovementioned software tools are presented. They allow integrated and easy access to local or remote sensors and actuators. The software tools, integrated in the free authoring tool Easy Java and Javascript Simulations (EJS) solve the interaction issues between the subsystem that integrates sensors and actuators into the network, called convergence subsystem in this paper, and the Human Machine Interface (HMI)—this one designed using the intuitive graphical system of EJS—located on the user’s computer. The proposed hardware architectures and software tools are described and experimental implementations with the proposed tools are presented.
Collapse
|
28
|
Maag C, Schneider N, Lübbeke T, Weisswange TH, Goerick C. Car Gestures - Advisory warning using additional steering wheel angles. Accid Anal Prev 2015; 83:143-153. [PMID: 26264518 DOI: 10.1016/j.aap.2015.07.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/31/2015] [Revised: 07/21/2015] [Accepted: 07/21/2015] [Indexed: 06/04/2023]
Abstract
Advisory warning systems (AWS) notify the driver about upcoming hazards. This is in contrast to the majority of currently deployed advanced driver assistance systems (ADAS) that manage emergency situations. The target of this study is to investigate the effectiveness, acceptance, and controllability of a specific kind of AWS that uses the haptic information channel for warning the driver. This could be beneficial, as alternatives for using the visual modality can help to reduce the risk of visual overload. The driving simulator study (N=24) compared an AWS based on additional steering wheel angle control (Car Gestures) with a visual warning presented in a simulated head-up display (HUD). Both types of warning were activated 3.5s before the hazard object was reached. An additional condition of unassisted driving completed the experimental design. The subjects encountered potential hazards in a variety of urban situations (e.g. a pedestrian standing on the curbs). For the investigated situations, subjective ratings show that a majority of drivers prefer visual warnings over haptic information via gestures. An analysis of driving behavior indicates that both warning approaches guide the vehicle away from the potential hazard. Whereas gestures lead to a faster lateral driving reaction (compared to HUD warnings), the visual warnings result in a greater safety benefit (measured by the minimum distance to the hazard object). A controllability study with gestures in the wrong direction (i.e. leading toward the hazard object) shows that drivers are able to cope with wrong haptic warnings and safety is not reduced compared to unassisted driving as well as compared to (correct) haptic gestures and visual warnings.
Collapse
Affiliation(s)
- Christian Maag
- WIVW GmbH, Robert-Bosch-Straße 4, 97209 Veitshöchheim, Germany.
| | | | - Thomas Lübbeke
- WIVW GmbH, Robert-Bosch-Straße 4, 97209 Veitshöchheim, Germany
| | - Thomas H Weisswange
- Honda Research Institute Europe GmbH, Carl-Legien-Strasse 30, 63073 Offenbach, Germany
| | - Christian Goerick
- Honda Research Institute Europe GmbH, Carl-Legien-Strasse 30, 63073 Offenbach, Germany
| |
Collapse
|