1
|
Wang M, Ye L, Sun X. Adaptive online terrain classification method for mobile robot based on vibration signals. INT J ADV ROBOT SYST 2021. [DOI: 10.1177/17298814211062035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
To improve the accuracy of terrain classification during mobile robot operation, an adaptive online terrain classification method based on vibration signals is proposed. First, the time domain and the combined features of the time, frequency, and time–frequency domains in the original vibration signal are extracted. These are adopted as the input of the random forest algorithm to generate classification models with different dimensions. Then, by judging the relationship between the current speed of the mobile robot and its critical speed, the classification model of different dimensions is adaptively selected for online classification. Offline and online experiments are conducted for four different terrains. The experimental results show that the proposed method can effectively avoid the self-vibration interference caused by an increase in the robot’s moving speed and achieve higher terrain classification accuracy.
Collapse
Affiliation(s)
- Mingming Wang
- Department of Electrical and Electronic Engineering, Shijiazhuang Tiedao University, Shijiazhuang, China
| | - Liming Ye
- Department of Electrical and Electronic Engineering, Shijiazhuang Tiedao University, Shijiazhuang, China
| | - Xiaoyun Sun
- Department of Electrical and Electronic Engineering, Shijiazhuang Tiedao University, Shijiazhuang, China
| |
Collapse
|
2
|
Khalili M, Ta K, Van der Loos HFM, Borisoff JF. Offline and Real-Time Implementation of a Terrain Classification Pipeline for Pushrim-Activated Power-Assisted Wheelchairs. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:4542-4545. [PMID: 34892227 DOI: 10.1109/embc46164.2021.9630749] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Pushrim-activated power-assisted wheelchairs (PAPAWs) are assistive technologies that provide propulsion assist to wheelchair users and enable access to various indoor and outdoor terrains. Therefore, it is beneficial to use PAPAW controllers that adapt to different terrain conditions. To achieve this objective, terrain classification techniques can be used as an integral part of the control architecture. Previously, the feasibility of using learning-based terrain classification models was investigated for offline applications. In this paper, we examine the effects of three model parameters (i.e., feature characteristics, terrain types, and the length of data segments) on offline and real-time classification accuracy. Our findings revealed that Random Forest classifiers are computationally efficient and can be used effectively for real-time terrain classification. These classifiers have the highest performance accuracy when used with a combination of time- and frequency-domain features. Additionally, we found that increasing the number of data points used for terrain estimation improves the prediction accuracy. Finally, our results revealed that classification accuracy can be improved by considering terrains with similar characteristics under one umbrella group. These findings can contribute to the development of real-time adaptive controllers that enhance PAPAW usability on different terrains.
Collapse
|
3
|
Xiao X, Biswas J, Stone P. Learning Inverse Kinodynamics for Accurate High-Speed Off-Road Navigation on Unstructured Terrain. IEEE Robot Autom Lett 2021. [DOI: 10.1109/lra.2021.3090023] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
4
|
Li Z, Kang Y, Lv W, Wu Y, Chen C, Xu Z. High-emitter identification model establishment using weighted extreme learning machine and active sampling. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2021.01.074] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
5
|
Oliveira FG, Neto AA, Howard D, Borges P, Campos MFM, Macharet DG. Three-Dimensional Mapping with Augmented Navigation Cost through Deep Learning. J INTELL ROBOT SYST 2021. [DOI: 10.1007/s10846-020-01304-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
6
|
Cheng C, Chang J, Lv W, Wu Y, Li K, Li Z, Yuan C, Ma S. Frequency-Temporal Disagreement Adaptation for Robotic Terrain Classification via Vibration in a Dynamic Environment. SENSORS 2020; 20:s20226550. [PMID: 33207829 PMCID: PMC7697547 DOI: 10.3390/s20226550] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/10/2020] [Revised: 11/08/2020] [Accepted: 11/14/2020] [Indexed: 11/16/2022]
Abstract
The accurate terrain classification in real time is of great importance to an autonomous robot working in field, because the robot could avoid non-geometric hazards, adjust control scheme, or improve localization accuracy, with the aid of terrain classification. In this paper, we investigate the vibration-based terrain classification (VTC) in a dynamic environment, and propose a novel learning framework, named DyVTC, which tackles online-collected unlabeled data with concept drift. In the DyVTC framework, the exterior disagreement (ex-disagreement) and interior disagreement (in-disagreement) are proposed novely based on the feature diversity and intrinsic temporal correlation, respectively. Such a disagreement mechanism is utilized to design a pseudo-labeling algorithm, which shows its compelling advantages in extracting key samples and labeling; and consequently, the classification accuracy could be retrieved by incremental learning in a changing environment. Since two sets of features are extracted from frequency and time domain to generate disagreements, we also name the proposed method feature-temporal disagreement adaptation (FTDA). The real-world experiment shows that the proposed DyVTC could reach an accuracy of 89.5%, but the traditional time- and frequency-domain terrain classification methods could only reach 48.8% and 71.5%, respectively, in a dynamic environment.
Collapse
Affiliation(s)
- Chen Cheng
- Department of Automation, University of Science and Technology of China, Hefei 230027, China; (C.C.); (J.C.); (K.L.); (Z.L.)
- School of Information Engineering, Anhui Institute of International Business, Hefei 231131, China
| | - Ji Chang
- Department of Automation, University of Science and Technology of China, Hefei 230027, China; (C.C.); (J.C.); (K.L.); (Z.L.)
| | - Wenjun Lv
- Department of Automation, University of Science and Technology of China, Hefei 230027, China; (C.C.); (J.C.); (K.L.); (Z.L.)
- Correspondence:
| | - Yuping Wu
- Key Laboratory of Industrial Computer Control Engineering of Hebei Province, Yanshan University, Qinhuangdao 066004, China;
| | - Kun Li
- Department of Automation, University of Science and Technology of China, Hefei 230027, China; (C.C.); (J.C.); (K.L.); (Z.L.)
- Department of Research and Development, Anhui Etown Information Technology Co., Ltd, Hefei 230011, China
| | - Zerui Li
- Department of Automation, University of Science and Technology of China, Hefei 230027, China; (C.C.); (J.C.); (K.L.); (Z.L.)
- Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei 230088, China; (C.Y.); (S.M.)
| | - Chenhui Yuan
- Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei 230088, China; (C.Y.); (S.M.)
- School of Computer Science and Technology, Anhui University, Hefei 230601, China
| | - Saifei Ma
- Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei 230088, China; (C.Y.); (S.M.)
- School of Computer Science and Technology, Anhui University, Hefei 230601, China
| |
Collapse
|
7
|
Low-Cost Road-Surface Classification System Based on Self-Organizing Maps. SENSORS 2020; 20:s20216009. [PMID: 33113910 PMCID: PMC7660168 DOI: 10.3390/s20216009] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/25/2020] [Revised: 10/16/2020] [Accepted: 10/18/2020] [Indexed: 11/22/2022]
Abstract
Expanding the performance and autonomous-decision capability of driver-assistance systems is critical in today’s automotive engineering industry to help drivers and reduce accident incidence. It is essential to provide vehicles with the necessary perception systems, but without creating a prohibitively expensive product. In this area, the continuous and precise estimation of a road surface on which a vehicle moves is vital for many systems. This paper proposes a low-cost approach to solve this issue. The developed algorithm resorts to analysis of vibrations generated by the tyre-rolling movement to classify road surfaces, which allows for optimizing vehicular-safety-system performance. The signal is analyzed by means of machine-learning techniques, and the classification and estimation of the surface are carried out with the use of a self-organizing-map (SOM) algorithm. Real recordings of the vibration produced by tyre rolling on six different types of surface were used to generate the model. The efficiency of the proposed model (88.54%) and its speed of execution were compared with those of other classifiers in order to evaluate its performance.
Collapse
|
8
|
Khalili M, McConkey KT, Ta K, Wu LC, Van der Loos HFM, Borisoff JF. Development of A Learning-Based Terrain Classification Framework for Pushrim-Activated Power-Assisted Wheelchairs .. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:4762-4765. [PMID: 33019055 DOI: 10.1109/embc44109.2020.9175678] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Pushrim-activated power-assisted wheels (PAPAWs) are assistive technologies that provide on-demand torque assistance to wheelchair users. Although the available power can reduce the physical load of wheelchair propulsion, it may also cause maneuverability and controllability issues. Commercially-available PAPAW controllers are insensitive to environmental changes, leading to inefficient and/or unsafe wheelchair movements. In this regard, adaptive velocity/torque control strategies could be employed to improve safety and stability. To investigate this objective, we propose a context-aware sensory framework to recognize terrain conditions. In this paper, we present a learning-based terrain classification framework for PAPAWs. Study participants performed various maneuvers consisting of common daily-life wheelchair propulsion routines on different indoor and outdoor terrains. Relevant features from wheelchair frame-mounted gyroscope and accelerometer measurements were extracted and used to train and test the proposed classifiers. Our findings revealed that a one-stage multi-label classification framework has a higher accuracy performance compared to a two-stage classification pipeline with an indoor-outdoor classification in the first stage. We also found that, on average, outdoor terrains can be classified with higher accuracy (90%) compared to indoor terrains (65%). This framework can be used for real-time terrain classification applications and provide the required information for an adaptive velocity/torque controller design.
Collapse
|
9
|
Liu H, Wu Y, Cao Y, Lv W, Han H, Li Z, Chang J. Well Logging Based Lithology Identification Model Establishment Under Data Drift: A Transfer Learning Method. SENSORS 2020; 20:s20133643. [PMID: 32610586 PMCID: PMC7374305 DOI: 10.3390/s20133643] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/29/2020] [Revised: 06/21/2020] [Accepted: 06/23/2020] [Indexed: 12/14/2022]
Abstract
Recent years have witnessed the development of the applications of machine learning technologies to well logging-based lithology identification. Most of the existing work assumes that the well loggings gathered from different wells share the same probability distribution; however, the variations in sedimentary environment and well-logging technique might cause the data drift problem; i.e., data of different wells have different probability distributions. Therefore, the model trained on old wells does not perform well in predicting the lithologies in newly-coming wells, which motivates us to propose a transfer learning method named the data drift joint adaptation extreme learning machine (DDJA-ELM) to increase the accuracy of the old model applying to new wells. In such a method, three key points, i.e., the project mean maximum mean discrepancy, joint distribution domain adaptation, and manifold regularization, are incorporated into extreme learning machine. As found experimentally in multiple wells in Jiyang Depression, Bohai Bay Basin, DDJA-ELM could significantly increase the accuracy of an old model when identifying the lithologies in new wells.
Collapse
Affiliation(s)
- Haining Liu
- School of Geosciences, China University of Petroleum, Qingdao 266580, China; (H.L.); (Y.C.)
- Shengli Geophysical Research Institute of SINOPEC, Dongying 257022, China;
| | - Yuping Wu
- School of Electrical Engineering, Yanshan University, Qinhuangdao 066004, China;
| | - Yingchang Cao
- School of Geosciences, China University of Petroleum, Qingdao 266580, China; (H.L.); (Y.C.)
| | - Wenjun Lv
- Department of Automation, University of Science and Technology of China, Hefei 230027, China; (Z.L.); (J.C.)
- Correspondence:
| | - Hongwei Han
- Shengli Geophysical Research Institute of SINOPEC, Dongying 257022, China;
| | - Zerui Li
- Department of Automation, University of Science and Technology of China, Hefei 230027, China; (Z.L.); (J.C.)
| | - Ji Chang
- Department of Automation, University of Science and Technology of China, Hefei 230027, China; (Z.L.); (J.C.)
| |
Collapse
|
10
|
Laplacian Support Vector Machine for Vibration-Based Robotic Terrain Classification. ELECTRONICS 2020. [DOI: 10.3390/electronics9030513] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
The achievement of robot autonomy has environmental perception as a prerequisite. The hazards rendered from uneven, soft and slippery terrains, which are generally named non-geometric hazards, are another potential threat reducing the traversing efficient, and therefore receiving more and more attention from the robotics community. In the paper, the vibration-based terrain classification (VTC) is investigated by taking a very practical issue, i.e., lack of labels, into consideration. According to the intrinsic temporal correlation existing in the sampled terrain sequence, a modified Laplacian SVM is proposed to utilise the unlabelled data to improve the classification performance. To the best of our knowledge, this is the first paper studying semi-supervised learning problem in robotic terrain classification. The experiment demonstrates that: (1) supervised learning (SVM) achieves a relatively low classification accuracy if given insufficient labels; (2) feature-space homogeneity based semi-supervised learning (traditional Laplacian SVM) cannot improve supervised learning’s accuracy, and even makes it worse; (3) feature- and temporal-space based semi-supervised learning (modified Laplacian SVM), which is proposed in the paper, could increase the classification accuracy very significantly.
Collapse
|
11
|
Deep Multi-Layer Perception Based Terrain Classification for Planetary Exploration Rovers. SENSORS 2019; 19:s19143102. [PMID: 31337058 PMCID: PMC6679340 DOI: 10.3390/s19143102] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/26/2019] [Revised: 07/08/2019] [Accepted: 07/08/2019] [Indexed: 11/18/2022]
Abstract
Accurate classification and identification of the detected terrain is the basis for the long-distance patrol mission of the planetary rover. But terrain measurement based on vision and radar is subject to conditions such as light changes and dust storms. In this paper, under the premise of not increasing the sensor load of the existing rover, a terrain classification and recognition method based on vibration is proposed. Firstly, the time-frequency domain transformation of vibration information is realized by fast Fourier transform (FFT), and the characteristic representation of vibration information is given. Secondly, a deep neural network based on multi-layer perception is designed to realize classification of different terrains. Finally, combined with the Jackal unmanned vehicle platform, the XQ unmanned vehicle platform, and the vibration sensor, the terrain classification comparison test based on five different terrains was completed. The results show that the proposed algorithm has higher classification accuracy, and different platforms and running speeds have certain influence on the terrain classification at the same time, which provides support for subsequent practical applications.
Collapse
|