Enhancing indoor inertial pedestrian navigation using a shoe-worn marker

Real-Time Pedestrian Tracking Terminal Based on Adaptive Zero Velocity Update

In the field of pedestrian dead reckoning (PDR), the zero velocity update (ZUPT) method with an inertial measurement unit (IMU) is a mature technology to calibrate dead reckoning. However, due to the complex walking modes of different individuals, it is essential and challenging to determine the ZUPT conditions, which has a direct and significant influence on the tracking accuracy. In this research, we adopted an adaptive zero velocity update (AZUPT) method based on convolution neural networks to classify the ZUPT conditions. The AZUPT model was robust regardless of the different motion types of various individuals. AZUPT was then implemented on the Zynq-7000 SoC platform to work in real time to validate its computational efficiency and performance superiority. Extensive real-world experiments were conducted by 60 different individuals in three different scenarios. It was demonstrated that the proposed system could work equally well in different environments, making it portable for PDR to be widely performed in various real-world situations.

A review of foot pose and trajectory estimation methods using inertial and auxiliary sensors for kinematic gait analysis

The use of foot mounted inertial and other auxiliary sensors for kinematic gait analysis has been extensively investigated during the last years. Although, these sensors still yield less accurate results than those obtained employing optical motion capture systems, the miniaturization and their low cost have allowed the estimation of kinematic spatiotemporal parameters in laboratory conditions and real life scenarios. The aim of this work was to present a comprehensive approach of this scientific area through a systematic literature research, breaking down the state-of-the-art methods into three main parts: (1) zero velocity interval detection techniques; (2) assumptions and sensors' utilization; (3) foot pose and trajectory estimation methods. Published articles from 1995 until December of 2018 were searched in the PubMed, IEEE Xplore and Google Scholar databases. The research was focused on two categories: (a) zero velocity interval detection methods; and (b) foot pose and trajectory estimation methods. The employed assumptions and the potential use of the sensors have been identified from the retrieved articles. Technical characteristics, categorized methodologies, application conditions, advantages and disadvantages have been provided, while, for the first time, assumptions and sensors' utilization have been identified, categorized and are presented in this review. Considerable progress has been achieved in gait parameters estimation on constrained laboratory environments taking into account assumptions such as a person walking on a flat floor. On the contrary, methods that rely on less constraining assumptions, and are thus applicable in daily life, led to less accurate results. Rule based methods have been mainly used for the detection of the zero velocity intervals, while more complex techniques have been proposed, which may lead to more accurate gait parameters. The review process has shown that presently the best-performing methods for gait parameter estimation make use of inertial sensors combined with auxiliary sensors such as ultrasonic sensors, proximity sensors and cameras. However, the experimental evaluation protocol was much more thorough, when single inertial sensors were used. Finally, it has been highlighted that the accuracy of setups using auxiliary sensors may further be improved by collecting measurements during the whole foot movement and not only partially as is currently the practice. This review has identified the need for research and development of methods and setups that allow for the robust estimation of kinematic gait parameters in unconstrained environments and under various gait profiles.

Spline Function Simulation Data Generation for Walking Motion Using Foot-Mounted Inertial Sensors

This paper investigates the generation of simulation data for motion estimation using inertial sensors. The smoothing algorithm with waypoint-based map matching is proposed using foot-mounted inertial sensors to estimate position and attitude. The simulation data are generated using spline functions, where the estimated position and attitude are used as control points. The attitude is represented using B-spline quaternion and the position is represented by eighth-order algebraic splines. The simulation data can be generated using inertial sensors (accelerometer and gyroscope) without using any additional sensors. Through indoor experiments, two scenarios were examined include 2D walking path (rectangular) and 3D walking path (corridor and stairs) for simulation data generation. The proposed simulation data is used to evaluate the estimation performance with different parameters such as different noise levels and sampling periods.

3D Tracking via Shoe Sensing

Most location-based services are based on a global positioning system (GPS), which only works well in outdoor environments. Compared to outdoor environments, indoor localization has created more buzz in recent years as people spent most of their time indoors working at offices and shopping at malls, etc. Existing solutions mainly rely on inertial sensors (i.e., accelerometer and gyroscope) embedded in mobile devices, which are usually not accurate enough to be useful due to the mobile devices’ random movements while people are walking. In this paper, we propose the use of shoe sensing (i.e., sensors attached to shoes) to achieve 3D indoor positioning. Specifically, a short-time energy-based approach is used to extract the gait pattern. Moreover, in order to improve the accuracy of vertical distance estimation while the person is climbing upstairs, a state classification is designed to distinguish the walking status including plane motion (i.e., normal walking and jogging horizontally), walking upstairs, and walking downstairs. Furthermore, we also provide a mechanism to reduce the vertical distance accumulation error. Experimental results show that we can achieve nearly 100% accuracy when extracting gait patterns from walking/jogging with a low-cost shoe sensor, and can also achieve 3D indoor real-time positioning with high accuracy.

A Novel Pedestrian Navigation Algorithm for a Foot-Mounted Inertial-Sensor-Based System

This paper proposes a novel zero velocity update (ZUPT) method for a foot-mounted pedestrian navigation system (PNS). First, the error model of the PNS is developed and a Kalman filter is built based on the error model. Second, a novel zero velocity detection algorithm based on the variations in speed over a gait cycle is proposed. A finite state machine including three states is employed to model a gait cycle. The state transition conditions are determined based on speed using a sliding window. Third, the ZUPT software flow is illustrated and described. Finally, the performances of the proposed method and other methods are examined and compared experimentally. The experimental results show that the mean relative accuracy of the proposed method is 0.89% under various motion modes.

Pedestrian Navigation Using Foot-Mounted Inertial Sensor and LIDAR

Foot-mounted inertial sensors can be used for indoor pedestrian navigation. In this paper, to improve the accuracy of pedestrian location, we propose a method using a distance sensor (LIDAR) in addition to an inertial measurement unit (IMU). The distance sensor is a time of flight range finder with 30 m measurement range (at 33.33 Hz). Using a distance sensor, walls on corridors are automatically detected. The detected walls are used to correct the heading of the pedestrian path. Through experiments, it is shown that the accuracy of the heading is significantly improved using the proposed algorithm. Furthermore, the system is shown to work robustly in indoor environments with many doors and passing people.

An Inertial and Optical Sensor Fusion Approach for Six Degree-of-Freedom Pose Estimation

Optical tracking provides relatively high accuracy over a large workspace but requires line-of-sight between the camera and the markers, which may be difficult to maintain in actual applications. In contrast, inertial sensing does not require line-of-sight but is subject to drift, which may cause large cumulative errors, especially during the measurement of position. To handle cases where some or all of the markers are occluded, this paper proposes an inertial and optical sensor fusion approach in which the bias of the inertial sensors is estimated when the optical tracker provides full six degree-of-freedom (6-DOF) pose information. As long as the position of at least one marker can be tracked by the optical system, the 3-DOF position can be combined with the orientation estimated from the inertial measurements to recover the full 6-DOF pose information. When all the markers are occluded, the position tracking relies on the inertial sensors that are bias-corrected by the optical tracking system. Experiments are performed with an augmented reality head-mounted display (ARHMD) that integrates an optical tracking system (OTS) and inertial measurement unit (IMU). Experimental results show that under partial occlusion conditions, the root mean square errors (RMSE) of orientation and position are 0.04° and 0.134 mm, and under total occlusion conditions for 1 s, the orientation and position RMSE are 0.022° and 0.22 mm, respectively. Thus, the proposed sensor fusion approach can provide reliable 6-DOF pose under long-term partial occlusion and short-term total occlusion conditions.