1
|
Liu S, Huang Z, Li J, Li A, Huang X. FILNet: Fast Image-Based Indoor Localization Using an Anchor Control Network. SENSORS (BASEL, SWITZERLAND) 2023; 23:8140. [PMID: 37836972 PMCID: PMC10575192 DOI: 10.3390/s23198140] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/25/2023] [Revised: 09/14/2023] [Accepted: 09/22/2023] [Indexed: 10/15/2023]
Abstract
This paper designs a fast image-based indoor localization method based on an anchor control network (FILNet) to improve localization accuracy and shorten the duration of feature matching. Particularly, two stages are developed for the proposed algorithm. The offline stage is to construct an anchor feature fingerprint database based on the concept of an anchor control network. This introduces detailed surveys to infer anchor features according to the information of control anchors using the visual-inertial odometry (VIO) based on Google ARcore. In addition, an affine invariance enhancement algorithm based on feature multi-angle screening and supplementation is developed to solve the image perspective transformation problem and complete the feature fingerprint database construction. In the online stage, a fast spatial indexing approach is adopted to improve the feature matching speed by searching for active anchors and matching only anchor features around the active anchors. Further, to improve the correct matching rate, a homography matrix filter model is used to verify the correctness of feature matching, and the correct matching points are selected. Extensive experiments in real-world scenarios are performed to evaluate the proposed FILNet. The experimental results show that in terms of affine invariance, compared with the initial local features, FILNet significantly improves the recall of feature matching from 26% to 57% when the angular deviation is less than 60 degrees. In the image feature matching stage, compared with the initial K-D tree algorithm, FILNet significantly improves the efficiency of feature matching, and the average time of the test image dataset is reduced from 30.3 ms to 12.7 ms. In terms of localization accuracy, compared with the benchmark method based on image localization, FILNet significantly improves the localization accuracy, and the percentage of images with a localization error of less than 0.1m increases from 31.61% to 55.89%.
Collapse
Affiliation(s)
- Sikang Liu
- School of Communication Engineering, Hangzhou Dianzi University, Hangzhou 310018, China;
- State Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Wuhan 430072, China;
| | - Zhao Huang
- School of Electronic Engineering, Queen Mary, University of London, London E1 4NS, UK; (Z.H.); (A.L.)
| | - Jiafeng Li
- State Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Wuhan 430072, China;
| | - Anna Li
- School of Electronic Engineering, Queen Mary, University of London, London E1 4NS, UK; (Z.H.); (A.L.)
| | - Xingru Huang
- School of Communication Engineering, Hangzhou Dianzi University, Hangzhou 310018, China;
| |
Collapse
|
2
|
Ouyang G, Abed-Meraim K, Ouyang Z. Magnetic-Field-Based Indoor Positioning Using Temporal Convolutional Networks. SENSORS (BASEL, SWITZERLAND) 2023; 23:1514. [PMID: 36772554 PMCID: PMC9921884 DOI: 10.3390/s23031514] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/24/2022] [Revised: 01/20/2023] [Accepted: 01/25/2023] [Indexed: 06/18/2023]
Abstract
Traditional magnetic-field positioning methods collect magnetic-field information from each spatial point to construct a magnetic-field fingerprint database. During the positioning phase, real-time magnetic-field measurements are matched to a magnetic-field map to predict the user's location. However, this approach requires a significant amount of time to traverse the entire magnetic-field fingerprint database and does not effectively leverage the magnetic-field sequence's unique patterns to improve the accuracy and robustness of the positioning system. In recent years, the application of deep learning for the indoor positioning of magnetic fields has grown rapidly, especially by using the magnetic-field sequence as a time series and a trained long short-term memory (LSTM) model to predict the position, directly avoiding the time-consuming matching process. However, the training of LSTM is time-consuming, and the degradation problem occurs as the stack of layers increases. This article proposes a temporal convolutional network (TCN)-based magnetic-field positioning system that extracts magnetic-field sequence features by preprocessing them with coordinate transformation, smoothing filtering, and first-order differencing. The proposed method is seamlessly applicable to heterogeneous smartphones. The trained TCN models are compared with the LSTM and gated recurrent unit (GRU) models, showing the high accuracy and robustness of the proposed algorithm.
Collapse
|
3
|
Yoon J, Kim S. Practical and Accurate Indoor Localization System Using Deep Learning. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22186764. [PMID: 36146116 PMCID: PMC9505274 DOI: 10.3390/s22186764] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/29/2022] [Revised: 09/05/2022] [Accepted: 09/05/2022] [Indexed: 06/02/2023]
Abstract
Indoor localization is an important technology for providing various location-based services to smartphones. Among the various indoor localization technologies, pedestrian dead reckoning using inertial measurement units is a simple and highly practical solution for indoor localization. In this study, we propose a smartphone-based indoor localization system using pedestrian dead reckoning. To create a deep learning model for estimating the moving speed, accelerometer data and GPS values were used as input data and data labels, respectively. This is a practical solution compared with conventional indoor localization mechanisms using deep learning. We improved the positioning accuracy via data preprocessing, data augmentation, deep learning modeling, and correction of heading direction. In a horseshoe-shaped indoor building of 240 m in length, the experimental results show a distance error of approximately 3 to 5 m.
Collapse
|
4
|
A CSI Fingerprint Method for Indoor Pseudolite Positioning Based on RT-ANN. FUTURE INTERNET 2022. [DOI: 10.3390/fi14080235] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023] Open
Abstract
At present, the interaction mechanism between the complex indoor environment and pseudolite signals has not been fundamentally resolved, and the stability, continuity, and accuracy of indoor positioning are still technical bottlenecks. In view of the shortcomings of the existing indoor fingerprint positioning methods, this paper proposes a hybrid CSI fingerprint method for indoor pseudolite positioning based on Ray Tracing and artificial neural network (RT-ANN), which combines the advantages of actual acquisition, deterministic simulation, and artificial neural network, and adds the simulation CSI feature parameters generated by modeling and simulation to the input of the neural network, extending the sample features of the neural network input dataset. Taking an airport environment as an example, it is proved that the hybrid method can improve the positioning accuracy in the area where the fingerprints have been collected, the positioning error is reduced by 54.7% compared with the traditional fingerprint positioning method. It is also proved that preliminary positioning can be completed in the area without fingerprint collection.
Collapse
|
5
|
Localizing pedestrians in indoor environments using magnetic field data with term frequency paradigm and deep neural networks. INT J MACH LEARN CYB 2021. [DOI: 10.1007/s13042-021-01279-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
6
|
Zhou R, Yang Y, Chen P. An RSS Transform-Based WKNN for Indoor Positioning. SENSORS 2021; 21:s21175685. [PMID: 34502577 PMCID: PMC8434578 DOI: 10.3390/s21175685] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/22/2021] [Revised: 08/20/2021] [Accepted: 08/21/2021] [Indexed: 01/27/2023]
Abstract
An RSS transform–based weighted k-nearest neighbor (WKNN) indoor positioning algorithm, Q-WKNN, is proposed to improve the positioning accuracy and real-time performance of Wi-Fi fingerprint–based indoor positioning. To smooth the RSS fluctuation difference caused by acquisition equipment, time, and environment changes, base Q is introduced in Q-WKNN to transform RSS to Q-based RSS, based on the relationship between the received signal strength (RSS) and physical distance. Analysis of the effective range of base Q indicates that Q-WKNN is more suitable for regions with noticeable environmental changes and fixed access points (APs). To reduce the positioning time, APs are selected to form a Q-WKNN similarity matrix. Adaptive K is applied to estimate the test point (TP) position. Commonly used indoor positioning algorithms are compared to Q-WKNN on Zenodo and underground parking databases. Results show that Q-WKNN has better positioning accuracy and real-time performance than WKNN, modified-WKNN (M-WKNN), Gaussian kernel (GK), and least squares-support vector machine (LS-SVM) algorithms.
Collapse
|
7
|
Lee BH, Park KM, Kim YH, Kim SC. Hybrid Approach for Indoor Localization Using Received Signal Strength of Dual-Band Wi-Fi. SENSORS 2021; 21:s21165583. [PMID: 34451026 PMCID: PMC8402246 DOI: 10.3390/s21165583] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Revised: 08/13/2021] [Accepted: 08/16/2021] [Indexed: 11/16/2022]
Abstract
In this paper, we propose a hybrid localization algorithm to boost the accuracy of range-based localization by improving the ranging accuracy under indoor non-line-of-sight (NLOS) conditions. We replaced the ranging part of the rule-based localization method with a deep regression model that uses data-driven learning with dual-band received signal strength (RSS). The ranging error caused by the NLOS conditions was effectively reduced by using the deep regression method. As a consequence, the positioning error could be reduced under NLOS conditions. The performance of the proposed method was verified through a ray-tracing-based simulation for indoor spaces. The proposed scheme showed a reduction in the positioning error of at least 22.3% in terms of the median root mean square error compared to the existing methods. In addition, we verified that the proposed method was robust to changes in the indoor structure.
Collapse
Affiliation(s)
- Byeong-ho Lee
- Department of Electrical and Computer Engineering, Institute of New Media & Communications, Seoul National University (SNU), Seoul 08826, Korea; (B.-h.L.); (K.-M.P.)
| | - Kyoung-Min Park
- Department of Electrical and Computer Engineering, Institute of New Media & Communications, Seoul National University (SNU), Seoul 08826, Korea; (B.-h.L.); (K.-M.P.)
| | - Yong-Hwa Kim
- Department of Data Science, Korea National University of Transportation, Uiwang-si 16106, Korea;
| | - Seong-Cheol Kim
- Department of Electrical and Computer Engineering, Institute of New Media & Communications, Seoul National University (SNU), Seoul 08826, Korea; (B.-h.L.); (K.-M.P.)
- Correspondence: ; Tel.: +82-02-880-8481
| |
Collapse
|
8
|
Ashraf I, Din S, Hur S, Kim G, Park Y. Empirical Overview of Benchmark Datasets for Geomagnetic Field-Based Indoor Positioning. SENSORS (BASEL, SWITZERLAND) 2021; 21:3533. [PMID: 34069507 PMCID: PMC8160647 DOI: 10.3390/s21103533] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/02/2021] [Revised: 05/07/2021] [Accepted: 05/14/2021] [Indexed: 11/16/2022]
Abstract
Indoor positioning and localization have been regarded as some of the most widely researched areas during the last decade. The wide proliferation of smartphones and the availability of fast-speed internet have initiated several location-based services. Concerning the importance of precise location information, many sensors are embedded into modern smartphones. Besides Wi-Fi positioning, a rich variety of technologies have been introduced or adopted for indoor positioning such as ultrawideband, infrared, radio frequency identification, Bluetooth beacons, pedestrian dead reckoning, and magnetic field, etc. However, special emphasis is put on infrastructureless approaches like Wi-Fi and magnetic field-based positioning, as they do not require additional infrastructure. Magnetic field positioning is an attractive solution for indoors; yet lack of public benchmarks and selection of suitable benchmarks are among the big challenges. While several benchmarks have been introduced over time, the selection criteria of a benchmark are not properly defined, which leads to positioning results that lack generalization. This study aims at analyzing various public benchmarks for magnetic field positioning and highlights their pros and cons for evaluation positioning algorithms. The concept of DUST (device, user, space, time) and DOWTS (dynamicity, orientation, walk, trajectory, and sensor fusion) is introduced which divides the characteristics of the magnetic field dataset into basic and advanced groups and discusses the publicly available datasets accordingly.
Collapse
Affiliation(s)
| | | | | | | | - Yongwan Park
- Department of Information and Communication Engineering, Yeungnam University, Gyeongbuk, Gyeongsan-si 38541, Korea; (I.A.); (S.D.); (S.H.); (G.K.)
| |
Collapse
|
9
|
Zhang M, Jia J, Chen J, Yang L, Guo L, Wang X. Real-time indoor localization using smartphone magnetic with LSTM networks. Neural Comput Appl 2021. [DOI: 10.1007/s00521-021-05774-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
10
|
Li W, Kang C, Guan H, Huang S, Zhao J, Zhou X, Li J. Deep Learning Correction Algorithm for The Active Optics System. SENSORS 2020; 20:s20216403. [PMID: 33182516 PMCID: PMC7665141 DOI: 10.3390/s20216403] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/14/2020] [Revised: 11/05/2020] [Accepted: 11/06/2020] [Indexed: 12/24/2022]
Abstract
The correction of wavefront aberration plays a vital role in active optics. The traditional correction algorithms based on the deformation of the mirror cannot effectively deal with disturbances in the real system. In this study, a new algorithm called deep learning correction algorithm (DLCA) is proposed to compensate for wavefront aberrations and improve the correction capability. The DLCA consists of an actor network and a strategy unit. The actor network is utilized to establish the mapping of active optics systems with disturbances and provide a search basis for the strategy unit, which can increase the search speed; The strategy unit is used to optimize the correction force, which can improve the accuracy of the DLCA. Notably, a heuristic search algorithm is applied to reduce the search time in the strategy unit. The simulation results show that the DLCA can effectively improve correction capability and has good adaptability. Compared with the least square algorithm (LSA), the algorithm we proposed has better performance, indicating that the DLCA is more accurate and can be used in active optics. Moreover, the proposed approach can provide a new idea for further research of active optics.
Collapse
Affiliation(s)
- Wenxiang Li
- Nanjing Astronomical Instruments Research Center, University of Science and Technology of China, Hefei 230026, China; (W.L.); (C.K.); (H.G.)
| | - Chao Kang
- Nanjing Astronomical Instruments Research Center, University of Science and Technology of China, Hefei 230026, China; (W.L.); (C.K.); (H.G.)
| | - Hengrui Guan
- Nanjing Astronomical Instruments Research Center, University of Science and Technology of China, Hefei 230026, China; (W.L.); (C.K.); (H.G.)
| | - Shen Huang
- CAS Nanjing Astronomical Instruments Co., Ltd., Nanjing 210042, China; (S.H.); (J.Z.); (J.L.)
| | - Jinbiao Zhao
- CAS Nanjing Astronomical Instruments Co., Ltd., Nanjing 210042, China; (S.H.); (J.Z.); (J.L.)
| | - Xiaojun Zhou
- Nanjing Astronomical Instruments Research Center, University of Science and Technology of China, Hefei 230026, China; (W.L.); (C.K.); (H.G.)
- CAS Nanjing Astronomical Instruments Co., Ltd., Nanjing 210042, China; (S.H.); (J.Z.); (J.L.)
- Correspondence:
| | - Jinpeng Li
- CAS Nanjing Astronomical Instruments Co., Ltd., Nanjing 210042, China; (S.H.); (J.Z.); (J.L.)
| |
Collapse
|
11
|
A New Dataset of People Flow in an Industrial Site with UWB and Motion Capture Systems. SENSORS 2020; 20:s20164511. [PMID: 32806669 PMCID: PMC7474431 DOI: 10.3390/s20164511] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/03/2020] [Revised: 07/30/2020] [Accepted: 08/09/2020] [Indexed: 11/26/2022]
Abstract
Improving performance and safety conditions in industrial sites remains a key objective for most companies. Currently, the main goal is to be able to dynamically locate both people and goods on the site. Security and access regulation to restricted areas are often ensured by doors or badge barriers and those have several issues when faced with people being in places they are not supposed to be in or even tools of objects being used incorrectly. In addition to this, a growing use of new devices requires precise information about their location in the environment such as mobile robots or drones. Therefore, it is becoming essential to have the tools to dynamically manage these flows of people and goods. Ultra-wide-band and motion capture solutions will be used to quickly identify people who may be in unauthorized areas or performing tasks which they have been uninstructed to do. In addition to the dynamic tracking of people, this also overcomes some issues associated with moving objects or tools around the production floor. We offer a new set of data that provides precise information on worker movement. This dataset can be used to develop new metrics regarding worker efficiency and safety.
Collapse
|
12
|
Smartphone Sensor Based Indoor Positioning: Current Status, Opportunities, and Future Challenges. ELECTRONICS 2020. [DOI: 10.3390/electronics9060891] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The last two decades have witnessed a rich variety of indoor positioning and localization research. Starting with Microsoft Research pioneering the fingerprint approach based RADAR, MIT’s Cricket, and then moving towards beacon-based localization are few among many others. In parallel, researchers looked into other appealing and promising technologies like radio frequency identification, ultra-wideband, infrared, and visible light-based systems. However, the proliferation of smartphones over the past few years revolutionized and reshaped indoor localization towards new horizons. The deployment of MEMS sensors in modern smartphones have initiated new opportunities and challenges for the industry and academia alike. Additionally, the demands and potential of location-based services compelled the researchers to look into more robust, accurate, smartphone deployable, and context-aware location sensing. This study presents a comprehensive review of the approaches that make use of data from one or more sensors to estimate the user’s indoor location. By analyzing the approaches leveraged on smartphone sensors, it discusses the associated challenges of such approaches and points out the areas that need considerable research to overcome their limitations.
Collapse
|
13
|
Ashraf I, Hur S, Park Y. Enhancing Performance of Magnetic Field Based Indoor Localization Using Magnetic Patterns from Multiple Smartphones. SENSORS 2020; 20:s20092704. [PMID: 32397444 PMCID: PMC7249215 DOI: 10.3390/s20092704] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/03/2020] [Revised: 05/02/2020] [Accepted: 05/07/2020] [Indexed: 11/26/2022]
Abstract
Wide expansion of smartphones triggered a rapid demand for precise localization that can meet the requirements of location-based services. Although the global positioning system is widely used for outdoor positioning, it cannot provide the same accuracy for the indoor. As a result, many alternative indoor positioning technologies like Wi-Fi, Bluetooth Low Energy (BLE), and geomagnetic field localization have been investigated during the last few years. Today smartphones possess a rich variety of embedded sensors like accelerometer, gyroscope, and magnetometer that can facilitate estimating the current location of the user. Traditional geomagnetic field-based fingerprint localization, although it shows promising results, it is limited by the fact that various smartphones have embedded magnetic sensors from different manufacturers and the magnetic field strength that is measured from these smartphones vary significantly. Consequently, the localization performance from various smartphones is different even when the same localization approach is used. So devising an approach that can provide similar performance with various smartphones is a big challenge. Contrary to previous works that build the fingerprint database from the geomagnetic field data of a single smartphone, this study proposes using the geomagnetic field data collected from multiple smartphones to make the geomagnetic field pattern (MP) database. Many experiments are carried out to analyze the performance of the proposed approach with various smartphones. Additionally, a lightweight threshold technique is proposed that can detect user motion using the acceleration data. Results demonstrate that the localization performance for four different smartphones is almost identical when tested with the database made using the magnetic field data from multiple smartphones than that of which considers the magnetic field data from only one smartphone. Moreover, the performance comparison with previous research indicates that the overall performance of smartphones is improved.
Collapse
|
14
|
Estimation of Indoor Location Through Magnetic Field Data: An Approach Based On Convolutional Neural Networks. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION 2020. [DOI: 10.3390/ijgi9040226] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Estimation of indoor location represents an interesting research topic since it is a main contextual variable for location bases services (LBS), eHealth applications and commercial systems, among others. For instance, hospitals require location data of their employees, as well as the location of their patients to offer services based on these locations at the correct moments of their needs. Several approaches have been proposed to tackle this problem using different types of artificial or natural signals (i.e., wifi, bluetooth, rfid, sound, movement, etc.). In this work, it is proposed the development of an indoor location estimator system, relying in the data provided by the magnetic field of the rooms, which has been demonstrated that is unique and quasi-stationary. For this purpose, it is analyzed the spectral evolution of the magnetic field data viewed as a bidimensional heatmap, avoiding temporal dependencies. A Fourier transform is applied to the bidimensional heatmap of the magnetic field data to feed a convolutional neural network (CNN) to generate a model to estimate the user’s location in a building. The evaluation of the CNN model to deploy an indoor location system (ILS) is done through measuring the Receiver Operating Characteristic (ROC) curve to observe the behavior in terms of sensitivity and specificity. Our experiments achieve a 0.99 Area Under the Curve (AUC) in the training data-set and a 0.74 in a total blind data set.
Collapse
|