1
|
Aydin M, Dalveren Y, Kara A, Derawi M. The Fast and Reliable Detection of Multiple Narrowband FH Signals: A Practical Framework. SENSORS (BASEL, SWITZERLAND) 2024; 24:4812. [PMID: 39123857 PMCID: PMC11314967 DOI: 10.3390/s24154812] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/26/2024] [Revised: 06/20/2024] [Accepted: 07/19/2024] [Indexed: 08/12/2024]
Abstract
Frequency hopping (FH) is a well-known technique that is commonly used in communication systems owing to its many advantages, including its strong anti-jamming capability. In this technique, basically, radio signals are transmitted by switching the carrier between different frequency channels. As a result, the FH signal is not stationary; hence, its spectrum is expected to change over time. Therefore, the task of detection and parameter estimation of FH signals is very challenging in practice. To address this challenge, the study presented in this article proposes a method that detects and estimates the parameters of multiple narrowband FH signals. In the proposed method, first, short-time Fourier transform (STFT) is utilized to analyze FH signals, and a practical binarization process based on thresholding is used to detect FH signals. Then, a new algorithm is proposed to ensure that the center frequencies of the detected signals are successfully separated. Next, another algorithm is proposed to estimate the parameters of the detected signals. After estimating the parameters for the entire spectrum, an approach is used to detect FH signals. Lastly, the hop-clustering process is applied to separate the hops into groups without time overlap. The simulation results show that the proposed method can be an efficient way for the fast and accurate parameter estimation and detection of multiple narrowband FH signals.
Collapse
Affiliation(s)
- Mutlu Aydin
- Department of Electrical and Electronics Engineering, Gazi University, Ankara 06570, Turkey; (M.A.); (A.K.)
- TUBITAK BILGEM ILTAREN, Sht Yzb Ilhan Tan Kislasi, Ankara 06800, Turkey
| | - Yaser Dalveren
- Department of Electrical and Electronics Engineering, Izmir Bakircay University, Izmir 35665, Turkey;
| | - Ali Kara
- Department of Electrical and Electronics Engineering, Gazi University, Ankara 06570, Turkey; (M.A.); (A.K.)
| | - Mohammad Derawi
- Department of Electronic Systems, Norwegian University of Science and Technology, 2815 Gjovik, Norway
| |
Collapse
|
2
|
Famili A, Stavrou A, Wang H, Park JM(J, Gerdes R. Securing Your Airspace: Detection of Drones Trespassing Protected Areas. SENSORS (BASEL, SWITZERLAND) 2024; 24:2028. [PMID: 38610239 PMCID: PMC11013887 DOI: 10.3390/s24072028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/15/2024] [Revised: 03/07/2024] [Accepted: 03/20/2024] [Indexed: 04/14/2024]
Abstract
Unmanned Aerial Vehicle (UAV) deployment has risen rapidly in recent years. They are now used in a wide range of applications, from critical safety-of-life scenarios like nuclear power plant surveillance to entertainment and hobby applications. While the popularity of drones has grown lately, the associated intentional and unintentional security threats require adequate consideration. Thus, there is an urgent need for real-time accurate detection and classification of drones. This article provides an overview of drone detection approaches, highlighting their benefits and limitations. We analyze detection techniques that employ radars, acoustic and optical sensors, and emitted radio frequency (RF) signals. We compare their performance, accuracy, and cost under different operating conditions. We conclude that multi-sensor detection systems offer more compelling results, but further research is required.
Collapse
Affiliation(s)
- Alireza Famili
- Department of Electrical and Computer Engineering, Virginia Tech, Arlington, VA 22203, USA; (A.S.); (H.W.); (J.-M.P.); (R.G.)
| | | | | | | | | |
Collapse
|
3
|
Seidaliyeva U, Ilipbayeva L, Taissariyeva K, Smailov N, Matson ET. Advances and Challenges in Drone Detection and Classification Techniques: A State-of-the-Art Review. SENSORS (BASEL, SWITZERLAND) 2023; 24:125. [PMID: 38202987 PMCID: PMC10780901 DOI: 10.3390/s24010125] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Revised: 12/05/2023] [Accepted: 12/15/2023] [Indexed: 01/12/2024]
Abstract
The fast development of unmanned aerial vehicles (UAVs), commonly known as drones, has brought a unique set of opportunities and challenges to both the civilian and military sectors. While drones have proven useful in sectors such as delivery, agriculture, and surveillance, their potential for abuse in illegal airspace invasions, privacy breaches, and security risks has increased the demand for improved detection and classification systems. This state-of-the-art review presents a detailed overview of current improvements in drone detection and classification techniques: highlighting novel strategies used to address the rising concerns about UAV activities. We investigate the threats and challenges faced due to drones' dynamic behavior, size and speed diversity, battery life, etc. Furthermore, we categorize the key detection modalities, including radar, radio frequency (RF), acoustic, and vision-based approaches, and examine their distinct advantages and limitations. The research also discusses the importance of sensor fusion methods and other detection approaches, including wireless fidelity (Wi-Fi), cellular, and Internet of Things (IoT) networks, for improving the accuracy and efficiency of UAV detection and identification.
Collapse
Affiliation(s)
- Ulzhalgas Seidaliyeva
- Department of Electronics, Telecommunications and Space Technologies, Satbayev University, Almaty 050013, Kazakhstan; (K.T.)
| | - Lyazzat Ilipbayeva
- Department of Radio Engineering, Electronics and Telecommunications, International IT University, Almaty 050040, Kazakhstan
| | - Kyrmyzy Taissariyeva
- Department of Electronics, Telecommunications and Space Technologies, Satbayev University, Almaty 050013, Kazakhstan; (K.T.)
| | - Nurzhigit Smailov
- Department of Electronics, Telecommunications and Space Technologies, Satbayev University, Almaty 050013, Kazakhstan; (K.T.)
| | - Eric T. Matson
- Department of Computer and Information Technology, Purdue University, West Lafayette, IN 47907-2021, USA;
| |
Collapse
|
4
|
Aouladhadj D, Kpre E, Deniau V, Kharchouf A, Gransart C, Gaquière C. Drone Detection and Tracking Using RF Identification Signals. SENSORS (BASEL, SWITZERLAND) 2023; 23:7650. [PMID: 37688105 PMCID: PMC10490811 DOI: 10.3390/s23177650] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Revised: 08/26/2023] [Accepted: 09/01/2023] [Indexed: 09/10/2023]
Abstract
The market for unmanned aerial systems (UASs) has grown considerably worldwide, but their ability to transmit sensitive information poses a threat to public safety. To counter these threats, authorities, and anti-drone organizations are ensuring that UASs comply with regulations, focusing on strategies to mitigate the risks associated with malicious drones. This study presents a technique for detecting drone models using identification (ID) tags in radio frequency (RF) signals, enabling the extraction of real-time telemetry data through the decoding of Drone ID packets. The system, implemented with a development board, facilitates efficient drone tracking. The results of a measurement campaign performance evaluation include maximum detection distances of 1.3 km for the Mavic Air, 1.5 km for the Mavic 3, and 3.7 km for the Mavic 2 Pro. The system accurately estimates a drone's 2D position, altitude, and speed in real time. Thanks to the decoding of telemetry packets, the system demonstrates promising accuracy, with worst-case distances between estimated and actual drone positions of 35 m for the Mavic 2 Pro, 17 m for the Mavic Air, and 15 m for the Mavic 3. In addition, there is a relative error of 14% for altitude measurements and 7% for speed measurements. The reaction times calculated to secure a vulnerable site within a 200 m radius are 1.83 min (Mavic Air), 1.03 min (Mavic 3), and 2.92 min (Mavic 2 Pro). This system is proving effective in addressing emerging concerns about drone-related threats, helping to improve public safety and security.
Collapse
Affiliation(s)
- Driss Aouladhadj
- COSYS-LEOST, Université Gustave Eiffel, 20 Rue Élisée Reclus, 59650 Villeneuve-d’Ascq, France; (V.D.); (C.G.)
- MC2 Technologies, 1 Rue Héraclès, 59493 Villeneuve-d’Ascq, France; (E.K.); (A.K.); (C.G.)
| | - Ettien Kpre
- MC2 Technologies, 1 Rue Héraclès, 59493 Villeneuve-d’Ascq, France; (E.K.); (A.K.); (C.G.)
| | - Virginie Deniau
- COSYS-LEOST, Université Gustave Eiffel, 20 Rue Élisée Reclus, 59650 Villeneuve-d’Ascq, France; (V.D.); (C.G.)
| | - Aymane Kharchouf
- MC2 Technologies, 1 Rue Héraclès, 59493 Villeneuve-d’Ascq, France; (E.K.); (A.K.); (C.G.)
| | - Christophe Gransart
- COSYS-LEOST, Université Gustave Eiffel, 20 Rue Élisée Reclus, 59650 Villeneuve-d’Ascq, France; (V.D.); (C.G.)
| | - Christophe Gaquière
- MC2 Technologies, 1 Rue Héraclès, 59493 Villeneuve-d’Ascq, France; (E.K.); (A.K.); (C.G.)
| |
Collapse
|
5
|
Sun Y, Zhi X, Han H, Jiang S, Shi T, Gong J, Zhang W. Enhancing UAV Detection in Surveillance Camera Videos through Spatiotemporal Information and Optical Flow. SENSORS (BASEL, SWITZERLAND) 2023; 23:6037. [PMID: 37447887 PMCID: PMC10347213 DOI: 10.3390/s23136037] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/04/2023] [Revised: 06/24/2023] [Accepted: 06/27/2023] [Indexed: 07/15/2023]
Abstract
The growing intelligence and prevalence of drones have led to an increase in their disorderly and illicit usage, posing substantial risks to aviation and public safety. This paper focuses on addressing the issue of drone detection through surveillance cameras. Drone targets in images possess distinctive characteristics, including small size, weak energy, low contrast, and limited and varying features, rendering precise detection a challenging task. To overcome these challenges, we propose a novel detection method that extends the input of YOLOv5s to a continuous sequence of images and inter-frame optical flow, emulating the visual mechanisms employed by humans. By incorporating the image sequence as input, our model can leverage both temporal and spatial information, extracting more features of small and weak targets through the integration of spatiotemporal data. This integration augments the accuracy and robustness of drone detection. Furthermore, the inclusion of optical flow enables the model to directly perceive the motion information of drone targets across consecutive frames, enhancing its ability to extract and utilize features from dynamic objects. Comparative experiments demonstrate that our proposed method of extended input significantly enhances the network's capability to detect small moving targets, showcasing competitive performance in terms of accuracy and speed. Specifically, our method achieves a final average precision of 86.87%, representing a noteworthy 11.49% improvement over the baseline, and the speed remains above 30 frames per second. Additionally, our approach is adaptable to other detection models with different backbones, providing valuable insights for domains such as Urban Air Mobility and autonomous driving.
Collapse
Affiliation(s)
| | | | - Haowen Han
- Research Center for Space Optical Engineering, Harbin Institute of Technology, Harbin 150001, China; (Y.S.); (X.Z.); (S.J.); (T.S.); (J.G.)
| | | | | | | | | |
Collapse
|
6
|
Digulescu A, Despina-Stoian C, Popescu F, Stanescu D, Nastasiu D, Sburlan D. UWB Sensing for UAV and Human Comparative Movement Characterization. SENSORS (BASEL, SWITZERLAND) 2023; 23:1956. [PMID: 36850555 PMCID: PMC9963829 DOI: 10.3390/s23041956] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/29/2022] [Revised: 01/21/2023] [Accepted: 02/07/2023] [Indexed: 06/18/2023]
Abstract
Nowadays, unmanned aerial vehicles/drones are involved in a continuously growing number of security incidents. Therefore, the research interest in drone versus human movement detection and characterization is justified by the fact that such devices represent a potential threat for indoor/office intrusion, while normally, a human presence is allowed after passing several security points. Our paper comparatively characterizes the movement of a drone and a human in an indoor environment. The movement map was obtained using advanced signal processing methods such as wavelet transform and the phase diagram concept, and applied to the signal acquired from UWB sensors.
Collapse
Affiliation(s)
- Angela Digulescu
- Department of Communications and Information Technology, “Ferdinand I” Military Technical Academy, 050141 Bucharest, Romania
| | - Cristina Despina-Stoian
- Department of Communications and Information Technology, “Ferdinand I” Military Technical Academy, 050141 Bucharest, Romania
| | - Florin Popescu
- Department of Communications and Information Technology, “Ferdinand I” Military Technical Academy, 050141 Bucharest, Romania
| | - Denis Stanescu
- Department of Communications and Information Technology, “Ferdinand I” Military Technical Academy, 050141 Bucharest, Romania
| | - Dragos Nastasiu
- Department of Communications and Information Technology, “Ferdinand I” Military Technical Academy, 050141 Bucharest, Romania
| | - Dragos Sburlan
- Faculty of Mathematics and Informatics, Ovidius University of Constanta, 900527 Constanta, Romania
| |
Collapse
|
7
|
Çetin E, Barrado C, Pastor E. Countering a Drone in a 3D Space: Analyzing Deep Reinforcement Learning Methods. SENSORS (BASEL, SWITZERLAND) 2022; 22:8863. [PMID: 36433460 PMCID: PMC9693844 DOI: 10.3390/s22228863] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Revised: 11/11/2022] [Accepted: 11/12/2022] [Indexed: 06/16/2023]
Abstract
Unmanned aerial vehicles (UAV), also known as drones have been used for a variety of reasons and the commercial drone market growth is expected to reach remarkable levels in the near future. However, some drone users can mistakenly or intentionally fly into flight paths at major airports, flying too close to commercial aircraft or invading people's privacy. In order to prevent these unwanted events, counter-drone technology is needed to eliminate threats from drones and hopefully they can be integrated into the skies safely. There are various counter-drone methods available in the industry. However, a counter-drone system supported by an artificial intelligence (AI) method can be an efficient way to fight against drones instead of human intervention. In this paper, a deep reinforcement learning (DRL) method has been proposed to counter a drone in a 3D space by using another drone. In a 2D space it is already shown that the deep reinforcement learning method is an effective way to counter a drone. However, countering a drone in a 3D space with another drone is a very challenging task considering the time required to train and avoid obstacles at the same time. A Deep Q-Network (DQN) algorithm with dueling network architecture and prioritized experience replay is presented to catch another drone in the environment provided by an Airsim simulator. The models have been trained and tested with different scenarios to analyze the learning progress of the drone. Experiences from previous training are also transferred before starting a new training by pre-processing the previous experiences and eliminating those considered as bad experiences. The results show that the best models are obtained with transfer learning and the drone learning progress has been increased dramatically. Additionally, an algorithm which combines imitation learning and reinforcement learning is implemented to catch the target drone. In this algorithm, called deep q-learning from demonstrations (DQfD), expert demonstrations data and self-generated data by the agent are sampled and the agent continues learning without overwriting the demonstration data. The main advantage of this algorithm is to accelerate the learning process even if there is a small amount of demonstration data.
Collapse
|
8
|
Di Vincenzo M, Palini F, De Marsico M, Borghi AM, Baldassarre G. A Natural Human-Drone Embodied Interface: Empirical Comparison With a Traditional Interface. Front Neurorobot 2022; 16:898859. [PMID: 36310633 PMCID: PMC9614065 DOI: 10.3389/fnbot.2022.898859] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Accepted: 05/23/2022] [Indexed: 11/16/2022] Open
Abstract
Despite the importance of usability in human-machine interaction (HMI), most commonly used devices are not usable by all potential users. In particular, users with low or null technological experience, or with special needs, require carefully designed systems and easy-to-use interfaces supporting recognition over recall. To this purpose, Natural User Interfaces (NUIs) represent an effective strategy as the user's learning is facilitated by features of the interface that mimic the human “natural” sensorimotor embodied interactions with the environment. This paper compares the usability of a new NUI (based on an eye-tracker and hand gesture recognition) with a traditional interface (keyboard) for the distal control of a simulated drone flying in a virtual environment. The whole interface relies on “dAIsy”, a new software allowing the flexible use of different input devices and the control of different robotic platforms. The 59 users involved in the study were required to complete two tasks with each interface, while their performance was recorded: (a) exploration: detecting trees embedded in an urban environment; (b) accuracy: guiding the drone as accurately and fast as possible along a predefined track. Then they were administered questionnaires regarding the user's background, the perceived embodiment of the device, and the perceived quality of the virtual experience while either using the NUI or the traditional interface. The results appear controversial and call for further investigation: (a) contrary to our hypothesis, the specific NUI used led to lower performance than the traditional interface; (b) however, the NUI was evaluated as more natural and embodied. The final part of the paper discusses the possible causes underlying these results that suggest possible future improvements of the NUI.
Collapse
Affiliation(s)
| | | | - Maria De Marsico
- Department of Computer Science, Sapienza University of Rome, Rome, Italy
| | - Anna M. Borghi
- Department of Dynamic and Clinical Psychology and Health Studies, Sapienza University of Rome, Rome, Italy
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy
| | - Gianluca Baldassarre
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy
- AI2Life Srl Innovative Startup, Spin-Off of ISTC-CNR, Rome, Italy
- *Correspondence: Gianluca Baldassarre
| |
Collapse
|
9
|
Wisniewski M, Rana ZA, Petrunin I. Drone Model Classification Using Convolutional Neural Network Trained on Synthetic Data. J Imaging 2022; 8:jimaging8080218. [PMID: 36005461 PMCID: PMC9410072 DOI: 10.3390/jimaging8080218] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Revised: 07/22/2022] [Accepted: 08/10/2022] [Indexed: 11/25/2022] Open
Abstract
We present a convolutional neural network (CNN) that identifies drone models in real-life videos. The neural network is trained on synthetic images and tested on a real-life dataset of drone videos. To create the training and validation datasets, we show a method of generating synthetic drone images. Domain randomization is used to vary the simulation parameters such as model textures, background images, and orientation. Three common drone models are classified: DJI Phantom, DJI Mavic, and DJI Inspire. To test the performance of the neural network model, Anti-UAV, a real-life dataset of flying drones is used. The proposed method reduces the time-cost associated with manually labelling drones, and we prove that it is transferable to real-life videos. The CNN achieves an overall accuracy of 92.4%, a precision of 88.8%, a recall of 88.6%, and an f1 score of 88.7% when tested on the real-life dataset.
Collapse
|
10
|
Cooperatively Routing a Truck and Multiple Drones for Target Surveillance. SENSORS 2022; 22:s22082909. [PMID: 35458894 PMCID: PMC9032715 DOI: 10.3390/s22082909] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/05/2022] [Revised: 04/01/2022] [Accepted: 04/02/2022] [Indexed: 01/27/2023]
Abstract
With the development of drone technology, drones have been deployed in civilian and military fields for target surveillance. As the endurance of drones is limited, large-scale target surveillance missions encounter some challenges. Based on this motivation, we proposed a new target surveillance mode via the cooperation of a truck and multiple drones, which enlarges the range of surveillance. This new mode aims to rationally plan the routes of trucks and drones and minimize the total cost. In this mode, the truck, which carries multiple drones, departs from its base, launches small drones along the way, surveils multiple targets, recycles all drones and returns to the base. When a drone is launched from the truck, it surveils multiple targets and flies back to the truck for recycling, and the energy consumption model of the drone is taken into account. To assist the new problem-solving, we developed a new heuristic method, namely, adaptive simulated annealing with large-scale neighborhoods, to optimize truck and drone routes, where a scoring strategy is designed to dynamically adjust the selection weight of destroy operators and repair operators. Additionally, extensive experiments are conducted on several synthetic cases and one real case. The experimental results show that the proposed algorithm can effectively solve the large-scale target surveillance problem. Furthermore, the proposed cooperation of truck and drone mode brings new ideas and solutions to targets surveillance problems.
Collapse
|