Passive Infrared Sensor-Based Occupancy Monitoring in Smart Buildings: A Review of Methodologies and Machine Learning Approaches

Buildings are rapidly becoming more digitized, largely due to developments in the internet of things (IoT). This provides both opportunities and challenges. One of the central challenges in the process of digitizing buildings is the ability to monitor these buildings' status effectively. This monitoring is essential for services that rely on information about the presence and activities of individuals within different areas of these buildings. Occupancy information (including people counting, occupancy detection, location tracking, and activity detection) plays a vital role in the management of smart buildings. In this article, we primarily focus on the use of passive infrared (PIR) sensors for gathering occupancy information. PIR sensors are among the most widely used sensors for this purpose due to their consideration of privacy concerns, cost-effectiveness, and low processing complexity compared to other sensors. Despite numerous literature reviews in the field of occupancy information, there is currently no literature review dedicated to occupancy information derived specifically from PIR sensors. Therefore, this review analyzes articles that specifically explore the application of PIR sensors for obtaining occupancy information. It provides a comprehensive literature review of PIR sensor technology from 2015 to 2023, focusing on applications in people counting, activity detection, and localization (tracking and location). It consolidates findings from articles that have explored and enhanced the capabilities of PIR sensors in these interconnected domains. This review thoroughly examines the application of various techniques, machine learning algorithms, and configurations for PIR sensors in indoor building environments, emphasizing not only the data processing aspects but also their advantages, limitations, and efficacy in producing accurate occupancy information. These developments are crucial for improving building management systems in terms of energy efficiency, security, and user comfort, among other operational aspects. The article seeks to offer a thorough analysis of the present state and potential future advancements of PIR sensor technology in efficiently monitoring and understanding occupancy information by classifying and analyzing improvements in these domains.

A Multitask Network for People Counting, Motion Recognition, and Localization Using Through-Wall Radar

Due to the outstanding penetrating detection performance of low-frequency electromagnetic waves, through-wall radar (TWR) has gained widespread applications in various fields, including public safety, counterterrorism operations, and disaster rescue. TWR is required to accomplish various tasks, such as people detection, people counting, and positioning in practical applications. However, most current research primarily focuses on one or two tasks. In this paper, we propose a multitask network that can simultaneously realize people counting, action recognition, and localization. We take the range-time-Doppler (RTD) spectra obtained from one-dimensional (1D) radar signals as datasets and convert the information related to the number, motion, and location of people into confidence matrices as labels. The convolutional layers and novel attention modules automatically extract deep features from the data and output the number, motion category, and localization results of people. We define the total loss function as the sum of individual task loss functions. Through the loss function, we transform the positioning problem into a multilabel classification problem, where a certain position in the distance confidence matrix represents a certain label. On the test set consisting of 10,032 samples from through-wall scenarios with a 24 cm thick brick wall, the accuracy of people counting can reach 96.94%, and the accuracy of motion recognition is 96.03%, with an average distance error of 0.12 m.

Deep Learning for Counting People from UWB Channel Impulse Response Signals

The use of higher frequency bands compared to other wireless communication protocols enhances the capability of accurately determining locations from ultra-wideband (UWB) signals. It can also be used to estimate the number of people in a room based on the waveform of the channel impulse response (CIR) from UWB transceivers. In this paper, we apply deep neural networks to UWB CIR signals for the purpose of estimating the number of people in a room. We especially focus on empirically investigating the various network architectures for classification from single UWB CIR data, as well as from various ensemble configurations. We present our processes for acquiring and preprocessing CIR data, our designs of the different network architectures and ensembles that were applied, and the comparative experimental evaluations. We demonstrate that deep neural networks can accurately classify the number of people within a Line of Sight (LoS), thereby achieving an 99% performance and efficiency with respect to both memory size and FLOPs (Floating Point Operations Per Second).

Convolutional Neural Networks and Heuristic Methods for Crowd Counting: A Systematic Review

The crowd counting task has become a pillar for crowd control as it provides information concerning the number of people in a scene. It is helpful in many scenarios such as video surveillance, public safety, and future event planning. To solve such tasks, researchers have proposed different solutions. In the beginning, researchers went with more traditional solutions, while recently the focus is on deep learning methods and, more specifically, on Convolutional Neural Networks (CNNs), because of their efficiency. This review explores these methods by focusing on their key differences, advantages, and disadvantages. We have systematically analyzed algorithms and works based on the different models suggested and the problems they are trying to solve. The main focus is on the shift made in the history of crowd counting methods, moving from the heuristic models to CNN models by identifying each category and discussing its different methods and architectures. After a deep study of the literature on crowd counting, the survey partitions current datasets into sparse and crowded ones. It discusses the reviewed methods by comparing their results on the different datasets. The findings suggest that the heuristic models could be even more effective than the CNN models in sparse scenarios.

CIR-Based Device-Free People Counting via UWB Signals

The outbreak of COVID-19 has resulted in many different policies being adopted across the world to reduce the spread of the virus. These policies include wearing surgical masks, hand hygiene practices, increased social distancing and full country-wide lockdown. Specifically, social distancing involves keeping a certain distance from others and avoiding gathering together in large groups. Automatic crowd density estimation is a technological solution that could help in guaranteeing social distancing by reducing the probability that two persons in a public area come in close proximity to each other while moving around. This paper proposes a novel low complexity RF sensing system for automatic people counting based on low cost UWB transceivers. The proposed system is based on an ordinary classifier that exploits features extracted from the channel impulse response of UWB communication signals. Specifically, features are extracted from the sorted list of singular values obtained from the singular value decomposition applied to the matrix of the channel impulse response vector differences. Experimental results achieved in two different environments show that the proposed system is a promising candidate for future automatic crowd density monitoring systems.

Trailgazers: A Scoping Study of Footfall Sensors to Aid Tourist Trail Management in Ireland and Other Atlantic Areas of Europe

This paper examines the current state of the art of commercially available outdoor footfall sensor technologies and defines individually tailored solutions for the walking trails involved in an ongoing research project. Effective implementation of footfall sensors can facilitate quantitative analysis of user patterns, inform maintenance schedules and assist in achieving management objectives, such as identifying future user trends like cyclo-tourism. This paper is informed by primary research conducted for the EU funded project TrailGazersBid (hereafter referred to as TrailGazers), led by Donegal County Council, and has Sligo County Council and Causeway Coast and Glens Council (NI) among the 10 project partners. The project involves three trails in Ireland and five other trails from Europe for comparison. It incorporates the footfall capture and management experiences of trail management within the EU Atlantic area and desk-based research on current footfall technologies and data capture strategies. We have examined 6 individual types of sensor and discuss the advantages and disadvantages of each. We provide key learnings and insights that can help to inform trail managers on sensor options, along with a decision-making tool based on the key factors of the power source and mounting method. The research findings can also be applied to other outdoor footfall monitoring scenarios.

Detecting, Tracking and Counting People Getting On/Off a Metropolitan Train Using a Standard Video Camera

The main source of delays in public transport systems (buses, trams, metros, railways) takes place in their stations. For example, a public transport vehicle can travel at 60 km per hour between stations, but its commercial speed (average en-route speed, including any intermediate delay) does not reach more than half of that value. Therefore, the problem that public transport operators must solve is how to reduce the delay in stations. From the perspective of transport engineering, there are several ways to approach this issue, from the design of infrastructure and vehicles to passenger traffic management. The tools normally available to traffic engineers are analytical models, microscopic traffic simulation, and, ultimately, real-scale laboratory experiments. In any case, the data that are required are number of passengers that get on and off from the vehicles, as well as the number of passengers waiting on platforms. Traditionally, such data has been collected manually by field counts or through videos that are then processed by hand. On the other hand, public transport networks, specially metropolitan railways, have an extensive monitoring infrastructure based on standard video cameras. Traditionally, these are observed manually or with very basic signal processing support, so there is significant scope for improving data capture and for automating the analysis of site usage, safety, and surveillance. This article shows a way of collecting and analyzing the data needed to feed both traffic models and analyze laboratory experimentation, exploiting recent intelligent sensing approaches. The paper presents a new public video dataset gathered using real-scale laboratory recordings. Part of this dataset has been annotated by hand, marking up head locations to provide a ground-truth on which to train and evaluate deep learning detection and tracking algorithms. Tracking outputs are then used to count people getting on and off, achieving a mean accuracy of 92% with less than 0.15% standard deviation on 322 mostly unseen dataset video sequences.

Development of a Sensor to Measure Physician Consultation Times

The duration of patient–physician contact is an important factor for the optimisation of treatment processes in healthcare systems. Available methods can be labour-intensive and the quality is, in many cases, poor. A part of this research project is to develop a sensor system, which allows the detection of people passing through a door, including the direction. For this purpose, two time of flight sensors are combined with a door sensor and a motion detection sensor (for redundancy) on one single side of the door frame. The period between two single measurements could be reduced to 50 ms, which allows the measurement of walking speed up to 2 ms−1. The accuracy of the time stamp for each event is less than one second and ensures a precise documentation of the consultation time. This paper presents the development of the sensor system, the miniaturisation of the installation and first measurement results, as well as the measurement’s concept of quality analysis, including multiple door applications. In future steps, the sensor system will be deployed at different medical practices to determine the exact duration of the patient–physician interaction over a longer time period.