Photogrammetric Co-Processing of Thermal Infrared Images and RGB Images

A Dataset of Visible Light and Thermal Infrared Images for Health Monitoring of Caged Laying Hens in Large-Scale Farming

Considering animal welfare, the free-range laying hen farming model is increasingly gaining attention. However, in some countries, large-scale farming still relies on the cage-rearing model, making the focus on the welfare of caged laying hens equally important. To evaluate the health status of caged laying hens, a dataset comprising visible light and thermal infrared images was established for analyses, including morphological, thermographic, comb, and behavioral assessments, enabling a comprehensive evaluation of the hens' health, behavior, and population counts. To address the issue of insufficient data samples in the health detection process for individual and group hens, a dataset named BClayinghens was constructed containing 61,133 images of visible light and thermal infrared images. The BClayinghens dataset was completed using three types of devices: smartphones, visible light cameras, and infrared thermal cameras. All thermal infrared images correspond to visible light images and have achieved positional alignment through coordinate correction. Additionally, the visible light images were annotated with chicken head labels, obtaining 63,693 chicken head labels, which can be directly used for training deep learning models for chicken head object detection and combined with corresponding thermal infrared data to analyze the temperature of the chicken heads. To enable the constructed deep-learning object detection and recognition models to adapt to different breeding environments, various data enhancement methods such as rotation, shearing, color enhancement, and noise addition were used for image processing. The BClayinghens dataset is important for applying visible light images and corresponding thermal infrared images in the health detection, behavioral analysis, and counting of caged laying hens under large-scale farming.

Fusion of Multimodal Imaging and 3D Digitization Using Photogrammetry

Multimodal sensors capture and integrate diverse characteristics of a scene to maximize information gain. In optics, this may involve capturing intensity in specific spectra or polarization states to determine factors such as material properties or an individual's health conditions. Combining multimodal camera data with shape data from 3D sensors is a challenging issue. Multimodal cameras, e.g., hyperspectral cameras, or cameras outside the visible light spectrum, e.g., thermal cameras, lack strongly in terms of resolution and image quality compared with state-of-the-art photo cameras. In this article, a new method is demonstrated to superimpose multimodal image data onto a 3D model created by multi-view photogrammetry. While a high-resolution photo camera captures a set of images from varying view angles to reconstruct a detailed 3D model of the scene, low-resolution multimodal camera(s) simultaneously record the scene. All cameras are pre-calibrated and rigidly mounted on a rig, i.e., their imaging properties and relative positions are known. The method was realized in a laboratory setup consisting of a professional photo camera, a thermal camera, and a 12-channel multispectral camera. In our experiments, an accuracy better than one pixel was achieved for the data fusion using multimodal superimposition. Finally, application examples of multimodal 3D digitization are demonstrated, and further steps to system realization are discussed.

Analysis of urban streets and surface thermal characteristics using thermal imaging camera in residential streets of Gurugram City, India

The thermal properties of the urban landscape are significantly affected by various human activities such as changing land use patterns, the construction of buildings and other impervious surfaces, and the development of transport systems. Urbanization often leads to the replacement of natural landscapes with impervious surfaces such as concrete and asphalt, which have a higher heat absorption capacity and lower emissivity. The continuous displacement of urban landscapes by impermeable surfaces therefore leads to an increase in urban temperatures, ultimately causing the development of the urban heat island (UHI) phenomenon. The study aims to analyze the thermal properties of physical elements in residential streets of Gurugram City using a thermal imaging camera to investigate the relationship between ambient air temperature and thermal behavior of surface materials. The study shows that the compact streets are 2-4 °C cooler than the open streets due to mutual shading of the buildings. Similarly, the temperature in the light-colored buildings is 1.5-4 °C lower than the dark buildings in the streets. In addition, a simple coat of paint over a plastered wall is much cooler than granite stone wall cladding. The study also showed how shading, whether by mutual shading or vegetative shading, can lower the surface temperature of urban materials. Building codes and design guidelines can therefore use such studies to make urban exteriors more pleasant by recommending lighter colors, plants, and local materials.

The Conception of Test Fields for Fast Geometric Calibration of the FLIR VUE PRO Thermal Camera for Low-Cost UAV Applications

The dynamic evolution of photogrammetry led to the development of numerous methods of geometric calibration of cameras, which are mostly based on building flat targets (fields) with features that can be distinguished in the images. Geometric calibration of thermal cameras for UAVs is an active research field that attracts numerous researchers. As a result of their low price and general availability, non-metric cameras are being increasingly used for measurement purposes. Apart from resolution, non-metric sensors do not have any other known parameters. The commonly applied process is self-calibration, which enables the determining of the approximate elements of the camera’s interior orientation. The purpose of this work was to analyze the possibilities of geometric calibration of thermal UAV cameras using proposed test field patterns and materials. The experiment was conducted on a FLIR VUE PRO thermal camera dedicated to UAV platforms. The authors propose the selection of various image processing methods (histogram equalization, thresholding, brightness correction) in order to improve the quality of the thermograms. The consecutive processing methods resulted in over 80% effectiveness on average by 94%, 81%, and 80 %, respectively. This effectiveness, for no processing and processing with the use of the filtering method, was: 42% and 38%, respectively. Only high-pass filtering did not improve the obtained results. The final results of the proposed method and structure of test fields were verified on chosen geometric calibration algorithms. The results of fast and low-cost calibration are satisfactory, especially in terms of the automation of this process. For geometric correction, the standard deviations for the results of specific methods of thermogram sharpness enhancement are two to three times better than results without any correction.