1
|
Ruiz-Santaquiteria J, Muñoz JD, Maigler FJ, Deniz O, Bueno G. Firearm-related action recognition and object detection dataset for video surveillance systems. Data Brief 2024; 52:110030. [PMID: 38299104 PMCID: PMC10827673 DOI: 10.1016/j.dib.2024.110030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2023] [Revised: 12/22/2023] [Accepted: 01/02/2024] [Indexed: 02/02/2024] Open
Abstract
The proposed dataset is comprised of 398 videos, each featuring an individual engaged in specific video surveillance actions. The ground truth for this dataset was expertly curated and is presented in JSON format (standard COCO), offering vital information about the dataset, video frames, and annotations, including precise bounding boxes outlining detected objects. The dataset encompasses three distinct categories for object detection: "Handgun", "Machine_Gun", and "No_Gun", dependent on the video's content. This dataset serves as a resource for research in firearm-related action recognition, firearm detection, security, and surveillance applications, enabling researchers and practitioners to develop and evaluate machine learning models for the detection of handguns and rifles across various scenarios. The meticulous ground truth annotations facilitate precise model evaluation and performance analysis, making this dataset an asset in the field of computer vision and public safety.
Collapse
Affiliation(s)
- Jesus Ruiz-Santaquiteria
- VISILAB, E.T.S. Ingeniería Industrial, University of Castilla-La Mancha, Avda. Camilo José Cela, Ciudad Real, Spain
| | - Juan D. Muñoz
- VISILAB, E.T.S. Ingeniería Industrial, University of Castilla-La Mancha, Avda. Camilo José Cela, Ciudad Real, Spain
| | - Francisco J. Maigler
- VISILAB, E.T.S. Ingeniería Industrial, University of Castilla-La Mancha, Avda. Camilo José Cela, Ciudad Real, Spain
| | - Oscar Deniz
- VISILAB, E.T.S. Ingeniería Industrial, University of Castilla-La Mancha, Avda. Camilo José Cela, Ciudad Real, Spain
| | - Gloria Bueno
- VISILAB, E.T.S. Ingeniería Industrial, University of Castilla-La Mancha, Avda. Camilo José Cela, Ciudad Real, Spain
| |
Collapse
|
2
|
Abstract
AbstractFast automatic handgun detection can be very useful to avoid or mitigate risks in public spaces. Detectors based on deep learning methods have been proposed in the literature to trigger an alarm if a handgun is detected in the image. However, those detectors are solely based on the weapon appearance on the image. In this work, we propose to combine the detector with the individual’s pose information in order to improve overall performance. To this end, a model that integrates grayscale images from the output of the handgun detector and heatmap-like images that represent pose is proposed. The results show an improvement over the original handgun detector. The proposed network provides a maximum improvement of a 17.5% in AP of the proposed combinational model over the baseline handgun detector.
Collapse
|
3
|
Salido J, Toledano PT, Vallez N, Deniz O, Ruiz-Santaquiteria J, Cristobal G, Bueno G. MicroHikari3D: an automated DIY digital microscopy platform with deep learning capabilities. Biomed Opt Express 2021; 12:7223-7243. [PMID: 34858711 PMCID: PMC8606155 DOI: 10.1364/boe.439014] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/27/2021] [Revised: 10/01/2021] [Accepted: 10/07/2021] [Indexed: 06/13/2023]
Abstract
A microscope is an essential tool in biosciences and production quality laboratories for unveiling the secrets of microworlds. This paper describes the development of MicroHikari3D, an affordable DIY optical microscopy platform with automated sample positioning, autofocus and several illumination modalities to provide a high-quality flexible microscopy tool for labs with a short budget. This proposed optical microscope design aims to achieve high customization capabilities to allow whole 2D slide imaging and observation of 3D live specimens. The MicroHikari3D motion control system is based on the entry level 3D printer kit Tronxy X1 controlled from a server running in a Raspberry Pi 4. The server provides services to a client mobile app for video/image acquisition, processing, and a high level classification task by applying deep learning models.
Collapse
Affiliation(s)
- J. Salido
- VISILAB Group, Universidad de Castilla-La Mancha, 13005 Ciudad Real, Spain
| | - P. T. Toledano
- VISILAB Group, Universidad de Castilla-La Mancha, 13005 Ciudad Real, Spain
| | - N. Vallez
- VISILAB Group, Universidad de Castilla-La Mancha, 13005 Ciudad Real, Spain
| | - O. Deniz
- VISILAB Group, Universidad de Castilla-La Mancha, 13005 Ciudad Real, Spain
| | | | - G. Cristobal
- Instituto de Optica (CSIC), Serrano 121, Madrid, Spain
| | - G. Bueno
- VISILAB Group, Universidad de Castilla-La Mancha, 13005 Ciudad Real, Spain
| |
Collapse
|
4
|
Ruiz-Santaquiteria J, Espinosa-Aranda JL, Deniz O, Sanchez C, Borrego-Ramos M, Blanco S, Cristobal G, Bueno G. Low-cost oblique illumination: an image quality assessment. J Biomed Opt 2018; 23:1-14. [PMID: 29297212 DOI: 10.1117/1.jbo.23.1.016001] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/22/2017] [Accepted: 12/04/2017] [Indexed: 06/07/2023]
Abstract
We study the effectiveness of several low-cost oblique illumination filters to improve overall image quality, in comparison with standard bright field imaging. For this purpose, a dataset composed of 3360 diatom images belonging to 21 taxa was acquired. Subjective and objective image quality assessments were done. The subjective evaluation was performed by a group of diatom experts by psychophysical test where resolution, focus, and contrast were assessed. Moreover, some objective nonreference image quality metrics were applied to the same image dataset to complete the study, together with the calculation of several texture features to analyze the effect of these filters in terms of textural properties. Both image quality evaluation methods, subjective and objective, showed better results for images acquired using these illumination filters in comparison with the no filtered image. These promising results confirm that this kind of illumination filters can be a practical way to improve the image quality, thanks to the simple and low cost of the design and manufacturing process.
Collapse
Affiliation(s)
| | | | - Oscar Deniz
- University of Castilla-La Mancha, ETSI Industriales, Visilab, Ciudad Real, Spain
| | - Carlos Sanchez
- Institute of Optics "Daza de Valdés", Spanish National Research Council (CSIC), Madrid, Spain
| | | | - Saul Blanco
- University of León, Institute of Environment, León, Spain
| | - Gabriel Cristobal
- Institute of Optics "Daza de Valdés", Spanish National Research Council (CSIC), Madrid, Spain
| | - Gloria Bueno
- University of Castilla-La Mancha, ETSI Industriales, Visilab, Ciudad Real, Spain
| |
Collapse
|
5
|
Sanchez C, Cristóbal G, Bueno G, Blanco S, Borrego-Ramos M, Olenici A, Pedraza A, Ruiz-Santaquiteria J. Oblique illumination in microscopy: A quantitative evaluation. Micron 2017; 105:47-54. [PMID: 29179008 DOI: 10.1016/j.micron.2017.11.006] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2017] [Revised: 11/14/2017] [Accepted: 11/14/2017] [Indexed: 10/18/2022]
Abstract
Many biological objects are barely distinguished with the brightfield microscope because they appear transparent, translucent and colourless. One simple way to make such specimens visible without compromising contrast and resolution is by controlling the amount and the directionality of the illumination light. Oblique illumination is an old technique described by many scientists and microscopists that however has been largely neglected in favour of other alternative methods. Oblique lighting (OL) is created by illuminating the sample by only a portion of the light coming from the condenser. If properly used it can improve the resolution and contrast of transparent specimens such as diatoms. In this paper a quantitative evaluation of OL in brigthfield microscopy is presented. Several feature descriptors were selected for characterising contrast and sharpness showing that in general OL provides better performance for distinguishing minute details compared to other lighting modalities. Oblique lighting is capable to produce directionally shadowed differential contrast images allowing to observe phase details in a similar way to differential contrast images (DIC) but at lower cost. The main advantage of OL is that the resolution of the light microscope can be increased by effectively doubling the angular aperture. OL appears as a cost-effective technique both for the amateur and professional scientist that can be used as a replacement of DIC or phase contrast when resources are scarce.
Collapse
Affiliation(s)
- Carlos Sanchez
- Instituto de Óptica (CSIC), Serrano 121, 28006 Madrid, Spain
| | | | - Gloria Bueno
- Univ. Castilla La Mancha, Av. Camilo Jose Cela s/n, 13071 Ciudad Real, Spain
| | - Saul Blanco
- Institute of the Environment, Univ. of Leon, La Serna 58, 24007 Leon, Spain
| | | | - Adriana Olenici
- Institute of the Environment, Univ. of Leon, La Serna 58, 24007 Leon, Spain; Fac. of Environmental Sci. and Eng., Babes-Bolyai University, Cluj-Napoca, Romania
| | - Anibal Pedraza
- Univ. Castilla La Mancha, Av. Camilo Jose Cela s/n, 13071 Ciudad Real, Spain
| | | |
Collapse
|