1
|
Abba S, Bizi AM, Lee JA, Bakouri S, Crespo ML. Real-time object detection, tracking, and monitoring framework for security surveillance systems. Heliyon 2024; 10:e34922. [PMID: 39145028 PMCID: PMC11320323 DOI: 10.1016/j.heliyon.2024.e34922] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2024] [Revised: 07/18/2024] [Accepted: 07/18/2024] [Indexed: 08/16/2024] Open
Abstract
The concept of security is becoming a global challenge, and governments, stakeholders, corporate societies, and individuals must urgently create a reasonable protection mechanism for good. Therefore, a real-time surveillance system is essential for detection, tracking, and monitoring. Many studies have attempted to provide better solutions but more research and better approaches are essential. This study presents a real-time framework for object detection and tracking for security surveillance systems. The system has been designed based on approximate median filtering, component labeling, background subtraction, and deep learning approaches. The new algorithms for object detection, tracking, and recognition have been implemented using Python and integrated with C# programming languages for ease of use. A software application framework is designed, implemented, and evaluated. The experimental results based on MOT-Challenge performance metrics show that the proposed algorithms have much better performance in terms of accuracy and precision on the MOT15, MOT16, and MOT17 datasets compared to state-of-the-art approaches. This framework also provides an accurate and effective means of monitoring and recognizing moving objects. The software development, including the design of the framework user interfaces, is coded in the C# programming language and integrated with Python using Microsoft Visual Studio (2019 edition). The integration is performed to provide a convenient user interface and to enable the execution of the framework as a standard and standalone software application. Future studies will consider the dynamic scalability of the framework to accommodate different surveillance application areas in overcrowded scenarios. Multiple data sources are integrated to enhance the performance for different scene times, locations, and weather conditions. Furthermore, other object-detection techniques such as You Only Look Once (YOLO) and its variants shall be considered in future studies. These techniques allow the framework to adapt to complex situations in which security surveillance is challenging.
Collapse
Affiliation(s)
- Sani Abba
- Department of Computer Science, Faculty of Science, Gubi Campus, Abubakar Tafawa Balewa University, Along Ningi/Kano Road, P.M.B. 0248, Bauchi, Nigeria
| | - Ali Mohammed Bizi
- Department of Computer Science, Faculty of Science, Gubi Campus, Abubakar Tafawa Balewa University, Along Ningi/Kano Road, P.M.B. 0248, Bauchi, Nigeria
| | - Jeong-A Lee
- Computer Systems Laboratory, Department of Computer Engineering, Chosun University, Dongku SeoSukDong 375, Gwangju, 501-759, South Korea
| | - Souley Bakouri
- Department of Computer Science, Faculty of Science, Gubi Campus, Abubakar Tafawa Balewa University, Along Ningi/Kano Road, P.M.B. 0248, Bauchi, Nigeria
| | - Maria Liz Crespo
- Multi-disciplinary Laboratory (MLab), Abdussalam International Centre for Theoretical Physics (ICTP), Via Beirut 31, 34014, Trieste, Italy
| |
Collapse
|
2
|
Wang J. Application research of image classification algorithm based on deep learning in household garbage sorting. Heliyon 2024; 10:e29966. [PMID: 38694073 PMCID: PMC11058889 DOI: 10.1016/j.heliyon.2024.e29966] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2023] [Revised: 04/17/2024] [Accepted: 04/18/2024] [Indexed: 05/03/2024] Open
Abstract
The classification of garbage types is an important issue in today's world, and its proper implementation can contribute to environmental conservation and improved efficiency of recycling processes. Unfortunately, the classification of garbage types is currently predominantly performed through human supervision, which leads to high errors and environmental risks. It is crucial to automate this procedure utilizing machine vision methods as a result. This research proposes a revolutionary deep learning-based strategy for classifying domestic waste. The suggested method uses deep learning methods to extract information from images. The Capuchin Search Algorithm (CapSA) is used to improve the hyperparameters of the convolutional neural network (CNN) used as the feature extraction model. Furthermore, for categorizing the retrieved features from the CNN model, a hybrid learning model based on Error-Correcting Output Codes (ECOC) and Artificial Neural Networks (ANN) is used. The classification accuracy may be successfully increased by using this hybrid model, and the benefit becomes more pronounced as the number of target categories rises. The TrashNet and HGCD databases were used to assess the suggested method's effectiveness, and its results in waste type detection were contrasted with those of earlier techniques. Based on the study findings, the suggested approach can identify trash types with an accuracy of 98.81 % and 99.01 % on the TrashNet and HGCD databases, respectively. This is at least a 1.46 % improvement over earlier approaches. The study's conclusions validate that the suggested strategy may be used in real-world scenarios and show how successful the approaches used in it are.
Collapse
Affiliation(s)
- Jianfei Wang
- Suzhou Chien-Shiung Institute of Technology, Taicang, 215411, China
| |
Collapse
|
3
|
Mishra S, Yaduvanshi R, Rajpoot P, Verma S, Pandey AK, Pandey D. An integrated deep-learning model for smart waste classification. ENVIRONMENTAL MONITORING AND ASSESSMENT 2024; 196:279. [PMID: 38367185 DOI: 10.1007/s10661-024-12410-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Accepted: 01/29/2024] [Indexed: 02/19/2024]
Abstract
Efficient waste management is essential for human well-being and environmental health, as neglecting proper disposal practices can lead to financial losses and the depletion of natural resources. Given the rapid urbanization and population growth, developing an automated, innovative waste classification model becomes imperative. To address this need, our paper introduces a novel and robust solution - a smart waste classification model that leverages a hybrid deep learning model (Optimized DenseNet-121 + SVM) to categorize waste items using the TrashNet datasets. Our proposed approach uses the advanced deep learning model DenseNet-121, optimized for superior performance, to extract meaningful features from an expanded TrashNet dataset. These features are subsequently fed into a support vector machine (SVM) for precise classification. Employing data augmentation techniques further enhances classification accuracy while mitigating the risk of overfitting, especially when working with limited TrashNet data. The results of our experimental evaluation of this hybrid deep learning model are highly promising, with an impressive accuracy rate of 99.84%. This accuracy surpasses similar existing models, affirming the efficacy and potential of our approach to revolutionizing waste classification for a sustainable and cleaner future.
Collapse
Affiliation(s)
- Shivendu Mishra
- Department of Information Technology, Rajkiya Engineering College, Ambedkar Nagar, 224122, Uttar pradesh, India
| | - Ritika Yaduvanshi
- Department of of Computer Science and Engineering, Mahamaya Colege of Agriculture Engineering and Technology, Ambedkar Nagar, 224122, Uttar pradesh, India
| | - Prince Rajpoot
- Department of Information Technology, Rajkiya Engineering College, Ambedkar Nagar, 224122, Uttar pradesh, India
| | - Sharad Verma
- Department of Information Technology, Rajkiya Engineering College, Ambedkar Nagar, 224122, Uttar pradesh, India
| | - Amit Kumar Pandey
- Department of Applied Science and Humanities, Rajkiya Engineering College, Ambedkar Nagar, 224122, Uttar pradesh, India.
| | - Digvijay Pandey
- Department of Technical Education, IET, Dr. A. P. J. Abdul Kalam Technical University, Lucknow, 226021, Uttar pradesh, India
| |
Collapse
|
4
|
Naf’an E, Sulaiman R, Ali NM. Optimization of Trash Identification on the House Compound Using a Convolutional Neural Network (CNN) and Sensor System. SENSORS (BASEL, SWITZERLAND) 2023; 23:1499. [PMID: 36772539 PMCID: PMC9920525 DOI: 10.3390/s23031499] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/10/2022] [Revised: 12/17/2022] [Accepted: 12/22/2022] [Indexed: 06/18/2023]
Abstract
This study aims to optimize the object identification process, especially identifying trash in the house compound. Most object identification methods cannot distinguish whether the object is a real image (3D) or a photographic image on paper (2D). This is a problem if the detected object is moved from one place to another. If the object is 2D, the robot gripper only clamps empty objects. In this study, the Sequential_Camera_LiDAR (SCL) method is proposed. This method combines a Convolutional Neural Network (CNN) with LiDAR (Light Detection and Ranging), with an accuracy of ±2 mm. After testing 11 types of trash on four CNN architectures (AlexNet, VGG16, GoogleNet, and ResNet18), the accuracy results are 80.5%, 95.6%, 98.3%, and 97.5%. This result is perfect for object identification. However, it needs to be optimized using a LiDAR sensor to determine the object in 3D or 2D. Trash will be ignored if the fast scanning process with the LiDAR sensor detects non-real (2D) trash. If Real (3D), the trash object will be scanned in detail to determine the robot gripper position in lifting the trash object. The time efficiency generated by fast scanning is between 13.33% to 59.26% depending on the object's size. The larger the object, the greater the time efficiency. In conclusion, optimization using the combination of a CNN and a LiDAR sensor can identify trash objects correctly and determine whether the object is real (3D) or not (2D), so a decision may be made to move the trash object from the detection location.
Collapse
Affiliation(s)
- Emil Naf’an
- Institute of IR4.0, Universiti Kebangsaan Malaysia, Bangi 43600, Malaysia
- Faculty of Computer Science, Universitas Putra Indonesia YPTK Padang, Padang 25221, Indonesia
| | - Riza Sulaiman
- Institute of IR4.0, Universiti Kebangsaan Malaysia, Bangi 43600, Malaysia
| | | |
Collapse
|
5
|
Neelakandan S, Prakash M, Geetha BT, Nanda AK, Metwally AM, Santhamoorthy M, Gupta MS. Metaheuristics with Deep Transfer Learning Enabled Detection and classification model for industrial waste management. CHEMOSPHERE 2022; 308:136046. [PMID: 36007730 DOI: 10.1016/j.chemosphere.2022.136046] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/11/2022] [Revised: 08/04/2022] [Accepted: 08/08/2022] [Indexed: 06/15/2023]
Abstract
Rapid industrialization has led to the generation of a considerable amount of waste, both solid and liquid, in industrial fields like food processing, sugar, pulp, sago or starch, dairies, paper, fruit processing, poultry, distilleries, slaughterhouses, tanneries, and so forth. Despite the requirement for pollution control measures, the waste is discharged into water bodies or generally dumped on land without appropriate management, and thus becomes a significant source of environmental pollution and health hazards. The most essential step of waste management is the segregation of waste into the various elements, and normally this process is done automatically by hand-picking. A smart waste material classification technique is required to simplify the procedures. Therefore, the study presents a new Metaheuristics with Deep Transfer Learning Enabled Detection and Classification Methods for Industrial Waste Management (MDTLDC-IWM) method. The presented MDTLDC-IWM model facilitates the use of DL models for the identification and classification of waste materials in the IWM system. To accomplish this, the presented MDTLDC-IWM model follows two key phases, namely waste object recognition and waste object classification. At the initial stage, the YOLO-v5 object detector with the Harris Hawks Optimization (HHO) algorithm is used. Next, in the second stage, the stacked sparse auto encoder (SSAE) model is applied for the waste object classification method. The SSAE model is effectively optimized using the Aquila Optimization Algorithm (AOA), which helps to accomplish maximum classification of waste objects. The MDTLDC-IWM model has achieved a precision of 96.84 percent and an F score of 96.71 percent. A benchmark dataset is used to test the experimental validity of the presented MDTLDC-IWM model. Extensive comparative analysis reported the enhanced performance of the MDTLDC-IWM model over recent state-of-the-art approaches.
Collapse
Affiliation(s)
- S Neelakandan
- Department of Computer Science and Engineering, R.M.K Engineering College, Chennai, India.
| | - M Prakash
- School of Computer Science and Engineering, Vellore Institute of Technology, Vellore, India
| | - B T Geetha
- Department of ECE, Saveetha School of Engineering, SIMATS, Saveetha University, Chennai, India
| | - Ashok Kumar Nanda
- Department of CSE, B V Raju Institute of Technology, Narsapur, Medak, Telangana, India
| | - Ahmed Mohammed Metwally
- Department of Mathematics, College of Science, King Saud University, Riyadh, 11451, Saudi Arabia
| | | | - M Satyanarayana Gupta
- Department of Aeronautical Engineering, MLR Institute of Technology, Hyderabad, Telangana, India.
| |
Collapse
|
6
|
Artificial Jellyfish Optimization with Deep-Learning-Driven Decision Support System for Energy Management in Smart Cities. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12157457] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
A smart city is a sustainable and effectual urban center which offers a maximal quality of life to its inhabitants with the optimal management of their resources. Energy management is the most difficult problem in such urban centers because of the difficulty of energy models and their important role. The recent developments of machine learning (ML) and deep learning (DL) models pave the way to design effective energy management schemes. In this respect, this study introduces an artificial jellyfish optimization with deep learning-driven decision support system (AJODL-DSSEM) model for energy management in smart cities. The proposed AJODL-DSSEM model predicts the energy in the smart city environment. To do so, the proposed AJODL-DSSEM model primarily performs data preprocessing at the initial stage to normalize the data. Besides, the AJODL-DSSEM model involves the attention-based convolutional neural network-bidirectional long short-term memory (CNN-ABLSTM) model for the prediction of energy. For the hyperparameter tuning of the CNN-ABLSTM model, the AJO algorithm was applied. The experimental validation of the proposed AJODL-DSSEM model was tested using two open-access datasets, namely the IHEPC and ISO-NE datasets. The comparative study reported the improved outcomes of the AJODL-DSSEM model over recent approaches.
Collapse
|
7
|
Classification of Trash and Valuables with Machine Vision in Shared Cars. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12115695] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
This study focused on the possibility of implementing a vision-based architecture to monitor and detect the presence of trash or valuables in shared cars. The system was introduced to take pictures of the rear seating area of a four-door passenger car. Image capture was performed with a stationary wide-angled camera unit, and image classification was conducted with a prediction model in a remote server. For classification, a convolutional neural network (CNN) in the form of a fine-tuned VGG16 model was developed. The CNN yielded an accuracy of 91.43% on a batch of 140 test images. To determine the correlation among the predictions, a confusion matrix was used, and in addition, for each predicted image, the certainty of the distinct output classes was examined. The execution time of the system, from capturing an image to displaying the results, ranged from 5.7 to 17.2 s. Misclassifications from the prediction model were observed in the results primarily due to the variation in ambient light levels and shadows within the images, which resulted in the target items lacking contrast with their neighbouring background. Developments pertaining to the modularity of the camera unit and expanding the dataset of training images are suggested for potential future research.
Collapse
|