1
|
Kumar A, Yadav DP, Kumar D, Pant M, Pant G. Multi-scale feature fusion-based lightweight dual stream transformer for detection of paddy leaf disease. ENVIRONMENTAL MONITORING AND ASSESSMENT 2023; 195:1020. [PMID: 37548778 DOI: 10.1007/s10661-023-11628-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/24/2022] [Accepted: 07/22/2023] [Indexed: 08/08/2023]
Abstract
Traditionally, rice leaf disease identification relies on a visual examination of abnormalities or an analytical result obtained by growing bacteria in the research lab. This method of visual evaluation is qualitative and error-prone. On the other hand, an artificial neural network system is fast and more accurate. Several pieces of research using traditional machine learning and deep convolution neural networks (CNN) have been utilized to overcome the issues. Still, these methods need more semantic contextual global and local feature extraction. Due to this, efficiency is less. Hence, in the present study, a multi-scale feature fusion-based RDTNet has been designed. The RDTNet contains two modules, and the first module extracts feature via three scales from the local binary pattern (LBP), gray, and a histogram of orient gradient (HOG) image. The second module extracts semantic global and local features through the transformer and convolution block. Furthermore, the computing cost is reduced by dividing the query into two parts and feeding them to convolution and the transformer block. The results indicate that the proposed method has a very high average precision, f1-score, and accuracy of 99.55%, 99.54%, and 99.53%, respectively. It is suggestive of improved classification accuracy using multi-scale features and the transformer. The model has also been validated on other datasets confirming that the present model can be used for real-time rice disease diagnosis. In the future, such models can be used for monitoring other crops, including wheat, tomato, and potato.
Collapse
Affiliation(s)
- Ajitesh Kumar
- Department of Computer Engineering & Applications, G.L.A. University, Mathura (U.P.), India.
| | - Dhirendra Prasad Yadav
- Department of Computer Engineering & Applications, G.L.A. University, Mathura (U.P.), India
| | - Deepak Kumar
- Department of Computer Science, NIT Meghalaya, Shillong, India
| | - Manu Pant
- Department of Biotechnology, Graphic Era (Deemed to Be University), Dehradun, India
| | - Gaurav Pant
- Department of Microbiology, Graphic Era (Deemed to be University), Dehradun, India
| |
Collapse
|
2
|
Chong JWR, Khoo KS, Chew KW, Ting HY, Show PL. Trends in digital image processing of isolated microalgae by incorporating classification algorithm. Biotechnol Adv 2023; 63:108095. [PMID: 36608745 DOI: 10.1016/j.biotechadv.2023.108095] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2022] [Revised: 12/17/2022] [Accepted: 01/01/2023] [Indexed: 01/05/2023]
Abstract
Identification of microalgae species is of importance due to the uprising of harmful algae blooms affecting both the aquatic habitat and human health. Despite this occurence, microalgae have been identified as a green biomass and alternative source due to its promising bioactive compounds accumulation that play a significant role in many industrial applications. Recently, microalgae species identification has been conducted through DNA analysis and various microscopy techniques such as light, scanning electron, transmission electron, and atomic force -microscopy. The aforementioned procedures have encouraged researchers to consider alternate ways due to limitations such as costly validation, requiring skilled taxonomists, prolonged analysis, and low accuracy. This review highlights the potential innovations in digital microscopy with the incorporation of both hardware and software that can produce a reliable recognition, detection, enumeration, and real-time acquisition of microalgae species. Several steps such as image acquisition, processing, feature extraction, and selection are discussed, for the purpose of generating high image quality by removing unwanted artifacts and noise from the background. These steps of identification of microalgae species is performed by reliable image classification through machine learning as well as deep learning algorithms such as artificial neural networks, support vector machines, and convolutional neural networks. Overall, this review provides comprehensive insights into numerous possibilities of microalgae image identification, image pre-processing, and machine learning techniques to address the challenges in developing a robust digital classification tool for the future.
Collapse
Affiliation(s)
- Jun Wei Roy Chong
- Zhejiang Provincial Key Laboratory for Subtropical Water Environment and Marine Biological Resources Protection, Wenzhou University, Wenzhou 325035, China; Department of Chemical and Environmental Engineering, Faculty of Science and Engineering, University of Nottingham Malaysia, Jalan Broga, Semenyih 43500, Selangor Darul Ehsan, Malaysia
| | - Kuan Shiong Khoo
- Department of Chemical Engineering and Materials Science, Yuan Ze University, Taoyuan, Taiwan.
| | - Kit Wayne Chew
- School of Chemistry, Chemical Engineering and Biotechnology, Nanyang Technological University, 62 Nanyang Drive, Singapore, 637459 Singapore
| | - Huong-Yong Ting
- Drone Research and Application Centre, University of Technology Sarawak, No.1, Jalan Universiti, 96000 Sibu, Sarawak, Malaysia
| | - Pau Loke Show
- Zhejiang Provincial Key Laboratory for Subtropical Water Environment and Marine Biological Resources Protection, Wenzhou University, Wenzhou 325035, China; Department of Chemical and Environmental Engineering, Faculty of Science and Engineering, University of Nottingham Malaysia, Jalan Broga, Semenyih 43500, Selangor Darul Ehsan, Malaysia; Department of Sustainable Engineering, Saveetha School of Engineering, SIMATS, Chennai 602105, India.
| |
Collapse
|
3
|
Chong JWR, Khoo KS, Chew KW, Vo DVN, Balakrishnan D, Banat F, Munawaroh HSH, Iwamoto K, Show PL. Microalgae identification: Future of image processing and digital algorithm. BIORESOURCE TECHNOLOGY 2023; 369:128418. [PMID: 36470491 DOI: 10.1016/j.biortech.2022.128418] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/02/2022] [Revised: 11/08/2022] [Accepted: 11/11/2022] [Indexed: 06/17/2023]
Abstract
The identification of microalgae species is an important tool in scientific research and commercial application to prevent harmful algae blooms (HABs) and recognizing potential microalgae strains for the bioaccumulation of valuable bioactive ingredients. The aim of this study is to incorporate rapid, high-accuracy, reliable, low-cost, simple, and state-of-the-art identification methods. Thus, increasing the possibility for the development of potential recognition applications, that could identify toxic-producing and valuable microalgae strains. Recently, deep learning (DL) has brought the study of microalgae species identification to a much higher depth of efficiency and accuracy. In doing so, this review paper emphasizes the significance of microalgae identification, and various forms of machine learning algorithms for image classification, followed by image pre-processing techniques, feature extraction, and selection for further classification accuracy. Future prospects over the challenges and improvements of potential DL classification model development, application in microalgae recognition, and image capturing technologies are discussed accordingly.
Collapse
Affiliation(s)
- Jun Wei Roy Chong
- Department of Chemical and Environmental Engineering, Faculty of Science and Engineering, University of Nottingham Malaysia Campus, Jalan Broga, Semenyih 43500, Selangor Darul Ehsan, Malaysia
| | - Kuan Shiong Khoo
- Department of Chemical Engineering and Materials Science, Yuan Ze University, Taoyuan, Taiwan; Centre for Research and Graduate Studies, University of Cyberjaya, Persiaran Bestari, 63000 Cyberjaya, Selangor, Malaysia
| | - Kit Wayne Chew
- School of Chemistry, Chemical Engineering and Biotechnology, Nanyang Technological University, 62 Nanyang Drive, Singapore, 637459, Singapore
| | - Dai-Viet N Vo
- Institute of Applied Technology and Sustainable Development, Nguyen Tat Thanh University, Ho Chi Minh City 755414, Vietnam
| | - Deepanraj Balakrishnan
- Department of Mechanical Engineering, College of Engineering, Prince Mohammad Bin Fahd University, Al Khobar, 31952, Saudi Arabia
| | - Fawzi Banat
- Department of Chemical Engineering, Khalifa University, P.O Box 127788, Abu Dhabi, United Arab Emirates
| | - Heli Siti Halimatul Munawaroh
- Study Program of Chemistry, Department of Chemistry Education, Universitas Pendidikan Indonesia, Bandung 40154, West Java, Indonesia
| | - Koji Iwamoto
- Malaysia-Japan International Institute of Technology, Universiti Teknologi Malaysia, Jalan Sultan Yahya Petra, 54100, Kuala Lumpur, Malaysia
| | - Pau Loke Show
- Department of Chemical and Environmental Engineering, Faculty of Science and Engineering, University of Nottingham Malaysia Campus, Jalan Broga, Semenyih 43500, Selangor Darul Ehsan, Malaysia; Zhejiang Provincial Key Laboratory for Subtropical Water Environment and Marine Biological Resources Protection, Wenzhou University, Wenzhou 325035, China; Department of Sustainable Engineering, Saveetha School of Engineering, SIMATS, Chennai 602105, India.
| |
Collapse
|
4
|
Gong X, Ma C, Sun B, Zhang J. An Efficient Self-Organized Detection System for Algae. SENSORS (BASEL, SWITZERLAND) 2023; 23:1609. [PMID: 36772648 PMCID: PMC9920197 DOI: 10.3390/s23031609] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/27/2022] [Revised: 01/25/2023] [Accepted: 01/31/2023] [Indexed: 06/18/2023]
Abstract
Algal blooms have seriously affected the production and life of people and real-time detection of algae in water samples is a powerful measure to prevent algal blooms. The traditional manual detection of algae with a microscope is extremely time-consuming. In recent years, although there have been many studies using deep learning to classify and detect algae, most of them have focused on the relatively simple task of algal classification. In addition, some existing algal detection studies not only use small datasets containing limited algal species, but also only prove that object detection algorithms can be applied to algal detection tasks. These studies cannot implement the real-time detection of algae and timely warning of algal blooms. Therefore, this paper proposes an efficient self-organized detection system for algae. Benefiting from this system, we propose an interactive method to generate the algal detection dataset containing 28,329 images, 562,512 bounding boxes and 54 genera. Then, based on this dataset, we not only explore and compare the performance of 10 different versions of state-of-the-art object detection algorithms for algal detection, but also tune the detection system we built to its optimum state. In practical application, the system not only has good algal detection results, but also can complete the scanning, photographing and detection of a 2 cm × 2 cm, 0.1 mL algal slide specimen within five minutes (the resolution is 0.25886 μm/pixel); such a task requires a well-trained algal expert to work continuously for more than three hours. The efficient algal self-organized detection system we built makes it possible to detect algae in real time. In the future, with the help of IoT, we can use various smart sensors, actuators and intelligent controllers to achieve real-time collection and wireless transmission of algal data, use the efficient algal self-organized detection system we built to implement real-time algal detection and upload the detection results to the cloud to realize timely warning of algal blooms.
Collapse
Affiliation(s)
- Xingrui Gong
- School of Computer Science and Engineering, Faculty of Innovation Engineering, Macau University of Science and Technology, Macau 999078, China
| | - Chao Ma
- Department of Engineering Science, Faculty of Innovation Engineering, Macau University of Science and Technology, Macau 999078, China
| | - Beili Sun
- Jiangsu Metabio Science & Technology Co., Ltd., Wuxi 214028, China
- Wuxi Key Laboratory of Biochips, Southeast University Wuxi Branch, Wuxi 214135, China
| | - Junyi Zhang
- Jiangsu Wuxi Environmental Monitoring Center, Wuxi 214121, China
- School of Environmental and Civil Engineering, Jiangnan University, Wuxi 214122, China
| |
Collapse
|
5
|
Gaur A, Pant G, Jalal AS. Computer-aided cyanobacterial harmful algae blooms (CyanoHABs) studies based on fused artificial intelligence (AI) models. ALGAL RES 2022. [DOI: 10.1016/j.algal.2022.102842] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/01/2022]
|
6
|
Baek SS, Jung EY, Pyo J, Pachepsky Y, Son H, Cho KH. Hierarchical deep learning model to simulate phytoplankton at phylum/class and genus levels and zooplankton at the genus level. WATER RESEARCH 2022; 218:118494. [PMID: 35523035 DOI: 10.1016/j.watres.2022.118494] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/01/2022] [Revised: 04/19/2022] [Accepted: 04/20/2022] [Indexed: 06/14/2023]
Abstract
Harmful algal blooms (HABs) have become a global issue, affecting public health and water industries in numerous countries. Because funds for monitoring HABs are limited, model development may be an alternative approach for understanding and managing HABs. Continuous monitoring based on grab sampling is time-consuming, costly, and labor-intensive. However, improving simulation performance remains a major challenge in modeling, and current methods are limited to simulating phytoplankton (e.g., Microcystis sp., Anabaena sp., Aulacoseira sp., Cyclotella sp., Pediastrum sp., and Eudorina sp.) and zooplankton (e.g., Cyclotella sp., Pediastrum sp., and Eudorina sp.) at the genus level. The traditional modeling approach is limited for evaluating the interactions between phytoplankton and zooplankton. Recently, deep learning (DL) models have been proposed for solving modeling problems because of their large data handling capabilities and model structure flexibilities. In this study, we evaluated the applicability of DL for simulating phytoplankton at the phylum/class and genus levels and zooplankton at the genus level. Our work was an explicit representation of the taxonomic and ecological hierarchy of the DL model structure. The prerequisite for this model design was the data collection at two taxonomic and hierarchical levels. Our model consisted of hierarchical DL with classification transformer (TF) and regression TF models. These DL models were hierarchically connected; the output of the phylum/class level model was transferred to the genus level simulation model, and the output of the genus level model was fed into the zooplankton simulation model. The classification TF model determined the phytoplankton occurrence initiation date, whereas the regression TF model quantified the cell concentration of plankton. The hierarchical DL showed potential to simulate phytoplankton at the phylum/class and genus levels by producing average R2, and root mean standard error values of 0.42 and 0.83 [log(cells mL-1)], respectively. All simulated plankton results closely matched the measured concentrations. Particularly, the simulated cyanobacteria showed good agreement with the measured cell concentration, with an R2 value of 0.72. In addition, our simulated result showed good agreement in peak concentration compared to observations. However, a limitation remained in following the temporal variation of Tintinnopsis sp. and Bosmia sp. Using an importance map from the TF model, water temperature, total phosphorus, and total nitrogen were identified as significant variables influencing phytoplankton and zooplankton blooms. Overall, our study demonstrated that DL can be used for modeling HABs at the phylum/class and genus levels.
Collapse
Affiliation(s)
- Sang-Soo Baek
- Department of Environmental Engineering, Yeungnam University, 280 Daehak-Ro, Gyeongsan-Si, Gyeongbuk 38541, South Korea
| | - Eun-Young Jung
- Center for Environmental Data Strategy, Korea Environment Institute, Sejong 30147, Republic of Korea
| | - JongCheol Pyo
- Busan Water Quality Institute, 421-1 Maeri, Sangdongmyun, Kimhae 621-813, Republic of Korea
| | - Yakov Pachepsky
- Environmental Microbial and Food Safety Laboratory, USDA-ARS, Beltsville, MD, USA
| | - Heejong Son
- Center for Environmental Data Strategy, Korea Environment Institute, Sejong 30147, Republic of Korea.
| | - Kyung Hwa Cho
- School of Urban and Environmental Engineering, Ulsan National Institute of Science and Technology, Ulsan 44919, Republic of Korea.
| |
Collapse
|
7
|
|
8
|
Alzubaidi L, Zhang J, Humaidi AJ, Al-Dujaili A, Duan Y, Al-Shamma O, Santamaría J, Fadhel MA, Al-Amidie M, Farhan L. Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. JOURNAL OF BIG DATA 2021; 8:53. [PMID: 33816053 PMCID: PMC8010506 DOI: 10.1186/s40537-021-00444-8] [Citation(s) in RCA: 792] [Impact Index Per Article: 264.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/21/2021] [Accepted: 03/22/2021] [Indexed: 05/04/2023]
Abstract
In the last few years, the deep learning (DL) computing paradigm has been deemed the Gold Standard in the machine learning (ML) community. Moreover, it has gradually become the most widely used computational approach in the field of ML, thus achieving outstanding results on several complex cognitive tasks, matching or even beating those provided by human performance. One of the benefits of DL is the ability to learn massive amounts of data. The DL field has grown fast in the last few years and it has been extensively used to successfully address a wide range of traditional applications. More importantly, DL has outperformed well-known ML techniques in many domains, e.g., cybersecurity, natural language processing, bioinformatics, robotics and control, and medical information processing, among many others. Despite it has been contributed several works reviewing the State-of-the-Art on DL, all of them only tackled one aspect of the DL, which leads to an overall lack of knowledge about it. Therefore, in this contribution, we propose using a more holistic approach in order to provide a more suitable starting point from which to develop a full understanding of DL. Specifically, this review attempts to provide a more comprehensive survey of the most important aspects of DL and including those enhancements recently added to the field. In particular, this paper outlines the importance of DL, presents the types of DL techniques and networks. It then presents convolutional neural networks (CNNs) which the most utilized DL network type and describes the development of CNNs architectures together with their main features, e.g., starting with the AlexNet network and closing with the High-Resolution network (HR.Net). Finally, we further present the challenges and suggested solutions to help researchers understand the existing research gaps. It is followed by a list of the major DL applications. Computational tools including FPGA, GPU, and CPU are summarized along with a description of their influence on DL. The paper ends with the evolution matrix, benchmark datasets, and summary and conclusion.
Collapse
Affiliation(s)
- Laith Alzubaidi
- School of Computer Science, Queensland University of Technology, Brisbane, QLD 4000 Australia
- AlNidhal Campus, University of Information Technology & Communications, Baghdad, 10001 Iraq
| | - Jinglan Zhang
- School of Computer Science, Queensland University of Technology, Brisbane, QLD 4000 Australia
| | - Amjad J. Humaidi
- Control and Systems Engineering Department, University of Technology, Baghdad, 10001 Iraq
| | - Ayad Al-Dujaili
- Electrical Engineering Technical College, Middle Technical University, Baghdad, 10001 Iraq
| | - Ye Duan
- Faculty of Electrical Engineering & Computer Science, University of Missouri, Columbia, MO 65211 USA
| | - Omran Al-Shamma
- AlNidhal Campus, University of Information Technology & Communications, Baghdad, 10001 Iraq
| | - J. Santamaría
- Department of Computer Science, University of Jaén, 23071 Jaén, Spain
| | - Mohammed A. Fadhel
- College of Computer Science and Information Technology, University of Sumer, Thi Qar, 64005 Iraq
| | - Muthana Al-Amidie
- Faculty of Electrical Engineering & Computer Science, University of Missouri, Columbia, MO 65211 USA
| | - Laith Farhan
- School of Engineering, Manchester Metropolitan University, Manchester, M1 5GD UK
| |
Collapse
|