Hyperspectral imaging with shallow convolutional neural networks (SCNN) predicts the early herbicide stress in wheat cultivars

Sugarcane disease recognition through visible and near-infrared spectroscopy using deep learning assisted continuous wavelet transform-based spectrogram

Utilizing visible and near-infrared (Vis-NIR) spectroscopy in conjunction with chemometrics methods has been widespread for identifying plant diseases. However, a key obstacle involves the extraction of relevant spectral characteristics. This study aimed to enhance sugarcane disease recognition by combining convolutional neural network (CNN) with continuous wavelet transform (CWT) spectrograms for spectral features extraction within the Vis-NIR spectra (380-1400 nm) to improve the accuracy of sugarcane diseases recognition. Using 130 sugarcane leaf samples, the obtained one-dimensional CWT coefficients from Vis-NIR spectra were transformed into two-dimensional spectrograms. Employing CNN, spectrogram features were extracted and incorporated into decision tree, K-nearest neighbour, partial least squares discriminant analysis, and random forest (RF) calibration models. The RF model, integrating spectrogram-derived features, demonstrated the best performance with an average precision of 0.9111, sensitivity of 0.9733, specificity of 0.9791, and accuracy of 0.9487. This study may offer a non-destructive, rapid, and accurate means to detect sugarcane diseases, enabling farmers to receive timely and actionable insights on the crops' health, thus minimizing crop loss and optimizing yields.

Early surveillance of rice bakanae disease using deep learning and hyperspectral imaging

Bakanae disease, caused by Fusarium fujikuroi, poses a significant threat to rice production and has been observed in most rice-growing regions. The disease symptoms caused by different pathogens may vary, including elongated and weak stems, slender and yellow leaves, and dwarfism, as example. Bakanae disease is likely to cause necrosis of diseased seedlings, and it may cause a large area of infection in the field through the transmission of conidia. Therefore, early disease surveillance plays a crucial role in securing rice production. Traditional monitoring methods are both time-consuming and labor-intensive and cannot be broadly applied. In this study, a combination of hyperspectral imaging technology and deep learning algorithms were used to achieve in situ detection of rice seedlings infected with bakanae disease. Phenotypic data were obtained on the 9th, 15th, and 21st day after rice infection to explore the physiological and biochemical performance, which helps to deepen the research on the disease mechanism. Hyperspectral data were obtained over these same periods of infection, and a deep learning model, named Rice Bakanae Disease-Visual Geometry Group (RBD-VGG), was established by leveraging hyperspectral imaging technology and deep learning algorithms. Based on this model, an average accuracy of 92.2% was achieved on the 21st day of infection. It also achieved an accuracy of 79.4% as early as the 9th day. Universal characteristic wavelengths were extracted to increase the feasibility of using portable spectral equipment for field surveillance. Collectively, the model offers an efficient and non-destructive surveillance methodology for monitoring bakanae disease, thereby providing an efficient avenue for disease prevention and control.

Supplementary Information

The online version contains supplementary material available at 10.1007/s42994-024-00169-1.

Rapid assessment of heavy metal accumulation capability of Sedum alfredii using hyperspectral imaging and deep learning

Hyperaccumulators are the material basis and key to the phytoremediation of heavy metal contaminated soils. Conventional methods for screening hyperaccumulators are highly dependent on the time- and labor-consuming sampling and chemical analysis. In this study, a novel spectral approach assisted with multi-task deep learning was proposed to streamline accumulating ecotype screening, heavy metal stress discrimination, and heavy metals quantification in plants. The significant Cd/Zn co-hyperaccumulator Sedum alfredii and its non-accumulating ecotype were stressed by Cd, Zn, and Pb. Spectral images of leaves were rapidly acquired by hyperspectral imaging. The self-designed deep learning architecture was composed of a shallow network (ENet) for accumulating ecotype identification, and a multi-task network (HMNet) for heavy metal stress type and accumulation prediction simultaneously. To further assess the robustness of the networks, they were compared with conventional machine learning models (i.e., partial least squares (PLS) and support vector machine (SVM)) on a series of evaluation metrics of classification, multi-label classification, and regression. S. alfredii with heavy metals accumulation capability was identified by ENet with 100 % accuracy. HMNet reduced overfitting and outperformed machine learning models with the average exact match ratio (EMR) of heavy metal stress discrimination increased by 7.46 %, and residual prediction deviations (RPD) of heavy metal concentrations prediction increased by 53.59 %. The method succeeded in rapidly and accurately discriminating heavy metal stress with EMRs over 91 % and accuracies over 96 %, and in predicting heavy metals accumulation with an average RPD of 3.29 for Zn, 2.57 for Cd, and 2.53 for Pb, indicating the satisfactory practicability and potential for sensing heavy metals accumulation. This study provides a relatively novel spectral method to facilitate hyperaccumulator screening and heavy metals accumulation prediction in the phytoremediation process.

Early detection of nicosulfuron toxicity and physiological prediction in maize using multi-branch deep learning models and hyperspectral imaging

The misuse of herbicides in fields can cause severe toxicity in maize, resulting in significant reductions in both yield and quality. Therefore, it is crucial to develop early and efficient methods for assessing herbicide toxicity, protecting maize production, and maintaining the field environment. In this study, we utilized maize crops treated with the widely used nicosulfuron herbicide and their hyperspectral images to develop the HerbiNet model. After 4 d of nicosulfuron treatment, the model achieved an accuracy of 91.37 % in predicting toxicity levels, with correlation coefficient R² values of 0.82 and 0.73 for soil plant analysis development (SPAD) and water content, respectively. Additionally, the model exhibited higher generalizability across datasets from different years and seasons, which significantly surpassed support vector machines, AlexNet, and partial least squares regression models. A lightweight model, HerbiNet-Lite, exhibited significantly low complexity using 18 spectral wavelengths. After 4 d of nicosulfuron treatment, the HerbiNet-Lite model achieved an accuracy of 87.93 % for toxicity prediction and R² values of 0.80 and 0.71 for SPAD and water content, respectively, while significantly reducing overfitting. Overall, this study provides an innovative approach for the early and accurate detection of nicosulfuron toxicity within maize fields.

Multiomics Explore the Detoxification Mechanism of Nanoselenium and Melatonin on Bensulfuron Methyl in Wheat Plants

Combining nanoselenium (nano-Se) and melatonin (MT) was more effective than treatment alone against abiotic stress. However, their combined application mitigated the toxic effects of bensulfuron methyl, and enhanced wheat growth and metabolism has not been studied. Metabolomics and proteomics revealed that combining nano-Se and MT markedly activated phenylpropanoid biosynthesis pathways, elevating the flavonoid (quercetin by 33.5 and 39.8%) and phenolic acid (vanillic acid by 38.8 and 48.7%) levels in leaves and roots of wheat plants. Interstingly, beneficial rhizosphere bacteria in their combination increased (Oxalobacteraceae, Nocardioidaceae, and Xanthomonadaceae), which positively correlated with the enhancement of soil urease and fluorescein diacetate enzyme activity (27.0 and 26.9%) and the allelopathic substance levels. To summarize, nano-Se and MT mitigate the adverse effects of bensulfuron methyl by facilitating interactions between the phenylpropane metabolism of the plant and the beneficial microbial community. The findings provide a theoretical basis for using nano-Se and MT to remediate herbicide-contaminated soil.

Machine learning based recommendation of agricultural and horticultural crop farming in India under the regime of NPK, soil pH and three climatic variables

Machine learning (ML) can make use of agricultural data related to crop yield under varying soil nutrient levels, and climatic fluctuations to suggest appropriate crops or supplementary nutrients to achieve the highest possible production. The aim of this study was to evaluate the efficacy of five distinct ML models for a dataset sourced from the Kaggle repository to generate practical recommendations for crop selection or determination of required nutrient(s) in a given site. The datasets contain information on NPK, soil pH, and three climatic variables: temperature, rainfall, and humidity. The models namely Support vector machine, XGBoost, Random forest, KNN, and Decision Tree were trained using yields of individual data sets of 11 agricultural and 10 horticultural crops, as well as combined yield of both agri-horticultural crops. The results strongly suggest to evaluate individual data sets separately for each crop category rather than using combined the data sets of both categories for better predictions. Comparing the five ML models, the XGBoost demonstrated the highest level of accuracy. The precision rates of XGBoost for recommending agricultural crops, horticultural crops, and a combination of both were 99.09 % (AUC 1.0), 99.3 % (AUC 1.0), and 98.51 % (AUC 0.99), respectively. This non-intrusive method for generating crop recommendations in diverse environmental conditions holds the potential to provide valuable insights for the development of a user-friendly AI cloud-based interface. Such an interface would enable rapid decision-making for optimal fertilizer applications and the selection of suitable crops for cultivation at specific sites.

An AI based smart-phone system for asbestos identification

Asbestos identification is a complex environmental and economic challenge. Typical commercial identification of asbestos involves sending samples to a laboratory where someone learned in the field uses light microscopy and specialized mounting to identify the morphologically distinct signatures of Asbestos. In this work we investigate the use of a portable (30x) microscope which works with a smart phone camera to develop an image recognition system. 7328 images from over 1000 distinct samples of cement sheet from Melbourne, Australia were used to train a phone-based image recognition system for Asbestos identification. Three common CNN's were tested ResNet101, InceptionV3 and VGG_16 with ResNet101 achieving the best result. The distinctiveness of Asbestos was found to be identified correctly 90% of the time using a phone-based system and no specialized mounting. The image recognition system was trained with ResNet101 a convolutional neural network deep learning model which weights layers with a residual function. Resulting in an accuracy of 98.46% and loss of 3.8% ResNet101 was found to produce a more accurate model for this use-case than other deep learning neural networks.

ResNet incorporating the fusion data of RGB & hyperspectral images improves classification accuracy of vegetable soybean freshness

The freshness of vegetable soybean (VS) is an important indicator for quality evaluation. Currently, deep learning-based image recognition technology provides a fast, efficient, and low-cost method for analyzing the freshness of food. The RGB (red, green, and blue) image recognition technology is widely used in the study of food appearance evaluation. In addition, the hyperspectral image has outstanding performance in predicting the nutrient content of samples. However, there are few reports on the research of classification models based on the fusion data of these two sources of images. We collected RGB and hyperspectral images at four different storage times of VS. The ENVI software was adopted to extract the hyperspectral information, and the RGB images were reconstructed based on the downsampling technology. Then, the one-dimensional hyperspectral data was transformed into a two-dimensional space, which allows it to be overlaid and concatenated with the RGB image data in the channel direction, thereby generating fused data. Compared with four commonly used machine learning models, the deep learning model ResNet18 has higher classification accuracy and computational efficiency. Based on the above results, a novel classification model named ResNet-R &H, which is based on the residual networks (ResNet) structure and incorporates the fusion data of RGB and hyperspectral images, was proposed. The ResNet-R &H can achieve a testing accuracy of 97.6%, which demonstrates a significant enhancement of 4.0% and 7.2% compared to the distinct utilization of hyperspectral data and RGB data, respectively. Overall, this research is significant in providing a unique, efficient, and more accurate classification approach in evaluating the freshness of vegetable soybean. The method proposed in this study can provide a theoretical reference for classifying the freshness of fruits and vegetables to improve classification accuracy and reduce human error and variability.

Predicting rice diseases using advanced technologies at different scales: present status and future perspectives

The past few years have witnessed significant progress in emerging disease detection techniques for accurately and rapidly tracking rice diseases and predicting potential solutions. In this review we focus on image processing techniques using machine learning (ML) and deep learning (DL) models related to multi-scale rice diseases. Furthermore, we summarize applications of different detection techniques, including genomic, physiological, and biochemical approaches. In addition, we also present the state-of-the-art in contemporary optical sensing applications of pathogen-plant interaction phenotypes. This review serves as a valuable resource for researchers seeking effective solutions to address the challenges of high-throughput data and model recognition for early detection of issues affecting rice crops through ML and DL models.

Hyperspectral Analysis for Discriminating Herbicide Site of Action: A Novel Approach for Accelerating Herbicide Research

In agricultural weed management, herbicides are indispensable, yet innovation in their modes of action (MOA)-the general mechanisms affecting plant processes-has slowed. A finer classification within MOA is the site of action (SOA), the specific biochemical pathway in plants targeted by herbicides. The primary objectives of this study were to evaluate the efficacy of hyperspectral imaging in the early detection of herbicide stress and to assess its potential in accelerating the herbicide development process by identifying unique herbicide sites of action (SOA). Employing a novel SOA classification method, eight herbicides with unique SOAs were examined via an automated, high-throughput imaging system equipped with a conveyor-based plant transportation at Purdue University. This is one of the earliest trials to test hyperspectral imaging on a large number of herbicides, and the study aimed to explore the earliest herbicide stress detection/classification date and accelerate the speed of herbicide development. The final models, trained on a dataset with nine treatments with 320 samples in two rounds, achieved an overall accuracy of 81.5% 1 day after treatment. With the high-precision models and rapid screening of numerous compounds in only 7 days, the study results suggest that hyperspectral technology combined with machine learning can contribute to the discovery of new herbicide MOA and help address the challenges associated with herbicide resistance. Although no public research to date has used hyperspectral technology to classify herbicide SOA, the successful evaluation of herbicide damage to crops provides hope to accelerate the progress of herbicide development.

The Recent Development of Acoustic Sensors as Effective Chemical Detecting Tools for Biological Cells and Their Bioactivities

One of the most significant developed technologies is the use of acoustic waves to determine the chemical structures of biological tissues and their bioactivities. In addition, the use of new acoustic techniques for in vivo visualizing and imaging of animal and plant cellular chemical compositions could significantly help pave the way toward advanced analytical technologies. For instance, acoustic wave sensors (AWSs) based on quartz crystal microbalance (QCM) were used to identify the aromas of fermenting tea such as linalool, geraniol, and trans-2-hexenal. Therefore, this review focuses on the use of advanced acoustic technologies for tracking the composition changes in plant and animal tissues. In addition, a few key configurations of the AWS sensors and their different wave pattern applications in biomedical and microfluidic media progress are discussed.

Proximal hyperspectral sensing of abiotic stresses in plants

Recent attempts, advances and challenges, as well as future perspectives regarding the application of proximal hyperspectral sensing (where sensors are placed within 10 m above plants, either on land-based platforms or in controlled environments) to assess plant abiotic stresses have been critically reviewed. Abiotic stresses, caused by either physical or chemical reasons such as nutrient deficiency, drought, salinity, heavy metals, herbicides, extreme temperatures, and so on, may be more damaging than biotic stresses (affected by infectious agents such as bacteria, fungi, insects, etc.) on crop yields. The proximal hyperspectral sensing provides images at a sub-millimeter spatial resolution for doing an in-depth study of plant physiology and thus offers a global view of the plant's status and allows for monitoring spatio-temporal variations from large geographical areas reliably and economically. The literature update has been based on 362 research papers in this field, published from 2010, most of which are from four years ago and, in our knowledge, it is the first paper that provides a comprehensive review of the applications of the technique for the detection of various types of abiotic stresses in plants.

Hyperspectral remote sensing to assess weed competitiveness in maize farmland ecosystems

Weed competition causes serious economic losses to maize production. Timely and accurate assessment of pressure from competition is crucial for ecological weed management. In this work, we apply hyperspectral remote sensing (HRS) technology to conduct a competitive experiment in Harbin, China, in 2021, with 5-leaf maize as the study target. A weed competition assessment method that combines comprehensive competition indices (CCI) and deep learning is proposed. For the comprehensive competition assessment, the relationship between different weed competitive pressures (Levels 1-5) and changes in the structural and physiological information of maize was analyzed. The accumulative/transient competition indices CCI-A and CCI-T were designed for accurate quantification. The results showed that parameters such as plant height, stalk thickness and nutrient elements of maize decreased with increasing competition level. Parameters, such as stomatal conductance and transpiration rate, showed a fluctuating change of increasing and then decreasing with increasing competition level. Compared with the traditional relative competitive intensity (RCI), the standard deviation of CCI is 0.303 and 0.499. The dispersion effect of CCI is better and more suitable for quantifying the competition response. HRS images combined with 3D-CNN model were then applied to reveal the spectral response to different weed competition pressures (Levels 1-5) and to make early predictions of weed competition. The first-order derivative showed that the spectral reflectance exhibited significant differences at 520-525 nm peak, 570-655 nm trough, and near 700 nm red edge. For hyperspectral spatial-spectral features, the 3D-CNN model is proposed for prediction of competing indices CCI. In addition, the VIP method is used to select the characteristic wavelengths. The 3D-CNN model achieves a prediction accuracy of RMSE = 0.106 and 0.152 using 13 feature bands, which can accurately quantify the subtle changes in competition indices. Overall, this study shows that the combination of CCI and deep learning can provide a multivariate and comprehensive assessment of weed competition pressure.

End-to-End Fusion of Hyperspectral and Chlorophyll Fluorescence Imaging to Identify Rice Stresses

Herbicides and heavy metals are hazardous substances of environmental pollution, resulting in plant stress and harming humans and animals. Identification of stress types can help trace stress sources, manage plant growth, and improve stress-resistant breeding. In this research, hyperspectral imaging (HSI) and chlorophyll fluorescence imaging (Chl-FI) were adopted to identify the rice plants under two types of herbicide stresses (butachlor (DCA) and quinclorac (ELK)) and two types of heavy metal stresses (cadmium (Cd) and copper (Cu)). Visible/near-infrared spectra of leaves (L-VIS/NIR) and stems (S-VIS/NIR) extracted from HSI and chlorophyll fluorescence kinetic curves of leaves (L-Chl-FKC) and stems (S-Chl-FKC) extracted from Chl-FI were fused to establish the models to detect the stress of the hazardous substances. Novel end-to-end deep fusion models were proposed for low-level, middle-level, and high-level information fusion to improve identification accuracy. Results showed that the high-level fusion-based convolutional neural network (CNN) models reached the highest detection accuracy (97.7%), outperforming the models using a single data source (<94.7%). Furthermore, the proposed end-to-end deep fusion models required a much simpler training procedure than the conventional two-stage deep learning fusion. This research provided an efficient alternative for plant stress phenotyping, including identifying plant stresses caused by hazardous substances of environmental pollution.

Detecting Asymptomatic Infections of Rice Bacterial Leaf Blight Using Hyperspectral Imaging and 3-Dimensional Convolutional Neural Network With Spectral Dilated Convolution

Rice is one of the most important food crops for human beings. Its total production ranks third in the grain crop output. Bacterial Leaf Blight (BLB), as one of the three major diseases of rice, occurs every year, posing a huge threat to rice production and safety. There is an asymptomatic period between the infection and the onset periods, and BLB will spread rapidly and widely under suitable conditions. Therefore, accurate detection of early asymptomatic BLB is very necessary. The purpose of this study was to test the feasibility of detecting early asymptomatic infection of the rice BLB disease based on hyperspectral imaging and Spectral Dilated Convolution 3-Dimensional Convolutional Neural Network (SDC-3DCNN). First, hyperspectral images were obtained from rice leaves infected with the BLB disease at the tillering stage. The spectrum was smoothed by the Savitzky-Golay (SG) method, and the wavelength between 450 and 950 nm was intercepted for analysis. Then Principal Component Analysis (PCA) and Random Forest (RF) were used to extract the feature information from the original spectra as inputs. The overall performance of the SDC-3DCNN model with different numbers of input features and different spectral dilated ratios was evaluated. Lastly, the saliency map visualization was used to explain the sensitivity of individual wavelengths. The results showed that the performance of the SDC-3DCNN model reached an accuracy of 95.4427% when the number of inputs is 50 characteristic wavelengths (extracted by RF) and the dilated ratio is set at 5. The saliency-sensitive wavelengths were identified in the range from 530 to 570 nm, which overlaps with the important wavelengths extracted by RF. According to our findings, combining hyperspectral imaging and deep learning can be a reliable approach for identifying early asymptomatic infection of the rice BLB disease, providing sufficient support for early warning and rice disease prevention.

Evaluation of a One-Dimensional Convolution Neural Network for Chlorophyll Content Estimation Using a Compact Spectrometer

Leaf chlorophyll content is used as a major indicator of plant stress and growth, and hyperspectral remote sensing is frequently used to monitor the chlorophyll content. Hyperspectral reflectance has been used to evaluate vegetation properties such as pigment content, plant structure and physiological features using portable spectroradiometers. However, the prices of these devices have not yet decreased to consumer-affordable levels, which prevents widespread use. In this study, a system based on a cost-effective fingertip-sized spectrometer (Colorcompass-LF, a total price for the proposed solution was approximately 1600 USD) was evaluated for its ability to estimate the chlorophyll contents of radish and wasabi leaves and was compared with the Analytical Spectral Devices FieldSpec4. The chlorophyll contents per leaf area (cm2) of radish were generally higher than those of wasabi and ranged from 42.20 to 94.39 μg/cm2 and 11.39 to 40.40 μg/cm2 for radish and wasabi, respectively. The chlorophyll content was estimated using regression models based on a one-dimensional convolutional neural network (1D-CNN) that was generated after the original reflectance from the spectrometer measurements was de-noised. The results from an independent validation dataset confirmed the good performance of the Colorcompass-LF after spectral correction using a second-degree polynomial, and very similar estimation accuracies were obtained for the measurements from the FieldSpec4. The coefficients of determination of the regression models based on 1D-CNN were almost same (with R2 = 0.94) and the ratios of performance to deviation based on reflectance after spectral correction using a second-degree polynomial for the Colorcompass-LF and the FieldSpec4 were 4.31 and 4.33, respectively.

Emerging Technologies for Detecting the Chemical Composition of Plant and Animal Tissues and Their Bioactivities: An Editorial

Integrating physical and chemical technologies for the characterization and modification of plants and animal tissues has been used for several decades to improve their detection potency and quality [...].

Using Deep Convolutional Neural Network for Image-Based Diagnosis of Nutrient Deficiencies in Plants Grown in Aquaponics

In the aquaponic system, plant nutrients bioavailable from fish excreta are not sufficient for optimal plant growth. Accurate and timely monitoring of the plant’s nutrient status grown in aquaponics is a challenge in order to maintain the balance and sustainability of the system. This study aimed to integrate color imaging and deep convolutional neural networks (DCNNs) to diagnose the nutrient status of lettuce grown in aquaponics. Our approach consists of multi-stage procedures, including plant object detection and classification of nutrient deficiency. The robustness and diagnostic capability of proposed approaches were evaluated using a total number of 3000 lettuce images that were classified into four nutritional classes—namely, full nutrition (FN), nitrogen deficiency (N), phosphorous deficiency (P), and potassium deficiency (K). The performance of the DCNNs was compared with traditional machine learning (ML) algorithms (i.e., Simple thresholding, K-means, support vector machine; SVM, k-nearest neighbor; KNN, and decision Tree; DT). The results demonstrated that the deep proposed segmentation model obtained an accuracy of 99.1%. Also, the deep proposed classification model achieved the highest accuracy of 96.5%. These results indicate that deep learning models, combined with color imaging, provide a promising approach to timely monitor nutrient status of the plants grown in aquaponics, which allows for taking preventive measures and mitigating economic and production losses. These approaches can be integrated into embedded devices to control nutrient cycles in aquaponics.