Multispectral images of peach related to firmness and maturity at harvest

A comprehensive review on acquisition of phenotypic information of Prunoideae fruits: Image technology

Fruit phenotypic information reflects all the physical, physiological, biochemical characteristics and traits of fruit. Accurate access to phenotypic information is very necessary and meaningful for post-harvest storage, sales and deep processing. The methods of obtaining phenotypic information include traditional manual measurement and damage detection, which are inefficient and destructive. In the field of fruit phenotype research, image technology is increasingly mature, which greatly improves the efficiency of fruit phenotype information acquisition. This review paper mainly reviews the research on phenotypic information of Prunoideae fruit based on three imaging techniques (RGB imaging, hyperspectral imaging, multispectral imaging). Firstly, the classification was carried out according to the image type. On this basis, the review and summary of previous studies were completed from the perspectives of fruit maturity detection, fruit quality classification and fruit disease damage identification. Analysis of the advantages and disadvantages of various types of images in the study, and try to give the next research direction for improvement.

Study on robust model construction method of multi-batch fruit online sorting by near-infrared spectroscopy

In the online detection of fruit samples by near-infrared spectroscopy (NIRS), the natural change of sample states or the variations of instruments will often cause a large error in predicting different batches of samples. In this study, a total of 440 tomato samples were collected in four batches with each batch of 110 samples. The Spectral and soluble solids content (SSC) of single batch were collected every other day in batch order. The multivariate statistical process control (MSPC) method was adopted to establish a stability monitor model. The robustness regression (Rob-Reg) and partial least squares regression (PLSR) were used for mixed modeling of multiple batches of samples to eliminate the variability influence of sample and instrument states. The results show that MSPC can effectively monitor the consistency of the same batch samples measured at different times or different batches. The variation of sample attributes with spectral acquisition time has dramatically damaged the adaptation of PLSR models. The Rob-Reg method can predict the SSC of the different batches of samples at different collection times. Compared with the PLSR method, the correlation coefficient of prediction (R_p) was improved from 0.61 to 0.66, and the root mean square error of prediction (RMSEP) was decreased from 0.55 to 0.44 for Rob-Reg method. The RPD of 3.85 indicated that the model is excellent. The Robust modeling method can be well applied to fruit near-infrared online detection system.

Broadacre Crop Yield Estimation Using Imaging Spectroscopy from Unmanned Aerial Systems (UAS): A Field-Based Case Study with Snap Bean

Accurate, precise, and timely estimation of crop yield is key to a grower’s ability to proactively manage crop growth and predict harvest logistics. Such yield predictions typically are based on multi-parametric models and in-situ sampling. Here we investigate the extension of a greenhouse study, to low-altitude unmanned aerial systems (UAS). Our principal objective was to investigate snap bean crop (Phaseolus vulgaris) yield using imaging spectroscopy (hyperspectral imaging) in the visible to near-infrared (VNIR; 400–1000 nm) region via UAS. We aimed to solve the problem of crop yield modelling by identifying spectral features explaining yield and evaluating the best time period for accurate yield prediction, early in time. We introduced a Python library, named Jostar, for spectral feature selection. Embedded in Jostar, we proposed a new ranking method for selected features that reaches an agreement between multiple optimization models. Moreover, we implemented a well-known denoising algorithm for the spectral data used in this study. This study benefited from two years of remotely sensed data, captured at multiple instances over the summers of 2019 and 2020, with 24 plots and 18 plots, respectively. Two harvest stage models, early and late harvest, were assessed at two different locations in upstate New York, USA. Six varieties of snap bean were quantified using two components of yield, pod weight and seed length. We used two different vegetation detection algorithms. the Red-Edge Normalized Difference Vegetation Index (RENDVI) and Spectral Angle Mapper (SAM), to subset the fields into vegetation vs. non-vegetation pixels. Partial least squares regression (PLSR) was used as the regression model. Among nine different optimization models embedded in Jostar, we selected the Genetic Algorithm (GA), Ant Colony Optimization (ACO), Simulated Annealing (SA), and Particle Swarm Optimization (PSO) and their resulting joint ranking. The findings show that pod weight can be explained with a high coefficient of determination (R2 = 0.78–0.93) and low root-mean-square error (RMSE = 940–1369 kg/ha) for two years of data. Seed length yield assessment resulted in higher accuracies (R2 = 0.83–0.98) and lower errors (RMSE = 4.245–6.018 mm). Among optimization models used, ACO and SA outperformed others and the SAM vegetation detection approach showed improved results when compared to the RENDVI approach when dense canopies were being examined. Wavelengths at 450, 500, 520, 650, 700, and 760 nm, were identified in almost all data sets and harvest stage models used. The period between 44–55 days after planting (DAP) the optimal time period for yield assessment. Future work should involve transferring the learned concepts to a multispectral system, for eventual operational use; further attention should also be paid to seed length as a ground truth data collection technique, since this yield indicator is far more rapid and straightforward.

Active and Passive Electro-Optical Sensors for Health Assessment in Food Crops

In agriculture, early detection of plant stresses is advantageous in preventing crop yield losses. Remote sensors are increasingly being utilized for crop health monitoring, offering non-destructive, spatialized detection and the quantification of plant diseases at various levels of measurement. Advances in sensor technologies have promoted the development of novel techniques for precision agriculture. As in situ techniques are surpassed by multispectral imaging, refinement of hyperspectral imaging and the promising emergence of light detection and ranging (LIDAR), remote sensing will define the future of biotic and abiotic plant stress detection, crop yield estimation and product quality. The added value of LIDAR-based systems stems from their greater flexibility in capturing data, high rate of data delivery and suitability for a high level of automation while overcoming the shortcomings of passive systems limited by atmospheric conditions, changes in light, viewing angle and canopy structure. In particular, a multi-sensor systems approach and associated data fusion techniques (i.e., blending LIDAR with existing electro-optical sensors) offer increased accuracy in plant disease detection by focusing on traditional optimal estimation and the adoption of artificial intelligence techniques for spatially and temporally distributed big data. When applied across different platforms (handheld, ground-based, airborne, ground/aerial robotic vehicles or satellites), these electro-optical sensors offer new avenues to predict and react to plant stress and disease. This review examines the key sensor characteristics, platform integration options and data analysis techniques recently proposed in the field of precision agriculture and highlights the key challenges and benefits of each concept towards informing future research in this very important and rapidly growing field.

Growth Stage Classification and Harvest Scheduling of Snap Bean Using Hyperspectral Sensing: A Greenhouse Study

The agricultural industry suffers from a significant amount of food waste, some of which originates from an inability to apply site-specific management at the farm-level. Snap bean, a broad-acre crop that covers hundreds of thousands of acres across the USA, is not exempt from this need for informed, within-field, and spatially-explicit management approaches. This study aimed to assess the utility of machine learning algorithms for growth stage and pod maturity classification of snap bean (cv. Huntington), as well as detecting and discriminating spectral and biophysical features that lead to accurate classification results. Four major growth stages and six main sieve size pod maturity levels were evaluated for growth stage and pod maturity classification, respectively. A point-based in situ spectroradiometer in the visible-near-infrared and shortwave-infrared domains (VNIR-SWIR; 400–2500 nm) was used and the radiance values were converted to reflectance to normalize for any illumination change between samples. After preprocessing the raw data, we approached pod maturity assessment with multi-class classification and growth stage determination with binary and multi-class classification methods. Results from the growth stage assessment via the binary method exhibited accuracies ranging from 90–98%, with the best mathematical enhancement method being the continuum-removal approach. The growth stage multi-class classification method used raw reflectance data and identified a pair of wavelengths, 493 nm and 640 nm, in two basic transforms (ratio and normalized difference), yielding high accuracies (~79%). Pod maturity assessment detected narrow-band wavelengths in the VIS and SWIR region, separating between not ready-to-harvest and ready-to-harvest scenarios with classification measures at the ~78% level by using continuum-removed spectra. Our work is a best-case scenario, i.e., we consider it a stepping-stone to understanding snap bean harvest maturity assessment via hyperspectral sensing at a scalable level (i.e., airborne systems). Future work involves transferring the concepts to unmanned aerial system (UAS) field experiments and validating whether or not a simple multispectral camera, mounted on a UAS, could incorporate < 10 spectral bands to meet the need of both growth stage and pod maturity classification in snap bean production.

Monitoring Plant Status and Fertilization Strategy through Multispectral Images

A crop monitoring system was developed for the supervision of organic fertilization status on tomato plants at early stages. An automatic and nondestructive approach was used to analyze tomato plants with different levels of water-soluble organic fertilizer (3 + 5 NK) and vermicompost. The evaluation system was composed by a multispectral camera with five lenses: green (550 nm), red (660 nm), red edge (735 nm), near infrared (790 nm), RGB, and a computational image processing system. The water-soluble fertilizer was applied weekly in four different treatments: (T0: 0 mL, T1: 6.25 mL, T2: 12.5 mL and T3: 25 mL) and the vermicomposting was added in Weeks 1 and 5. The trial was conducted in a greenhouse and 192 images were taken with each lens. A plant segmentation algorithm was developed and several vegetation indices were calculated. On top of calculating indices, multiple morphological features were obtained through image processing techniques. The morphological features were revealed to be more feasible to distinguish between the control and the organic fertilized plants than the vegetation indices. The system was developed in order to be assembled in a precision organic fertilization robotic platform.

Oviposition Suitability of Drosophila Suzukii (Diptera: Drosophilidae) for Nectarine Varieties and Its Correlation with the Physiological Indexes

The nectarine is an important fruit, which is attacked by Drosophila suzukii in Europe and the United States but there are no reports of it attacking nectarines in China. Here, we determined the oviposition preference of D. suzukii six on intact and sliced nectarine varieties in China and how physical and physiological indexes of the fruit correlate with these preferences. D. suzukii were allowed to oviposit on two early–, two middle– and two late–maturing varieties of nectarine—Shuguang and Chunguang, Fengguang and Zhong you 4, Zhong you 7 and Zhong you 8, respectively and the number of larvae also followed the order. The firmness, soluble solids content and the nutritional components of the amino acid, protein, soluble sugar and pectin contents of each variety were measured. D. suzukii preferred the early Shuguang variety, followed by the early Chunguang variety and then the middle Zhong you 4 and Fengguang varieties. Taken together, results show that D. suzukii shows preferences for earlier rather than later varieties of nectarines in China and that these preferences are related to the fruit’s physical and physiological traits. Results suggest that mixed cultivation of early–, middle– and late–maturing nectarine varieties should be avoided in order to prevent fly dispersal and infestation by D. suzukii.

Applications of Photonics in Agriculture Sector: A Review

The agricultural industry has made a tremendous contribution to the foundations of civilization. Basic essentials such as food, beverages, clothes and domestic materials are enriched by the agricultural industry. However, the traditional method in agriculture cultivation is labor-intensive and inadequate to meet the accelerating nature of human demands. This scenario raises the need to explore state-of-the-art crop cultivation and harvesting technologies. In this regard, optics and photonics technologies have proven to be effective solutions. This paper aims to present a comprehensive review of three photonic techniques, namely imaging, spectroscopy and spectral imaging, in a comparative manner for agriculture applications. Essentially, the spectral imaging technique is a robust solution which combines the benefits of both imaging and spectroscopy but faces the risk of underutilization. This review also comprehends the practicality of all three techniques by presenting existing examples in agricultural applications. Furthermore, the potential of these techniques is reviewed and critiqued by looking into agricultural activities involving palm oil, rubber, and agro-food crops. All the possible issues and challenges in implementing the photonic techniques in agriculture are given prominence with a few selective recommendations. The highlighted insights in this review will hopefully lead to an increased effort in the development of photonics applications for the future agricultural industry.

Evaluation of Chilling Injury in Mangoes Using Multispectral Imaging

Commodities originating from tropical and subtropical climes are prone to chilling injury (CI). This injury could affect the quality and marketing potential of mango after harvest. This will later affect the quality of the produce and subsequent consumer acceptance. In this study, the appearance of CI symptoms in mango was evaluated non-destructively using multispectral imaging. The fruit were stored at 4 °C to induce CI and 12 °C to preserve the quality of the control samples for 4 days before they were taken out and stored at ambient temperature for 24 hr. Measurements using multispectral imaging and standard reference methods were conducted before and after storage. The performance of multispectral imaging was compared using standard reference properties including moisture content (MC), total soluble solids (TSS) content, firmness, pH, and color. Least square support vector machine (LS-SVM) combined with principal component analysis (PCA) were used to discriminate CI samples with those of control and before storage, respectively. The statistical results demonstrated significant changes in the reference quality properties of samples before and after storage. The results also revealed that multispectral parameters have a strong correlation with the reference parameters of L^* , a^* , TSS, and MC. The MC and L^* were found to be the best reference parameters in identifying the severity of CI in mangoes. PCA and LS-SVM analysis indicated that the fruit were successfully classified into their categories, that is, before storage, control, and CI. This indicated that the multispectral imaging technique is feasible for detecting CI in mangoes during postharvest storage and processing.

PRACTICAL APPLICATION

This paper demonstrates a fast, easy, and accurate method of identifying the effect of cold storage on mango, nondestructively. The method presented in this paper can be used industrially to efficiently differentiate different fruits from each other after low temperature storage.

Advances in Non-Destructive Early Assessment of Fruit Ripeness towards Defining Optimal Time of Harvest and Yield Prediction-A Review

Global food security for the increasing world population not only requires increased sustainable production of food but a significant reduction in pre- and post-harvest waste. The timing of when a fruit is harvested is critical for reducing waste along the supply chain and increasing fruit quality for consumers. The early in-field assessment of fruit ripeness and prediction of the harvest date and yield by non-destructive technologies have the potential to revolutionize farming practices and enable the consumer to eat the tastiest and freshest fruit possible. A variety of non-destructive techniques have been applied to estimate the ripeness or maturity but not all of them are applicable for in situ (field or glasshouse) assessment. This review focuses on the non-destructive methods which are promising for, or have already been applied to, the pre-harvest in-field measurements including colorimetry, visible imaging, spectroscopy and spectroscopic imaging. Machine learning and regression models used in assessing ripeness are also discussed.

Non-destructive detection of dicyandiamide in infant formula powder using multi-spectral imaging coupled with chemometrics

BACKGROUND

Dicyandiamide (DCD) contamination of milk and milk products has become an urgent and broadly recognised topic as a result of several food safety scares. This study investigated the potential of using multi-spectral imaging (405-970 nm) coupled with chemometrics for detection of DCD in infant formula powder. Partial least squares (PLS), least squares-support vector machines (LS-SVM), and back-propagation neural network (BPNN) were applied to develop quantitative models.

RESULTS

Compared with PLS and LS-SVM, BPNN considerably improved the prediction performance with coefficient of determination in prediction (RP2) = 0.935 and 0.873, residual predictive deviation (RPD) = 3.777 and 3.060 for brand 1 and brand 2 of infant formula powders, respectively. Besides, multi-spectral imaging was able to differentiate unadulterated infant formula powder from samples containing 0.01% DCD with no misclassification using BPNN model.

CONCLUSION

The study demonstrated that multi-spectral imaging combined with chemometrics enables rapid and non-destructive detection of DCD in infant formula powder. © 2016 Society of Chemical Industry.

Rapid and non-destructive determination of rancidity levels in butter cookies by multi-spectral imaging

BACKGROUND

Rancidity is an important attribute for quality assessment of butter cookies, while traditional methods for rancidity measurement are usually laborious, destructive and prone to operational error. In the present paper, the potential of applying multi-spectral imaging (MSI) technology with 19 wavelengths in the range of 405-970 nm to evaluate the rancidity in butter cookies was investigated.

RESULTS

Moisture content, acid value and peroxide value were determined by traditional methods and then related with the spectral information by partial least squares regression (PLSR) and back-propagation artificial neural network (BP-ANN). The optimal models for predicting moisture content, acid value and peroxide value were obtained by PLSR. The correlation coefficient (r) obtained by PLSR models revealed that MSI had a perfect ability to predict moisture content (r = 0.909), acid value (r = 0.944) and peroxide value (r = 0.971).

CONCLUSION

The study demonstrated that the rancidity level of butter cookies can be continuously monitored and evaluated in real-time by the multi-spectral imaging, which is of great significance for developing online food safety monitoring solutions.

Visible Light Image-Based Method for Sugar Content Classification of Citrus

Visible light imaging of citrus fruit from Mie Prefecture of Japan was performed to determine whether an algorithm could be developed to predict the sugar content. This nondestructive classification showed that the accurate segmentation of different images can be realized by a correlation analysis based on the threshold value of the coefficient of determination. There is an obvious correlation between the sugar content of citrus fruit and certain parameters of the color images. The selected image parameters were connected by addition algorithm. The sugar content of citrus fruit can be predicted by the dummy variable method. The results showed that the small but orange citrus fruits often have a high sugar content. The study shows that it is possible to predict the sugar content of citrus fruit and to perform a classification of the sugar content using light in the visible spectrum and without the need for an additional light source.

Fruit quality evaluation using spectroscopy technology: a review

An overview is presented with regard to applications of visible and near infrared (Vis/NIR) spectroscopy, multispectral imaging and hyperspectral imaging techniques for quality attributes measurement and variety discrimination of various fruit species, i.e., apple, orange, kiwifruit, peach, grape, strawberry, grape, jujube, banana, mango and others. Some commonly utilized chemometrics including pretreatment methods, variable selection methods, discriminant methods and calibration methods are briefly introduced. The comprehensive review of applications, which concentrates primarily on Vis/NIR spectroscopy, are arranged according to fruit species. Most of the applications are focused on variety discrimination or the measurement of soluble solids content (SSC), acidity and firmness, but also some measurements involving dry matter, vitamin C, polyphenols and pigments have been reported. The feasibility of different spectral modes, i.e., reflectance, interactance and transmittance, are discussed. Optimal variable selection methods and calibration methods for measuring different attributes of different fruit species are addressed. Special attention is paid to sample preparation and the influence of the environment. Areas where further investigation is needed and problems concerning model robustness and model transfer are identified.

Application of multispectral imaging to determine quality attributes and ripeness stage in strawberry fruit

Multispectral imaging with 19 wavelengths in the range of 405–970 nm has been evaluated for nondestructive determination of firmness, total soluble solids (TSS) content and ripeness stage in strawberry fruit. Several analysis approaches, including partial least squares (PLS), support vector machine (SVM) and back propagation neural network (BPNN), were applied to develop theoretical models for predicting the firmness and TSS of intact strawberry fruit. Compared with PLS and SVM, BPNN considerably improved the performance of multispectral imaging for predicting firmness and total soluble solids content with the correlation coefficient (r) of 0.94 and 0.83, SEP of 0.375 and 0.573, and bias of 0.035 and 0.056, respectively. Subsequently, the ability of multispectral imaging technology to classify fruit based on ripeness stage was tested using SVM and principal component analysis-back propagation neural network (PCA-BPNN) models. The higher classification accuracy of 100% was achieved using SVM model. Moreover, the results of all these models demonstrated that the VIS parts of the spectra were the main contributor to the determination of firmness, TSS content estimation and classification of ripeness stage in strawberry fruit. These results suggest that multispectral imaging, together with suitable analysis model, is a promising technology for rapid estimation of quality attributes and classification of ripeness stage in strawberry fruit.

Review: computer vision applied to the inspection and quality control of fruits and vegetables

This is a review of the current existing literature concerning the inspection of fruits and vegetables with the application of computer vision, where the techniques most used to estimate various properties related to quality are analyzed. The objectives of the typical applications of such systems include the classification, quality estimation according to the internal and external characteristics, supervision of fruit processes during storage or the evaluation of experimental treatments. In general, computer vision systems do not only replace manual inspection, but can also improve their skills. In conclusion, computer vision systems are powerful tools for the automatic inspection of fruits and vegetables. In addition, the development of such systems adapted to the food industry is fundamental to achieve competitive advantages.

Multispectral vision for monitoring peach ripeness

The main objective of this research was to develop an automatic procedure able to classify Rich Lady commercial peaches according to their ripeness stage through multispectral imaging techniques. A classification procedure was applied to the ratio images calculated as red (R, 680 nm) divided by infrared (IR, 800 nm), that is, R/IR images. Four image-based ripeness reference classes (A: unripe to D: overripe) were generated from 380 fruit images (season 1: 2006) by a nonsupervised classification method and evaluated according to reference measurements of the ripeness of the same samples: Magness-Taylor penetrometry firmness, low-mass impact firmness, reflectance at 680 nm (R680, and soluble solids content. The assignment of unknown sample images from those season 1 images (internal validation, n = 380) and of 240 images from the 2nd season (season 2: 2007) to the ripeness reference classes (external validation) was carried out by computing the minimum Euclidean distance (classification distance, C(d)) between each unknown image histogram and the average histogram of each ripeness reference class. For both validation phases, firmness values decreased and R680 increased for increasing alphabetical order of image-based class letter, reflecting the ripening process. Moreover, 70% (season 1) and 80% (season 2) of the samples below bruise susceptibility firmness were classified into class D.

PRACTICAL APPLICATION

This work proposes and validates a procedure for assessing peach ripeness through spectral imaging. The control of ripeness in this fruit is crucial for ensuring its quality and the measurement of optimum peach ripeness at harvest and postharvest is a controversial issue, which needs to be balanced between a minimum ripeness, acceptable for the consumer, and a maximum ripeness, to minimize fruit losses during the postharvest process. The proposed method is nondestructive and quick, showing thus, a good perspective for its application in fresh fruit packing lines, either for peach ripeness assessment or for other fruits (providing adequate calibration).