Apple quality identification and classification by image processing based on convolutional neural networks

Unique Plant Resources and Distribution Patterns in the Valley Forest of the Irtysh River Basin

The river valley forests of the Irtysh River Basin are a germplasm bank of Salicaceae species and rare plant resources in China, and the distribution varies with the river and is highly distinctive. However, there is a dearth of systematic research on the characteristics of plant resources. In this study, a comprehensive investigation was conducted in the trunk stream and six tributaries with valley forest distribution in the Irtysh River Basin, and 244 quadrats were set up. The analysis focused on the composition of the flora and resource characteristics. The results reveal the following: (1) The valley forests of the Irtysh River Basin contain 256 species of plants belonging to 57 families and 178 genera, among which 19 species of trees, 23 species of shrubs, and 214 species of herbs were investigated. (2) Among the identified species, 226 (88.67%) were recognized as resource plants, with medicinal plants being the most abundant (176 species, 68.75% of the total). (3) The distribution patterns of trees, shrubs, and herbs of each resource type vary across rivers. Elevation drop, river length, and river distance all significantly affect the number of specie. This study elucidated the current status and distributional characteristics of plant resources in the valley forests of the Irtysh River Basin, which is essential for both biodiversity conservation and sustainable resource utilization.

Quasi Real-Time Apple Defect Segmentation Using Deep Learning

Defect segmentation of apples is an important task in the agriculture industry for quality control and food safety. In this paper, we propose a deep learning approach for the automated segmentation of apple defects using convolutional neural networks (CNNs) based on a U-shaped architecture with skip-connections only within the noise reduction block. An ad-hoc data synthesis technique has been designed to increase the number of samples and at the same time to reduce neural network overfitting. We evaluate our model on a dataset of multi-spectral apple images with pixel-wise annotations for several types of defects. In this paper, we show that our proposal outperforms in terms of segmentation accuracy general-purpose deep learning architectures commonly used for segmentation tasks. From the application point of view, we improve the previous methods for apple defect segmentation. A measure of the computational cost shows that our proposal can be employed in real-time (about 100 frame-per-second on GPU) and in quasi-real-time (about 7/8 frame-per-second on CPU) visual-based apple inspection. To further improve the applicability of the method, we investigate the potential of using only RGB images instead of multi-spectral images as input images. The results prove that the accuracy in this case is almost comparable with the multi-spectral case.

Recognition of liver tumors by predicted hyperspectral features based on patient's Computed Tomography radiomics features

BACKGROUND

Primary liver tumors have posed a serious threat to human life and health, and their early diagnosis is urgent. Therefore, enhancing the accuracy of non-invasive early detection of liver tumors is imperative.

METHODS

Firstly, image enhancement was applied to augment the dataset, resulting in a total of 464 samples after employing seven data augmentation methods. Subsequently, the XGBoost model was utilized to construct and learn the mapping relationship between Computed Tomography (CT) and corresponding hyperspectral imaging (HSI) data. This model enables the prediction of HSI features corresponding to CT features, thereby enriching CT with more comprehensive hyperspectral information.

RESULTS

Four classifiers were employed to discern the presence of tumors in patients. The results demonstrated exceptional performance, with a classification accuracy exceeding 90%.

CONCLUSIONS

This study proposes an artificial intelligence-based methodology that utilizes early CT radiomics features to predict HSI features. Subsequently, the results are utilized for non-invasive tumor prediction and early screening, thereby enhancing the accuracy of non-invasive liver tumor detection.

Analyzing the Quality Parameters of Apples by Spectroscopy from Vis/NIR to NIR Region: A Comprehensive Review

Spectroscopic methods deliver a valuable non-destructive analytical tool that provides simultaneous qualitative and quantitative characterization of various samples. Apples belong to the world's most consumed crops and with the current challenges of climate change and human impacts on the environment, maintaining high-quality apple production has become critical. This review comprehensively analyzes the application of spectroscopy in near-infrared (NIR) and visible (Vis) regions, which not only show particular potential in evaluating the quality parameters of apples but also in optimizing their production and supply routines. This includes the assessment of the external and internal characteristics such as color, size, shape, surface defects, soluble solids content (SSC), total titratable acidity (TA), firmness, starch pattern index (SPI), total dry matter concentration (DM), and nutritional value. The review also summarizes various techniques and approaches used in Vis/NIR studies of apples, such as authenticity, origin, identification, adulteration, and quality control. Optical sensors and associated methods offer a wide suite of solutions readily addressing the main needs of the industry in practical routines as well, e.g., efficient sorting and grading of apples based on sweetness and other quality parameters, facilitating quality control throughout the production and supply chain. This review also evaluates ongoing development trends in the application of handheld and portable instruments operating in the Vis/NIR and NIR spectral regions for apple quality control. The use of these technologies can enhance apple crop quality, maintain competitiveness, and meet the demands of consumers, making them a crucial topic in the apple industry. The focal point of this review is placed on the literature published in the last five years, with the exceptions of seminal works that have played a critical role in shaping the field or representative studies that highlight the progress made in specific areas.

Deep Learning-Based Intelligent Apple Variety Classification System and Model Interpretability Analysis

In this study, series networks (AlexNet and VGG-19) and directed acyclic graph (DAG) networks (ResNet-18, ResNet-50, and ResNet-101) with transfer learning were employed to identify and classify 13 classes of apples from 7439 images. Two training datasets, model evaluation metrics, and three visualization methods were used to objectively assess, compare, and interpret five Convolutional Neural Network (CNN)-based models. The results show that the dataset configuration had a significant impact on the classification results, as all models achieved over 96.1% accuracy on dataset A (training-to-testing = 2.4:1.0) compared to 89.4-93.9% accuracy on dataset B (training-to-testing = 1.0:3.7). VGG-19 achieved the highest accuracy of 100.0% on dataset A and 93.9% on dataset B. Moreover, for networks of the same framework, the model size, accuracy, and training and testing times increased as the model depth (number of layers) increased. Furthermore, feature visualization, strongest activations, and local interpretable model-agnostic explanations techniques were used to show the understanding of apple images by different trained models, as well as to reveal how and why the models make classification decisions. These results improve the interpretability and credibility of CNN-based models, which provides guidance for future applications of deep learning methods in agriculture.

Real-Time Grading of Defect Apples Using Semantic Segmentation Combination with a Pruned YOLO V4 Network

At present, the apple grading system usually conveys apples by a belt or rollers. This usually leads to low hardness or expensive fruits being bruised, resulting in economic losses. In order to realize real-time detection and classification of high-quality apples, separate fruit trays were designed to convey apples and used to prevent apples from being bruised during image acquisition. A semantic segmentation method based on the BiSeNet V2 deep learning network was proposed to segment the defective parts of defective apples. BiSeNet V2 for apple defect detection obtained a slightly better result in MPA with a value of 99.66%, which was 0.14 and 0.19 percentage points higher than DAnet and Unet, respectively. A model pruning method was used to optimize the structure of the YOLO V4 network. The detection accuracy of defect regions in apple images was further improved by the pruned YOLO V4 network. Then, a surface mapping method between the defect area in apple images and the actual defect area was proposed to accurately calculate the defect area. Finally, apples on separate fruit trays were sorted according to the number and area of defects in the apple images. The experimental results showed that the average accuracy of apple classification was 92.42%, and the F1 score was 94.31. In commercial separate fruit tray grading and sorting machines, it has great application potential.

Circle Fitting Based Image Segmentation and Multi-Scale Block Local Binary Pattern Based Distinction of Ring Rot and Anthracnose on Apple Fruits

Ring rot caused by Botryosphaeria dothidea and anthracnose caused by Colletotrichum gloeosporioides are two important apple fruit diseases. It is critical to conduct timely and accurate distinction and diagnosis of the two diseases for apple disease management and apple quality control. The automatic distinction between the two diseases was investigated based on image processing technology in this study. The acquired disease images were preprocessed via image scaling, color image contrast stretching, and morphological opening and closing reconstruction. Then, two lesion segmentation methods based on circle fitting were proposed and used to conduct lesion segmentation. After comparison with the manual segmentation results obtained via the software Adobe Photoshop CC, Lesion segmentation method 1 was chosen for further disease image processing. The gray images on the nine components in the RGB, HSI, and L*a*b* color spaces of the segmented lesion images were filtered by using multi-scale block local binary pattern operators with the sizes of pixel blocks of 1 × 1, 2 × 2, and 3 × 3, respectively, and the corresponding local binary pattern (LBP) histogram vectors were calculated as the features of the lesion images. Subsequently, support vector machine (SVM) models and random forest models were built based on individual LBP histogram features or different LBP histogram feature combinations for distinguishing the diseases. The optimal SVM model with the distinction accuracies of the training and testing sets equal to 100 and 95.12% and the optimal random forest model with the distinction accuracies of the training and testing sets equal to 100 and 90.24% were achieved. The results indicated that the distinction between the two diseases could be implemented with high accuracy by using the proposed method. In this study, a method based on image processing technology was provided for the distinction of ring rot and anthracnose on apple fruits.

Complete chloroplast genome studies of different apple varieties indicated the origin of modern cultivated apples from Malus sieversii and Malus sylvestris

Background

Apple is one of the most important temperate deciduous fruit trees worldwide, with a wide range of cultivation. In this study, we assessed the variations and phylogenetic relationships between the complete chloroplast genomes of wild and cultivated apples (Malus spp.).

Method

We obtained the complete chloroplast genomes of 24 apple varieties using next-generation sequencing technology and compared them with genomes of (downloaded from NCBI) the wild species.

Result

The chloroplast genome of Malus is highly conserved, with a genome length of 160,067-160,290 bp, and all have a double-stranded circular tetrad structure. The gene content and sequences of genomes of wild species and cultivated apple were almost the same, but several mutation hotspot regions (psbI-atpA, psbM-psbD, and ndhC-atpE) were detected in these genomes. These regions can provide valuable information for solving specific molecular markers in taxonomic research. Phylogenetic analysis revealed that Malus formed a new clade and four cultivated varieties clustered into a branch with M. sylvestris and M. sieversii, which indicated that M. sylvestris and M. sieversii were the ancestor species of the cultivated apple.

Remote drain inspection framework using the convolutional neural network and re-configurable robot Raptor

Drain blockage is a crucial problem in the urban environment. It heavily affects the ecosystem and human health. Hence, routine drain inspection is essential for urban environment. Manual drain inspection is a tedious task and prone to accidents and water-borne diseases. This work presents a drain inspection framework using convolutional neural network (CNN) based object detection algorithm and in house developed reconfigurable teleoperated robot called 'Raptor'. The CNN based object detection model was trained using a transfer learning scheme with our custom drain-blocking objects data-set. The efficiency of the trained CNN algorithm and drain inspection robot Raptor was evaluated through various real-time drain inspection field trial. The experimental results indicate that our trained object detection algorithm has detect and classified the drain blocking objects with 91.42% accuracy for both offline and online test images and is able to process 18 frames per second (FPS). Further, the maneuverability of the robot was evaluated from various open and closed drain environment. The field trial results ensure that the robot maneuverability was stable, and its mapping and localization is also accurate in a complex drain environment.