1
|
Tang H, Cheng X, Yu Q, Zhang J, Wang N, Liu L. Improved Transformer for Time Series Senescence Root Recognition. PLANT PHENOMICS (WASHINGTON, D.C.) 2024; 6:0159. [PMID: 38629083 PMCID: PMC11018523 DOI: 10.34133/plantphenomics.0159] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Accepted: 02/24/2024] [Indexed: 04/19/2024]
Abstract
The root is an important organ for plants to obtain nutrients and water, and its phenotypic characteristics are closely related to its functions. Deep-learning-based high-throughput in situ root senescence feature extraction has not yet been published. In light of this, this paper suggests a technique based on the transformer neural network for retrieving cotton's in situ root senescence properties. High-resolution in situ root pictures with various levels of senescence are the main subject of the investigation. By comparing the semantic segmentation of the root system by general convolutional neural networks and transformer neural networks, SegFormer-UN (large) achieves the optimal evaluation metrics with mIoU, mRecall, mPrecision, and mF1 metric values of 81.52%, 86.87%, 90.98%, and 88.81%, respectively. The segmentation results indicate more accurate predictions at the connections of root systems in the segmented images. In contrast to 2 algorithms for cotton root senescence extraction based on deep learning and image processing, the in situ root senescence recognition algorithm using the SegFormer-UN model has a parameter count of 5.81 million and operates at a fast speed, approximately 4 min per image. It can accurately identify senescence roots in the image. We propose that the SegFormer-UN model can rapidly and nondestructively identify senescence root in in situ root images, providing important methodological support for efficient crop senescence research.
Collapse
Affiliation(s)
- Hui Tang
- College of Mechanical and Electrical Engineering,
Hebei Agricultural University, 071000 Baoding, China
| | - Xue Cheng
- College of Mechanical and Electrical Engineering,
Hebei Agricultural University, 071000 Baoding, China
| | - Qiushi Yu
- College of Mechanical and Electrical Engineering,
Hebei Agricultural University, 071000 Baoding, China
| | - JiaXi Zhang
- College of Mechanical and Electrical Engineering,
Hebei Agricultural University, 071000 Baoding, China
| | - Nan Wang
- College of Mechanical and Electrical Engineering,
Hebei Agricultural University, 071000 Baoding, China
- State Key Laboratory of North China Crop Improvement and Regulation,
Hebei Agricultural University, 071000 Baoding, China
| | - Liantao Liu
- State Key Laboratory of North China Crop Improvement and Regulation,
Hebei Agricultural University, 071000 Baoding, China
| |
Collapse
|
2
|
Amelio A, Bonifazi G, Corradini E, Di Saverio S, Marchetti M, Ursino D, Virgili L. Defining a deep neural network ensemble for identifying fabric colors. Appl Soft Comput 2022. [DOI: 10.1016/j.asoc.2022.109687] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
3
|
Yang Z, Leng L, Li M, Chu J. A computer-aid multi-task light-weight network for macroscopic feces diagnosis. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 81:15671-15686. [PMID: 35250359 PMCID: PMC8884099 DOI: 10.1007/s11042-022-12565-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/18/2021] [Revised: 06/15/2021] [Accepted: 01/31/2022] [Indexed: 06/14/2023]
Abstract
The abnormal traits and colors of feces typically indicate that the patients are probably suffering from tumor or digestive-system diseases. Thus a fast, accurate and automatic health diagnosis system based on feces is urgently necessary for improving the examination speed and reducing the infection risk. The rarity of the pathological images would deteriorate the accuracy performance of the trained models. In order to alleviate this problem, we employ augmentation and over-sampling to expand the samples of the classes that have few samples in the training batch. In order to achieve an impressive recognition performance and leverage the latent correlation between the traits and colors of feces pathological samples, a multi-task network is developed to recognize colors and traits of the macroscopic feces images. The parameter number of a single multi-task network is generally much smaller than the total parameter number of multiple single-task networks, so the storage cost is reduced. The loss function of the multi-task network is the weighted sum of the losses of the two tasks. In this paper, the weights of the tasks are determined according to their difficulty levels that are measured by the fitted linear functions. The sufficient experiments confirm that the proposed method can yield higher accuracies, and the efficiency is also improved.
Collapse
Affiliation(s)
- Ziyuan Yang
- School of Software, Nanchang Hangkong University, Nanchang, 330063 People’s Republic of China
- College of Computer Science, Sichuan University, Chengdu, 610065 People’s Republic of China
| | - Lu Leng
- School of Software, Nanchang Hangkong University, Nanchang, 330063 People’s Republic of China
- School of Electrical and Electronic Engineering, College of Engineering, Yonsei University, Seoul, 120749 Republic of Korea
| | - Ming Li
- School of Information Engineering, Nanchang Hangkong University, Nanchang, 330063 People’s Republic of China
| | - Jun Chu
- School of Software, Nanchang Hangkong University, Nanchang, 330063 People’s Republic of China
| |
Collapse
|
4
|
Abstract
At present, diverse, innovative technology is used in electronics and ubiquitous computing environments [...]
Collapse
|
5
|
Paxinou E, Kalles D, Panagiotakopoulos CT, Verykios VS. Analyzing Sequence Data with Markov Chain Models in Scientific Experiments. ACTA ACUST UNITED AC 2021; 2:385. [PMID: 34308368 PMCID: PMC8294291 DOI: 10.1007/s42979-021-00768-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2021] [Accepted: 07/04/2021] [Indexed: 11/05/2022]
Abstract
Virtual reality-based instruction is becoming an important resource to improve learning outcomes and communicate hands-on skills in science laboratory courses. Our study attempts first to investigate whether a Markov chain model can predict the students’ performance in conducting an experiment and whether simulations improve learner achievement in handling lab equipment and conducting science experiments in physical labs. In the present study, three cohorts of graduate students are trained on a microscopy experiment using different teaching methodologies. The effectiveness of the teaching strategies is evaluated by observing the sequences of students’ actions, while engaging in the microscopy experiment in real-lab situations. The students’ ability in performing the science experiment is estimated by sequential analysis using a Markov chain model. According to the Markov chain analysis, the students who are trained via a virtual reality software exhibit a higher probability to perform the steps of the experiment without difficulty and without assistance than their fellow students who attend more traditional training scenarios. Our study indicates that a Markov chain model is a powerful tool that can lead to a dynamic evaluation of the students’ performance in science experiments by tracing the students’ knowledge states and by predicting their innate abilities.
Collapse
Affiliation(s)
- Evgenia Paxinou
- School of Science and Technology, Hellenic Open University, Patras, Greece
| | - Dimitrios Kalles
- School of Science and Technology, Hellenic Open University, Patras, Greece
| | | | | |
Collapse
|
6
|
Lay-Ekuakille A, Djungha Okitadiowo JP, Di Luccio D, Palmisano M, Budillon G, Benassai G, Maggi S. Image Sensors for Wave Monitoring in Shore Protection: Characterization through a Machine Learning Algorithm. SENSORS 2021; 21:s21124203. [PMID: 34207454 PMCID: PMC8234781 DOI: 10.3390/s21124203] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/10/2021] [Revised: 06/06/2021] [Accepted: 06/15/2021] [Indexed: 12/03/2022]
Abstract
Waves propagating on the water surface can be considered as propagating in a dispersive medium, where gravity and surface tension at the air–water interface act as restoring forces. The velocity at which energy is transported in water waves is defined by the group velocity. The paper reports the use of video-camera observations to study the impact of water waves on an urban shore. The video-monitoring system consists of two separate cameras equipped with progressive RGB CMOS sensors that allow 1080p HDTV video recording. The sensing system delivers video signals that are processed by a machine learning technique. The scope of the research is to identify features of water waves that cannot be normally observed. First, a conventional modelling was performed using data delivered by image sensors together with additional data such as temperature, and wind speed, measured with dedicated sensors. Stealth waves are detected, as are the inverting phenomena encompassed in waves. This latter phenomenon can be detected only through machine learning. This double approach allows us to prevent extreme events that can take place in offshore and onshore areas.
Collapse
Affiliation(s)
- Aimé Lay-Ekuakille
- Department of Innovation Engineering, University of Salento, 73100 Lecce, Italy
- Correspondence: ; Tel.: +39-0832-297-822-821; Fax: +39-0832-297-827
| | | | - Diana Di Luccio
- Science and Technologies Department, University of Naples “Parthenope”, 80133 Naples, Italy; (D.D.L.); (G.B.)
| | - Maurizio Palmisano
- CNR, National Research Council, Experimental Research Center, 82100 Benevento, Italy;
| | - Giorgio Budillon
- Science and Technologies Department, University of Naples “Parthenope”, 80133 Naples, Italy; (D.D.L.); (G.B.)
| | - Guido Benassai
- Engineering Department, University of Naples “Parthenope”, 80133 Naples, Italy;
| | - Sabino Maggi
- CNR, National Research Council, Institute of Atmospheric Pollution Research, 70126 Bari, Italy;
- Faculty of Engineering, International Telematic University UniNettuno, 00186 Rome, Italy
| |
Collapse
|
7
|
A Light-Weight Practical Framework for Feces Detection and Trait Recognition. SENSORS 2020; 20:s20092644. [PMID: 32384651 PMCID: PMC7248729 DOI: 10.3390/s20092644] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/10/2020] [Revised: 05/04/2020] [Accepted: 05/05/2020] [Indexed: 12/14/2022]
Abstract
Fecal trait examinations are critical in the clinical diagnosis of digestive diseases, and they can effectively reveal various aspects regarding the health of the digestive system. An automatic feces detection and trait recognition system based on a visual sensor could greatly alleviate the burden on medical inspectors and overcome many sanitation problems, such as infections. Unfortunately, the lack of digital medical images acquired with camera sensors due to patient privacy has obstructed the development of fecal examinations. In general, the computing power of an automatic fecal diagnosis machine or a mobile computer-aided diagnosis device is not always enough to run a deep network. Thus, a light-weight practical framework is proposed, which consists of three stages: illumination normalization, feces detection, and trait recognition. Illumination normalization effectively suppresses the illumination variances that degrade the recognition accuracy. Neither the shape nor the location is fixed, so shape-based and location-based object detection methods do not work well in this task. Meanwhile, this leads to a difficulty in labeling the images for training convolutional neural networks (CNN) in detection. Our segmentation scheme is free from training and labeling. The feces object is accurately detected with a well-designed threshold-based segmentation scheme on the selected color component to reduce the background disturbance. Finally, the preprocessed images are categorized into five classes with a light-weight shallow CNN, which is suitable for feces trait examinations in real hospital environments. The experiment results from our collected dataset demonstrate that our framework yields a satisfactory accuracy of 98.4%, while requiring low computational complexity and storage.
Collapse
|
8
|
Optimizing the Performance of Breast Cancer Classification by Employing the Same Domain Transfer Learning from Hybrid Deep Convolutional Neural Network Model. ELECTRONICS 2020. [DOI: 10.3390/electronics9030445] [Citation(s) in RCA: 39] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Breast cancer is a significant factor in female mortality. An early cancer diagnosis leads to a reduction in the breast cancer death rate. With the help of a computer-aided diagnosis system, the efficiency increased, and the cost was reduced for the cancer diagnosis. Traditional breast cancer classification techniques are based on handcrafted features techniques, and their performance relies upon the chosen features. They also are very sensitive to different sizes and complex shapes. However, histopathological breast cancer images are very complex in shape. Currently, deep learning models have become an alternative solution for diagnosis, and have overcome the drawbacks of classical classification techniques. Although deep learning has performed well in various tasks of computer vision and pattern recognition, it still has some challenges. One of the main challenges is the lack of training data. To address this challenge and optimize the performance, we have utilized a transfer learning technique which is where the deep learning models train on a task, and then fine-tune the models for another task. We have employed transfer learning in two ways: Training our proposed model first on the same domain dataset, then on the target dataset, and training our model on a different domain dataset, then on the target dataset. We have empirically proven that the same domain transfer learning optimized the performance. Our hybrid model of parallel convolutional layers and residual links is utilized to classify hematoxylin–eosin-stained breast biopsy images into four classes: invasive carcinoma, in-situ carcinoma, benign tumor and normal tissue. To reduce the effect of overfitting, we have augmented the images with different image processing techniques. The proposed model achieved state-of-the-art performance, and it outperformed the latest methods by achieving a patch-wise classification accuracy of 90.5%, and an image-wise classification accuracy of 97.4% on the validation set. Moreover, we have achieved an image-wise classification accuracy of 96.1% on the test set of the microscopy ICIAR-2018 dataset.
Collapse
|