1
|
Teramoto S, Uga Y. Convolutional neural networks combined with conventional filtering to semantically segment plant roots in rapidly scanned X-ray computed tomography volumes with high noise levels. PLANT METHODS 2024; 20:73. [PMID: 38773503 PMCID: PMC11106967 DOI: 10.1186/s13007-024-01208-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/09/2023] [Accepted: 05/15/2024] [Indexed: 05/23/2024]
Abstract
BACKGROUND X-ray computed tomography (CT) is a powerful tool for measuring plant root growth in soil. However, a rapid scan with larger pots, which is required for throughput-prioritized crop breeding, results in high noise levels, low resolution, and blurred root segments in the CT volumes. Moreover, while plant root segmentation is essential for root quantification, detailed conditional studies on segmenting noisy root segments are scarce. The present study aimed to investigate the effects of scanning time and deep learning-based restoration of image quality on semantic segmentation of blurry rice (Oryza sativa) root segments in CT volumes. RESULTS VoxResNet, a convolutional neural network-based voxel-wise residual network, was used as the segmentation model. The training efficiency of the model was compared using CT volumes obtained at scan times of 33, 66, 150, 300, and 600 s. The learning efficiencies of the samples were similar, except for scan times of 33 and 66 s. In addition, The noise levels of predicted volumes differd among scanning conditions, indicating that the noise level of a scan time ≥ 150 s does not affect the model training efficiency. Conventional filtering methods, such as median filtering and edge detection, increased the training efficiency by approximately 10% under any conditions. However, the training efficiency of 33 and 66 s-scanned samples remained relatively low. We concluded that scan time must be at least 150 s to not affect segmentation. Finally, we constructed a semantic segmentation model for 150 s-scanned CT volumes, for which the Dice loss reached 0.093. This model could not predict the lateral roots, which were not included in the training data. This limitation will be addressed by preparing appropriate training data. CONCLUSIONS A semantic segmentation model can be constructed even with rapidly scanned CT volumes with high noise levels. Given that scanning times ≥ 150 s did not affect the segmentation results, this technique holds promise for rapid and low-dose scanning. This study offers insights into images other than CT volumes with high noise levels that are challenging to determine when annotating.
Collapse
Affiliation(s)
- Shota Teramoto
- Institute of Crop Sciences, National Agriculture & Food Research Organization, Tsukuba, Ibaraki, 305-8602, Japan.
| | - Yusaku Uga
- Institute of Crop Sciences, National Agriculture & Food Research Organization, Tsukuba, Ibaraki, 305-8602, Japan
| |
Collapse
|
2
|
Harandi N, Vandenberghe B, Vankerschaver J, Depuydt S, Van Messem A. How to make sense of 3D representations for plant phenotyping: a compendium of processing and analysis techniques. PLANT METHODS 2023; 19:60. [PMID: 37353846 DOI: 10.1186/s13007-023-01031-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Accepted: 05/19/2023] [Indexed: 06/25/2023]
Abstract
Computer vision technology is moving more and more towards a three-dimensional approach, and plant phenotyping is following this trend. However, despite its potential, the complexity of the analysis of 3D representations has been the main bottleneck hindering the wider deployment of 3D plant phenotyping. In this review we provide an overview of typical steps for the processing and analysis of 3D representations of plants, to offer potential users of 3D phenotyping a first gateway into its application, and to stimulate its further development. We focus on plant phenotyping applications where the goal is to measure characteristics of single plants or crop canopies on a small scale in research settings, as opposed to large scale crop monitoring in the field.
Collapse
Affiliation(s)
- Negin Harandi
- Center for Biosystems and Biotech Data Science, Ghent University Global Campus, 119 Songdomunhwa-ro, Yeonsu-gu, Incheon, South Korea
- Department of Applied Mathematics, Computer Science and Statistics, Ghent University, Krijgslaan 281, S9, Ghent, Belgium
| | | | - Joris Vankerschaver
- Center for Biosystems and Biotech Data Science, Ghent University Global Campus, 119 Songdomunhwa-ro, Yeonsu-gu, Incheon, South Korea
- Department of Applied Mathematics, Computer Science and Statistics, Ghent University, Krijgslaan 281, S9, Ghent, Belgium
| | - Stephen Depuydt
- Erasmus Applied University of Sciences and Arts, Campus Kaai, Nijverheidskaai 170, Anderlecht, Belgium
| | - Arnout Van Messem
- Department of Mathematics, Université de Liège, Allée de la Découverte 12, Liège, Belgium.
| |
Collapse
|
3
|
Barron A. Applications of Microct Imaging to Archaeobotanical Research. JOURNAL OF ARCHAEOLOGICAL METHOD AND THEORY 2023:1-36. [PMID: 37359278 PMCID: PMC10225294 DOI: 10.1007/s10816-023-09610-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 04/05/2023] [Indexed: 06/28/2023]
Abstract
The potential applications of microCT scanning in the field of archaeobotany are only just beginning to be explored. The imaging technique can extract new archaeobotanical information from existing archaeobotanical collections as well as create new archaeobotanical assemblages within ancient ceramics and other artefact types. The technique could aid in answering archaeobotanical questions about the early histories of some of the world's most important food crops from geographical regions with amongst the poorest rates of archaeobotanical preservation and where ancient plant exploitation remains poorly understood. This paper reviews current uses of microCT imaging in the investigation of archaeobotanical questions, as well as in cognate fields of geosciences, geoarchaeology, botany and palaeobotany. The technique has to date been used in a small number of novel methodological studies to extract internal anatomical morphologies and three-dimensional quantitative data from a range of food crops, which includes sexually-propagated cereals and legumes, and asexually-propagated underground storage organs (USOs). The large three-dimensional, digital datasets produced by microCT scanning have been shown to aid in taxonomic identification of archaeobotanical specimens, as well as robustly assess domestication status. In the future, as scanning technology, computer processing power and data storage capacities continue to improve, the possible applications of microCT scanning to archaeobotanical studies will only increase with the development of machine and deep learning networks enabling the automation of analyses of large archaeobotanical assemblages.
Collapse
Affiliation(s)
- Aleese Barron
- School of Archaeology and Anthropology, Australian National University, Banks Building, Canberra, Canberra ACT 2601 Australia
- Department of Materials Physics, Research School of Physics, Australian National University, Canberra, Canberra ACT 2601 Australia
| |
Collapse
|
4
|
Alle J, Gruber R, Wörlein N, Uhlmann N, Claußen J, Wittenberg T, Gerth S. 3D segmentation of plant root systems using spatial pyramid pooling and locally adaptive field-of-view inference. FRONTIERS IN PLANT SCIENCE 2023; 14:1120189. [PMID: 37082341 PMCID: PMC10110838 DOI: 10.3389/fpls.2023.1120189] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Accepted: 03/13/2023] [Indexed: 05/03/2023]
Abstract
Background The non-invasive 3D-imaging and successive 3D-segmentation of plant root systems has gained interest within fundamental plant research and selectively breeding resilient crops. Currently the state of the art consists of computed tomography (CT) scans and reconstruction followed by an adequate 3D-segmentation process. Challenge Generating an exact 3D-segmentation of the roots becomes challenging due to inhomogeneous soil composition, as well as high scale variance in the root structures themselves. Approach (1) We address the challenge by combining deep convolutional neural networks (DCNNs) with a weakly supervised learning paradigm. Furthermore, (2) we apply a spatial pyramid pooling (SPP) layer to cope with the scale variance of roots. (3) We generate a fine-tuned training data set with a specialized sub-labeling technique. (4) Finally, to yield fast and high-quality segmentations, we propose a specialized iterative inference algorithm, which locally adapts the field of view (FoV) for the network. Experiments We compare our segmentation results against an analytical reference algorithm for root segmentation (RootForce) on a set of roots from Cassava plants and show qualitatively that an increased amount of root voxels and root branches can be segmented. Results Our findings show that with the proposed DCNN approach combined with the dynamic inference, much more, and especially fine, root structures can be detected than with a classical analytical reference method. Conclusion We show that the application of the proposed DCNN approach leads to better and more robust root segmentation, especially for very small and thin roots.
Collapse
Affiliation(s)
- Jonas Alle
- Fraunhofer Institut für Integrierte Schaltungen (IIS), Fraunhofer Institute for Integrated Circuits Institut für Integrierte Schaltungen (IIS), Division Development Center X-Ray Technology, Fürth, Germany
| | - Roland Gruber
- Fraunhofer Institut für Integrierte Schaltungen (IIS), Fraunhofer Institute for Integrated Circuits Institut für Integrierte Schaltungen (IIS), Division Development Center X-Ray Technology, Fürth, Germany
- Friedrich-Alexander-Universität Erlangen-Nürnberg, Chair for Visual Computing, Erlangen, Germany
| | - Norbert Wörlein
- Fraunhofer Institut für Integrierte Schaltungen (IIS), Fraunhofer Institute for Integrated Circuits Institut für Integrierte Schaltungen (IIS), Division Development Center X-Ray Technology, Fürth, Germany
| | - Norman Uhlmann
- Fraunhofer Institut für Integrierte Schaltungen (IIS), Fraunhofer Institute for Integrated Circuits Institut für Integrierte Schaltungen (IIS), Division Development Center X-Ray Technology, Fürth, Germany
| | - Joelle Claußen
- Fraunhofer Institut für Integrierte Schaltungen (IIS), Fraunhofer Institute for Integrated Circuits Institut für Integrierte Schaltungen (IIS), Division Development Center X-Ray Technology, Fürth, Germany
| | - Thomas Wittenberg
- Friedrich-Alexander-Universität Erlangen-Nürnberg, Chair for Visual Computing, Erlangen, Germany
- Fraunhofer Institut für Integrierte Schaltungen (IIS), Fraunhofer Institute for Integrated Circuits Institut für Integrierte Schaltungen (IIS), Division Smart Sensors and Electronics, Erlangen, Germany
| | - Stefan Gerth
- Fraunhofer Institut für Integrierte Schaltungen (IIS), Fraunhofer Institute for Integrated Circuits Institut für Integrierte Schaltungen (IIS), Division Development Center X-Ray Technology, Fürth, Germany
- *Correspondence: Stefan Gerth,
| |
Collapse
|
5
|
Herrero-Huerta M, Raumonen P, Gonzalez-Aguilera D. 4DRoot: Root phenotyping software for temporal 3D scans by X-ray computed tomography. FRONTIERS IN PLANT SCIENCE 2022; 13:986856. [PMID: 36212319 PMCID: PMC9539560 DOI: 10.3389/fpls.2022.986856] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Accepted: 08/23/2022] [Indexed: 06/16/2023]
Abstract
Currently, plant phenomics is considered the key to reducing the genotype-to-phenotype knowledge gap in plant breeding. In this context, breakthrough imaging technologies have demonstrated high accuracy and reliability. The X-ray computed tomography (CT) technology can noninvasively scan roots in 3D; however, it is urgently required to implement high-throughput phenotyping procedures and analyses to increase the amount of data to measure more complex root phenotypic traits. We have developed a spatial-temporal root architectural modeling software tool based on 4D data from temporal X-ray CT scans. Through a cylinder fitting, we automatically extract significant root architectural traits, distribution, and hierarchy. The open-source software tool is named 4DRoot and implemented in MATLAB. The source code is freely available at https://github.com/TIDOP-USAL/4DRoot. In this research, 3D root scans from the black walnut tree were analyzed, a punctual scan for the spatial study and a weekly time-slot series for the temporal one. 4DRoot provides breeders and root biologists an objective and useful tool to quantify carbon sequestration throw trait extraction. In addition, 4DRoot could help plant breeders to improve plants to meet the food, fuel, and fiber demands in the future, in order to increase crop yield while reducing farming inputs.
Collapse
Affiliation(s)
- Monica Herrero-Huerta
- Department of Cartographic and Land Engineering, Higher Polytechnic School of Ávila, Universidad de Salamanca, Ávila, Spain
| | - Pasi Raumonen
- Department of Computing Sciences, Tampere University, Tampere, Finland
| | - Diego Gonzalez-Aguilera
- Department of Cartographic and Land Engineering, Higher Polytechnic School of Ávila, Universidad de Salamanca, Ávila, Spain
| |
Collapse
|
6
|
Lucas M, Nguyen LTT, Guber A, Kravchenko AN. Cover crop influence on pore size distribution and biopore dynamics: Enumerating root and soil faunal effects. FRONTIERS IN PLANT SCIENCE 2022; 13:928569. [PMID: 36160999 PMCID: PMC9491155 DOI: 10.3389/fpls.2022.928569] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/25/2022] [Accepted: 08/05/2022] [Indexed: 06/16/2023]
Abstract
Pore structure is a key determinant of soil functioning, and both root growth and activity of soil fauna are modified by and interact with pore structure in multiple ways. Cover cropping is a rapidly growing popular strategy for improving agricultural sustainability, including improvements in pore structure. However, since cover crop species encompass a variety of contrasting root architectures, they can have disparate effects on formation of soil pores and their characteristics, thus on the pore structure formation. Moreover, utilization of the existing pore systems and its modification by new root growth, in conjunction with soil fauna activity, can also vary by cover crop species, affecting the dynamics of biopores (creation and demolition). The objectives of this study were (i) to quantify the influence of 5 cover crop species on formation and size distribution of soil macropores (>36 μm Ø); (ii) to explore the changes in the originally developed pore architecture after an additional season of cover crop growth; and (iii) to assess the relative contributions of plant roots and soil fauna to fate and modifications of biopores. Intact soil cores were taken from 5 to 10 cm depth after one season of cover crop growth, followed by X-ray computed micro-tomography (CT) characterization, and then, the cores were reburied for a second root growing period of cover crops to explore subsequent changes in pore characteristics with the second CT scanning. Our data suggest that interactions of soil fauna and roots with pore structure changed over time. While in the first season, large biopores were created at the expense of small pores, in the second year these biopores were reused or destroyed by the creation of new ones through earthworm activities and large root growth. In addition, the creation of large biopores (>0.5 mm) increased total macroporosity. During the second root growing period, these large sized macropores, however, are reduced in size again through the action of soil fauna smaller than earthworms, suggesting a highly dynamic equilibrium. Different effects of cover crops on pore structure mainly arise from their differences in root volume, mean diameter as well as their reuse of existing macropores.
Collapse
Affiliation(s)
- Maik Lucas
- Department of Soil System Science, Helmholtz Centre for Environmental Research – UFZ, Halle, Germany
| | - Linh T. T. Nguyen
- Department of Plant, Soil and Microbial Sciences, Michigan State University, East Lansing, MI, United States
| | - Andrey Guber
- Department of Plant, Soil and Microbial Sciences, Michigan State University, East Lansing, MI, United States
| | - Alexandra N. Kravchenko
- Department of Plant, Soil and Microbial Sciences, Michigan State University, East Lansing, MI, United States
| |
Collapse
|
7
|
Teramoto S, Uga Y. Improving the efficiency of plant root system phenotyping through digitization and automation. BREEDING SCIENCE 2022; 72:48-55. [PMID: 36045896 PMCID: PMC8987843 DOI: 10.1270/jsbbs.21053] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/27/2021] [Accepted: 11/11/2021] [Indexed: 05/19/2023]
Abstract
Root system architecture (RSA) determines unevenly distributed water and nutrient availability in soil. Genetic improvement of RSA, therefore, is related to crop production. However, RSA phenotyping has been carried out less frequently than above-ground phenotyping because measuring roots in the soil is difficult and labor intensive. Recent advancements have led to the digitalization of plant measurements; this digital phenotyping has been widely used for measurements of both above-ground and RSA traits. Digital phenotyping for RSA is slower and more difficult than for above-ground traits because the roots are hidden underground. In this review, we summarized recent trends in digital phenotyping for RSA traits. We classified the sample types into three categories: soil block containing roots, section of soil block, and root sample. Examples of the use of digital phenotyping are presented for each category. We also discussed room for improvement in digital phenotyping in each category.
Collapse
Affiliation(s)
- Shota Teramoto
- Institute of Crop Science, National Agriculture and Food Research Organization, Tsukuba, Ibaraki 305-8518, Japan
| | - Yusaku Uga
- Institute of Crop Science, National Agriculture and Food Research Organization, Tsukuba, Ibaraki 305-8518, Japan
- Corresponding author (e-mail: )
| |
Collapse
|
8
|
Zeng D, Li M, Jiang N, Ju Y, Schreiber H, Chambers E, Letscher D, Ju T, Topp CN. TopoRoot: a method for computing hierarchy and fine-grained traits of maize roots from 3D imaging. PLANT METHODS 2021; 17:127. [PMID: 34903248 PMCID: PMC8667396 DOI: 10.1186/s13007-021-00829-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Accepted: 11/30/2021] [Indexed: 06/14/2023]
Abstract
BACKGROUND 3D imaging, such as X-ray CT and MRI, has been widely deployed to study plant root structures. Many computational tools exist to extract coarse-grained features from 3D root images, such as total volume, root number and total root length. However, methods that can accurately and efficiently compute fine-grained root traits, such as root number and geometry at each hierarchy level, are still lacking. These traits would allow biologists to gain deeper insights into the root system architecture. RESULTS We present TopoRoot, a high-throughput computational method that computes fine-grained architectural traits from 3D images of maize root crowns or root systems. These traits include the number, length, thickness, angle, tortuosity, and number of children for the roots at each level of the hierarchy. TopoRoot combines state-of-the-art algorithms in computer graphics, such as topological simplification and geometric skeletonization, with customized heuristics for robustly obtaining the branching structure and hierarchical information. TopoRoot is validated on both CT scans of excavated field-grown root crowns and simulated images of root systems, and in both cases, it was shown to improve the accuracy of traits over existing methods. TopoRoot runs within a few minutes on a desktop workstation for images at the resolution range of 400^3, with minimal need for human intervention in the form of setting three intensity thresholds per image. CONCLUSIONS TopoRoot improves the state-of-the-art methods in obtaining more accurate and comprehensive fine-grained traits of maize roots from 3D imaging. The automation and efficiency make TopoRoot suitable for batch processing on large numbers of root images. Our method is thus useful for phenomic studies aimed at finding the genetic basis behind root system architecture and the subsequent development of more productive crops.
Collapse
Affiliation(s)
- Dan Zeng
- Department of Computer Science and Engineering, Washington University in St. Louis, Saint Louis, MO, 63130, USA.
| | - Mao Li
- Donald Danforth Plant Science Center, Saint Louis, MO, 63132, USA
| | - Ni Jiang
- Donald Danforth Plant Science Center, Saint Louis, MO, 63132, USA
| | - Yiwen Ju
- Department of Computer Science and Engineering, Washington University in St. Louis, Saint Louis, MO, 63130, USA
| | - Hannah Schreiber
- Department of Computer Science, Saint Louis University, Saint Louis, MO, 63103, USA
| | - Erin Chambers
- Department of Computer Science, Saint Louis University, Saint Louis, MO, 63103, USA
| | - David Letscher
- Department of Computer Science, Saint Louis University, Saint Louis, MO, 63103, USA
| | - Tao Ju
- Department of Computer Science and Engineering, Washington University in St. Louis, Saint Louis, MO, 63130, USA
| | | |
Collapse
|