1
|
Mostafa S, Mondal D, Panjvani K, Kochian L, Stavness I. Explainable deep learning in plant phenotyping. Front Artif Intell 2023; 6:1203546. [PMID: 37795496 PMCID: PMC10546035 DOI: 10.3389/frai.2023.1203546] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2023] [Accepted: 08/25/2023] [Indexed: 10/06/2023] Open
Abstract
The increasing human population and variable weather conditions, due to climate change, pose a threat to the world's food security. To improve global food security, we need to provide breeders with tools to develop crop cultivars that are more resilient to extreme weather conditions and provide growers with tools to more effectively manage biotic and abiotic stresses in their crops. Plant phenotyping, the measurement of a plant's structural and functional characteristics, has the potential to inform, improve and accelerate both breeders' selections and growers' management decisions. To improve the speed, reliability and scale of plant phenotyping procedures, many researchers have adopted deep learning methods to estimate phenotypic information from images of plants and crops. Despite the successful results of these image-based phenotyping studies, the representations learned by deep learning models remain difficult to interpret, understand, and explain. For this reason, deep learning models are still considered to be black boxes. Explainable AI (XAI) is a promising approach for opening the deep learning model's black box and providing plant scientists with image-based phenotypic information that is interpretable and trustworthy. Although various fields of study have adopted XAI to advance their understanding of deep learning models, it has yet to be well-studied in the context of plant phenotyping research. In this review article, we reviewed existing XAI studies in plant shoot phenotyping, as well as related domains, to help plant researchers understand the benefits of XAI and make it easier for them to integrate XAI into their future studies. An elucidation of the representations within a deep learning model can help researchers explain the model's decisions, relate the features detected by the model to the underlying plant physiology, and enhance the trustworthiness of image-based phenotypic information used in food production systems.
Collapse
Affiliation(s)
- Sakib Mostafa
- Department of Computer Science, University of Saskatchewan, Saskatoon, SK, Canada
| | - Debajyoti Mondal
- Department of Computer Science, University of Saskatchewan, Saskatoon, SK, Canada
| | - Karim Panjvani
- Global Institute for Food Security, University of Saskatchewan, Saskatoon, SK, Canada
| | - Leon Kochian
- Global Institute for Food Security, University of Saskatchewan, Saskatoon, SK, Canada
| | - Ian Stavness
- Department of Computer Science, University of Saskatchewan, Saskatoon, SK, Canada
| |
Collapse
|
2
|
Wan X, Li Z, Yu W, Wang A, Ke X, Guo H, Su J, Li L, Gui Q, Zhao S, Robertson J, Zhang Z, Guo Y. Machine Learning Paves the Way for High Entropy Compounds Exploration: Challenges, Progress, and Outlook. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2023:e2305192. [PMID: 37688451 DOI: 10.1002/adma.202305192] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Revised: 08/08/2023] [Indexed: 09/10/2023]
Abstract
Machine learning (ML) has emerged as a powerful tool in the research field of high entropy compounds (HECs), which have gained worldwide attention due to their vast compositional space and abundant regulatability. However, the complex structure space of HEC poses challenges to traditional experimental and computational approaches, necessitating the adoption of machine learning. Microscopically, machine learning can model the Hamiltonian of the HEC system, enabling atomic-level property investigations, while macroscopically, it can analyze macroscopic material characteristics such as hardness, melting point, and ductility. Various machine learning algorithms, both traditional methods and deep neural networks, can be employed in HEC research. Comprehensive and accurate data collection, feature engineering, and model training and selection through cross-validation are crucial for establishing excellent ML models. ML also holds promise in analyzing phase structures and stability, constructing potentials in simulations, and facilitating the design of functional materials. Although some domains, such as magnetic and device materials, still require further exploration, machine learning's potential in HEC research is substantial. Consequently, machine learning has become an indispensable tool in understanding and exploiting the capabilities of HEC, serving as the foundation for the new paradigm of Artificial-intelligence-assisted material exploration.
Collapse
Affiliation(s)
- Xuhao Wan
- School of Electrical Engineering and Automation, Wuhan University, Wuhan, Hubei, 430072, China
| | - Zeyuan Li
- School of Power and Mechanical Engineering, Wuhan University, Wuhan, Hubei, 430072, China
| | - Wei Yu
- School of Electrical Engineering and Automation, Wuhan University, Wuhan, Hubei, 430072, China
| | - Anyang Wang
- School of Electrical Engineering and Automation, Wuhan University, Wuhan, Hubei, 430072, China
| | - Xue Ke
- School of Electrical Engineering and Automation, Wuhan University, Wuhan, Hubei, 430072, China
| | - Hailing Guo
- School of Electrical Engineering and Automation, Wuhan University, Wuhan, Hubei, 430072, China
| | - Jinhao Su
- School of Electrical Engineering and Automation, Wuhan University, Wuhan, Hubei, 430072, China
| | - Li Li
- The Institute of Technological Sciences, Wuhan University, Wuhan, Hubei, 430072, China
| | - Qingzhong Gui
- School of Electrical Engineering and Automation, Wuhan University, Wuhan, Hubei, 430072, China
| | - Songpeng Zhao
- The Institute of Technological Sciences, Wuhan University, Wuhan, Hubei, 430072, China
| | - John Robertson
- Department of Engineering, Cambridge University, Cambridge, CB2 1PZ, UK
| | - Zhaofu Zhang
- The Institute of Technological Sciences, Wuhan University, Wuhan, Hubei, 430072, China
| | - Yuzheng Guo
- School of Electrical Engineering and Automation, Wuhan University, Wuhan, Hubei, 430072, China
| |
Collapse
|
3
|
Ye D, Wu L, Li X, Atoba TO, Wu W, Weng H. A Synthetic Review of Various Dimensions of Non-Destructive Plant Stress Phenotyping. PLANTS (BASEL, SWITZERLAND) 2023; 12:1698. [PMID: 37111921 PMCID: PMC10146287 DOI: 10.3390/plants12081698] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Revised: 04/08/2023] [Accepted: 04/16/2023] [Indexed: 06/19/2023]
Abstract
Non-destructive plant stress phenotyping begins with traditional one-dimensional (1D) spectroscopy, followed by two-dimensional (2D) imaging, three-dimensional (3D) or even temporal-three-dimensional (T-3D), spectral-three-dimensional (S-3D), and temporal-spectral-three-dimensional (TS-3D) phenotyping, all of which are aimed at observing subtle changes in plants under stress. However, a comprehensive review that covers all these dimensional types of phenotyping, ordered in a spatial arrangement from 1D to 3D, as well as temporal and spectral dimensions, is lacking. In this review, we look back to the development of data-acquiring techniques for various dimensions of plant stress phenotyping (1D spectroscopy, 2D imaging, 3D phenotyping), as well as their corresponding data-analyzing pipelines (mathematical analysis, machine learning, or deep learning), and look forward to the trends and challenges of high-performance multi-dimension (integrated spatial, temporal, and spectral) phenotyping demands. We hope this article can serve as a reference for implementing various dimensions of non-destructive plant stress phenotyping.
Collapse
Affiliation(s)
- Dapeng Ye
- College of Mechanical and Electrical Engineering, Fujian Agriculture and Forestry University, Fuzhou 350002, China
- Fujian Key Laboratory of Agricultural Information Sensing Technology, College of Mechanical and Electrical Engineering, Fujian Agriculture and Forestry University, Fuzhou 350002, China
| | - Libin Wu
- College of Mechanical and Electrical Engineering, Fujian Agriculture and Forestry University, Fuzhou 350002, China
- Fujian Key Laboratory of Agricultural Information Sensing Technology, College of Mechanical and Electrical Engineering, Fujian Agriculture and Forestry University, Fuzhou 350002, China
| | - Xiaobin Li
- College of Mechanical and Electrical Engineering, Fujian Agriculture and Forestry University, Fuzhou 350002, China
- Fujian Key Laboratory of Agricultural Information Sensing Technology, College of Mechanical and Electrical Engineering, Fujian Agriculture and Forestry University, Fuzhou 350002, China
| | - Tolulope Opeyemi Atoba
- College of Mechanical and Electrical Engineering, Fujian Agriculture and Forestry University, Fuzhou 350002, China
- Fujian Key Laboratory of Agricultural Information Sensing Technology, College of Mechanical and Electrical Engineering, Fujian Agriculture and Forestry University, Fuzhou 350002, China
| | - Wenhao Wu
- College of Mechanical and Electrical Engineering, Fujian Agriculture and Forestry University, Fuzhou 350002, China
- Fujian Key Laboratory of Agricultural Information Sensing Technology, College of Mechanical and Electrical Engineering, Fujian Agriculture and Forestry University, Fuzhou 350002, China
| | - Haiyong Weng
- College of Mechanical and Electrical Engineering, Fujian Agriculture and Forestry University, Fuzhou 350002, China
- Fujian Key Laboratory of Agricultural Information Sensing Technology, College of Mechanical and Electrical Engineering, Fujian Agriculture and Forestry University, Fuzhou 350002, China
| |
Collapse
|
4
|
Harfouche AL, Nakhle F, Harfouche AH, Sardella OG, Dart E, Jacobson D. A primer on artificial intelligence in plant digital phenomics: embarking on the data to insights journey. TRENDS IN PLANT SCIENCE 2023; 28:154-184. [PMID: 36167648 DOI: 10.1016/j.tplants.2022.08.021] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Revised: 08/22/2022] [Accepted: 08/25/2022] [Indexed: 06/16/2023]
Abstract
Artificial intelligence (AI) has emerged as a fundamental component of global agricultural research that is poised to impact on many aspects of plant science. In digital phenomics, AI is capable of learning intricate structure and patterns in large datasets. We provide a perspective and primer on AI applications to phenome research. We propose a novel human-centric explainable AI (X-AI) system architecture consisting of data architecture, technology infrastructure, and AI architecture design. We clarify the difference between post hoc models and 'interpretable by design' models. We include guidance for effectively using an interpretable by design model in phenomic analysis. We also provide directions to sources of tools and resources for making data analytics increasingly accessible. This primer is accompanied by an interactive online tutorial.
Collapse
Affiliation(s)
- Antoine L Harfouche
- Department for Innovation in Biological, Agro-Food, and Forest Systems, University of Tuscia, Viterbo, VT 01100, Italy.
| | - Farid Nakhle
- Department for Innovation in Biological, Agro-Food, and Forest Systems, University of Tuscia, Viterbo, VT 01100, Italy
| | - Antoine H Harfouche
- Unité de Formation et de Recherche en Sciences Économiques, Gestion, Mathématiques, et Informatique, Université Paris Nanterre, 92001 Nanterre, France
| | - Orlando G Sardella
- Department for Innovation in Biological, Agro-Food, and Forest Systems, University of Tuscia, Viterbo, VT 01100, Italy
| | - Eli Dart
- Energy Sciences Network (ESnet), Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA
| | - Daniel Jacobson
- Biosciences Division, Oak Ridge National Laboratory, Oak Ridge, TN 37831, USA
| |
Collapse
|
5
|
TinyML for Ultra-Low Power AI and Large Scale IoT Deployments: A Systematic Review. FUTURE INTERNET 2022. [DOI: 10.3390/fi14120363] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022] Open
Abstract
The rapid emergence of low-power embedded devices and modern machine learning (ML) algorithms has created a new Internet of Things (IoT) era where lightweight ML frameworks such as TinyML have created new opportunities for ML algorithms running within edge devices. In particular, the TinyML framework in such devices aims to deliver reduced latency, efficient bandwidth consumption, improved data security, increased privacy, lower costs and overall network cost reduction in cloud environments. Its ability to enable IoT devices to work effectively without constant connectivity to cloud services, while nevertheless providing accurate ML services, offers a viable alternative for IoT applications seeking cost-effective solutions. TinyML intends to deliver on-premises analytics that bring significant value to IoT services, particularly in environments with limited connection. This review article defines TinyML, presents an overview of its benefits and uses and provides background information based on up-to-date literature. Then, we demonstrate the TensorFlow Lite framework which supports TinyML along with analytical steps for an ML model creation. In addition, we explore the integration of TinyML with network technologies such as 5G and LPWAN. Ultimately, we anticipate that this analysis will serve as an informational pillar for the IoT/Cloud research community and pave the way for future studies.
Collapse
|
6
|
Ray PP. A review on TinyML: State-of-the-art and prospects. JOURNAL OF KING SAUD UNIVERSITY - COMPUTER AND INFORMATION SCIENCES 2022. [DOI: 10.1016/j.jksuci.2021.11.019] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|