1
|
Jayakody H, Petrie P, Boer HJD, Whitty M. A generalised approach for high-throughput instance segmentation of stomata in microscope images. Plant Methods 2021; 17:27. [PMID: 33750422 PMCID: PMC7945362 DOI: 10.1186/s13007-021-00727-4] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/02/2020] [Accepted: 02/26/2021] [Indexed: 05/05/2023]
Abstract
BACKGROUND Stomata analysis using microscope imagery provides important insight into plant physiology, health and the surrounding environmental conditions. Plant scientists are now able to conduct automated high-throughput analysis of stomata in microscope data, however, existing detection methods are sensitive to the appearance of stomata in the training images, thereby limiting general applicability. In addition, existing methods only generate bounding-boxes around detected stomata, which require users to implement additional image processing steps to study stomata morphology. In this paper, we develop a fully automated, robust stomata detection algorithm which can also identify individual stomata boundaries regardless of the plant species, sample collection method, imaging technique and magnification level. RESULTS The proposed solution consists of three stages. First, the input image is pre-processed to remove any colour space biases occurring from different sample collection and imaging techniques. Then, a Mask R-CNN is applied to estimate individual stomata boundaries. The feature pyramid network embedded in the Mask R-CNN is utilised to identify stomata at different scales. Finally, a statistical filter is implemented at the Mask R-CNN output to reduce the number of false positive generated by the network. The algorithm was tested using 16 datasets from 12 sources, containing over 60,000 stomata. For the first time in this domain, the proposed solution was tested against 7 microscope datasets never seen by the algorithm to show the generalisability of the solution. Results indicated that the proposed approach can detect stomata with a precision, recall, and F-score of 95.10%, 83.34%, and 88.61%, respectively. A separate test conducted by comparing estimated stomata boundary values with manually measured data showed that the proposed method has an IoU score of 0.70; a 7% improvement over the bounding-box approach. CONCLUSIONS The proposed method shows robust performance across multiple microscope image datasets of different quality and scale. This generalised stomata detection algorithm allows plant scientists to conduct stomata analysis whilst eliminating the need to re-label and re-train for each new dataset. The open-source code shared with this project can be directly deployed in Google Colab or any other Tensorflow environment.
Collapse
Affiliation(s)
- Hiranya Jayakody
- School of Mechanical and Manufacturing Engineering, UNSW, Sydney, Australia
| | - Paul Petrie
- School of Mechanical and Manufacturing Engineering, UNSW, Sydney, Australia
- South Australian Research and Development Institute, Urrbrae, Australia
| | - Hugo Jan de Boer
- Department of Environmental Sciences, Copernicus institute of sustainable development, Utrecht University, Utrecht, Netherlands
| | - Mark Whitty
- School of Mechanical and Manufacturing Engineering, UNSW, Sydney, Australia
| |
Collapse
|
2
|
Millstead L, Jayakody H, Patel H, Kaura V, Petrie PR, Tomasetig F, Whitty M. Accelerating Automated Stomata Analysis Through Simplified Sample Collection and Imaging Techniques. Front Plant Sci 2020; 11:580389. [PMID: 33101348 PMCID: PMC7546325 DOI: 10.3389/fpls.2020.580389] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/06/2020] [Accepted: 09/10/2020] [Indexed: 05/13/2023]
Abstract
Digital image processing is commonly used in plant health and growth analysis, aiming to improve research efficiency and repeatability. One focus is analysing the morphology of stomata, with the aim to better understand the regulation of gas exchange, its link to photosynthesis and water use and how they are influenced by climatic conditions. Despite the key role played by these cells, their microscopic analysis is largely manual, requiring intricate sample collection, laborious microscope application and the manual operation of a graphical user interface to identify and measure stomata. This research proposes a simple, end-to-end solution which enables automatic analysis of stomata by introducing key changes to imaging techniques, stomata detection as well as stomatal pore area calculation. An optimal procedure was developed for sample collection and imaging by investigating the suitability of using an automatic microscope slide scanner to image nail polish imprints. The use of the slide scanner allows the rapid collection of high-quality images from entire samples with minimal manual effort. A convolutional neural network was used to automatically detect stomata in the input image, achieving average precision, recall and F-score values of 0.79, 0.85, and 0.82 across four plant species. A novel binary segmentation and stomatal cross section analysis method is developed to estimate the pore boundary and calculate the associated area. The pore estimation algorithm correctly identifies stomata pores 73.72% of the time. Ultimately, this research presents a fast and simplified method of stomatal assay generation requiring minimal human intervention, enhancing the speed of acquiring plant health information.
Collapse
Affiliation(s)
- Luke Millstead
- School of Mechanical and Manufacturing Engineering, University of New South Wales, Sydney, NSW, Australia
| | - Hiranya Jayakody
- School of Mechanical and Manufacturing Engineering, University of New South Wales, Sydney, NSW, Australia
- *Correspondence: Hiranya Jayakody,
| | - Harsh Patel
- School of Mechanical and Manufacturing Engineering, University of New South Wales, Sydney, NSW, Australia
| | - Vihaan Kaura
- School of Mechanical and Manufacturing Engineering, University of New South Wales, Sydney, NSW, Australia
| | - Paul R. Petrie
- School of Mechanical and Manufacturing Engineering, University of New South Wales, Sydney, NSW, Australia
- Crop Sciences Division, South Australian Research and Development Institute, Waite Campus, Urrbrae, SA, Australia
| | - Florence Tomasetig
- Mark Wainwright Analytical Centre, University of New South Wales, Sydney, NSW, Australia
| | - Mark Whitty
- School of Mechanical and Manufacturing Engineering, University of New South Wales, Sydney, NSW, Australia
| |
Collapse
|
3
|
Marshell M, Corkill M, Whitty M, Thomas A, Turner J. Stratification of fertility potential according to cervical mucus symptoms: achieving pregnancy in fertile and infertile couples. HUM FERTIL 2019; 24:353-359. [PMID: 31661330 DOI: 10.1080/14647273.2019.1671613] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
Women wishing to conceive are largely unaware of fertility symptoms at the time of ovulation. This study investigated the effectiveness of fertility-awareness in achieving pregnancy, particularly fertile mucus pattern, in the context of infertility. The 384 eligible participants were taken from consecutive women desiring pregnancy who attended 17 Australian Billings Ovulation Method® clinics from 1999-2003. This cohort included couples with infertility ≥12 months (51%) and female age >35 years (28%). Under fertility-awareness instruction, pregnancy was achieved by 240 couples (62.5%) after maximum follow-up of two years. Mucus symptom observations effectively stratified 'low pregnancy-potential' (35.2%) and 'high pregnancy-potential' groups. Pregnancy rates were ∼30% higher in the latter group (44.4% versus 72.3%) in addition to consistent effects observed on pregnancy achievements within subgroups defined by prognostic factors such as duration of infertility (p = 0.001) and increasing female age (p = 0.04). Fertile symptoms were also associated with significantly shorter time to conception (4.2 versus 6.4 months) in a survival analysis (p = 0.003). Billings Ovulation Method® observations strongly predicted successful conception. This has the capacity to provide a rapid, reliable and cost-effective approach to stratifying fertility potential, including directing timely and targeted investigations/management, and is accessible for women who may be remote from primary or specialist care.
Collapse
Affiliation(s)
- Marie Marshell
- Ovulation Method Research and Reference Centre of Australia, Melbourne, Australia
| | - Marian Corkill
- Ovulation Method Research and Reference Centre of Australia, Melbourne, Australia
| | | | - Adrian Thomas
- Ovulation Method Research and Reference Centre of Australia, Melbourne, Australia
| | - Joseph Turner
- School of Rural Medicine, University of New England, Armidale, Australia.,Faculty of Medicine, Rural Clinical School, University of Queensland, Toowoomba, Australia
| |
Collapse
|
4
|
Hirayama M, Whitty M, Katupitiya J, Guivant J. An optimized approach for automatic material distribution operations of bulldozers. INT J ADV ROBOT SYST 2018. [DOI: 10.1177/1729881418764716] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Affiliation(s)
- Masami Hirayama
- School of Mechanical and Manufacturing Engineering, University of New South Wales, Sydney, New South Wales, Australia
- Komatsu Ltd, Tokyo, Japan
| | - Mark Whitty
- School of Mechanical and Manufacturing Engineering, University of New South Wales, Sydney, New South Wales, Australia
| | - Jayantha Katupitiya
- School of Mechanical and Manufacturing Engineering, University of New South Wales, Sydney, New South Wales, Australia
| | - Jose Guivant
- School of Mechanical and Manufacturing Engineering, University of New South Wales, Sydney, New South Wales, Australia
| |
Collapse
|
5
|
Jayakody H, Liu S, Whitty M, Petrie P. Microscope image based fully automated stomata detection and pore measurement method for grapevines. Plant Methods 2017; 13:94. [PMID: 29151841 PMCID: PMC5678568 DOI: 10.1186/s13007-017-0244-9] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/21/2017] [Accepted: 10/25/2017] [Indexed: 05/20/2023]
Abstract
BACKGROUND Stomatal behavior in grapevines has been identified as a good indicator of the water stress level and overall health of the plant. Microscope images are often used to analyze stomatal behavior in plants. However, most of the current approaches involve manual measurement of stomatal features. The main aim of this research is to develop a fully automated stomata detection and pore measurement method for grapevines, taking microscope images as the input. The proposed approach, which employs machine learning and image processing techniques, can outperform available manual and semi-automatic methods used to identify and estimate stomatal morphological features. RESULTS First, a cascade object detection learning algorithm is developed to correctly identify multiple stomata in a large microscopic image. Once the regions of interest which contain stomata are identified and extracted, a combination of image processing techniques are applied to estimate the pore dimensions of the stomata. The stomata detection approach was compared with an existing fully automated template matching technique and a semi-automatic maximum stable extremal regions approach, with the proposed method clearly surpassing the performance of the existing techniques with a precision of 91.68% and an F1-score of 0.85. Next, the morphological features of the detected stomata were measured. Contrary to existing approaches, the proposed image segmentation and skeletonization method allows us to estimate the pore dimensions even in cases where the stomatal pore boundary is only partially visible in the microscope image. A test conducted using 1267 images of stomata showed that the segmentation and skeletonization approach was able to correctly identify the stoma opening 86.27% of the time. Further comparisons made with manually traced stoma openings indicated that the proposed method is able to estimate stomata morphological features with accuracies of 89.03% for area, 94.06% for major axis length, 93.31% for minor axis length and 99.43% for eccentricity. CONCLUSIONS The proposed fully automated solution for stomata detection and measurement is able to produce results far superior to existing automatic and semi-automatic methods. This method not only produces a low number of false positives in the stomata detection stage, it can also accurately estimate the pore dimensions of partially incomplete stomata images. In addition, it can process thousands of stomata in minutes, eliminating the need for researchers to manually measure stomata, thereby accelerating the process of analysing plant health.
Collapse
Affiliation(s)
- Hiranya Jayakody
- School of Mechanical and Manufacturing Engineering, UNSW, Sydney, Australia
| | - Scarlett Liu
- School of Mechanical and Manufacturing Engineering, UNSW, Sydney, Australia
| | - Mark Whitty
- School of Mechanical and Manufacturing Engineering, UNSW, Sydney, Australia
| | - Paul Petrie
- The Australian Wine Research Institute (AWRI), Adelaide, Australia
- South Australian Research and Development Institute (SARDI), Adelaide, Australia
| |
Collapse
|
6
|
|
7
|
Guivant J, Cossell S, Whitty M, Katupitiya J. Internet-based operation of autonomous robots: The role of data replication, compression, bandwidth allocation and visualization. J FIELD ROBOT 2012. [DOI: 10.1002/rob.21432] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
8
|
Abstract
Past research on online relationships has predominantly been concerned with how the quality of online relationships compares with offline relationships. This research has been more concerned with the medium itself than with the meanings that users construct around their interpersonal interactions within this medium. The current paper seeks to redress this imbalance by exploring the ways that available social cues are used to shape the meanings of online relationships. Sixty Internet users, ranging in age from 19-51 years, were interviewed about their online relationships. It was found that ideals that are important in traditional relationships, such as trust, honesty, and commitment are just as important in online relationships; however, the cues that signify these ideals vary.
Collapse
Affiliation(s)
- M Whitty
- School of Applied Social and Human Sciences, University of Western Sydney, Sydney, Australia.
| | | |
Collapse
|
9
|
Whitty M. Commissioner's view. Go configure. Health Serv J 1999; 109:suppl 10-1. [PMID: 10537532] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 04/13/2023]
|
10
|
Abstract
To ascertain the contribution of systemic hypertension in the progression of renal failure, we have studied the effects of pharmacological treatment of hypertension in rats with the remnant kidney model of renal insufficiency, streptozotocin diabetes, or nephrotoxic serum nephritis. Treatment with the angiotensin converting enzyme (ACE) inhibitor enalapril lowered systemic blood pressure in the remnant kidney and diabetic animals, but did not lower blood pressure in rats with nephrotoxic serum nephritis. Proteinuria was reduced in all three models, and creatinine clearance improved in the remnant kidney and diabetic animals, when compared with untreated controls. In the remnant kidney and diabetic models systemic blood pressure was lowered to a similar degree by treatments with a calcium blocker, with no improvement in either proteinuria, or glomerular filtration rate. Further studies of the long-term effects of enalapril have been undertaken in rats with the two kidney one clip model of hypertension. Rats treated with enalapril had a lower blood pressure and improved survival over one year of treatment, compared with untreated rats. After 1 year of treatment however the clipped kidney was small and fibrotic, and non functional. Following withdrawal of enalapril therapy there was no functional improvement of the clipped kidney. The possibility that ACE inhibitors have a specific intra-renal effect reducing the rate of progression of renal disease now needs confirmation in human studies. In renovascular hypertension however, intra-renal changes induced by ACE inhibitors may cause irreversible renal damage.
Collapse
Affiliation(s)
- B Jackson
- University of Melbourne, Department of Medicine, Austin Hospital, Heidelberg, Victoria, Australia
| | | | | |
Collapse
|
11
|
Jackson B, Whitty M, Debrevi L, Cubela R. Preservation of renal structure and function in the rat remnant kidney model of chronic renal failure by enalapril treatment. Pathology 1987; 19:38-42. [PMID: 3035469 DOI: 10.3109/00313028709065133] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
The remnant kidney model of chronic renal failure was established in rats subject to subtotal (1 7/8) nephrectomy and the evolution of renal injury studied over a period of 6 wk. One wk after subtotal nephrectomy, rats had a mean conscious systolic blood pressure of 158 +/- 5 mm Hg and serum creatinine of 128 +/- 9 mumol/l. Both systolic blood pressure and serum creatinine rose over the next 5 wk in concert with progressive glomerulosclerosis and proteinuria. Enalapril, an angiotensin converting enzyme inhibitor, was administered (5 mg/kg/day) to rats (n = 11) from 1 wk after subtotal nephrectomy. Enalapril lowered systolic blood pressure over the treatment period. Systolic blood pressure was 122 +/- 5 mm Hg compared with 176 +/- 7 mm Hg in untreated rats (p less than 0.001) at 6 wk. Serum creatinine 6 wk after subtotal nephrectomy was 110 +/- 9 mumol/l with enalapril treatment, compared with 159 +/- 21 mumol/l (p less than 0.025) in control animals. Enalapril treated rats had lower urinary protein excretion than controls (15 +/- 3 mg/24 hr vs 85 +/- 22 mg/24 hr, p less than 0.0001) at 6 weeks. Glomerulosclerosis, assessed by blinded histological score, was also reduced in the enalapril treated group (1.79 +/- 0.08 vs 2.36 +/- 0.16, p less than 0.01). Enalapril treatment was associated with a reduction in filtration fraction (51Cr-EDTA/125I-hippurate clearance). At 6 wk, filtration fraction was 0.30 +/- 0.03 in enalapril treated and 0.48 +/- 0.03 in control rats (p less than 0.001). Enalapril treatment in the subtotal nephrectomy model of renal failure preserved renal structure and function.(ABSTRACT TRUNCATED AT 250 WORDS)
Collapse
|
12
|
Jackson B, Debrevi L, Cubela R, Whitty M, Johnston CI. Preservation of renal function in the rat remnant kidney model of chronic renal failure by blood pressure reduction. Clin Exp Pharmacol Physiol 1986; 13:319-23. [PMID: 3731536 DOI: 10.1111/j.1440-1681.1986.tb00356.x] [Citation(s) in RCA: 13] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
Abstract
The remnant kidney model of chronic renal failure was established in female Sprague-Dawley rats subjected to surgical removal of the right kidney and segmental infarction of seven-eighths of the left kidney. Plasma creatinine (mumol/l) rose from 65 (s.e.m. = 16, n = 18) to 153 (s.e.m. = 27, t-test, P less than 0.001, d.f. = 17) over 6 weeks. Histological glomerulosclerotic lesions were present from 2 weeks and prominent by 6 weeks post-surgery. Rats were treated with enalapril (5 mg/kg per day, n = 11) or felodipine (30 mg/kg per day, n = 13) from 1 week post-surgery, and their course compared to untreated rats (n = 18). Blood pressure (mmHg) was lowered by both treatments. Six weeks post-nephrectomy, systolic blood pressure in the untreated group was 176 (s.e.m. = 7, n = 18), enalapril group 122 (s.e.m. = 5, t-test, P less than 0.001, d.f. = 27), and felodipine group 128 (s.e.m. = 3, t-test, P less than 0.001, d.f. = 29). Plasma creatinine (mumol/l) was lower in the enalapril group (110, s.e.m. = 8, t-test, P less than 0.05, d.f. = 27) but not the felodipine group (173, s.e.m. = 19, t-test, n.s.) 6 weeks after subtotal nephrectomy compared to the untreated group (153, s.e.m. = 27). Glomerulosclerosis (blinded histological score) was reduced with enalapril treatment (1.93, s.e.m. = 0.03, t-test, P less than 0.05, d.f. = 27) but not felodipine treatment (2.15, s.e.m. = 0.04, c.f. untreated 2.36, s.e.m. = 0.12, t-test, n.s.). Urinary protein excretion (mg/24 h) was 84 (s.e.m. = 22, n = 13) in untreated rats, 15 (s.e.m. = 3, t-test, P less than 0.001, d.f. = 22) in enalapril-treated rats and 221 (s.e.m. = 35, n = 10) with felodipine treatment. Functional and structural damage in the rat remnant kidney model of chronic renal failure was ameliorated by treatment with enalapril but not by treatment with felodipine.
Collapse
|