102
|
Bjerge K, Nielsen JB, Sepstrup MV, Helsing-Nielsen F, Høye TT. An Automated Light Trap to Monitor Moths (Lepidoptera) Using Computer Vision-Based Tracking and Deep Learning. SENSORS 2021; 21:s21020343. [PMID: 33419136 PMCID: PMC7825571 DOI: 10.3390/s21020343] [Citation(s) in RCA: 26] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/18/2020] [Revised: 12/20/2020] [Accepted: 12/30/2020] [Indexed: 02/06/2023]
Abstract
Insect monitoring methods are typically very time-consuming and involve substantial investment in species identification following manual trapping in the field. Insect traps are often only serviced weekly, resulting in low temporal resolution of the monitoring data, which hampers the ecological interpretation. This paper presents a portable computer vision system capable of attracting and detecting live insects. More specifically, the paper proposes detection and classification of species by recording images of live individuals attracted to a light trap. An Automated Moth Trap (AMT) with multiple light sources and a camera was designed to attract and monitor live insects during twilight and night hours. A computer vision algorithm referred to as Moth Classification and Counting (MCC), based on deep learning analysis of the captured images, tracked and counted the number of insects and identified moth species. Observations over 48 nights resulted in the capture of more than 250,000 images with an average of 5675 images per night. A customized convolutional neural network was trained on 2000 labeled images of live moths represented by eight different classes, achieving a high validation F1-score of 0.93. The algorithm measured an average classification and tracking F1-score of 0.71 and a tracking detection rate of 0.79. Overall, the proposed computer vision system and algorithm showed promising results as a low-cost solution for non-destructive and automatic monitoring of moths.
Collapse
Affiliation(s)
- Kim Bjerge
- School of Engineering, Aarhus University, Finlandsgade 22, 8200 Aarhus N, Denmark; (J.B.N.); (M.V.S.)
- Correspondence:
| | - Jakob Bonde Nielsen
- School of Engineering, Aarhus University, Finlandsgade 22, 8200 Aarhus N, Denmark; (J.B.N.); (M.V.S.)
| | - Martin Videbæk Sepstrup
- School of Engineering, Aarhus University, Finlandsgade 22, 8200 Aarhus N, Denmark; (J.B.N.); (M.V.S.)
| | | | - Toke Thomas Høye
- Department of Bioscience and Arctic Research Centre, Aarhus University, Grenåvej 14, 8410 Rønde, Denmark;
| |
Collapse
|
103
|
Dietz S, Beazley KF, Lemieux CJ, St. Clair C, Coristine L, Higgs E, Smith R, Pellatt M, Beaty C, Cheskey E, Cooke SJ, Crawford L, Davis R, Forbes G, Gadallah F(Z, Kendall P, Mandrak N, Moola F, Parker S, Quayle J, Ray JC, Richardson K, Smith K, Snider J, Smol JP, Sutherland WJ, Vallillee A, White L, Woodley A. Emerging issues for protected and conserved areas in Canada. Facets (Ott) 2021. [DOI: 10.1139/facets-2021-0072] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Horizon scanning is increasingly used in conservation to systematically explore emerging policy and management issues. We present the results of a horizon scan of issues likely to impact management of Canadian protected and conserved areas over the next 5–10 years. Eighty-eight individuals participated, representing a broad community of academics, government and nongovernment organizations, and foundations, including policymakers and managers of protected and conserved areas. This community initially identified 187 issues, which were subsequently triaged to 15 horizon issues by a group of 33 experts using a modified Delphi technique. Results were organized under four broad categories: ( i) emerging effects of climate change in protected and conserved areas design, planning, and management (i.e., large-scale ecosystem changes, species translocation, fire regimes, ecological integrity, and snow patterns); ( ii) Indigenous governance and knowledge systems (i.e., Indigenous governance and Indigenous knowledge and Western science); ( iii) integrated conservation approaches across landscapes and seascapes (i.e., connectivity conservation, integrating ecosystem values and services, freshwater planning); and ( iv) early responses to emerging cumulative, underestimated, and novel threats (i.e., management of cumulative impacts, declining insect biomass, increasing anthropogenic noise, synthetic biology). Overall, the scan identified several emerging issues that require immediate attention to effectively reduce threats, respond to opportunities, and enhance preparedness and capacity to react.
Collapse
Affiliation(s)
- Sabine Dietz
- Ecosystem Science Laboratory, Office of the Chief Ecosystem Scientist, Protected Areas Establishment and Conservation Directorate, Parks Canada Agency, Gatineau QC J8X 0B3, Canada
| | - Karen F. Beazley
- School for Resource and Environmental Studies, Dalhousie University, Halifax, NS B3H 4R2, Canada
| | - Christopher J. Lemieux
- Department of Geography and Environmental Studies, Wilfrid Laurier University, Waterloo, Ontario, N2L 3C5, Canada
| | - Colleen St. Clair
- Biological Sciences, University of Alberta, Edmonton, AB, T6G 2E9, Canada
| | - Laura Coristine
- Environment and Climate Change Canada, Canadian Wildlife Service, Gatineau, QC, K1A 0H3, Canada
| | - Eric Higgs
- School of Environmental Studies, University of Victoria, Victoria, BC V8W 2Y2, Canada
| | - Risa Smith
- International Union for the Conservation of Nature/World Commission on Protected Areas
| | - Marlow Pellatt
- Ecosystem Science Laboratory, Office of the Chief Ecosystem Scientist, Protected Areas Establishment and Conservation Directorate, Parks Canada Agency, Gatineau QC J8X 0B3, Canada
| | | | | | - Steven J. Cooke
- Institute for Environmental and Interdisciplinary Sciences and Department of Biology, Carleton University, Ottawa, ON K1S 5B6, Canada
| | - Lindsay Crawford
- Environment and Climate Change Canada, Gatineau, QC K1A 0H3, Canada
| | - Rob Davis
- Ontario Parks, Ministry of the Environment, Conservation and Parks, Peterborough, ON K9J 8M5, Canada
| | - Graham Forbes
- University of New Brunswick, Fredericton, NB E3B 5A3, Canada
| | - Fawziah (ZuZu) Gadallah
- Environment and Climate Change Canada, Canadian Wildlife Service, Gatineau, QC, K1A 0H3, Canada
| | | | - Nick Mandrak
- Department of Biological Sciences, University of Toronto Scarborough, Toronto, ON, M1C 1A4, Canada
| | - Faisal Moola
- Geography, Environment & Geomatics, University of Guelph, Guelph, ON, N1G 2W1, Canada
| | - Scott Parker
- Protected Areas Establishment and Conservation Directorate, Parks Canada Agency, Gatineau QC J8X 0B3, Canada
| | | | - Justina C. Ray
- Wildlife Conservation Society Canada, Toronto, ON M5S 3A7, Canada
| | - Karen Richardson
- Ecosystem Science Laboratory, Office of the Chief Ecosystem Scientist, Protected Areas Establishment and Conservation Directorate, Parks Canada Agency, Gatineau QC J8X 0B3, Canada
| | - Kevin Smith
- Ducks Unlimited Canada, Edmonton, AB T5S 0A2, Canada
| | - James Snider
- World Wildlife Fund Canada, Toronto, ON M5V 1S8, Canada
| | - John P. Smol
- Paleoecological Environmental Assessment and Research Lab (PEARL), Department of Biology, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - William J Sutherland
- Department of Zoology, University of Cambridge, Cambridge CB2 3EJ, UK; Biosecurity Research Initiative at St Catharine’s, St Catharine’s College, Cambridge CB2 1RL, UK
| | | | - Lori White
- Environment and Climate Change Canada, Gatineau, QC K1A 0H3, Canada
| | - Alison Woodley
- Canadian Parks and Wilderness Society, Ottawa, ON K2P 0A4, Canada
| |
Collapse
|
104
|
Rzanny M, Wittich HC, Mäder P, Deggelmann A, Boho D, Wäldchen J. Image-Based Automated Recognition of 31 Poaceae Species: The Most Relevant Perspectives. FRONTIERS IN PLANT SCIENCE 2021; 12:804140. [PMID: 35154194 PMCID: PMC8826579 DOI: 10.3389/fpls.2021.804140] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/28/2021] [Accepted: 12/20/2021] [Indexed: 05/07/2023]
Abstract
Poaceae represent one of the largest plant families in the world. Many species are of great economic importance as food and forage plants while others represent important weeds in agriculture. Although a large number of studies currently address the question of how plants can be best recognized on images, there is a lack of studies evaluating specific approaches for uniform species groups considered difficult to identify because they lack obvious visual characteristics. Poaceae represent an example of such a species group, especially when they are non-flowering. Here we present the results from an experiment to automatically identify Poaceae species based on images depicting six well-defined perspectives. One perspective shows the inflorescence while the others show vegetative parts of the plant such as the collar region with the ligule, adaxial and abaxial side of the leaf and culm nodes. For each species we collected 80 observations, each representing a series of six images taken with a smartphone camera. We extract feature representations from the images using five different convolutional neural networks (CNN) trained on objects from different domains and classify them using four state-of-the art classification algorithms. We combine these perspectives via score level fusion. In order to evaluate the potential of identifying non-flowering Poaceae we separately compared perspective combinations either comprising inflorescences or not. We find that for a fusion of all six perspectives, using the best combination of feature extraction CNN and classifier, an accuracy of 96.1% can be achieved. Without the inflorescence, the overall accuracy is still as high as 90.3%. In all but one case the perspective conveying the most information about the species (excluding inflorescence) is the ligule in frontal view. Our results show that even species considered very difficult to identify can achieve high accuracies in automatic identification as long as images depicting suitable perspectives are available. We suggest that our approach could be transferred to other difficult-to-distinguish species groups in order to identify the most relevant perspectives.
Collapse
Affiliation(s)
- Michael Rzanny
- Department of Biogeochemical Integration, Max Planck Institute for Biogeochemistry, Jena, Germany
- *Correspondence: Michael Rzanny
| | - Hans Christian Wittich
- Data-intensive Systems and Visualisation, Technische Universität Ilmenau, Ilmenau, Germany
| | - Patrick Mäder
- Data-intensive Systems and Visualisation, Technische Universität Ilmenau, Ilmenau, Germany
- Faculty of Biological Sciences, Friedrich Schiller University, Jena, Germany
| | - Alice Deggelmann
- Department of Biogeochemical Integration, Max Planck Institute for Biogeochemistry, Jena, Germany
| | - David Boho
- Data-intensive Systems and Visualisation, Technische Universität Ilmenau, Ilmenau, Germany
| | - Jana Wäldchen
- Department of Biogeochemical Integration, Max Planck Institute for Biogeochemistry, Jena, Germany
| |
Collapse
|