1
|
Stevenson S, Liscio E. Assessing iPhone LiDAR & Recon-3D for determining area of origin in bloodstain pattern analysis. J Forensic Sci 2024; 69:1045-1060. [PMID: 38314622 DOI: 10.1111/1556-4029.15476] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2023] [Revised: 01/04/2024] [Accepted: 01/18/2024] [Indexed: 02/06/2024]
Abstract
Bloodstain pattern analysis (BPA) has proven to be a useful tool in forensic and criminal investigations for quite some time. Traditionally, documenting a crime scene for a bloodletting event was completed using manual techniques, physical strings, and a tape measure. In more recent years, laser scanners and 3D software programs have become a preferred method to capture accurate data that improves the validity and reliability of BPA. The initial cost of laser scanning equipment is relatively high, rendering these systems inaccessible to some police and smaller agencies. Recon-3D is a newly developed iPhone application that utilizes the iPhone LiDAR sensor in combination with video data to create 3D point clouds of crime scenes. To assess the viability of Recon-3D for area of origin analysis, two tests were performed. One was a series of bloodstain impacts which were analyzed in FARO Zone 3D software, while the second was a series of 6 repeated Recon-3D scans of two 90-degree walls which was then compared to the FARO Focus S350 scanner using CloudCompare software. A total of eight impact patterns were made at three different distances from a wall. The area of origin was measured and compared to the known location of the blood source. The average total 3D error for the area of origin set at 25, 50, and 100 cm from two perpendicular walls was found to be 6.04, 15.16, and 36.59 cm, respectively. These results are similar to past studies where programs such as HemoSpat have been used. The results of the point cloud comparison show that on average, 95% of the points from Recon-3D fall below a threshold of 3.6 mm when compared to a FARO Focus S350 laser scanner. Thus, the results of this test suggest that Recon-3D is an accurate and affordable scanning application for bloodstain patterns at crime scenes and the data provide acceptable results for area of origin analysis in BPA programs which accept laser scanner data.
Collapse
Affiliation(s)
- Stephanie Stevenson
- Forensic Science Department, Trent University, Peterborough, Ontario, Canada
| | | |
Collapse
|
2
|
Meana V, Zapico P, Cuesta E, Giganto S, Martinez-Pellitero S. Laser Triangulation Sensors Performance in Scanning Different Materials and Finishes. Sensors (Basel) 2024; 24:2410. [PMID: 38676027 PMCID: PMC11054147 DOI: 10.3390/s24082410] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/05/2024] [Revised: 04/03/2024] [Accepted: 04/04/2024] [Indexed: 04/28/2024]
Abstract
The variety of equipment implementing laser triangulation technology for 3D scanning makes it difficult to analyse their performance, comparability, and traceability. In this study, three laser triangulation sensors arranged in different configurations are analysed using high precision spheres made of different materials and surface finishes. Three types of reference parameters were used: diameter, form error, and standard deviation of the point cloud. The experimentation was based on studying the quality of the point clouds generated by the three sensors, which enabled us to find and quantify an edge effect in the horizon of the scanned surface. A procedure to reach the optimal filtering conditions was proposed, and a chart of recommended usage of each sphere (material and finish) was created for the different types of sensors. This filter enables removal of both spurious points and those few points that spoil the form error, greatly improving the quality of the measurement.
Collapse
Affiliation(s)
- Victor Meana
- Department of Construction and Manufacturing Engineering, University of Oviedo, Campus of Gijon, 33203 Gijon, Spain; (P.Z.); (E.C.)
| | - Pablo Zapico
- Department of Construction and Manufacturing Engineering, University of Oviedo, Campus of Gijon, 33203 Gijon, Spain; (P.Z.); (E.C.)
| | - Eduardo Cuesta
- Department of Construction and Manufacturing Engineering, University of Oviedo, Campus of Gijon, 33203 Gijon, Spain; (P.Z.); (E.C.)
| | - Sara Giganto
- Area of Manufacturing Engineering, University of Leon—Universidad de León, Campus de Vegazana, 24071 Leon, Spain; (S.G.); (S.M.-P.)
| | - Susana Martinez-Pellitero
- Area of Manufacturing Engineering, University of Leon—Universidad de León, Campus de Vegazana, 24071 Leon, Spain; (S.G.); (S.M.-P.)
| |
Collapse
|
3
|
Kreslin M, Češarek P, Žnidarič A, Kokot D, Kalin J, Vezočnik R. Vehicle-Bridge Interaction Modelling Using Precise 3D Road Surface Analysis. Sensors (Basel) 2024; 24:709. [PMID: 38276400 PMCID: PMC10818885 DOI: 10.3390/s24020709] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/20/2023] [Revised: 01/12/2024] [Accepted: 01/17/2024] [Indexed: 01/27/2024]
Abstract
Uneven road surfaces are the primary source of excitation in the dynamic interaction between a bridge and a vehicle and can lead to errors in bridge weigh-in-motion (B-WIM) systems. In order to correctly reproduce this interaction in a numerical model of a bridge, it is essential to know the magnitude and location of the various roadway irregularities. This paper presents a methodology for measuring the 3D road surface using static terrestrial laser scanning and a numerical model for simulating vehicle passage over a bridge with a measured road surface. This model allows the evaluation of strain responses in the time domain at any bridge location considering different parameters such as vehicle type, lateral position and speed, road surface unevenness, bridge type, etc. Since the time domain strains are crucial for B-WIM algorithms, the proposed approach facilitates the analysis of the different factors affecting the B-WIM results. The first validation of the proposed methodology was carried out on a real bridge, where extensive measurements were performed using different sensors, including measurements of the road surface, the response of the bridge when crossed by a test vehicle and the dynamic properties of the bridge and vehicle. The comparison between the simulated and measured bridge response marks a promising step towards investigating the influence of unevenness on the results of B-WIM.
Collapse
Affiliation(s)
- Maja Kreslin
- Department of Structures, Slovenian National Building and Civil Engineering Institute, Dimičeva ulica 12, 1000 Ljubljana, Slovenia; (A.Ž.); (D.K.); (J.K.); (R.V.)
| | - Peter Češarek
- Faculty of Civil and Geodetic Engineering, University of Ljubljana, Jamova cesta 2, 1000 Ljubljana, Slovenia;
| | - Aleš Žnidarič
- Department of Structures, Slovenian National Building and Civil Engineering Institute, Dimičeva ulica 12, 1000 Ljubljana, Slovenia; (A.Ž.); (D.K.); (J.K.); (R.V.)
| | - Darko Kokot
- Department of Structures, Slovenian National Building and Civil Engineering Institute, Dimičeva ulica 12, 1000 Ljubljana, Slovenia; (A.Ž.); (D.K.); (J.K.); (R.V.)
| | - Jan Kalin
- Department of Structures, Slovenian National Building and Civil Engineering Institute, Dimičeva ulica 12, 1000 Ljubljana, Slovenia; (A.Ž.); (D.K.); (J.K.); (R.V.)
| | - Rok Vezočnik
- Department of Structures, Slovenian National Building and Civil Engineering Institute, Dimičeva ulica 12, 1000 Ljubljana, Slovenia; (A.Ž.); (D.K.); (J.K.); (R.V.)
| |
Collapse
|
4
|
Trębacz P, Frymus J, Pawlik M, Barteczko A, Kurkowska A, Czopowicz M, Antonowicz M, Kajzer W. Comparison of the Visibility of Canine Menisci before and after Tibial Plateau Leveling Osteotomy: 3D-Printed Model Study. Animals (Basel) 2023; 14:65. [PMID: 38200797 PMCID: PMC10778292 DOI: 10.3390/ani14010065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Revised: 12/15/2023] [Accepted: 12/21/2023] [Indexed: 01/12/2024] Open
Abstract
The aim of this study was to compare the degree of visibility of the lateral and medial menisci before and after tibial plateau leveling osteotomy (TPLO) on 3D-printed models created after laser scanning of the right tibia with menisci derived from a fresh cadaver of a 4-year-old adult male golden retriever. The models were produced of white polylactic acid, and the menisci were filled with light-curing red resin. The models showed a similar conformation as the natural specimen harvested from the cadaver, maintaining the same length and width, in addition to reproducing the anatomical structures. From the pre- and post-TPLO radiographs, it was possible to identify the anatomical structures corresponding to the tibial plateau. The preoperative tibial plateau angle was 26.2°, and the postoperative one ranged between 4.0° and 5.3° (4.6 ± 0.4°). In the bird's-eye photo, the total number of red pixels in the lateral and the medial meniscus was 2,053,995 and 2,140,939, respectively. Before TPLO, only between 14% and 19% of the entire area of the menisci was visible, and the unhidden part of the entire area of the meniscus before TPLO did not differ significantly between the lateral (16.2 ± 1.6%) and the medial (16.4 ± 1.6%) meniscus (p = 0.351). The visible part of the entire meniscus area increased significantly after TPLO both in the lateral and medial menisci (p < 0.001)-mean difference ± SD of 30.3 ± 4.3% (CI 95%: 27.9%, 32.6%) and 36.4 ± 6.4% (CI 95%: 32.9%, 40.0%), respectively. In conclusion, the intraoperative examination and treatment of dog menisci are easier after TPLO.
Collapse
Affiliation(s)
- Piotr Trębacz
- Department of Surgery and Anesthesiology of Small Animals, Institute of Veterinary Medicine, Warsaw University of Life Sciences-SGGW, Nowoursynowska 159c, 02-776 Warsaw, Poland
| | - Jan Frymus
- Department of Surgery and Anesthesiology of Small Animals, Institute of Veterinary Medicine, Warsaw University of Life Sciences-SGGW, Nowoursynowska 159c, 02-776 Warsaw, Poland
| | - Mateusz Pawlik
- CABIOMEDE Ltd., Karola Olszewskiego 21, 25-663 Kielce, Poland; (M.P.); (A.B.); (A.K.)
| | - Anna Barteczko
- CABIOMEDE Ltd., Karola Olszewskiego 21, 25-663 Kielce, Poland; (M.P.); (A.B.); (A.K.)
| | - Aleksandra Kurkowska
- CABIOMEDE Ltd., Karola Olszewskiego 21, 25-663 Kielce, Poland; (M.P.); (A.B.); (A.K.)
| | - Michał Czopowicz
- Division of Veterinary Epidemiology and Economics, Institute of Veterinary Medicine, Warsaw University of Life Sciences-SGGW, Nowoursynowska 159c, 02-776 Warsaw, Poland;
| | - Magdalena Antonowicz
- Department of Biomaterials and Medical Devices Engineering, Faculty of Biomedical Engineering, Silesian University of Technology, Roosevelta 40, 41-800 Zabrze, Poland; (M.A.); (W.K.)
| | - Wojciech Kajzer
- Department of Biomaterials and Medical Devices Engineering, Faculty of Biomedical Engineering, Silesian University of Technology, Roosevelta 40, 41-800 Zabrze, Poland; (M.A.); (W.K.)
| |
Collapse
|
5
|
Pavelka K, Matoušková E, Pavelka K. Remarks on Geomatics Measurement Methods Focused on Forestry Inventory. Sensors (Basel) 2023; 23:7376. [PMID: 37687832 PMCID: PMC10490742 DOI: 10.3390/s23177376] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Revised: 08/08/2023] [Accepted: 08/14/2023] [Indexed: 09/10/2023]
Abstract
This contribution focuses on a comparison of modern geomatics technologies for the derivation of growth parameters in forest management. The present text summarizes the results of our measurements over the last five years. As a case project, a mountain spruce forest with planned forest logging was selected. In this locality, terrestrial laser scanning (TLS) and terrestrial and drone close-range photogrammetry were experimentally used, as was the use of PLS mobile technology (personal laser scanning) and ALS (aerial laser scanning). Results from the data joining, usability, and economics of all technologies for forest management and ecology were discussed. ALS is expensive for small areas and the results were not suitable for a detailed parameter derivation. The RPAS (remotely piloted aircraft systems, known as "drones") method of data acquisition combines the benefits of close-range and aerial photogrammetry. If the approximate height and number of the trees are known, one can approximately calculate the extracted cubage of wood mass before forest logging. The use of conventional terrestrial close-range photogrammetry and TLS proved to be inappropriate and practically unusable in our case, and also in standard forestry practice after consultation with forestry workers. On the other hand, the use of PLS is very simple and allows you to quickly define ordered parameters and further calculate, for example, the cubic volume of wood stockpiles. The results from our research into forestry show that drones can be used to estimate quantities (wood cubature) and inspect the health status of spruce forests, However, PLS seems, nowadays, to be the best solution in forest management for deriving forest parameters. Our results are mainly oriented to practice and in no way diminish the general research in this area.
Collapse
Affiliation(s)
- Karel Pavelka
- Department of Geomatics, Faculty of Civil Engineering, Czech Technical University in Prague, 166 29 Prague, Czech Republic; (E.M.)
| | | | | |
Collapse
|
6
|
Abdollahi A, Arefi H, Malihi S, Maboudi M. Progressive Model-Driven Approach for 3D Modeling of Indoor Spaces. Sensors (Basel) 2023; 23:5934. [PMID: 37447783 DOI: 10.3390/s23135934] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/14/2023] [Revised: 06/09/2023] [Accepted: 06/19/2023] [Indexed: 07/15/2023]
Abstract
This paper focuses on the 3D modeling of the interior spaces of buildings. Three-dimensional point clouds from laser scanners can be considered the most widely used data for 3D indoor modeling. Therefore, the walls, ceiling and floor are extracted as the main structural fabric and reconstructed. In this paper, a method is presented to tackle the problems related to the data including obstruction, clutter and noise. This method reconstructs indoor space in a model-driven approach using watertight predefined models. Employing the two-step implementation of this process, the algorithm is able to model non-rectangular spaces with an even number of sides. Afterwards, an "improvement" process increases the level of details by modeling the intrusion and protrusion of the model. The 3D model is formed by extrusion from 2D to 3D. The proposed model-driven algorithm is evaluated with four benchmark real-world datasets. The efficacy of the proposed method is proved by the range of [77%, 95%], [85%, 97%] and [1.7 cm, 2.4 cm] values of completeness, correctness and geometric accuracy, respectively.
Collapse
Affiliation(s)
- Ali Abdollahi
- School of Engineering, Faculty of Surveying and Geospatial Engineering, University of Tehran, Tehran 1417614411, Iran
| | - Hossein Arefi
- School of Engineering, Faculty of Surveying and Geospatial Engineering, University of Tehran, Tehran 1417614411, Iran
- Department of Geoinformatics and Surveying, School of Engineering, Mainz University of Applied Sciences, 55128 Mainz, Germany
| | - Shirin Malihi
- School of Engineering, University of Edinburgh, Edinburgh EH9 3JL, UK
| | - Mehdi Maboudi
- Institute of Geodesy and Photogrammetry, Technische Universität Braunschweig, 38106 Braunschweig, Germany
| |
Collapse
|
7
|
Rak G, Hočevar M, Kolbl Repinc S, Novak L, Bizjan B. A Review on Methods for Measurement of Free Water Surface. Sensors (Basel) 2023; 23:1842. [PMID: 36850437 PMCID: PMC9962330 DOI: 10.3390/s23041842] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/20/2022] [Revised: 01/12/2023] [Accepted: 02/06/2023] [Indexed: 06/18/2023]
Abstract
Turbulent free-surface flows are encountered in several engineering applications and are typically characterized by the entrainment of air bubbles due to intense mixing and surface deformation. The resulting complex multiphase structure of the air-water interface presents a challenge in precise and reliable measurements of the free-water-surface topography. Conventional methods by manometers, wave probes, point gauges or electromagnetic/ultrasonic devices are proven and reliable, but also time-consuming, with limited accuracy and are mostly intrusive. Accurate spatial and temporal measurements of complex three-dimensional free-surface flows in natural and man-made hydraulic structures are only viable by high-resolution non-contact methods, namely, LIDAR-based laser scanning, photogrammetric reconstruction from cameras with overlapping field of view, or laser triangulation that combines laser ranging with high-speed imaging data. In the absence of seeding particles and optical calibration targets, sufficient flow aeration is essential for the operation of both laser- and photogrammetry-based methods, with local aeration properties significantly affecting the measurement uncertainty of laser-based methods.
Collapse
Affiliation(s)
- Gašper Rak
- Faculty of Civil and Geodetic Engineering, University of Ljubljana, Jamova cesta 2, 1000 Ljubljana, Slovenia
| | - Marko Hočevar
- Faculty of Mechanical Engineering, University of Ljubljana, Aškerčeva cesta 6, 1000 Ljubljana, Slovenia
| | - Sabina Kolbl Repinc
- Faculty of Civil and Geodetic Engineering, University of Ljubljana, Jamova cesta 2, 1000 Ljubljana, Slovenia
- The National Institute of Chemistry, Hajdrihova ulica 19, 1000 Ljubljana, Slovenia
| | - Lovrenc Novak
- Faculty of Mechanical Engineering, University of Ljubljana, Aškerčeva cesta 6, 1000 Ljubljana, Slovenia
| | - Benjamin Bizjan
- Faculty of Civil and Geodetic Engineering, University of Ljubljana, Jamova cesta 2, 1000 Ljubljana, Slovenia
- Faculty of Mechanical Engineering, University of Ljubljana, Aškerčeva cesta 6, 1000 Ljubljana, Slovenia
| |
Collapse
|
8
|
Petras V, Petrasova A, McCarter JB, Mitasova H, Meentemeyer RK. Point Density Variations in Airborne Lidar Point Clouds. Sensors (Basel) 2023; 23:1593. [PMID: 36772634 PMCID: PMC9920349 DOI: 10.3390/s23031593] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Revised: 01/26/2023] [Accepted: 01/27/2023] [Indexed: 06/18/2023]
Abstract
In spite of increasing point density and accuracy, airborne lidar point clouds often exhibit point density variations. Some of these density variations indicate issues with point clouds, potentially leading to errors in derived products. To highlight these issues, we provide an overview of point density variations and show examples in six airborne lidar point cloud datasets that we used in our topographic and geospatial modeling research. Using the published literature, we identified sources of point density variations and issues indicated or caused by these variations. Lastly, we discuss the reduction in point density variations using decimations, homogenizations, and their applicability.
Collapse
Affiliation(s)
- Vaclav Petras
- Center for Geospatial Analytics, North Carolina State University, 2800 Faucette Dr., Campus Box 7106, Raleigh, NC 27695, USA
| | - Anna Petrasova
- Center for Geospatial Analytics, North Carolina State University, 2800 Faucette Dr., Campus Box 7106, Raleigh, NC 27695, USA
| | - James B. McCarter
- Department of Forestry and Environmental Resources, North Carolina State University, 2820 Faucette Dr., Campus Box 8001, Raleigh, NC 27695, USA
| | - Helena Mitasova
- Center for Geospatial Analytics, North Carolina State University, 2800 Faucette Dr., Campus Box 7106, Raleigh, NC 27695, USA
- Department of Marine, Earth, and Atmospheric Sciences, North Carolina State University, 2800 Faucette Drive, Campus Box 8208, Raleigh, NC 27695, USA
| | - Ross K. Meentemeyer
- Center for Geospatial Analytics, North Carolina State University, 2800 Faucette Dr., Campus Box 7106, Raleigh, NC 27695, USA
- Department of Forestry and Environmental Resources, North Carolina State University, 2820 Faucette Dr., Campus Box 8001, Raleigh, NC 27695, USA
| |
Collapse
|
9
|
Dai Z, Wolf A, Ley PP, Glück T, Sundermeier MC, Lachmayer R. Requirements for Automotive LiDAR Systems. Sensors (Basel) 2022; 22:s22197532. [PMID: 36236631 PMCID: PMC9572322 DOI: 10.3390/s22197532] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Revised: 09/23/2022] [Accepted: 09/28/2022] [Indexed: 05/25/2023]
Abstract
Light detection and ranging (LiDAR) are fundamental sensors that help driving tasks for autonomous driving at various levels. Commercially available systems come in different specialized design schemes and involve plenty of specifications. In the literature, there are insufficient representations of the technical requirements for LiDAR systems in the automotive context, such as range, detection quality, resolving power, field of view, and eye safety. For this reason, the requirements above require to be derived based on ADAS functions. The requirements for various key LiDAR metrics, including detection range, field of view, angular resolution, and laser safety, are analyzed in this paper. LiDAR systems are available with various radiation patterns that significantly impact on detection range. Therefore, the detection range under various radiation patterns is firstly investigated in this paper. Based on ADAS functions, the required detection range and field of view for LiDAR systems are examined, taking into account various travel speeds to avoid collision and the coverage of the entire lane width. Furthermore, the angular resolution limits are obtained utilizing the KITTI dataset and exemplary 3D detection algorithms. Finally, the maximum detection ranges for the different radiation patterns are compared under the consideration of derived requirements and laser safety.
Collapse
Affiliation(s)
- Zhuoqun Dai
- Institute of Product Development, Leibniz University Hannover, 30823 Garbsen, Germany
| | - Alexander Wolf
- Institute of Product Development, Leibniz University Hannover, 30823 Garbsen, Germany
- Cluster of Excellence PhoenixD (Photonics, Optics, and Engineering-Innovation across Disciplines), Gottfried Wilhelm Leibniz Universität Hannover, Welfengarten 1A, 30167 Hannover, Germany
| | - Peer-Phillip Ley
- Institute of Product Development, Leibniz University Hannover, 30823 Garbsen, Germany
| | - Tobias Glück
- Institute of Product Development, Leibniz University Hannover, 30823 Garbsen, Germany
| | | | - Roland Lachmayer
- Institute of Product Development, Leibniz University Hannover, 30823 Garbsen, Germany
- Cluster of Excellence PhoenixD (Photonics, Optics, and Engineering-Innovation across Disciplines), Gottfried Wilhelm Leibniz Universität Hannover, Welfengarten 1A, 30167 Hannover, Germany
| |
Collapse
|
10
|
Lenda G, Marmol U. Effect of Various Edge Configurations on the Accuracy of the Modelling Shape of Shell Structures Using Spline Functions. Sensors (Basel) 2022; 22:7202. [PMID: 36236299 PMCID: PMC9571436 DOI: 10.3390/s22197202] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/08/2022] [Revised: 09/15/2022] [Accepted: 09/21/2022] [Indexed: 06/16/2023]
Abstract
Spline functions are a useful tool for modelling the shape of shell structures. They have curvature continuity that allows good approximation accuracy for various objects, including hyperboloid cooling towers, spherical domes, paraboloid bowls of radio telescopes, or many other types of smooth free surfaces. Spline models can be used to determine the displacement of structures based on point clouds from laser scanning or photogrammetry. The curvature continuity of splines may, however, cause local distortions in models that have edges. Edges may appear in point clouds where surface patches are joined, on surfaces equipped with additional technical infrastructure or with cracks and shifts in the structure. Taking the properties of spline functions into account, several characteristic types of edge configurations can be distinguished, which may, to a different extent, affect the values of modelling errors. The research conducted below was aimed at identifying such configurations based on theoretical considerations and then assessing their effect on the accuracy of modelling shell structures measured by laser scanning. It turned out to be possible to distinguish between edge configurations, based on the deviation values.
Collapse
|
11
|
Chew MYL, Gan VJL. Long-Standing Themes and Future Prospects for the Inspection and Maintenance of Façade Falling Objects from Tall Buildings. Sensors (Basel) 2022; 22:6070. [PMID: 36015831 PMCID: PMC9414696 DOI: 10.3390/s22166070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/16/2022] [Revised: 08/08/2022] [Accepted: 08/10/2022] [Indexed: 06/15/2023]
Abstract
The increasing number of accidents arising from falling objects from the façade of tall buildings has attracted much attention globally. To regulators, a preventive approach based on a mandatory periodic façade inspection has been deemed as a necessary measure to maintain the functionality and integrity of the façade of tall buildings. Researchers worldwide have been working towards a predictive approach to allow for the assessment of the likely failure during some future period, by measuring the condition of the façade to detect latent defects and anomalies. The methods proposed include laser scanning, image-based sensing and infrared thermography to support the automatic façade visual inspection. This paper aims to review and analyse the state-of-the-art literature on the automated inspection of building façades, with emphasis on the detection and maintenance management of latent defects and anomalies for falling objects from tall buildings. A step-by-step holistic method is leveraged to retrieve the available literature from databases, followed by the analyses of relevant articles in different long-standing research themes. The types and characteristics of façade falling objects, legislations, practices and the effectiveness of various inspection techniques are discussed. Various diagnostic, inspection and analytical methods which support façade inspection and maintenance are analysed with discussion on the potential future research in this field.
Collapse
|
12
|
Chau WY, Loong CN, Wang YH, Chiu SW, Tan TJ, Wu J, Leung ML, Tan PS, Ooi GL. Understanding the dynamic properties of trees using the motions constructed from multi-beam flash light detection and ranging measurements. J R Soc Interface 2022; 19:20220319. [PMID: 35919983 PMCID: PMC9346362 DOI: 10.1098/rsif.2022.0319] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
Abstract
Measuring the three-dimensional motion of trees at every position remains challenging as it requires dynamic measurement technology with sufficient spatial and temporal resolution. Consequently, this study explores the use of a novel multi-beam flash light detection and ranging (LiDAR) sensor to tackle such a sensing barrier. A framework is proposed to record tree vibrations, to construct the motions of tree skeletons from the point-cloud frames recorded by the LiDAR sensor and to derive the dynamic properties of trees. The feasibility of the framework is justified through measurement on a Ficus microcarpa under pull-and-release tests. The relative differences for the first two modal frequencies between the LiDAR and linear variable differential transformer measurements in the displacement Fourier spectra are 0.1% and 2.5%, respectively. The framework is further adopted to study the dynamic response of different trees subjected to typhoons, including a Liquidambar formosana, three Araucaria heterophylla trees, a Sterculia lanceolata, a Celtis sinensis, a Tabebuia chrysantha and a Cinnamomum camphora. Results suggest that broadleaved trees might exhibit vibration in a wide frequency band, whereas the coniferous trees could follow a distinct dominant frequency.
Collapse
Affiliation(s)
- Wai Yi Chau
- Department of Civil and Environmental Engineering, the Hong Kong University of Science and Technology, Kowloon, Hong Kong
| | - Cheng Ning Loong
- Department of Civil and Environmental Engineering, the Hong Kong University of Science and Technology, Kowloon, Hong Kong
| | - Yu-Hsing Wang
- Department of Civil and Environmental Engineering, the Hong Kong University of Science and Technology, Kowloon, Hong Kong
| | - Siu-Wai Chiu
- Department of Civil and Environmental Engineering, the Hong Kong University of Science and Technology, Kowloon, Hong Kong
| | - Tun Jian Tan
- Department of Civil and Environmental Engineering, the Hong Kong University of Science and Technology, Kowloon, Hong Kong
| | - Jimmy Wu
- Department of Civil and Environmental Engineering, the Hong Kong University of Science and Technology, Kowloon, Hong Kong
| | - Mei Ling Leung
- Department of Civil and Environmental Engineering, the Hong Kong University of Science and Technology, Kowloon, Hong Kong
| | - Pin Siang Tan
- Department of Civil and Environmental Engineering, the Hong Kong University of Science and Technology, Kowloon, Hong Kong
| | - Ghee Leng Ooi
- Department of Civil and Environmental Engineering, the Hong Kong University of Science and Technology, Kowloon, Hong Kong
| |
Collapse
|
13
|
Fang J, Zhang Y, Zhang Y, Guo H, Sun Z. High-Definition Survey of Architectural Heritage Fusing Multisensors-The Case of Beamless Hall at Linggu Temple in Nanjing, China. Sensors (Basel) 2022; 22:3369. [PMID: 35591059 PMCID: PMC9100895 DOI: 10.3390/s22093369] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Revised: 04/25/2022] [Accepted: 04/26/2022] [Indexed: 06/15/2023]
Abstract
Following the development of digital measurement technology in recent years, the information contained in the measurement outcomes have become increasingly rich. However, the traditional graphical representation method based on vector graph needs to be updated. In this study, we use the Beamless Hall of Linggu Temple as an example. Measurements are conducted by using digital techniques, including three-dimensional (3D) laser scanning, close-range photogrammetry, and infrared thermal imaging. The pseudocolours that express spatial information and moisture distribution are calculated and generated through point clouds, which are used to express the land subsidence, wall deformation, moisture distribution, and other effects of the Beamless Hall. Furthermore, combining it with two-dimensional (2D) graphical representation, such as the plan, elevation, and section, damage-related information can be expressed intuitively and efficiently. This method can combine the advantages of graphics and images to provide a comprehensive and intuitive representation of the digital measurement results of brick architecture heritage. It can also provide a reference for surveying similar monuments and buildings of our architectural heritage.
Collapse
|
14
|
Heczko D, Oščádal P, Kot T, Boleslavský A, Krys V, Bém J, Virgala I, Bobovský Z. Finding the Optimal Pose of 2D LLT Sensors to Improve Object Pose Estimation. Sensors (Basel) 2022; 22:1536. [PMID: 35214438 DOI: 10.3390/s22041536] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/07/2022] [Revised: 01/28/2022] [Accepted: 02/15/2022] [Indexed: 12/04/2022]
Abstract
In this paper, we examine a method for improving pose estimation by correctly positioning the sensors relative to the scanned object. Three objects made of different materials and using different manufacturing technologies were selected for the experiment. To collect input data for orientation estimation, a simulation environment was created where each object was scanned at different poses. A simulation model of the laser line triangulation sensor was created for scanning, and the optical surface properties of the scanned objects were set to simulate real scanning conditions. The simulation was verified on a real system using the UR10e robot to rotate and move the object. The presented results show that the simulation matches the real measurements and that the appropriate placement of the sensors has improved the orientation estimation.
Collapse
|
15
|
Lipecki T. Non-Contact Diagnostics of the Geometry of a Historic Wooden Building as an Element of Periodic Safety Assessment. Sensors (Basel) 2022; 22:s22041301. [PMID: 35214204 PMCID: PMC8875963 DOI: 10.3390/s22041301] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/08/2021] [Revised: 02/01/2022] [Accepted: 02/02/2022] [Indexed: 02/05/2023]
Abstract
The article presents a method of non-invasive diagnostics of a historic wooden church, built in the 18th century. Over the hundreds of years of its use, changes in the geometry of the structure have been observed. This article presents the requirements of so-called architectural and geodetic survey and the method of using terrestrial laser scanning to create a three-dimensional solid model of an object. The diagnostic tests performed made it possible to perform analysis based on a so-called point cloud, which is a virtual representation of a real object. In order to determine the basic parameters of the building, the area and volume of all rooms were determined. It was found that the object exhibited deformations that cannot be explained solely as a result of imperfections during climb and normal wear and tear during operation. Therefore, the changes in shape were assessed in detail by means of an assessment of the verticality of the pillars supporting two levels of the church, the verticality of the walls, and the inconsistency of the floors, as well as the shape and horizontality of the roof edge. Additional InSAR and FEM tests of the object’s location on the ground allowed identification of the cause of the object deformation as the influence of inhomogeneous groundwater relations under the building. Without prophylactic measures, this deformation phenomenon can be expected to worsen. The tests described should therefore be considered as essential in subsequent diagnostic cycles and permit future extended numerical FEM analysis.
Collapse
Affiliation(s)
- Tomasz Lipecki
- Faculty of Mining Surveying and Environmental Engineering, AGH University, Al. A. Mickiewicza 30, 30-059 Krakow, Poland
| |
Collapse
|
16
|
Putkiranta P, Kurkela M, Ingman M, Keitaanniemi A, El Issaoui A, Kaartinen H, Honkavaara E, Hyyppä H, Hyyppä J, Vaaja MT. Performance Assessment of Reference Modelling Methods for Defect Evaluation in Asphalt Concrete. Sensors (Basel) 2021; 21:8190. [PMID: 34960282 DOI: 10.3390/s21248190] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/03/2021] [Revised: 11/30/2021] [Accepted: 12/03/2021] [Indexed: 01/18/2023]
Abstract
The deterioration of road conditions and increasing repair deficits pose challenges for the maintenance of reliable road infrastructure, and thus threaten, for example, safety and the fluent flow of traffic. Improved and more efficient procedures for maintenance are required, and these require improved knowledge of road conditions, i.e., improved data. Three-dimensional mapping presents possibilities for large-scale collection of data on road surfaces and automatic evaluation of maintenance needs. However, the development and, specifically, evaluation of large-scale mobile methods requires reliable references. To evaluate possibilities for close-range, static, high-resolution, three-dimensional measurement of road surfaces for reference use, three measurement methods and five instrumentations are investigated: terrestrial laser scanning (TLS, Leica RTC360), photogrammetry using high-resolution professional-grade cameras (Nikon D800 and D810E), photogrammetry using an industrial camera (FLIR Grasshopper GS3-U3-120S6C-C), and structured-light handheld scanners Artec Leo and Faro Freestyle. High-resolution photogrammetry is established as reference based on laboratory measurements and point density. The instrumentations are compared against one another using cross-sections, point–point distances, and ability to obtain key metrics of defects, and a qualitative assessment of the processing procedures for each is carried out. It is found that photogrammetric models provide the highest resolutions (10–50 million points per m2) and photogrammetric and TLS approaches perform robustly in precision with consistent sub-millimeter offsets relative to one another, while handheld scanners perform relatively inconsistently. A discussion on the practical implications of using each of the examined instrumentations is presented.
Collapse
|
17
|
Seo H, Zhao Y, Chen C. Displacement Estimation Error in Laser Scanning Monitoring of Retaining Structures Considering Roughness. Sensors (Basel) 2021; 21:7370. [PMID: 34770674 DOI: 10.3390/s21217370] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/11/2021] [Revised: 10/29/2021] [Accepted: 11/03/2021] [Indexed: 11/25/2022]
Abstract
Point clouds were obtained after laser scanning of the concrete panel, SMW, and sheet pile which is most widely used in retaining structures. The surface condition of the point cloud affects the displacement calculation, and hence both local roughness and global curvature of each point cloud were analyzed using the different sizes of the kernel. The curvature of the three retaining structures was also analyzed by the azimuth angle. In this paper, artificial displacements are generated for the point clouds of 100%, 80%, 60%, 40%, and 20% of the retaining structures, and displacement and analysis errors were calculated using the C2C, C2M, and M3C2 methods. C2C method is affected by the resolution of the point cloud, and the C2M method underestimates the displacement by the location of the points in the curvature of the retaining structures. M3C2 method had the lowest error, and the optimized M3C2 parameters for analyzing the displacement were presented.
Collapse
|
18
|
Deng A, Cao M, Lu Q, Xu W. Identification of Multiple Cracks in Composite Laminated Beams Using Perturbation to Dynamic Equilibrium. Sensors (Basel) 2021; 21:s21186171. [PMID: 34577378 PMCID: PMC8472946 DOI: 10.3390/s21186171] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/04/2021] [Revised: 09/03/2021] [Accepted: 09/10/2021] [Indexed: 11/17/2022]
Abstract
Identification of cracks in beam-type components is significant to ensure the safety of structures. Among the approaches relying on mode shapes, the concept of transverse pseudo-force (TPF) has been well proved for single and multiple crack identification in beams made of isotropic materials; however, there is a noticeable gap between the concept of TPF and its applications in composite laminated beams. To fill this gap, an enhanced TPF approach that relies on perturbation to dynamic equilibrium is proposed for the identification of multiple cracks in composite laminated beams. Starting from the transverse equation of motion, this study formulates the TPF in a composite laminated beam for the identification of multiple cracks. The capability of the approach is numerically verified using the FE method. The applicability of the approach is experimentally validated on a carbon fiber-reinforced polymer laminated beam with three cracks, the mode shapes of which are acquired through non-contact vibration measurement using a scanning laser vibrometer. In particular, a statistic manner is utilized to enable the approach to be feasible to real scenarios in the absence of material and structural information; besides, an integrating scheme is utilized to enable the approach to be capable of identifying cracks even in the vicinity of nodes of mode shapes.
Collapse
Affiliation(s)
- Aimin Deng
- Department of Engineering Mechanics, Hohai University, Nanjing 210098, China; (A.D.); (M.C.); (Q.L.)
- Jiangsu Province Wind Power Structural Engineering Research Center, Hohai University, Nanjing 210098, China
| | - Maosen Cao
- Department of Engineering Mechanics, Hohai University, Nanjing 210098, China; (A.D.); (M.C.); (Q.L.)
- Jiangsu Province Wind Power Structural Engineering Research Center, Hohai University, Nanjing 210098, China
| | - Qitian Lu
- Department of Engineering Mechanics, Hohai University, Nanjing 210098, China; (A.D.); (M.C.); (Q.L.)
- Jiangsu Province Wind Power Structural Engineering Research Center, Hohai University, Nanjing 210098, China
| | - Wei Xu
- Department of Engineering Mechanics, Hohai University, Nanjing 210098, China; (A.D.); (M.C.); (Q.L.)
- Jiangsu Province Wind Power Structural Engineering Research Center, Hohai University, Nanjing 210098, China
- Correspondence:
| |
Collapse
|
19
|
Meana V, Cuesta E, Álvarez BJ. Testing the Sandblasting Process in the Manufacturing of Reference Spheres for Non-Contact Metrology Applications. Materials (Basel) 2021; 14:ma14185187. [PMID: 34576407 PMCID: PMC8468224 DOI: 10.3390/ma14185187] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/22/2021] [Revised: 09/02/2021] [Accepted: 09/08/2021] [Indexed: 11/30/2022]
Abstract
To ensure that measurements can be made with non-contact metrology technologies, it is necessary to use verification and calibration procedures using precision artefacts as reference elements. In this environment, the need for increasingly accurate but also more cost-effective calibration artefacts is a clear demand in industry. The aim of this work is to demonstrate the feasibility of using low-cost precision spheres as reference artefacts in calibration and verification procedures of non-contact metrological equipment. Specifically, low-cost precision stainless steel spheres are used as reference artefacts. Obviously, for such spheres to be used as standard artefacts, it is necessary to change their optical behavior by removing their high brightness. For this purpose, the spheres are subjected to a manual sandblasting process, which is also a very low-cost process. The equipment used to validate the experiment is a laser triangulation sensor mounted on a Coordinate Measuring Machine (CMM). The CMM touch probe, which is much more accurate, will be used as a device for measuring the influence of sandblasting on the spheres. Subsequently, the influence of this post-processing is also checked with the laser triangulation sensor. Ultimately, the improvement in the quality of the point clouds captured by the laser sensor will be tested after removing the brightness, which distorts and reduces the quantity of points as well as the quality of the point clouds. In addition to the number of points obtained, the parameters used to study the effect of sandblasting on each sphere, both in contact probing and laser scanning, are the measured diameter, the form error, as well as the standard deviation of the point cloud regarding the best-fit sphere.
Collapse
|
20
|
Marra A, Gerbino S, Greco A, Fabbrocino G. Combining Integrated Informative System and Historical Digital Twin for Maintenance and Preservation of Artistic Assets. Sensors (Basel) 2021; 21:s21175956. [PMID: 34502848 PMCID: PMC8434664 DOI: 10.3390/s21175956] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/25/2021] [Revised: 08/29/2021] [Accepted: 08/30/2021] [Indexed: 11/30/2022]
Abstract
The protection of artistic and cultural heritage is a major challenge due to its peculiarities and its exposure to significant natural hazards. Several methodologies exist to assess the condition of artistic heritage and to protect it from exceptional actions. Moreover, novel digital technologies offer many solutions able to deliver a digital replica of artifacts of interest, so that a reduction in the uncertainties in the analysis models can be achieved. A rational approach to the preservation and protection of artistic heritage is based on traditional approaches supported and integrated by novel technologies, so that qualitative and quantitative indicators of the current condition of artistic heritage can be defined and validated in an interdisciplinary framework. The present paper reports the results of an approach to the maintenance and preservation of art objects housed in a museum complex based on a comprehensive digital path towards a Historical Digital Twin (HDT). A workflow aimed at estimating the stress regime and the dynamic properties of two sculptures, based on the detailed three-dimensional model resulting from a laser scanner survey, is illustrated and discussed. The results highlight the great advantages resulting from the integration of traditional and novel procedures in the field of conservation of artistic assets.
Collapse
Affiliation(s)
- Adriana Marra
- Institute for Construction Technologies, Italian National Research Council, ITC-CNR, 67100 L’Aquila, Italy;
| | - Salvatore Gerbino
- Department of Engineering—University of Campania “Luigi Vanvitelli”, 81031 Aversa, Italy; (S.G.); (A.G.)
| | - Alessandro Greco
- Department of Engineering—University of Campania “Luigi Vanvitelli”, 81031 Aversa, Italy; (S.G.); (A.G.)
| | - Giovanni Fabbrocino
- Institute for Construction Technologies, Italian National Research Council, ITC-CNR, 67100 L’Aquila, Italy;
- Department of Biosciences and Territory, University of Molise, 86100 Campobasso, Italy
- Correspondence:
| |
Collapse
|
21
|
Brazeal RG, Wilkinson BE, Hochmair HH. A Rigorous Observation Model for the Risley Prism-Based Livox Mid-40 Lidar Sensor. Sensors (Basel) 2021; 21:s21144722. [PMID: 34300462 PMCID: PMC8309668 DOI: 10.3390/s21144722] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/09/2021] [Revised: 07/02/2021] [Accepted: 07/07/2021] [Indexed: 11/16/2022]
Abstract
Modern lidar sensors are continuing to decrease in size, weight, and cost, but the demand for fast, abundant, and high-accuracy lidar observations is only increasing. The Livox Mid-40 lidar sensor was designed for use within sense-and-avoid navigation systems for autonomous vehicles, but has also found adoption within aerial mapping systems. In order to characterize the overall quality of the point clouds from the Mid-40 sensor and enable sensor calibration, a rigorous model of the sensor’s raw observations is needed. This paper presents the development of an angular observation model for the Mid-40 sensor, and its application within an extended Kalman filter that uses the sensor’s data to estimate the model’s operating parameters, systematic errors, and the instantaneous prism rotation angles for the Risley prism optical steering mechanism. The analysis suggests that the Mid-40’s angular observations are more accurate than the specifications provided by the manufacturer. Additionally, it is shown that the prism rotation angles can be used within a planar constrained least-squares adjustment to theoretically improve the accuracy of the angular observations of the Mid-40 sensor.
Collapse
Affiliation(s)
- Ryan G. Brazeal
- Geomatics Program, School of Forest, Fisheries, and Geomatics Sciences, University of Florida, Gainesville, FL 32611, USA;
- Geospatial Modeling and Applications Laboratory, School of Forest, Fisheries, and Geomatics Sciences, University of Florida, Gainesville, FL 32611, USA
| | - Benjamin E. Wilkinson
- Geomatics Program, School of Forest, Fisheries, and Geomatics Sciences, University of Florida, Gainesville, FL 32611, USA;
- Geospatial Modeling and Applications Laboratory, School of Forest, Fisheries, and Geomatics Sciences, University of Florida, Gainesville, FL 32611, USA
- Correspondence:
| | - Hartwig H. Hochmair
- Geomatics Program, Fort Lauderdale Research & Education Center, School of Forest, Fisheries, and Geomatics Sciences, University of Florida, Fort Lauderdale, FL 33314, USA;
| |
Collapse
|
22
|
Han Y, Sun H, Zhong R. Three-Dimensional Linear Restoration of a Tunnel Based on Measured Track and Uncontrolled Mobile Laser Scanning. Sensors (Basel) 2021; 21:s21113815. [PMID: 34072991 PMCID: PMC8197905 DOI: 10.3390/s21113815] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/12/2021] [Revised: 05/26/2021] [Accepted: 05/27/2021] [Indexed: 11/16/2022]
Abstract
Traditional precision measurement adopts discrete artificial static observation, which cannot meet the demands of the dynamic, continuous, fine and high-precision holographic measurement of large-scale infrastructure construction and complex operation and maintenance management. Due to its advantages of fast, accurate and convenient measurement, mobile laser scanning technology is becoming a popular technology in the maintenance and measurement of infrastructure construction such as tunnels. However, in some environments without satellite signals, such as indoor areas and underground spaces, it is difficult to obtain 3D data by means of mobile measurement technology. This paper proposes a method to restore the linear of the point cloud obtained by mobile laser scanning based on the measured track center line. In this paper, the measured track position is interpolated with a cubic spline to calculate the translations, and the rotation parameters are calculated by combining the simulation design data. The point cloud of the cross-section of the tunnel under the local coordinate system is converted to the absolute coordinate system to calculate the tunnel line. In addition, the method is verified by experiments combined with the subway tunnel data, and the overall point error can be controlled to within 0.1 m. The average deviation in the horizontal direction is 0.0551 m, and that in the vertical direction is 0.0274 m. Compared with the previous methods, this method can effectively avoid the obvious deformation of the tunnel and the sharp increase in the error, and can process the tunnel point cloud data more accurately and quickly. It also provides better data support for subsequent tunnel analysis such as 3D display, completion survey, systematic hazard management and so on.
Collapse
|
23
|
Balolia KL, Massey JS. How does scanner choice and 3D model resolution affect data accuracy? J Anat 2021; 238:679-692. [PMID: 33146411 PMCID: PMC7855060 DOI: 10.1111/joa.13343] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2020] [Revised: 08/21/2020] [Accepted: 09/28/2020] [Indexed: 11/28/2022] Open
Abstract
Researchers using digital methods often collect data from 3D models at different resolutions, obtained using different scanning techniques. Although previous research has sought to understand whether scanning method and model resolution affect data accuracy, no study has systematically evaluated the sources of error associated with scanning method, data acquisition method and model resolution with the aim of providing practical recommendations about the model resolution required to yield sufficiently accurate data for specimens of given sizes. In this study, using data taken from primate specimens of three broad size categories, we test whether 3D models obtained using five different scanners (Breuckmann SmartSCAN, DAVID/HP 3D Pro S3, NextEngine 2020i, Creaform Go!Scan 20 and microCT/clinicalCT) yield accurate measurements. We assess whether caliper measurements can be used alongside measurements collected from 3D surface models, whether scanning resolution affects measurement accuracy, and how scan resolution, estimated using each scanner's proprietary software, compares to model resolution measured in a standardized way. Each scanner produces 3D models that yield accurate measurements for each size category, however, combining caliper data with those taken from digital models can be problematic. Our results indicate that the accuracy of measurements taken from 3D models depends on both object size and model resolution. Based on our findings, we recommend that small specimens should be scanned at <0.3 mm, medium specimens at 0.3-0.7 mm, and large specimens at 0.3-0.5 mm resolutions if data taken from 3D surface models are to be combined with caliper datasets. We further show, for the first time, that discrepancies in estimated final model resolution are frequently observed across software packages. We therefore recommend that researchers ensure that final model resolutions are adequate based on specimen size and are independently verified using a software package other than the scanner's proprietary software. Finally, we consider the implications of the findings that measurements obtained from surface models are variably consistent with those obtained using calipers.
Collapse
Affiliation(s)
- Katharine L. Balolia
- School of Archaeology and AnthropologyThe Australian National UniversityCanberraACTAustralia
| | - Jason S. Massey
- Department of Integrative Biology and PhysiologyUniversity of Minnesota Medical SchoolMinneapolisMNUSA
- Department of Anatomy and Developmental BiologyMonash UniversityMelbourneVicAustralia
| |
Collapse
|
24
|
Seidel D, Annighöfer P, Thielman A, Seifert QE, Thauer JH, Glatthorn J, Ehbrecht M, Kneib T, Ammer C. Predicting Tree Species From 3D Laser Scanning Point Clouds Using Deep Learning. Front Plant Sci 2021; 12:635440. [PMID: 33643364 PMCID: PMC7902704 DOI: 10.3389/fpls.2021.635440] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Accepted: 01/19/2021] [Indexed: 06/12/2023]
Abstract
Automated species classification from 3D point clouds is still a challenge. It is, however, an important task for laser scanning-based forest inventory, ecosystem models, and to support forest management. Here, we tested the performance of an image classification approach based on convolutional neural networks (CNNs) with the aim to classify 3D point clouds of seven tree species based on 2D representation in a computationally efficient way. We were particularly interested in how the approach would perform with artificially increased training data size based on image augmentation techniques. Our approach yielded a high classification accuracy (86%) and the confusion matrix revealed that despite rather small sample sizes of the training data for some tree species, classification accuracy was high. We could partly relate this to the successful application of the image augmentation technique, improving our result by 6% in total and 13, 14, and 24% for ash, oak and pine, respectively. The introduced approach is hence not only applicable to small-sized datasets, it is also computationally effective since it relies on 2D instead of 3D data to be processed in the CNN. Our approach was faster and more accurate when compared to the point cloud-based "PointNet" approach.
Collapse
Affiliation(s)
- Dominik Seidel
- Faculty of Forest Sciences, Silviculture and Forest Ecology of the Temperate Zones, University of Göttingen, Göttingen, Germany
| | - Peter Annighöfer
- Forest and Agroforest Systems, Technical University of Munich, Freising, Germany
| | - Anton Thielman
- Campus Institute Data Science and Chairs of Statistics and Econometries, Göttingen, Germany
| | - Quentin Edward Seifert
- Campus Institute Data Science and Chairs of Statistics and Econometries, Göttingen, Germany
| | - Jan-Henrik Thauer
- Campus Institute Data Science and Chairs of Statistics and Econometries, Göttingen, Germany
| | - Jonas Glatthorn
- Faculty of Forest Sciences, Silviculture and Forest Ecology of the Temperate Zones, University of Göttingen, Göttingen, Germany
| | - Martin Ehbrecht
- Faculty of Forest Sciences, Silviculture and Forest Ecology of the Temperate Zones, University of Göttingen, Göttingen, Germany
| | - Thomas Kneib
- Campus Institute Data Science and Chairs of Statistics and Econometries, Göttingen, Germany
| | - Christian Ammer
- Faculty of Forest Sciences, Silviculture and Forest Ecology of the Temperate Zones, University of Göttingen, Göttingen, Germany
| |
Collapse
|
25
|
El Issaoui A, Feng Z, Lehtomäki M, Hyyppä E, Hyyppä H, Kaartinen H, Kukko A, Hyyppä J. Feasibility of Mobile Laser Scanning towards Operational Accurate Road Rut Depth Measurements. Sensors (Basel) 2021; 21:1180. [PMID: 33567550 DOI: 10.3390/s21041180] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/09/2020] [Revised: 01/14/2021] [Accepted: 02/03/2021] [Indexed: 01/18/2023]
Abstract
This paper studied the applicability of the Roamer-R4DW mobile laser scanning (MLS) system for road rut depth measurement. The MLS system was developed by the Finnish Geospatial Research Institute (FGI), and consists of two mobile laser scanners and a Global Navigation Satellite System (GNSS)-inertial measurement unit (IMU) positioning system. In the study, a fully automatic algorithm was developed to calculate and analyze the rut depths, and verified in 64 reference pavement plots (1.0 m × 3.5 m). We showed that terrestrial laser scanning (TLS) data is an adequate reference for MLS-based rutting studies. The MLS-derived rut depths based on 64 plots resulted in 1.4 mm random error, which can be considered adequate precision for operational rutting depth measurements. Such data, also covering the area outside the pavement, would be ideal for multiple road environment applications since the same data can also be used in applications, from high-definition maps to autonomous car navigation and digitalization of street environments over time and in space.
Collapse
|
26
|
Pavlovčič U, Arko P, Jezeršek M. Simultaneous Hand-Eye and Intrinsic Calibration of a Laser Profilometer Mounted on a Robot Arm. Sensors (Basel) 2021; 21:s21041037. [PMID: 33546317 PMCID: PMC7913545 DOI: 10.3390/s21041037] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/03/2020] [Revised: 01/27/2021] [Accepted: 02/02/2021] [Indexed: 11/25/2022]
Abstract
A method for simultaneous laser profilometer and hand–eye calibration in relation to an industrial robot as well as its implementation is presented. In contrast to other methods, the new calibration procedure requires the measurement of only one reference geometry to calculate all the transformation parameters. The reference geometry is measured with a laser profilometer from 15 different poses. The intrinsic parameters of the profilometer, as well as the extrinsic (hand–eye) parameters, are then numerically optimized to achieve the minimum deviation between the reference and the measured geometry. The method was characterized with experiments that revealed a standard deviation of the displacements between the reference geometry after the calibration of less than 0.105 mm in the case of using the robot-arm actuator and 0.046 mm in case of using a 5-axis CNC milling machine. The entire procedure, including measurement and calculation, can be completely automated and lasts less than 10 min. This opens up possibilities for regular on-site recalibration of the entire system.
Collapse
Affiliation(s)
- Urban Pavlovčič
- Laboratory for Laser Techniques, Faculty of Mechanical Engineering, University of Ljubljana, Aškerčeva cesta 6, 1000 Ljubljana, Slovenia;
| | - Peter Arko
- Yaskawa Slovenija d.o.o., Lepovče 23, 1310 Ribnica, Slovenia;
| | - Matija Jezeršek
- Laboratory for Laser Techniques, Faculty of Mechanical Engineering, University of Ljubljana, Aškerčeva cesta 6, 1000 Ljubljana, Slovenia;
- Correspondence: ; Tel.: +386-1-4771-171
| |
Collapse
|
27
|
Cekus D, Kwiatoń P, Nadolski M, Sokół K. Quality Assessment of a Manufactured Bell Using a 3D Scanning Process. Sensors (Basel) 2020; 20:s20247057. [PMID: 33317174 PMCID: PMC7764211 DOI: 10.3390/s20247057] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/16/2020] [Revised: 12/03/2020] [Accepted: 12/07/2020] [Indexed: 06/12/2023]
Abstract
Bells as percussion instruments have been known to humanity for ages. The casting process, the shape and the materials have changed over the years. The functional properties of bells depend on the casting quality and the generated sound. The casting quality is related to the shape, material and technology. The acoustic quality must fulfill specific parameters. This work concerns the assessment of the quality of the manufactured bells and the possibility of replacing tin bronze with a material with similar mechanical properties. Therefore, bell bronze-which is dedicated to this type of work-and aluminum bronze-which is characterized by high strength and hardness, have been applied to casting. The laser scanning technique was used to assess the quality of castings. Based on a point cloud, an optimized mesh was generated from which the 3D model was finally created. On the basis of the CAD model, the defects resulting from the casting process were determined in the form of graphical comparison. The correctness of the selected foundry shrinkage of the selected material was also determined. The manufactured bells were also assessed for sound quality. Vibration frequencies were determined using a vibration analyzer and free software Wavanal. The experimental results were compared with the ones obtained from the numerical frequency analysis. With the help of tests, the quality of the bells was assessed, and it was determined whether aluminum bronze meets the acoustic criteria. The presented method can be used in the development of bell templates. These templates will allow the bell to obtain the correct shape and acoustic quality without the need for a tuning process.
Collapse
Affiliation(s)
- Dawid Cekus
- Department of Mechanics and Machine Design Fundamentals, Faculty of Mechanical Engineering and Computer Science, Czestochowa University of Technology, ul. Dąbrowskiego 73, 42-201 Czestochowa, Poland; (P.K.); (K.S.)
| | - Paweł Kwiatoń
- Department of Mechanics and Machine Design Fundamentals, Faculty of Mechanical Engineering and Computer Science, Czestochowa University of Technology, ul. Dąbrowskiego 73, 42-201 Czestochowa, Poland; (P.K.); (K.S.)
| | - Maciej Nadolski
- Department of Metallurgy and Metal Technology, Faculty of Production Engineering and Materials Technology, Czestochowa University of Technology, Al. Armii Krajowej 19, 42-201 Czestochowa, Poland;
| | - Krzysztof Sokół
- Department of Mechanics and Machine Design Fundamentals, Faculty of Mechanical Engineering and Computer Science, Czestochowa University of Technology, ul. Dąbrowskiego 73, 42-201 Czestochowa, Poland; (P.K.); (K.S.)
| |
Collapse
|
28
|
Chen J, Yi JSK, Kahoush M, Cho ES, Cho YK. Point Cloud Scene Completion of Obstructed Building Facades with Generative Adversarial Inpainting. Sensors (Basel) 2020; 20:s20185029. [PMID: 32899749 PMCID: PMC7571037 DOI: 10.3390/s20185029] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/02/2020] [Revised: 08/29/2020] [Accepted: 09/02/2020] [Indexed: 12/03/2022]
Abstract
Collecting 3D point cloud data of buildings is important for many applications such as urban mapping, renovation, preservation, and energy simulation. However, laser-scanned point clouds are often difficult to analyze, visualize, and interpret due to incompletely scanned building facades caused by numerous sources of defects such as noise, occlusions, and moving objects. Several point cloud scene completion algorithms have been proposed in the literature, but they have been mostly applied to individual objects or small-scale indoor environments and not on large-scale scans of building facades. This paper introduces a method of performing point cloud scene completion of building facades using orthographic projection and generative adversarial inpainting methods. The point cloud is first converted into the 2D structured representation of depth and color images using an orthographic projection approach. Then, a data-driven 2D inpainting approach is used to predict the complete version of the scene, given the incomplete scene in the image domain. The 2D inpainting process is fully automated and uses a customized generative-adversarial network based on Pix2Pix that is trainable end-to-end. The inpainted 2D image is finally converted back into a 3D point cloud using depth remapping. The proposed method is compared against several baseline methods, including geometric methods such as Poisson reconstruction and hole-filling, as well as learning-based methods such as the point completion network (PCN) and TopNet. Performance evaluation is carried out based on the task of reconstructing real-world building facades from partial laser-scanned point clouds. Experimental results using the performance metrics of voxel precision, voxel recall, position error, and color error showed that the proposed method has the best performance overall.
Collapse
Affiliation(s)
- Jingdao Chen
- Institute for Robotics and Intelligent Machines, Georgia Institute of Technology, 801 Atlantic Dr. N.W., Atlanta, GA 30332, USA
- Correspondence:
| | - John Seon Keun Yi
- School of Computer Science, Georgia Institute of Technology, 801 Atlantic Dr. N.W., Atlanta, GA 30332, USA; (J.S.K.Y.); (M.K.)
| | - Mark Kahoush
- School of Computer Science, Georgia Institute of Technology, 801 Atlantic Dr. N.W., Atlanta, GA 30332, USA; (J.S.K.Y.); (M.K.)
| | - Erin S. Cho
- Alpharetta High School, 3595 Webb Bridge Rd, Alpharetta, GA 30005, USA;
| | - Yong K. Cho
- School of Civil and Environmental Engineering, Georgia Institute of Technology, 790 Atlantic Dr. N.W., Atlanta, GA 30332, USA;
| |
Collapse
|
29
|
Chan TO, Xia L, Lichti DD, Sun Y, Wang J, Jiang T, Li Q. Geometric Modelling for 3D Point Clouds of Elbow Joints in Piping Systems. Sensors (Basel) 2020; 20:s20164594. [PMID: 32824328 PMCID: PMC7471979 DOI: 10.3390/s20164594] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/27/2020] [Revised: 08/13/2020] [Accepted: 08/14/2020] [Indexed: 11/16/2022]
Abstract
Pipe elbow joints exist in almost every piping system supporting many important applications such as clean water supply. However, spatial information of the elbow joints is rarely extracted and analyzed from observations such as point cloud data obtained from laser scanning due to lack of a complete geometric model that can be applied to different types of joints. In this paper, we proposed a novel geometric model and several model adaptions for typical elbow joints including the 90° and 45° types, which facilitates the use of 3D point clouds of the elbow joints collected from laser scanning. The model comprises translational, rotational, and dimensional parameters, which can be used not only for monitoring the joints’ geometry but also other applications such as point cloud registrations. Both simulated and real datasets were used to verify the model, and two applications derived from the proposed model (point cloud registration and mounting bracket detection) were shown. The results of the geometric fitting of the simulated datasets suggest that the model can accurately recover the geometry of the joint with very low translational (0.3 mm) and rotational (0.064°) errors when ±0.02 m random errors were introduced to coordinates of a simulated 90° joint (with diameter equal to 0.2 m). The fitting of the real datasets suggests that the accuracy of the diameter estimate reaches 97.2%. The joint-based registration accuracy reaches sub-decimeter and sub-degree levels for the translational and rotational parameters, respectively.
Collapse
Affiliation(s)
- Ting On Chan
- Guangdong Provincial Key Laboratory of Urbanization and Geo-Simulation, School of Geography and Planning, Sun Yat-sen University, Guangzhou 510000, China; (T.O.C.); (T.J.); (Q.L.)
| | - Linyuan Xia
- Guangdong Provincial Key Laboratory of Urbanization and Geo-Simulation, School of Geography and Planning, Sun Yat-sen University, Guangzhou 510000, China; (T.O.C.); (T.J.); (Q.L.)
- Correspondence: ; Tel.: +86-20-84112486
| | - Derek D. Lichti
- Department of Geomatics Engineering, University of Calgary, 2500 University Dr NW, Calgary, AB T2N 1N4, Canada;
| | - Yeran Sun
- Department of Geography, College of Science, Swansea University, Swansea SA28PP, UK;
| | - Jun Wang
- School of Electrical and Computer Engineering, Nanfang College of Sun Yat-sen University, Guangzhou 510000, China;
| | - Tao Jiang
- Guangdong Provincial Key Laboratory of Urbanization and Geo-Simulation, School of Geography and Planning, Sun Yat-sen University, Guangzhou 510000, China; (T.O.C.); (T.J.); (Q.L.)
| | - Qianxia Li
- Guangdong Provincial Key Laboratory of Urbanization and Geo-Simulation, School of Geography and Planning, Sun Yat-sen University, Guangzhou 510000, China; (T.O.C.); (T.J.); (Q.L.)
| |
Collapse
|
30
|
Wang D, Watkins C, Xie H. MEMS Mirrors for LiDAR: A review. Micromachines (Basel) 2020; 11:mi11050456. [PMID: 32349453 PMCID: PMC7281653 DOI: 10.3390/mi11050456] [Citation(s) in RCA: 61] [Impact Index Per Article: 15.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/02/2020] [Revised: 04/23/2020] [Accepted: 04/23/2020] [Indexed: 01/23/2023]
Abstract
In recent years, Light Detection and Ranging (LiDAR) has been drawing extensive attention both in academia and industry because of the increasing demand for autonomous vehicles. LiDAR is believed to be the crucial sensor for autonomous driving and flying, as it can provide high-density point clouds with accurate three-dimensional information. This review presents an extensive overview of Microelectronechanical Systems (MEMS) scanning mirrors specifically for applications in LiDAR systems. MEMS mirror-based laser scanners have unrivalled advantages in terms of size, speed and cost over other types of laser scanners, making them ideal for LiDAR in a wide range of applications. A figure of merit (FoM) is defined for MEMS mirrors in LiDAR scanners in terms of aperture size, field of view (FoV) and resonant frequency. Various MEMS mirrors based on different actuation mechanisms are compared using the FoM. Finally, a preliminary assessment of off-the-shelf MEMS scanned LiDAR systems is given.
Collapse
|
31
|
Kersten T, Paffenholz JA. Feasibility of Consumer Grade GNSS Receivers for the Integration in Multi-Sensor-Systems. Sensors (Basel) 2020; 20:E2463. [PMID: 32357583 DOI: 10.3390/s20092463] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/11/2020] [Revised: 04/23/2020] [Accepted: 04/24/2020] [Indexed: 12/03/2022]
Abstract
Various GNSS applications require low-cost, small-scale, lightweight and power-saving GNSS devices and require high precision in terms of low noise for carrier phase and code observations. Applications vary from navigation approaches to positioning in geo-monitoring units up to integration in multi-sensor-systems. For highest precision, only GNSS receivers are suitable that provide access to raw data such as carrier phase, code ranges, Doppler and signal strength. A system integration is only possible if the overall noise level is known and quantified at the level of the original observations. A benchmark analysis based on a zero baseline is proposed to quantify the stochastic properties. The performance of the consumer grade GNSS receiver is determined and evaluated against geodetic GNSS receivers to better understand the utilization of consumer grade receivers. Results indicate high similarity to the geodetic receiver, even though technical limitations are present. Various stochastic techniques report normally distributed carrier-phase noise of 2 mm and code-range noise of 0.5–0.8 m. This is confirmed by studying the modified Allan standard deviation and code-minus-carrier combinations. Derived parameters serve as important indicators for the integration of GNSS receivers into multi-sensor-systems.
Collapse
|
32
|
Kwiatkowski J, Anigacz W, Beben D. Comparison of Non-Destructive Techniques for Technological Bridge Deflection Testing. Materials (Basel) 2020; 13:ma13081908. [PMID: 32325629 PMCID: PMC7215276 DOI: 10.3390/ma13081908] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/18/2020] [Revised: 04/14/2020] [Accepted: 04/15/2020] [Indexed: 11/27/2022]
Abstract
This paper presents a comparison and assessment of usefulness of various measuring techniques (terrestrial laser scanning (TLS), tachymetry, photogrammetry) applied to establish the behavior of a suspension bridge under different load scenarios. The applied techniques were examined on the bridge with a 165 m span. The tested structure works as the technological bridge for a belt conveyor linking a lime mine and cement plant. The testing range consisted of conducting the non-contact measuring of the bridge and cable displacements under dynamic loads (during the belt conveyor movement—normal service loads) and static loads (while stopped). Tachymetric surveys were carried out using a precise total station (to obtain the reference data). A Canon 750D digital camera was applied in the photogrammetry technique. FARO Focus 3D and Trimble TX8 scanners were employed for the TLS measuring. The obtained results are especially important for bridge inspectors and managers who can use the non-contact measurements of serviced structures.
Collapse
Affiliation(s)
| | - Wojciech Anigacz
- Faculty of Civil Engineering and Architecture, Opole University of Technology, 45-758 Opole, Poland;
| | - Damian Beben
- Faculty of Civil Engineering and Architecture, Opole University of Technology, 45-758 Opole, Poland;
- Correspondence: ; Tel.: +48-77-449-8739
| |
Collapse
|
33
|
Binczyk M, Kalitowski P, Szulwic J, Tysiac P. Nondestructive Testing of the Miter Gates Using Various Measurement Methods. Sensors (Basel) 2020; 20:E1749. [PMID: 32245211 DOI: 10.3390/s20061749] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/12/2020] [Revised: 03/12/2020] [Accepted: 03/19/2020] [Indexed: 11/16/2022]
Abstract
When any problems related to civil engineering structures appear, identifying the issue through the usage of only one measuring method is difficult. Therefore, comprehensive tests are required to identify the main source. The strains and displacement measurements, as well as modal identification, are widely used in the nondestructive testing of structures. However, measurements are usually carried out at several points and confirm or exclude only one of many potential causes of the problem. The main aim of this paper is to identify the causes of miter gates’ excessive vibration. The research includes displacement measurements using a tachometer and a laser scanner, acceleration measurements connected with modal analysis, and calculations with the finite element method (FEM) model. The numerical model underwent verification regarding test results. Particular attention was paid to evaluate the practical use of a laser scanner for diagnosing miter gates. Unlike classical methods, it measures many points. The analysis eliminated a number of potential causes of excessive vibration and highlighted the field of excessive deformation. The identified anomaly could be associated with bearings’ misalignment after closing the door. This construction part should be subjected to further research using classical methods. The laser scanning has been proven to be a method that can only generally present the deformation of the structure.
Collapse
|
34
|
Porcelli F, Sambuelli L, Comina C, Spanò A, Lingua A, Calantropio A, Catanzariti G, Chiabrando F, Fischanger F, Maschio P, Ellaithy A, Airoldi G, De Ruvo V. Integrated Geophysics and Geomatics Surveys in the Valley of the Kings. Sensors (Basel) 2020; 20:E1552. [PMID: 32168983 DOI: 10.3390/s20061552] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/31/2019] [Revised: 03/05/2020] [Accepted: 03/07/2020] [Indexed: 11/24/2022]
Abstract
Recent results within the framework of the collaborative project The Complete Geophysical Survey of the Valley of the Kings (VOK) (Luxor, Egypt) are reported in this article. In October 2018, a team of geomatics and geophysics researchers coordinated by the Polytechnic University of Turin worked side by side in the VOK. Topographic measurements in support of geophysical surveys and the achievement of a very large-scale 3D map of the Eastern VOK were the two main objectives of the geomatics campaign. Innovative 3D metric technologies and methods, based on terrestrial laser scanning (both static and mobile) and close-range photogrammetry were employed by the Geomatics team. The geophysical campaign focused on the acquisition of Electrical Resistivity Tomography (ERT), Ground Penetrating Radar (GPR) and high spatial density Geomagnetic (GM) data. ERT new data around KV62, both inverted in 2D sections and added to the previous ones to perform a new global 3D inversion, confirm the previous results showing both conductive and resistive anomalies that have to be explained. GPR timeslices showed some interesting features in the area in front of the KV2 entrance where GM gradient map also presents localized anomalies. In the area SSW of the KV2 the GM gradient maps evidenced also a large semicircular anomaly which, up to now, has no explanation. The potentialities of using magnetic techniques as a complement to other non-invasive techniques in the search for structures of archeological significance have been explored. The application of modern and innovative methods of 3D metric survey enabled to achieve a complete 3D mapping of what is currently visible in the valley. The integration of 2D/3D mapping data concerning visible elements and hypothetical anomalies, together with the recovering in the same global reference system of underground documentation pertaining to the Theban Mapping Project, prefigure the enhancement of multi-temporal site representation. This strategy enables the fruition development of the already discovered archaeological heritage, using modern criteria of valorization and conservation.
Collapse
|
35
|
Abstract
In light microscopy, illuminating light is passed through the sample as uniformly as possible over the field of view. For thicker samples, where the objective lens does not have sufficient depth of focus, light from sample planes above and below the focal plane will also be detected. The out-of-focus light will add blur to the image, reducing the resolution. In fluorescence microscopy, any dye molecules in the field of view will be stimulated, including those in out-of-focus planes. Confocal microscopy provides a means of rejecting the out-of-focus light from the detector such that it does not contribute blur to the images being collected. This technique allows for high-resolution imaging in thick tissues. In a confocal microscope, the illumination and detection optics are focused on the same diffraction-limited spot in the sample, which is the only spot imaged by the detector during a confocal scan. To generate a complete image, the spot must be moved over the sample and data collected point by point. A significant advantage of the confocal microscope is the optical sectioning provided, which allows for 3D reconstruction of a sample from high-resolution stacks of images. Several types of confocal microscopes have been developed for this purpose, and each has different advantages and disadvantages. This article provides a concise introduction to confocal microscopy. © 2019 by John Wiley & Sons, Inc.
Collapse
Affiliation(s)
- Amicia D. Elliott
- NIMH Section on Neural Function, National Institutes of Health, Bethesda, Maryland
| |
Collapse
|
36
|
Ge Y, Lin Z, Tang H, Zhong P, Cao B. Measurement of Particle Size of Loose Accumulation Based on Alpha Shapes (AS) and Hill Climbing-Region Growing (HC-RG) Algorithms. Sensors (Basel) 2020; 20:s20030883. [PMID: 32046026 PMCID: PMC7039390 DOI: 10.3390/s20030883] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/10/2019] [Revised: 02/01/2020] [Accepted: 02/02/2020] [Indexed: 11/16/2022]
Abstract
The loose accumulation CAUSED by landslide, collapse, debris flow, and mine blasting, exerts considerable negative influence to human activities. Besides, it can easily trigger secondary disaster under inner and outer geological conditions. Extraction and measurement of the particle of loose accumulation is of importance for prediction of slope stability and mine blasting. In this paper, the 3D laser scanning is utilized to collect the point clouds of granular materials in physical model (three types of materials) and landslide accumulation in field, respectively. Then, the alpha shapes (AS) and hill climbing-region growing (HC-RG) algorithms are introduced for identifying particles and finding their dimensions (e.g., particle number and radii). Comparison between the recognition results and reality shows that both algorithms can provide a good performance in laboratory physical model, and acceptable results can be obtained when applying two algorithm to field survey. AS algorithm needs less time to process data than HC-GR algorithm; however, the recognition from HC-RG algorithm is more accurate than that by AS algorithm.
Collapse
Affiliation(s)
- Yunfeng Ge
- Faculty of Engineering, China University of Geosciences, Wuhan 430074, China; (Y.G.); (B.C.)
| | - Zishan Lin
- Faculty of Engineering, China University of Geosciences, Wuhan 430074, China; (Y.G.); (B.C.)
| | - Huiming Tang
- Faculty of Engineering, China University of Geosciences, Wuhan 430074, China; (Y.G.); (B.C.)
- Three Gorges Research Center for Geo-Hazard, Ministry of Education, China University of Geosciences, Wuhan 430074, China
- Correspondence: ; Tel.: +86-136-0715-3663
| | - Peng Zhong
- School of Earth Sciences and Engineering, Nanjing University, Nanjing 210046, China;
| | - Bei Cao
- Faculty of Engineering, China University of Geosciences, Wuhan 430074, China; (Y.G.); (B.C.)
| |
Collapse
|
37
|
Faria M, Ferreira AS, Pérez-Leon H, Maza I, Viguria A. Autonomous 3D Exploration of Large Structures Using an UAV Equipped with a 2D LIDAR. Sensors (Basel) 2019; 19:E4849. [PMID: 31717255 DOI: 10.3390/s19224849] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/30/2019] [Revised: 10/09/2019] [Accepted: 11/05/2019] [Indexed: 12/04/2022]
Abstract
This paper addressed the challenge of exploring large, unknown, and unstructured industrial environments with an unmanned aerial vehicle (UAV). The resulting system combined well-known components and techniques with a new manoeuvre to use a low-cost 2D laser to measure a 3D structure. Our approach combined frontier-based exploration, the Lazy Theta* path planner, and a flyby sampling manoeuvre to create a 3D map of large scenarios. One of the novelties of our system is that all the algorithms relied on the multi-resolution of the octomap for the world representation. We used a Hardware-in-the-Loop (HitL) simulation environment to collect accurate measurements of the capability of the open-source system to run online and on-board the UAV in real-time. Our approach is compared to different reference heuristics under this simulation environment showing better performance in regards to the amount of explored space. With the proposed approach, the UAV is able to explore 93% of the search space under 30 min, generating a path without repetition that adjusts to the occupied space covering indoor locations, irregular structures, and suspended obstacles.
Collapse
|
38
|
Zhang J, Qiu Y, Duan X, Xu K, Yang AC. An Improved Robust Method for Pose Estimation of Cylindrical Parts with Interference Features. Sensors (Basel) 2019; 19:E2234. [PMID: 31091821 DOI: 10.3390/s19102234] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/25/2019] [Revised: 05/12/2019] [Accepted: 05/13/2019] [Indexed: 11/17/2022]
Abstract
Horizontal docking assembly is a fundamental process in the aerospace assembly, where intelligent measurement and adjustable support systems are urgently needed to achieve higher automation and precision. Thus, a laser scanning approach is employed to obtain the point cloud from a laser scanning sensor. And a method of section profile fitting is put forward to solve the pose parameters from the data cloud acquired by the laser scanning sensor. Firstly, the data is segmented into planar profiles by a series of parallel planes, and ellipse fitting is employed to estimate each center of the section profiles. Secondly, the pose of the part can be obtained through a spatial straight line fitting with these profile centers. However, there may be some interference features on the surface of the parts in the practical assembly process, which will cause negative effects to the measurement. Aiming at the interferences, a robust method improved from M-estimation and RANSAC is proposed to enhance the measurement robustness. The proportion of the inner points in a whole profile point set is set as a judgment criterion to validate each planar profile. Finally, a prototype is fabricated, a series of experiments have been conducted to verify the proposed method.
Collapse
|
39
|
Puttonen E, Lehtomäki M, Litkey P, Näsi R, Feng Z, Liang X, Wittke S, Pandžić M, Hakala T, Karjalainen M, Pfeifer N. A Clustering Framework for Monitoring Circadian Rhythm in Structural Dynamics in Plants From Terrestrial Laser Scanning Time Series. Front Plant Sci 2019; 10:486. [PMID: 31110511 PMCID: PMC6499199 DOI: 10.3389/fpls.2019.00486] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/11/2018] [Accepted: 03/29/2019] [Indexed: 05/28/2023]
Abstract
Terrestrial Laser Scanning (TLS) can be used to monitor plant dynamics with a frequency of several times per hour and with sub-centimeter accuracy, regardless of external lighting conditions. TLS point cloud time series measured at short intervals produce large quantities of data requiring fast processing techniques. These must be robust to the noise inherent in point clouds. This study presents a general framework for monitoring circadian rhythm in plant movements from TLS time series. Framework performance was evaluated using TLS time series collected from two Norway maples (Acer platanoides) and a control target, a lamppost. The results showed that the processing framework presented can capture a plant's circadian rhythm in crown and branches down to a spatial resolution of 1 cm. The largest movements in both Norway maples were observed before sunrise and at their crowns' outer edges. The individual cluster movements were up to 0.17 m (99th percentile) for the taller Norway maple and up to 0.11 m (99th percentile) for the smaller tree from their initial positions before sunset.
Collapse
Affiliation(s)
- Eetu Puttonen
- Department of Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute, National Land Survey of Finland, Helsinki, Finland
- Department of Remote Sensing and Photogrammetry, Centre of Excellence in Laser Scanning Research, National Land Survey of Finland, Helsinki, Finland
| | - Matti Lehtomäki
- Department of Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute, National Land Survey of Finland, Helsinki, Finland
| | - Paula Litkey
- Department of Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute, National Land Survey of Finland, Helsinki, Finland
| | - Roope Näsi
- Department of Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute, National Land Survey of Finland, Helsinki, Finland
| | - Ziyi Feng
- Department of Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute, National Land Survey of Finland, Helsinki, Finland
| | - Xinlian Liang
- Department of Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute, National Land Survey of Finland, Helsinki, Finland
| | - Samantha Wittke
- Department of Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute, National Land Survey of Finland, Helsinki, Finland
- Department of Built Environment, Aalto University, Espoo, Finland
| | - Miloš Pandžić
- University of Novi Sad, BioSense Institute, Novi Sad, Serbia
| | - Teemu Hakala
- Department of Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute, National Land Survey of Finland, Helsinki, Finland
- Department of Remote Sensing and Photogrammetry, Centre of Excellence in Laser Scanning Research, National Land Survey of Finland, Helsinki, Finland
| | - Mika Karjalainen
- Department of Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute, National Land Survey of Finland, Helsinki, Finland
- Department of Remote Sensing and Photogrammetry, Centre of Excellence in Laser Scanning Research, National Land Survey of Finland, Helsinki, Finland
| | - Norbert Pfeifer
- Department of Geodesy and Geoinformation, Technische Universität Wien, Vienna, Austria
| |
Collapse
|
40
|
Idrobo-Pizo GA, Motta JMST, Sampaio RC. A Calibration Method for a Laser Triangulation Scanner Mounted on a Robot Arm for Surface Mapping. Sensors (Basel) 2019; 19:s19081783. [PMID: 31013968 PMCID: PMC6515248 DOI: 10.3390/s19081783] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/13/2019] [Revised: 03/06/2019] [Accepted: 03/12/2019] [Indexed: 06/02/2023]
Abstract
This paper presents and discusses a method to calibrate a specially built laser triangulation sensor to scan and map the surface of hydraulic turbine blades and to assign 3D coordinates to a dedicated robot to repair, by welding in layers, the damage on blades eroded by cavitation pitting and/or cracks produced by cyclic loading. Due to the large nonlinearities present in a camera and laser diodes, large range distances become difficult to measure with high precision. Aiming to improve the precision and accuracy of the range measurement sensor based on laser triangulation, a calibration model is proposed that involves the parameters of the camera, lens, laser positions, and sensor position on the robot arm related to the robot base to find the best accuracy in the distance range of the application. The developed sensor is composed of a CMOS camera and two laser diodes that project light lines onto the blade surface and needs image processing to find the 3D coordinates. The distances vary from 250 to 650 mm and the accuracy obtained within the distance range is below 1 mm. The calibration process needs a previous camera calibration and special calibration boards to calculate the correct distance between the laser diodes and the camera. The sensor position fixed on the robot arm is found by moving the robot to selected positions. The experimental procedures show the success of the calibration scheme.
Collapse
Affiliation(s)
- Gerardo Antonio Idrobo-Pizo
- Faculty of Gama-FGA, Department Electronics Engineering, University of Brasilia, Brasilia-DF 72.444-240, Brazil.
| | - José Maurício S T Motta
- Faculty of Technology-FT, Department of Mechanical and Mechatronics Engineering, University of Brasilia, Brasilia-DF 70910-900, Brazil.
| | - Renato Coral Sampaio
- Faculty of Gama-FGA, Department Software Engineering, University of Brasilia, Brasilia-DF 72.444-240, Brazil.
| |
Collapse
|
41
|
Fryskowska A. An Improvement in the Identification of the Centres of Checkerboard Targets in Point Clouds Using Terrestrial Laser Scanning. Sensors (Basel) 2019; 19:s19040938. [PMID: 30813356 PMCID: PMC6412337 DOI: 10.3390/s19040938] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/29/2018] [Revised: 01/25/2019] [Accepted: 02/19/2019] [Indexed: 11/16/2022]
Abstract
Measurement using terrestrial laser scanning is performed at several stations to measure an entire object. In order to obtain a complete and uniform point cloud, it is necessary to register each and every scan in one local or global coordinate system. One registration method is based on reference points-in this case, checkerboard targets. The aim of this research was to analyse the accuracy of checkerboard target identification and propose an algorithm to improve the accuracy of target centre identification, particularly for low-resolution and low-quality point clouds. The proposed solution is based on the geometric determination of the target centre. This work presents an outline of a new approach, designed by the author, to discuss the influence of the point cloud parameters on the process of checkerboard centre identification and to propose an improvement in target centre identification. The validation of the proposed solutions reveals that the difference between the typical automatic target identification and the proposed method amounts to a maximum of 6 mm for scans of different qualities. The proposed method may serve as an alternative to, or supplement for, checkerboard identification, particularly when the quality of these scans is not sufficient for automatic algorithms.
Collapse
Affiliation(s)
- Anna Fryskowska
- Department of Remote Sensing, Photogrammetry and Imagery Intelligence, Geodesy Institute, Faculty of Civil Engineering and Geodesy, Military University of Technology, Warsaw, Poland.
| |
Collapse
|
42
|
Hung TP, Shi HE, Kuang JH. Temperature Modeling of AISI 1045 Steel during Surface Hardening Processes. Materials (Basel) 2018; 11:E1815. [PMID: 30257417 DOI: 10.3390/ma11101815] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/20/2018] [Revised: 09/18/2018] [Accepted: 09/22/2018] [Indexed: 11/17/2022]
Abstract
A Coupled thermo-mechanical finite element model was employed to simulate the possible effects of varying laser scanning parameters on the surface hardening process for AISI 1045 and AISI 4140 steels. We took advantage of the high-power density of laser beams to heat the surface of workpieces quickly to achieve self-quenching effects. The finite element model, along with the temperature-dependent material properties, was applied to characterize the possible quenching and tempering effects during single-track laser surface heat treatment. We verified the accuracy of the proposed model through experiments. The effects of laser surface hardening parameters, such as power variation, scanning speed, and laser spot size, on the surface temperature distribution, hardening width, and hardening depth variations during the single-track surface laser treatment process, were investigated using the proposed model. The analysis results show that laser power and scanning speed are the key parameters that affect the hardening of the material. The numerical results reveal that the proposed finite element model is able to simulate the laser surface heat treatment process and tempering effect of steel.
Collapse
|
43
|
Cheng L, Chen S, Liu X, Xu H, Wu Y, Li M, Chen Y. Registration of Laser Scanning Point Clouds: A Review. Sensors (Basel) 2018; 18:s18051641. [PMID: 29883397 PMCID: PMC5981425 DOI: 10.3390/s18051641] [Citation(s) in RCA: 40] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/21/2018] [Revised: 05/09/2018] [Accepted: 05/16/2018] [Indexed: 11/16/2022]
Abstract
The integration of multi-platform, multi-angle, and multi-temporal LiDAR data has become important for geospatial data applications. This paper presents a comprehensive review of LiDAR data registration in the fields of photogrammetry and remote sensing. At present, a coarse-to-fine registration strategy is commonly used for LiDAR point clouds registration. The coarse registration method is first used to achieve a good initial position, based on which registration is then refined utilizing the fine registration method. According to the coarse-to-fine framework, this paper reviews current registration methods and their methodologies, and identifies important differences between them. The lack of standard data and unified evaluation systems is identified as a factor limiting objective comparison of different methods. The paper also describes the most commonly-used point cloud registration error analysis methods. Finally, avenues for future work on LiDAR data registration in terms of applications, data, and technology are discussed. In particular, there is a need to address registration of multi-angle and multi-scale data from various newly available types of LiDAR hardware, which will play an important role in diverse applications such as forest resource surveys, urban energy use, cultural heritage protection, and unmanned vehicles.
Collapse
Affiliation(s)
- Liang Cheng
- Jiangsu Provincial Key Laboratory of Geographic Information Science and Technology, Nanjing University, Nanjing 210093, China.
- Collaborative Innovation Center for the South Sea Studies, Nanjing University, Nanjing 210093, China.
- Collaborative Innovation Center of Novel Software Technology and Industrialization, Nanjing University, Nanjing 210093, China.
- School of Geographic and Oceanographic Sciences, Nanjing University, Nanjing 210093, China.
| | - Song Chen
- Jiangsu Provincial Key Laboratory of Geographic Information Science and Technology, Nanjing University, Nanjing 210093, China.
- Collaborative Innovation Center for the South Sea Studies, Nanjing University, Nanjing 210093, China.
- School of Geographic and Oceanographic Sciences, Nanjing University, Nanjing 210093, China.
| | - Xiaoqiang Liu
- Jiangsu Provincial Key Laboratory of Geographic Information Science and Technology, Nanjing University, Nanjing 210093, China.
- Collaborative Innovation Center for the South Sea Studies, Nanjing University, Nanjing 210093, China.
- School of Geographic and Oceanographic Sciences, Nanjing University, Nanjing 210093, China.
| | - Hao Xu
- Jiangsu Provincial Key Laboratory of Geographic Information Science and Technology, Nanjing University, Nanjing 210093, China.
- Collaborative Innovation Center for the South Sea Studies, Nanjing University, Nanjing 210093, China.
- School of Geographic and Oceanographic Sciences, Nanjing University, Nanjing 210093, China.
| | - Yang Wu
- Jiangsu Provincial Key Laboratory of Geographic Information Science and Technology, Nanjing University, Nanjing 210093, China.
- Collaborative Innovation Center for the South Sea Studies, Nanjing University, Nanjing 210093, China.
- School of Geographic and Oceanographic Sciences, Nanjing University, Nanjing 210093, China.
| | - Manchun Li
- Jiangsu Provincial Key Laboratory of Geographic Information Science and Technology, Nanjing University, Nanjing 210093, China.
- Collaborative Innovation Center for the South Sea Studies, Nanjing University, Nanjing 210093, China.
- Collaborative Innovation Center of Novel Software Technology and Industrialization, Nanjing University, Nanjing 210093, China.
- School of Geographic and Oceanographic Sciences, Nanjing University, Nanjing 210093, China.
| | - Yanming Chen
- Jiangsu Provincial Key Laboratory of Geographic Information Science and Technology, Nanjing University, Nanjing 210093, China.
- Collaborative Innovation Center for the South Sea Studies, Nanjing University, Nanjing 210093, China.
- Collaborative Innovation Center of Novel Software Technology and Industrialization, Nanjing University, Nanjing 210093, China.
- School of Geographic and Oceanographic Sciences, Nanjing University, Nanjing 210093, China.
| |
Collapse
|
44
|
Hui F, Zhu J, Hu P, Meng L, Zhu B, Guo Y, Li B, Ma Y. Image-based dynamic quantification and high-accuracy 3D evaluation of canopy structure of plant populations. Ann Bot 2018; 121:1079-1088. [PMID: 29509841 PMCID: PMC5906925 DOI: 10.1093/aob/mcy016] [Citation(s) in RCA: 34] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/30/2017] [Accepted: 01/24/2018] [Indexed: 05/24/2023]
Abstract
BACKGROUND AND AIMS Global agriculture is facing the challenge of a phenotyping bottleneck due to large-scale screening/breeding experiments with improved breeds. Phenotypic analysis with high-throughput, high-accuracy and low-cost technologies has therefore become urgent. Recent advances in image-based 3D reconstruction offer the opportunity of high-throughput phenotyping. The main aim of this study was to quantify and evaluate the canopy structure of plant populations in two and three dimensions based on the multi-view stereo (MVS) approach, and to monitor plant growth and development from seedling stage to fruiting stage. METHODS Multi-view images of flat-leaf cucumber, small-leaf pepper and curly-leaf eggplant were obtained by moving a camera around the plant canopy. Three-dimensional point clouds were reconstructed from images based on the MVS approach and were then converted into surfaces with triangular facets. Phenotypic parameters, including leaf length, leaf width, leaf area, plant height and maximum canopy width, were calculated from reconstructed surfaces. Accurate evaluation in 2D and 3D for individual leaves was performed by comparing reconstructed phenotypic parameters with referenced values and by calculating the Hausdorff distance, i.e. the mean distance between two surfaces. KEY RESULTS Our analysis demonstrates that there were good agreements in leaf parameters between referenced and estimated values. A high level of overlap was also found between surfaces of image-based reconstructions and laser scanning. Accuracy of 3D reconstruction of curly-leaf plants was relatively lower than that of flat-leaf plants. Plant height of three plants and maximum canopy width of cucumber and pepper showed an increasing trend during the 70 d after transplanting. Maximum canopy width of eggplants reached its peak at the 40th day after transplanting. The larger leaf phenotypic parameters of cucumber were mostly found at the middle-upper leaf position. CONCLUSIONS High-accuracy 3D evaluation of reconstruction quality indicated that dynamic capture of the 3D canopy based on the MVS approach can be potentially used in 3D phenotyping for applications in breeding and field management.
Collapse
Affiliation(s)
- Fang Hui
- Key Laboratory of Arable Land Conservation (North China), Ministry of Agriculture, College of Resources and Environmental Sciences, China Agricultural University, Beijing, China
| | - Jinyu Zhu
- Institute of Vegetables and Flowers, Chinese Academy of Agricultural Science, Beijing, China
| | - Pengcheng Hu
- Key Laboratory of Arable Land Conservation (North China), Ministry of Agriculture, College of Resources and Environmental Sciences, China Agricultural University, Beijing, China
| | - Lei Meng
- Department of Geography and Institute of the Environment and Sustainability, Western Michigan University, Kalamazoo, MI, USA
| | - Binglin Zhu
- Key Laboratory of Arable Land Conservation (North China), Ministry of Agriculture, College of Resources and Environmental Sciences, China Agricultural University, Beijing, China
| | - Yan Guo
- Key Laboratory of Arable Land Conservation (North China), Ministry of Agriculture, College of Resources and Environmental Sciences, China Agricultural University, Beijing, China
| | - Baoguo Li
- Key Laboratory of Arable Land Conservation (North China), Ministry of Agriculture, College of Resources and Environmental Sciences, China Agricultural University, Beijing, China
| | - Yuntao Ma
- Key Laboratory of Arable Land Conservation (North China), Ministry of Agriculture, College of Resources and Environmental Sciences, China Agricultural University, Beijing, China
| |
Collapse
|
45
|
Pérez-Ruiz M, Rallo P, Jiménez MR, Garrido-Izard M, Suárez MP, Casanova L, Valero C, Martínez-Guanter J, Morales-Sillero A. Evaluation of Over-The-Row Harvester Damage in a Super-High-Density Olive Orchard Using On-Board Sensing Techniques. Sensors (Basel) 2018; 18:E1242. [PMID: 29673226 DOI: 10.3390/s18041242] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/14/2018] [Revised: 04/12/2018] [Accepted: 04/14/2018] [Indexed: 11/17/2022]
Abstract
New super-high-density (SHD) olive orchards designed for mechanical harvesting using over-the-row harvesters are becoming increasingly common around the world. Some studies regarding olive SHD harvesting have focused on the effective removal of the olive fruits; however, the energy applied to the canopy by the harvesting machine that can result in fruit damage, structural damage or extra stress on the trees has been little studied. Using conventional analyses, this study investigates the effects of different nominal speeds and beating frequencies on the removal efficiency and the potential for fruit damage, and it uses remote sensing to determine changes in the plant structures of two varieties of olive trees (‘Manzanilla Cacereña’ and ‘Manzanilla de Sevilla’) planted in SHD orchards harvested by an over-the-row harvester. ‘Manzanilla de Sevilla’ fruit was the least tolerant to damage, and for this variety, harvesting at the highest nominal speed led to the greatest percentage of fruits with cuts. Different vibration patterns were applied to the olive trees and were evaluated using triaxial accelerometers. The use of two light detection and ranging (LiDAR) sensing devices allowed us to evaluate structural changes in the studied olive trees. Before- and after-harvest measurements revealed significant differences in the LiDAR data analysis, particularly at the highest nominal speed. The results of this work show that the operating conditions of the harvester are key to minimising fruit damage and that a rapid estimate of the damage produced by an over-the-row harvester with contactless sensing could provide useful information for automatically adjusting the machine parameters in individual olive groves in the future.
Collapse
|
46
|
Åkerblom M, Raumonen P, Casella E, Disney MI, Danson FM, Gaulton R, Schofield LA, Kaasalainen M. Non-intersecting leaf insertion algorithm for tree structure models. Interface Focus 2018; 8:20170045. [PMID: 29503724 PMCID: PMC5829186 DOI: 10.1098/rsfs.2017.0045] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/07/2017] [Indexed: 11/29/2022] Open
Abstract
We present an algorithm and an implementation to insert broadleaves or needleleaves into a quantitative structure model according to an arbitrary distribution, and a data structure to store the required information efficiently. A structure model contains the geometry and branching structure of a tree. The purpose of this work is to offer a tool for making more realistic simulations of tree models with leaves, particularly for tree models developed from terrestrial laser scanning (TLS) measurements. We demonstrate leaf insertion using cylinder-based structure models, but the associated software implementation is written in a way that enables the easy use of other types of structure models. Distributions controlling leaf location, size and angles as well as the shape of individual leaves are user definable, allowing any type of distribution. The leaf generation process consist of two stages, the first of which generates individual leaf geometry following the input distributions, while in the other stage intersections are prevented by carrying out transformations when required. Initial testing was carried out on English oak trees to demonstrate the approach and to assess the required computational resources. Depending on the size and complexity of the tree, leaf generation takes between 6 and 18 min. Various leaf area density distributions were defined, and the resulting leaf covers were compared with manual leaf harvesting measurements. The results are not conclusive, but they show great potential for the method. In the future, if our method is demonstrated to work well for TLS data from multiple tree types, the approach is likely to be very useful for three-dimensional structure and radiative transfer simulation applications, including remote sensing, ecology and forestry, among others.
Collapse
Affiliation(s)
- Markku Åkerblom
- Laboratory of Mathematics, Tampere University of Technology, PO Box 553, 33101 Tampere, Finland
| | - Pasi Raumonen
- Laboratory of Mathematics, Tampere University of Technology, PO Box 553, 33101 Tampere, Finland
| | - Eric Casella
- Centre for Sustainable Forestry and Climate Change, Forest Research, Farnham GU10 4LH, UK
| | - Mathias I Disney
- Department of Geography, University College London, Gower Street, London WC1E 6BT, UK.,NERC National Centre for Earth Observation (NCEO), UK
| | - F Mark Danson
- School of Environment and Life Sciences, University of Salford, Salford M5 4WT, UK
| | - Rachel Gaulton
- School of Engineering, Newcastle University, Newcastle upon Tyne NE1 7RU, UK
| | - Lucy A Schofield
- School of Humanities, Religion and Philosophy, York St John University, York YO31 7EX, UK
| | - Mikko Kaasalainen
- Laboratory of Mathematics, Tampere University of Technology, PO Box 553, 33101 Tampere, Finland
| |
Collapse
|
47
|
Herzog H, Klein B, Ziegler A. Form and function of the teleost lateral line revealed using three-dimensional imaging and computational fluid dynamics. J R Soc Interface 2018; 14:rsif.2016.0898. [PMID: 28468922 DOI: 10.1098/rsif.2016.0898] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2016] [Accepted: 04/11/2017] [Indexed: 11/12/2022] Open
Abstract
Fishes sense weak water motion using the lateral line. Among the thousands of described fish species, this organ may differ in size, shape and distribution of individual mechanoreceptors or lateral line canals. The reasons for this diversity remain unclear, but are very likely related to habitat preferences. To better understand the performance of the organ in natural hydrodynamic surroundings, various three-dimensional imaging datasets of the cephalic lateral line were gathered using Leuciscus idus as representative freshwater teleost. These data are employed to simulate hydrodynamic phenomena around the head and within lateral line canals. The results show that changes in canal dimensions alter the absolute stimulation amplitudes, but have little effect on the relation between bulk water flow and higher frequency signals. By contrast, depressions in the skin known as epidermal pits reduce bulk flow stimulation and increase the ratio between higher-frequency signals and the background flow stimulus.
Collapse
Affiliation(s)
- Hendrik Herzog
- Institut für Zoologie, Rheinische Friedrich-Wilhelms-Universität Bonn, Poppelsdorfer Schloss, 53115 Bonn, Germany
| | - Birgit Klein
- Institut für Zoologie, Rheinische Friedrich-Wilhelms-Universität Bonn, Poppelsdorfer Schloss, 53115 Bonn, Germany
| | - Alexander Ziegler
- Institut für Evolutionsbiologie und Ökologie, Rheinische Friedrich-Wilhelms-Universität Bonn, An der Immenburg 1, 53121 Bonn, Germany
| |
Collapse
|
48
|
Kaasalainen S, Åkerblom M, Nevalainen O, Hakala T, Kaasalainen M. Uncertainty in multispectral lidar signals caused by incidence angle effects. Interface Focus 2018; 8:20170033. [PMID: 29503718 PMCID: PMC5829180 DOI: 10.1098/rsfs.2017.0033] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/12/2017] [Indexed: 11/12/2022] Open
Abstract
Multispectral terrestrial laser scanning (TLS) is an emerging technology. Several manufacturers already offer commercial dual or three wavelength airborne laser scanners, while multispectral TLS is still carried out mainly with research instruments. Many of these research efforts have focused on the study of vegetation. The aim of this paper is to study the uncertainty of the measurement of spectral indices of vegetation with multispectral lidar. Using two spectral indices as examples, we find that the uncertainty is due to systematic errors caused by the wavelength dependency of laser incidence angle effects. This finding is empirical, and the error cannot be removed by modelling or instrument modification. The discovery and study of these effects has been enabled by hyperspectral and multispectral TLS, and it has become a subject of active research within the past few years. We summarize the most recent studies on multi-wavelength incidence angle effects and present new results on the effect of specular reflection from the leaf surface, and the surface structure, which have been suggested to play a key role. We also discuss the consequences to the measurement of spectral indices with multispectral TLS, and a possible correction scheme using a synthetic laser footprint.
Collapse
Affiliation(s)
- Sanna Kaasalainen
- Finnish Geospatial Research Institute Institute - FGI, Department of Navigation and Positioning, Geodeetinrinne 2, 02431 Masala, Finland
| | - Markku Åkerblom
- Tampere University of Technology, Laboratory of Mathematics, 33101 Tampere, Finland
| | - Olli Nevalainen
- FGI, Department of Remote Sensing and Photogrammetry, Geodeetinrinne 2, 02431 Masala, Finland
| | - Teemu Hakala
- FGI, Department of Remote Sensing and Photogrammetry, Geodeetinrinne 2, 02431 Masala, Finland
| | - Mikko Kaasalainen
- Tampere University of Technology, Laboratory of Mathematics, 33101 Tampere, Finland
| |
Collapse
|
49
|
Morsdorf F, Kükenbrink D, Schneider FD, Abegg M, Schaepman ME. Close-range laser scanning in forests: towards physically based semantics across scales. Interface Focus 2018; 8:20170046. [PMID: 29503725 DOI: 10.1098/rsfs.2017.0046] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/11/2017] [Indexed: 11/12/2022] Open
Abstract
Laser scanning with its unique measurement concept holds the potential to revolutionize the way we assess and quantify three-dimensional vegetation structure. Modern laser systems used at close range, be it on terrestrial, mobile or unmanned aerial platforms, provide dense and accurate three-dimensional data whose information just waits to be harvested. However, the transformation of such data to information is not as straightforward as for airborne and space-borne approaches, where typically empirical models are built using ground truth of target variables. Simpler variables, such as diameter at breast height, can be readily derived and validated. More complex variables, e.g. leaf area index, need a thorough understanding and consideration of the physical particularities of the measurement process and semantic labelling of the point cloud. Quantified structural models provide a framework for such labelling by deriving stem and branch architecture, a basis for many of the more complex structural variables. The physical information of the laser scanning process is still underused and we show how it could play a vital role in conjunction with three-dimensional radiative transfer models to shape the information retrieval methods of the future. Using such a combined forward and physically based approach will make methods robust and transferable. In addition, it avoids replacing observer bias from field inventories with instrument bias from different laser instruments. Still, an intensive dialogue with the users of the derived information is mandatory to potentially re-design structural concepts and variables so that they profit most of the rich data that close-range laser scanning provides.
Collapse
Affiliation(s)
- F Morsdorf
- Remote Sensing Laboratories, Department of Geography, University of Zürich, Winterthurerstrasse 190, 8057 Zürich, Switzerland.,URPP Global Change and Biodiversity, University of Zürich, Winterthurerstrasse 190, 8057 Zürich, Switzerland
| | - D Kükenbrink
- Remote Sensing Laboratories, Department of Geography, University of Zürich, Winterthurerstrasse 190, 8057 Zürich, Switzerland
| | - F D Schneider
- Remote Sensing Laboratories, Department of Geography, University of Zürich, Winterthurerstrasse 190, 8057 Zürich, Switzerland.,URPP Global Change and Biodiversity, University of Zürich, Winterthurerstrasse 190, 8057 Zürich, Switzerland
| | - M Abegg
- Remote Sensing Laboratories, Department of Geography, University of Zürich, Winterthurerstrasse 190, 8057 Zürich, Switzerland.,Forest Resources and Management, WSL Swiss Federal Institute for Forest, Snow and Landscape Research WSL, Zürcherstrasse 111, 8903 Birmensdorf, Switzerland
| | - M E Schaepman
- Remote Sensing Laboratories, Department of Geography, University of Zürich, Winterthurerstrasse 190, 8057 Zürich, Switzerland.,URPP Global Change and Biodiversity, University of Zürich, Winterthurerstrasse 190, 8057 Zürich, Switzerland
| |
Collapse
|
50
|
Zlinszky A, Molnár B, Barfod AS. Not All Trees Sleep the Same-High Temporal Resolution Terrestrial Laser Scanning Shows Differences in Nocturnal Plant Movement. Front Plant Sci 2017; 8:1814. [PMID: 29104583 PMCID: PMC5654925 DOI: 10.3389/fpls.2017.01814] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/09/2017] [Accepted: 10/05/2017] [Indexed: 06/01/2023]
Abstract
Circadian leaf movements are widely known in plants, but nocturnal movement of tree branches were only recently discovered by using terrestrial laser scanning (TLS), a high resolution three-dimensional surveying technique. TLS uses a pulsed laser emitted in a regular scan pattern for rapid measurement of distances to the targets, thus producing three dimensional point cloud models of sub-centimeter resolution and accuracy in a few minutes. Here, we aim to gain an overview of the variability of circadian movement of small trees across different taxonomic groups, growth forms and leaf anatomies. We surveyed a series of 18 full scans over a 12-h night period to measure nocturnal changes in shape simultaneously for an experimental setup of 22 plants representing different species. Resulting point clouds were evaluated by comparing changes in height percentiles of laser scanning points belonging to the canopy. Changes in crown shape were observed for all studied trees, but clearly distinguishable sleep movements are apparently rare. Ambient light conditions were continuously dark between sunset (7:30 p.m.) and sunrise (6:00 a.m.), but most changes in movement direction occurred during this period, thus most of the recorded changes in crown shape were probably not controlled by ambient light. The highest movement amplitudes, for periodic circadian movement around 2 cm were observed for Aesculus and Acer, compared to non-periodic continuous change in shape of 5 cm for Gleditschia and 2 cm for Fargesia. In several species we detected 2-4 h cycles of minor crown movement of 0.5-1 cm, which is close to the limit of our measurement accuracy. We present a conceptual framework for interpreting observed changes as a combination of circadian rhythm with a period close to 12 h, short-term oscillation repeated every 2-4 h, aperiodic continuous movement in one direction and measurement noise which we assume to be random. Observed movement patterns are interpreted within this framework, and connections with morphology and taxonomy are proposed. We confirm the existence of overnight "sleep" movement for some trees, but conclude that circadian movement is a variable phenomenon in plants, probably controlled by a complex combination of anatomical, physiological, and morphological factors.
Collapse
Affiliation(s)
- András Zlinszky
- Balaton Limnological Institute, Centre for Ecological Research, Hungarian Academy of Sciences, Tihany, Hungary
- Ecoinformatics and Biodiversity Section, Department of Bioscience, Aarhus University, Aarhus, Denmark
| | - Bence Molnár
- Department of Photogrammetry and Geoinformatics, Budapest University of Technology and Economics, Budapest, Hungary
| | - Anders S. Barfod
- Ecoinformatics and Biodiversity Section, Department of Bioscience, Aarhus University, Aarhus, Denmark
| |
Collapse
|