1
|
Titmus M, Whittaker G, Radunski M, Ellery P, Ir de Oliveira B, Radley H, Helmholz P, Sun Z. A workflow for the creation of photorealistic 3D cadaveric models using photogrammetry. J Anat 2023; 243:319-333. [PMID: 37432760 DOI: 10.1111/joa.13872] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Revised: 01/20/2023] [Accepted: 03/17/2023] [Indexed: 07/12/2023] Open
Abstract
Three-dimensional (3D) representations of anatomical specimens are increasingly used as learning resources. Photogrammetry is a well-established technique that can be used to generate 3D models and has only been recently applied to produce visualisations of cadaveric specimens. This study has developed a semi-standardised photogrammetry workflow to produce photorealistic models of human specimens. Eight specimens, each with unique anatomical characteristics, were successfully digitised into interactive 3D models using the described workflow and the strengths and limitations of the technique are described. Various tissue types were reconstructed with apparent preservation of geometry and texture which visually resembled the original specimen. Using this workflow, an institution could digitise their existing cadaveric resources, facilitating the delivery of novel educational experiences.
Collapse
Affiliation(s)
- Morgan Titmus
- Curtin Medical School, Curtin University, Perth, Australia
| | - Gary Whittaker
- Curtin Medical School, Curtin University, Perth, Australia
| | - Milo Radunski
- Curtin Medical School, Curtin University, Perth, Australia
| | - Paul Ellery
- Curtin Medical School, Curtin University, Perth, Australia
| | | | - Hannah Radley
- Curtin Medical School, Curtin University, Perth, Australia
| | - Petra Helmholz
- School of Earth and Planetary Sciences, Curtin University, Perth, Australia
| | - Zhonghua Sun
- Curtin Medical School, Curtin University, Perth, Australia
| |
Collapse
|
2
|
Jasińska A, Pyka K, Pastucha E, Midtiby HS. A Simple Way to Reduce 3D Model Deformation in Smartphone Photogrammetry. SENSORS (BASEL, SWITZERLAND) 2023; 23:728. [PMID: 36679525 PMCID: PMC9860635 DOI: 10.3390/s23020728] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/14/2022] [Revised: 01/03/2023] [Accepted: 01/04/2023] [Indexed: 06/17/2023]
Abstract
Recently, the term smartphone photogrammetry gained popularity. This suggests that photogrammetry may become a simple measurement tool by virtually every smartphone user. The research was undertaken to clarify whether it is appropriate to use the Structure from Motion-Multi Stereo View (SfM-MVS) procedure with self-calibration as it is done in Uncrewed Aerial Vehicle photogrammetry. First, the geometric stability of smartphone cameras was tested. Fourteen smartphones were calibrated on the checkerboard test field. The process was repeated multiple times. These observations were found: (1) most smartphone cameras have lower stability of the internal orientation parameters than a Digital Single-Lens Reflex (DSLR) camera, and (2) the principal distance and position of the principal point are constantly changing. Then, based on images from two selected smartphones, 3D models of a small sculpture were developed. The SfM-MVS method was used, with self-calibration and pre-calibration variants. By comparing the resultant models with the reference DSLR-created model it was shown that introducing calibration obtained in the test field instead of self-calibration improves the geometry of 3D models. In particular, deformations of local concavities and convexities decreased. In conclusion, there is real potential in smartphone photogrammetry, but it also has its limits.
Collapse
Affiliation(s)
- Aleksandra Jasińska
- Faculty of Geo-Data Science, Geodesy, and Environmental Engineering, AGH University of Science and Technology, al. Mickiewicza 30, 30-059 Cracow, Poland
| | - Krystian Pyka
- Faculty of Geo-Data Science, Geodesy, and Environmental Engineering, AGH University of Science and Technology, al. Mickiewicza 30, 30-059 Cracow, Poland
| | - Elżbieta Pastucha
- UAS Center, The Maersk Mc-Kinney Moller Institute, University of Southern Denmark, Campusvey 55, 5230 Odense, Denmark
| | - Henrik Skov Midtiby
- UAS Center, The Maersk Mc-Kinney Moller Institute, University of Southern Denmark, Campusvey 55, 5230 Odense, Denmark
| |
Collapse
|
3
|
Li W, Xue Z, Li J, Wang H. The interior environment design for entrepreneurship education under the virtual reality and artificial intelligence-based learning environment. Front Psychol 2022; 13:944060. [PMID: 36438308 PMCID: PMC9683108 DOI: 10.3389/fpsyg.2022.944060] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2022] [Accepted: 09/15/2022] [Indexed: 09/08/2024] Open
Abstract
Nowadays, with the rapid growth of artificial intelligence (AI), entrepreneurship education has attracted more and more attention from society. To this end, it is necessary to gradually transform the traditional teaching mode into a new type of teaching that is more innovative, practical, and inclusive and in line with entrepreneurship education. The focus of the teaching mode change is on the optimization of the teaching environment. For this purpose, a method derived from distributed virtual reality (DVR) technology is specially designed. It refers to the fact that multiple users can join together through a computer network and participate in a virtual space at the same time to experience the virtual experience together. Based on this, the distributed 3D interior design is innovatively proposed. The innovation is mainly reflected in the application of VR technology, which is different from traditional software design. According to the functions and needs of the entrepreneurship teaching environment, first, the distributed feature information is collected, and second, the corresponding color image model is constructed by the fusion method, and edge contour detection and corresponding feature data extraction are carried out for the distributed image. Using a Red, Green, and Blue (RGB) color decomposition method, the pixel feature decomposition of spatially distributed image color is performed. And the feature reorganization of the 3D point cloud is combined to optimize the color space and color features of the combined design. On this basis, the distributed 3D interior design system is designed with VR and visual simulation technology. Finally, the Three-Dimensional Studio Max (3ds MAX) is used to establish 3D modeling, and the modeling software Multigen Creator is adopted to carry out the hierarchical structural design. The test results manifest that the Normalized Root Mean Square Error (RMSE) and information saturation of the distributed 3D interior design are reduced by 0.2 compared with the traditional design, the time overhead is shortened to one-sixth of the original, and the effect is more in line with the design requirements. It is hoped that this design method can provide new ideas and new perspectives for the optimization of the entrepreneurship teaching environment.
Collapse
Affiliation(s)
- Wangting Li
- Academy of Arts, Shandong University of Science and Technology, Qingdao, China
| | - Zhijing Xue
- College of Art and Design, Zhengzhou University of Industry Technology, Zhengzhou, China
| | - Jiayi Li
- College of Business, Gachon University, Seongnam, South Korea
| | - Hongkai Wang
- Academy of Arts and Design, Tsinghua University, Beijing, China
- College of Journalism and Communications, Shih Hsin University, Taipei, China
| |
Collapse
|
4
|
Łabędź P, Skabek K, Ozimek P, Rola D, Ozimek A, Ostrowska K. Accuracy Verification of Surface Models of Architectural Objects from the iPad LiDAR in the Context of Photogrammetry Methods. SENSORS (BASEL, SWITZERLAND) 2022; 22:8504. [PMID: 36366204 PMCID: PMC9657006 DOI: 10.3390/s22218504] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Revised: 10/26/2022] [Accepted: 10/31/2022] [Indexed: 06/16/2023]
Abstract
The creation of accurate three-dimensional models has been radically simplified in recent years by developing photogrammetric methods. However, the photogrammetric procedure requires complex data processing and does not provide an immediate 3D model, so its use during field (in situ) surveys is infeasible. This paper presents the mapping of fragments of built structures at different scales (finest detail, garden sculpture, architectural interior, building facade) by using a LiDAR sensor from the Apple iPad Pro mobile device. The resulting iPad LiDAR and photogrammetric models were compared with reference models derived from laser scanning and point measurements. For small objects with complex geometries acquired by iPad LiDAR, up to 50% of points were unaligned with the reference models, which is much more than for photogrammetric models. This was primarily due to much less frequent sampling and, consequently, a sparser grid. This simplification of object surfaces is highly beneficial in the case of walls and building facades as it smooths out their surfaces. The application potential of the IPad LiDAR Pro is severely constrained by its range cap being 5 m, which greatly limits the size of objects that can be recorded, and excludes most buildings.
Collapse
Affiliation(s)
- Piotr Łabędź
- Faculty of Computer Science and Telecommunications, Cracow University of Technology, Warszawska 24, 31-155 Kraków, Poland
| | - Krzysztof Skabek
- Faculty of Computer Science and Telecommunications, Cracow University of Technology, Warszawska 24, 31-155 Kraków, Poland
| | - Paweł Ozimek
- Faculty of Computer Science and Telecommunications, Cracow University of Technology, Warszawska 24, 31-155 Kraków, Poland
| | - Dominika Rola
- Faculty of Computer Science and Telecommunications, Cracow University of Technology, Warszawska 24, 31-155 Kraków, Poland
| | - Agnieszka Ozimek
- Faculty of Architecture, Cracow University of Technology, Warszawska 24, 31-155 Kraków, Poland
| | - Ksenia Ostrowska
- Faculty of Mechanical Engineering, Cracow University of Technology, al. Jana Pawła II 37, 31-864 Kraków, Poland
| |
Collapse
|
5
|
Multi-Camera Workflow Applied to a Cultural Heritage Building: Alhambra’s Torre de la Cautiva from the Inside. HERITAGE 2021. [DOI: 10.3390/heritage5010002] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
It is increasingly necessary to generate accessible and navigable digital representations of historical or heritage buildings. This article explains the workflow that was applied to create such a digital component for one of the least accessible areas of the Alhambra palace in Granada, the so-called Torre de la Cautiva (Tower of the Captive). The main goal of this process was to create affordable, photorealistic 3D models that contribute to the dissemination of cultural heritage, the decision making for its conservation and restoration, and public engagement and entertainment. With enough preparation, the time spent gathering data following a Structure from Motion (SfM) approach can be significantly reduced by using a multi-camera (low cost DSLR) photogrammetric strategy. Without the possibility of artificial lighting, it was essential to use RAW images and calibrate the color in the scene for material and texture characterization. Through processing, the amount of data was reduced by optimizing the model’s topology. Thus, a photorealistic result was obtained that could be managed and visualized in immersive Visual Reality (VR) environments, simulating different historical periods and environmental and lighting conditions. The potential of this method allows, with slight modifications, the creation of HBIMs and the adaptation to VR systems development, whose current visualization quality is below the resolution of actionable models in rendering engines.
Collapse
|
6
|
Marra A, Gerbino S, Greco A, Fabbrocino G. Combining Integrated Informative System and Historical Digital Twin for Maintenance and Preservation of Artistic Assets. SENSORS 2021; 21:s21175956. [PMID: 34502848 PMCID: PMC8434664 DOI: 10.3390/s21175956] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/25/2021] [Revised: 08/29/2021] [Accepted: 08/30/2021] [Indexed: 11/30/2022]
Abstract
The protection of artistic and cultural heritage is a major challenge due to its peculiarities and its exposure to significant natural hazards. Several methodologies exist to assess the condition of artistic heritage and to protect it from exceptional actions. Moreover, novel digital technologies offer many solutions able to deliver a digital replica of artifacts of interest, so that a reduction in the uncertainties in the analysis models can be achieved. A rational approach to the preservation and protection of artistic heritage is based on traditional approaches supported and integrated by novel technologies, so that qualitative and quantitative indicators of the current condition of artistic heritage can be defined and validated in an interdisciplinary framework. The present paper reports the results of an approach to the maintenance and preservation of art objects housed in a museum complex based on a comprehensive digital path towards a Historical Digital Twin (HDT). A workflow aimed at estimating the stress regime and the dynamic properties of two sculptures, based on the detailed three-dimensional model resulting from a laser scanner survey, is illustrated and discussed. The results highlight the great advantages resulting from the integration of traditional and novel procedures in the field of conservation of artistic assets.
Collapse
Affiliation(s)
- Adriana Marra
- Institute for Construction Technologies, Italian National Research Council, ITC-CNR, 67100 L’Aquila, Italy;
| | - Salvatore Gerbino
- Department of Engineering—University of Campania “Luigi Vanvitelli”, 81031 Aversa, Italy; (S.G.); (A.G.)
| | - Alessandro Greco
- Department of Engineering—University of Campania “Luigi Vanvitelli”, 81031 Aversa, Italy; (S.G.); (A.G.)
| | - Giovanni Fabbrocino
- Institute for Construction Technologies, Italian National Research Council, ITC-CNR, 67100 L’Aquila, Italy;
- Department of Biosciences and Territory, University of Molise, 86100 Campobasso, Italy
- Correspondence:
| |
Collapse
|
7
|
Łabędź P, Skabek K, Ozimek P, Nytko M. Histogram Adjustment of Images for Improving Photogrammetric Reconstruction. SENSORS (BASEL, SWITZERLAND) 2021; 21:4654. [PMID: 34300393 PMCID: PMC8309522 DOI: 10.3390/s21144654] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Revised: 06/26/2021] [Accepted: 07/05/2021] [Indexed: 11/17/2022]
Abstract
The accuracy of photogrammetric reconstruction depends largely on the acquisition conditions and on the quality of input photographs. This paper proposes methods of improving raster images that increase photogrammetric reconstruction accuracy. These methods are based on modifying color image histograms. Special emphasis was placed on the selection of channels of the RGB and CIE L*a*b* color models for further improvement of the reconstruction process. A methodology was proposed for assessing the quality of reconstruction based on premade reference models using positional statistics. The analysis of the influence of image enhancement on reconstruction was carried out for various types of objects. The proposed methods can significantly improve the quality of reconstruction. The superiority of methods based on the luminance channel of the L*a*b* model was demonstrated. Our studies indicated high efficiency of the histogram equalization method (HE), although these results were not highly distinctive for all performed tests.
Collapse
Affiliation(s)
| | | | - Paweł Ozimek
- Faculty of Computer Science and Telecommunications, Cracow University of Technology, Warszawska 24, 31-155 Kraków, Poland; (P.Ł.); (K.S.); (M.N.)
| | | |
Collapse
|
8
|
Digital Modelling and Accuracy Verification of a Complex Architectural Object Based on Photogrammetric Reconstruction. BUILDINGS 2021. [DOI: 10.3390/buildings11050206] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Data concerning heritage buildings are necessary for all kinds of building surveying and design. This paper presents a method for creating a precise model of a historical architectural and landscape object with complex geometry. Photogrammetric techniques were used, combining terrestrial imaging and photographs taken using UAVs. In large-scale objects, it is necessary to divide the reconstruction into smaller parts and adopt an iterative approach based on the gradual completion of missing fragments, especially those resulting from occlusions. The model developed via the reconstruction was compared with geometrically reliable data (LAS point clouds) available in the public domain. The degree of accuracy it achieved can be used in conservation, for example, in construction cost estimates. Despite extensive research on photogrammetric techniques and their applicability in reconstructing cultural heritage sites, the results obtained have not yet been compared by other researchers with LAS point clouds from the information system for land cover (ISOK).
Collapse
|