VIRTUAL PALEONTOLOGY—AN OVERVIEW

Accelerating segmentation of fossil CT scans through Deep Learning

Recent developments in Deep Learning have opened the possibility for automated segmentation of large and highly detailed CT scan datasets of fossil material. However, previous methodologies have required large amounts of training data to reliably extract complex skeletal structures. Here we present a method for automated Deep Learning segmentation to obtain high-fidelity 3D models of fossils digitally extracted from the surrounding rock, training the model with less than 1%-2% of the total CT dataset. This workflow has the capacity to revolutionise the use of Deep Learning to significantly reduce the processing time of such data and boost the availability of segmented CT-scanned fossil material for future research outputs. Our final Unet segmentation model achieved a validation Dice similarity of 0.96.

Exploring the preservation of a parasitic trace in decapod crustaceans using finite elements analysis

The fossil record of parasitism is poorly understood, due largely to the scarcity of strong fossil evidence of parasites. Understanding the preservation potential for fossil parasitic evidence is critical to contextualizing the fossil record of parasitism. Here, we present the first use of X-ray computed tomography (CT) scanning and finite elements analysis (FEA) to analyze the impact of a parasite-induced fossil trace on host preservation. Four fossil and three modern decapod crustacean specimens with branchial swellings attributed to an epicaridean isopod parasite were CT scanned and examined with FEA to assess differences in the magnitude and distribution of stress between normal and swollen branchial chambers. The results of the FEA show highly localized stress peaks in reaction to point forces, with higher peak stress on the swollen branchial chamber for nearly all specimens and different forces applied, suggesting a possible shape-related decrease in the preservation potential of these parasitic swellings. Broader application of these methods as well as advances in the application of 3D data analysis in paleontology are critical to understanding the fossil record of parasitism and other poorly represented fossil groups.

New insights into endolithic palaeocommunity development in mobile hard substrate using CT imaging of bioeroded clasts from the Pliocene (Almería, SE Spain)

Bioeroded carbonate clasts from a Pliocene shallow-marine succession of Almería (SE Spain, Betic Cordillera) were analysed with computed tomography (CT). This revealed the detailed 3D architecture of bioerosion structures hidden within and allowed for their ichnotaxonomic identification (14 ichnospecies of 5 ichnogenera) and quantification. Borings are produced by worms, mostly polychaetes and sipunculids dominated, followed by bivalves and lastly by sponges. The crosscutting relationship between the borings and their preservation characteristics points to a complex colonization history of the clasts with repeated bioerosive episodes interrupted by physical disturbances, including overturning and abrasion of the clasts followed by their recolonization. Our findings facilitated paleoenvironmental interpretation and can be compared to analogous modern-day ecological succession. The sharp dominance of worm borings - early successional species - may be related to frequent, periodic, physical disturbance that possibly prevented the cobble-dwelling macroboring community from being overtaken by sponges - late successional taxa. CT, hand sample and petrographic observations detected, aside from borings, other irregularly shaped pores which are interpreted to be generated by diagenetic processes including dolomitization, silicification and dissolution, representing an intraparticle moldic and moldic enlarged porosity. Boring porosity crosscutting the diagenetically altered grains suggests the later occurrence of bioerosion processes. Irregular shapes ranging from roughly spherical, elongate sub-polyhedral to amoeboid resemble morphologies produced by modern sponges. Moldic pores possibly acted as primary domiciles for boring sponges, which infested, altered and enlarged pre-existing pores as they grew (as happens in the modern), providing an example of how biological and non-biological processes interacted and together influenced endolithic palaeocommunity development.

DiceCT for fishes: recommendations for pairing iodine contrast agents with μCT to visualize soft tissues in fishes

Computed tomography (CT) scanning and other high-throughput three-dimensional (3D) visualization tools are transforming the ways we study morphology, ecology and evolutionary biology research beyond generating vast digital repositories of anatomical data. Contrast-enhanced chemical staining methods, which render soft tissues radio-opaque when coupled with CT scanning, encompass several approaches that are growing in popularity and versatility. Of these, the various diceCT techniques that use an iodine-based solution like Lugol's have provided access to an array of morphological data sets spanning extant vertebrate lineages. This contribution outlines straightforward means for applying diceCT techniques to preserved museum specimens of cartilaginous and bony fishes, collectively representing half of vertebrate species diversity. This study contrasts the benefits of using either aqueous or ethylic Lugol's solutions and reports few differences between these methods with respect to the time required to achieve optimal tissue contrast. It also explores differences in minimum stain duration required for different body sizes and shapes and provides recommendations for staining specimens individually or in small batches. As reported by earlier studies, the authors note a decrease in pH during staining with either aqueous or ethylic Lugol's. Nonetheless, they could not replicate the drastic declines in pH reported elsewhere. They provide recommendations for researchers and collections staff on how to incorporate diceCT into existing curatorial practices, while offsetting risk to specimens. Finally, they outline how diceCT with Lugol's can aid ichthyologists of all kinds in visualizing anatomical structures of interest: from brains and gizzards to gas bladders and pharyngeal jaw muscles.

Back to life: Techniques for developing high-quality 3D reconstructions of plants and animals from digitized specimens

Expanded use of 3D imaging in organismal biology and paleontology has substantially enhanced the ability to visualize and analyze specimens. These techniques have improved our understanding of the anatomy of many taxa, and the integration of downstream computational tools applied to 3D datasets have broadened the range of analyses that can be performed (e.g., finite element analyses, geometric morphometrics, biomechanical modeling, physical modeling using 3D printing). However, morphological analyses inevitably present challenges, particularly in fossil taxa where taphonomic or preservational artifacts distort and reduce the fidelity of the original morphology through shearing, compression, and disarticulation, for example. Here, we present a compilation of techniques to build high-quality 3D digital models of extant and fossil taxa from 3D imaging data using freely available software for students and educators. Our case studies and associated step-by-step supplementary tutorials present instructions for working with reconstructions of plants and animals to directly address and resolve common issues with 3D imaging data. The strategies demonstrated here optimize scientific accuracy and computational efficiency and can be applied to a broad range of taxa.

Quantitative dual-energy CT as a nondestructive tool to identify indicators for fossilized bone in vertebrate paleontology

Dual-energy computed tomography (DECT) is an imaging technique that combines nondestructive morphological cross-sectional imaging of objects and the quantification of their chemical composition. However, its potential to assist investigations in paleontology has not yet been explored. This study investigates quantitative DECT for the nondestructive density- and element-based material decomposition of fossilized bones. Specifically, DECT was developed and validated for imaging-based calcium and fluorine quantification in bones of five fossil vertebrates from different geological time periods and of one extant vertebrate. The analysis shows that DECT material maps can differentiate bone from surrounding sediment and reveals fluorine as an imaging marker for fossilized bone and a reliable indicator of the age of terrestrial fossils. Moreover, the jaw bone mass of Tyrannosaurus rex showed areas of particularly high fluorine concentrations on DECT, while conventional CT imaging features supported the diagnosis of chronic osteomyelitis. These findings highlight the relevance of radiological imaging techniques in the natural sciences by introducing quantitative DECT imaging as a nondestructive approach for material decomposition in fossilized objects, thereby potentially adding to the toolbox of paleontological studies.

The efficacy of computed tomography scanning versus surface scanning in 3D finite element analysis

Finite element analysis (FEA) is a commonly used application in biomechanical studies of both extant and fossil taxa to assess stress and strain in solid structures such as bone. FEA can be performed on 3D structures that are generated using various methods, including computed tomography (CT) scans and surface scans. While previous palaeobiological studies have used both CT scanned models and surface scanned models, little research has evaluated to what degree FE results may vary when CT scans and surface scans of the same object are compared. Surface scans do not preserve the internal geometries of 3D structures, which are typically preserved in CT scans. Here, we created 3D models from CT scans and surface scans of the same specimens (crania and mandibles of a Nile crocodile, a green sea turtle, and a monitor lizard) and performed FEA under identical loading parameters. It was found that once surface scanned models are solidified, they output stress and strain distributions and model deformations comparable to their CT scanned counterparts, though differing by notable stress and strain magnitudes in some cases, depending on morphology of the specimen and the degree of reconstruction applied. Despite similarities in overall mechanical behaviour, surface scanned models can differ in exterior shape compared to CT scanned models due to inaccuracies that can occur during scanning and reconstruction, resulting in local differences in stress distribution. Solid-fill surface scanned models generally output lower stresses compared to CT scanned models due to their compact interiors, which must be accounted for in studies that use both types of scans.

A Plea for a New Synthesis: From Twentieth-Century Paleobiology to Twenty-First-Century Paleontology and Back Again

In this paper, I will briefly discuss the elements of novelty and continuity between twentieth-century paleobiology and twenty-first-century paleontology. First, I will outline the heated debate over the disciplinary status of paleontology in the mid-twentieth century. Second, I will analyze the main theoretical issue behind this debate by considering two prominent case studies within the broader paleobiology agenda. Third, I will turn to twenty-first century paleontology and address five representative research topics. In doing so, I will characterize twenty-first century paleontology as a science that strives for more data, more technology, and more integration. Finally, I will outline what twenty-first-century paleontology might inherit from twentieth-century paleobiology: the pursuit of and plea for a new synthesis that could lead to a second paleobiological revolution. Following in the footsteps of the paleobiological revolution of the 1960s and 1970s, the paleobiological revolution of the twenty-first century would enable paleontologists to gain strong political representation and argue with a decisive voice at the "high table" on issues such as the expanded evolutionary synthesis, the conservation of Earth's environment, and global climate change.

Paleomimetics: A Conceptual Framework for a Biomimetic Design Inspired by Fossils and Evolutionary Processes

In biomimetic design, functional systems, principles, and processes observed in nature are used for the development of innovative technical systems. The research on functional features is often carried out without giving importance to the generative mechanism behind them: evolution. To deeply understand and evaluate the meaning of functional morphologies, integrative structures, and processes, it is imperative to not only describe, analyse, and test their behaviour, but also to understand the evolutionary history, constraints, and interactions that led to these features. The discipline of palaeontology and its approach can considerably improve the efficiency of biomimetic transfer by analogy of function; additionally, this discipline, as well as biology, can contribute to the development of new shapes, textures, structures, and functional models for productive and generative processes useful in the improvement of designs. Based on the available literature, the present review aims to exhibit the potential contribution that palaeontology can offer to biomimetic processes, integrating specific methodologies and knowledge in a typical biomimetic design approach, as well as laying the foundation for a biomimetic design inspired by extinct species and evolutionary processes: Paleomimetics. A state of the art, definition, method, and tools are provided, and fossil entities are presented as potential role models for technical transfer solutions.

A proposed standard for quantifying 3-D hindlimb joint poses in living and extinct archosaurs

The last common ancestor of birds and crocodylians plus all of its descendants (clade Archosauria) dominated terrestrial Mesozoic ecosystems, giving rise to disparate body plans, sizes, and modes of locomotion. As in the fields of vertebrate morphology and paleontology more generally, studies of archosaur skeletal structure have come to depend on tools for acquiring, measuring, and exploring three‐dimensional (3‐D) digital models. Such models, in turn, form the basis for many analyses of musculoskeletal function. A set of shared conventions for describing 3‐D pose (joint or limb configuration) and 3‐D kinematics (change in pose through time) is essential for fostering comparison of posture/movement among such varied species, as well as for maximizing communication among scientists. Following researchers in human biomechanics, we propose a standard methodological approach for measuring the relative position and orientation of the major segments of the archosaur pelvis and hindlimb in 3‐D. We describe the construction of anatomical and joint coordinate systems using the extant guineafowl and alligator as examples. Our new standards are then applied to three extinct taxa sampled from the wider range of morphological, postural, and kinematic variation that has arisen across >250 million years of archosaur evolution. These proposed conventions, and the founding principles upon which they are based, can also serve as starting points for measuring poses between elements within a hindlimb segment, for establishing coordinate systems in the forelimb and axial skeleton, or for applying our archosaurian system more broadly to different vertebrate clades.

Histology and μCT reveal the unique evolution and development of multiple tooth rows in the synapsid Endothiodon

Several amniote lineages independently evolved multiple rows of marginal teeth in response to the challenge of processing high fiber plant matter. Multiple tooth rows develop via alterations to tooth replacement in captorhinid reptiles and ornithischian dinosaurs, but the specific changes that produce this morphology differ, reflecting differences in their modes of tooth attachment. To further understand the mechanisms by which multiple tooth rows can develop, we examined this feature in Endothiodon bathystoma, a member of the only synapsid clade (Anomodontia) to evolve a multi-rowed marginal dentition. We histologically sampled Endothiodon mandibles with and without multiple tooth rows as well as single-rowed maxillae. We also segmented functional and replacement teeth in µ-CT scanned mandibles and maxillae of Endothiodon and several other anomodonts with 'postcanine' teeth to characterize tooth replacement in the clade. All anomodonts in our sample displayed a space around the tooth roots for a soft tissue attachment between tooth and jaw in life. Trails of alveolar bone indicate varying degrees of labial migration of teeth through ontogeny, often altering the spatial relationships of functional and replacement teeth in the upper and lower jaws. We present a model of multiple tooth row development in E. bathystoma in which labial migration of functional teeth was extensive enough to prevent resorption and replacement by newer generations of teeth. This model represents another mechanism by which multiple tooth rows evolved in amniotes. The multiple tooth rows of E. bathystoma may have provided more extensive contact between the teeth and a triturating surface on the palatine during chewing.

The use of photogrammetric fossil models in palaeontology education

Photogrammetry allows overlapping photographs of fossils to be taken and converted into photo-realistic three-dimensional (3-D) digital models. These models offer potential advantages in teaching palaeontology: they are cheap to produce, can be easily shared and allow the study of rare and delicate specimens. Here I describe approaches for using photogrammetric models in the teaching and learning of palaeontology. Little is known about how students perceive these models and whether they find them valuable in their learning. To address this, first-year university students taught using both fossil specimens and digital models were surveyed about their experience through an anonymous online survey. Most students found that the digital models were easy to use, helped them understand anatomy and were more useful than studying photographs. However, most did not see the models as a substitute for studying real fossils and felt they could learn more from physical models. Digital models are a useful addition to palaeontological education that can supplement real fossils and allow palaeontological education to take place in circumstances where handling of specimens is not possible.

Three-dimensional segmentation of computed tomography data using Drishti Paint: new tools and developments

Computed tomography (CT) has become very widely used in scientific and medical research and industry for its non-destructive and high-resolution means of detecting internal structure. Three-dimensional segmentation of computed tomography data sheds light on internal features of target objects. Three-dimensional segmentation of CT data is supported by various well-established software programs, but the powerful functionalities and capabilities of open-source software have not been fully revealed. Here, we present a new release of the open-source volume exploration, rendering and three-dimensional segmentation software, Drishti v. 2.7. We introduce a new tool for thresholding volume data (i.e. gradient thresholding) and a protocol for performing three-dimensional segmentation using the 3D Freeform Painter tool. These new tools and workflow enable more accurate and precise digital reconstruction, three-dimensional modelling and three-dimensional printing results. We use scan data of a fossil fish as a case study, but our procedure is widely applicable in biological, medical and industrial research.

Extracting Three-dimensional Information from SEM Images by Means of Photogrammetry

Optical photogrammetry software has been applied to scanning electron microscope images to obtain 3D models and quantitative data on carbon particles and graphite nanoparticles. Image acquisition has been automated by the use of external macro software. Mesh data has been reconstructed from a number of images taken at multiple sample stage tilt angles with a supplementary measurement of TEM grids for method validation. This 3D model has been scaled and processed to obtain values such as the volume, height and surface area of the samples and has been quantitatively compared to 2D measurements.

Evaluating fidelity of CT based 3D models for Zebrafish conductive hearing system

The zebrafish Weberian apparatus is an emerging model for human conductive hearing system. Their Weberian apparatus comprises minute bones and ligamentary links, and conducts sound pressure transmission from the gas bladder to inner ear through four pairs of Weberian ossicles along the vertebral column. We herein present a methodological study using MicroCT to image the Weberian apparatus for biomechanical and morphological analysis. The aim of this work is to evaluate computational models generated from multiple MicroCT scans with different parameters, to identify the most feasible scan combination for practical (minimized scan time) yet accurate (relative to highest resolution) biomechanical simulations. We segmented and created 3D models from CT scan image stacks at 4.64 μm, 5.05 μm, 9.30 μm and 13.08 μm voxel resolutions, respectively. Then, we used geometric morphometrics analysis to quantify inter-model shape differences, as well as a series of finite element modal and harmonic analyses to simulate auditory signal vibrations. Relative to the highest resolution and most accurate model, the Model 9.30 is closest in overall geometry and biomechanical behavior of all lower resolution models. The differences in resolution and quality of the CT substantially affect the segmentation and reconstruction process of the three-dimensional model of the ossicles, and the subsequent analyses. We conclude that scan voxel resolution is a key factor influencing outcomes of biomechanical simulations of delicate and minute structures, especially when studying the harmonic response of minute ossicles connected by ligaments using finite element modeling. Furthermore, contrast variations in CT images as determined by x-ray power and scan speed, also affect fidelity in 3D models and simulation outcomes.

Technoscientific approaches to deep time

In this paper, I argue that in order to understand the process behind the knowledge production in the historical sciences, we should change our theoretical focus slightly to consider the historical sciences as technoscientific disciplines. If we investigate the intertwinement of technology and theory, we can provide new insights into historical scientific knowledge production, preconditions, and aims. I will provide evidence for my claim by showing the central features of paleontological and paleobiological data practices of the nineteenth and twentieth centuries. In order to work with something that is imperfect and incomplete (the fossil record), paleontologists used different technological devices. These devices process, extract, correct, simulate, and eventually present paleontological explananda. Therefore, the appearance of anatomical features of non-manipulable fossilized organisms, phenomena such as mass-extinctions, or the life-like display of extinct specimens in a museum's hall, depend both on the correct use of technological devices and on the interplay between these devices and theories. Consequently, in order to capture its underlying epistemology, historical sciences should be analyzed and investigated against other technoscientific disciplines such as chemistry, synthetic biology, and nanotechnology, and not necessarily only against classical experimental sciences. This approach will help us understand how historical scientists can obtain their epistemic access to deep time.

Brain evolution in Proboscidea (Mammalia, Afrotheria) across the Cenozoic

As the largest and among the most behaviourally complex extant terrestrial mammals, proboscideans (elephants and their extinct relatives) are iconic representatives of the modern megafauna. The timing of the evolution of large brain size and above average encephalization quotient remains poorly understood due to the paucity of described endocranial casts. Here we created the most complete dataset on proboscidean endocranial capacity and analysed it using phylogenetic comparative methods and ancestral character states reconstruction using maximum likelihood. Our analyses support that, in general, brain size and body mass co-evolved in proboscideans across the Cenozoic; however, this pattern appears disrupted by two instances of specific increases in relative brain size in the late Oligocene and early Miocene. These increases in encephalization quotients seem to correspond to intervals of important climatic, environmental and faunal changes in Africa that may have positively selected for larger brain size or body mass.

Protocol for the reconstruction of micromammals from fossils. Two case studies: The skulls of Beremendia fissidens and Dolinasorex glyphodon

We have developed a protocol for reconstructing 3D models of the skulls of extinct species of small mammals. For the first time, the reconstruction uses fragments of fossils from a mixture of different specimens and from related extant species. We use free software and commercial computers to make the process reproducible and usable for the scientific community. We present a semi-quantitative protocol to face the problem of making 3D reconstructions of fossil species that are incomplete in the fossil record and/or represented by a mixture of different individuals, as usually occurs with small vertebrates. Therefore this approach is useful when no complete skull is available. The protocol combines the use of microCT scan technology with a subsequent computer treatment using different software tools for 3D reconstruction from microCT and 3D design and printing (e.g. Fiji, SPIERS, Meshlab, Meshmixer) in a defined order. This kind of free and relatively simple software, plus the detailed description, makes this protocol practicable for researchers who do not necessarily have great deal of experience in working with 3D. As an example, we have performed virtual reconstructions of the skulls of two species of insectivore small mammals (Eulipotyphla): Beremendia fissidens and Dolinasorex glyphodon. The resulting skulls, plus models of the extant shrews Blarina brevicauda, Neomys fodiens, Crocidura russula and Sorex coronatus, make it possible to compare characteristics that can only be observed by means of microCT 3D reconstructions, and given the characteristics of the material, using this protocol. Among the characters we can compare are the position of the mandibles, the spatial relations among all the teeth, the shape of the snout and, in general, all parameters related with the anatomy of the rostrum. Moreover, these reconstructions can be used in different types of context: for anatomical purposes, especially to see internal features or characteristics at whole-skull scale, for bioengineering, animation, or other techniques that need a digital model.

APPLICATIONS OF THREE-DIMENSIONAL BOX MODELING TO PALEONTOLOGICAL FUNCTIONAL ANALYSIS

Functional analysis through computer modeling can inform on how extinct organisms moved and fed, allowing us to test long-standing paleobiological hypotheses. Many such studies are based on digital models derived from computed tomography or surface scanning, but these methods are not appropriate for all fossils. Here, we show that box modeling—3-D modeling of complex shapes based on simple objects—can be used to reconstruct the morphology of various fossil specimens. Moreover, the results of computational functional analyses utilizing such models are very similar to those for models derived from tomographic or surface-based techniques. Box modeling is more broadly applicable than alternative methods for digitizing specimens; hence, there is great potential for this approach in paleontological functional analysis. Possible applications include large-scale comparative studies, analyses of hypothetical morphologies, and virtually restoring incomplete/distorted specimens.