Estimating age and synthesising growth in children and adolescents using 3D facial prototypes

Coordinate-wise monotonic transformations enable privacy-preserving age estimation with 3D face point cloud

The human face is a valuable biomarker of aging, but the collection and use of its image raise significant privacy concerns. Here we present an approach for facial data masking that preserves age-related features using coordinate-wise monotonic transformations. We first develop a deep learning model that estimates age directly from non-registered face point clouds with high accuracy and generalizability. We show that the model learns a highly indistinguishable mapping using faces treated with coordinate-wise monotonic transformations, indicating that the relative positioning of facial information is a low-level biomarker of facial aging. Through visual perception tests and computational 3D face verification experiments, we demonstrate that transformed faces are significantly more difficult to perceive for human but not for machines, except when only the face shape information is accessible. Our study leads to a facial data protection guideline that has the potential to broaden public access to face datasets with minimized privacy risks.

Using data-driven phenotyping to investigate the impact of sex on 3D human facial surface morphology

The effects of sex on human facial morphology have been widely documented. Because sexual dimorphism is relevant to a variety of scientific and applied disciplines, it is imperative to have a complete and accurate account of how and where male and female faces differ. We apply a comprehensive facial phenotyping strategy to a large set of existing 3D facial surface images. We investigate facial sexual dimorphism in terms of size, shape, and shape variance. We also assess the ability to correctly assign sex based on shape, both for the whole face and for subregions. We applied a predefined data-driven segmentation to partition the 3D facial surfaces of 2446 adults into 63 hierarchically linked regions, ranging from global (whole face) to highly localized subparts. Each facial region was then analyzed with spatially dense geometric morphometrics. To describe the major modes of shape variation, principal components analysis was applied to the Procrustes aligned 3D points comprising each of the 63 facial regions. Both nonparametric and permutation-based statistics were then used to quantify the facial size and shape differences and visualizations were generated. Males were significantly larger than females for all 63 facial regions. Statistically significant sex differences in shape were also seen in all regions and the effects tended to be more pronounced for the upper lip and forehead, with more subtle changes emerging as the facial regions became more granular. Males also showed greater levels of shape variance, with the largest effect observed for the central forehead. Classification accuracy was highest for the full face (97%), while most facial regions showed an accuracy of 75% or greater. In summary, sex differences in both size and shape were present across every part of the face. By breaking the face into subparts, some shape differences emerged that were not apparent when analyzing the face as a whole. The increase in facial shape variance suggests possible evolutionary origins and may offer insights for understanding congenital facial malformations. Our classification results indicate that a high degree of accuracy is possible with only parts of the face, which may have implications for biometrics applications.

Exploring the midline soft tissue surface changes from 12 to 15 years of age in three distinct country population cohorts

INTRODUCTION

Several studies have highlighted differences in the facial features in a White European population. Genetics appear to have a major influence on normal facial variation, and environmental factors are likely to have minor influences on face shape directly or through epigenetic mechanisms.

AIM

The aim of this longitudinal cohort study is to determine the rate of change in midline facial landmarks in three distinct homogenous population groups (Finnish, Latvian, and Welsh) from 12.8 to 15.3 years of age. This age range covers the pubertal growth period for the majority of boys and girls.

METHODS

A cohort of children aged 12 were monitored for facial growth in three countries [Finland (n = 60), Latvia (n = 107), and Wales (n = 96)]. Three-dimensional facial surface images were acquired (using either laser or photogrammetric methods) at regular intervals (6-12 months) for 4 years. Ethical approval was granted in each country. Nine midline landmarks were identified and the relative spatial positions of these surface landmarks were measured relative to the mid-endocanthion (men) over a 4-year period.

RESULTS

This study reports the children who attended 95 per cent of all scanning sessions (Finland 48 out of 60; Latvia 104 out of 107; Wales 50 out of 96). Considerable facial variation is seen for all countries and sexes. There are clear patterns of growth that show different magnitudes at different age groups for the different country groups, sexes, and facial parameters. The greatest single yearly growth rate (5.4 mm) was seen for Welsh males for men-pogonion distance at 13.6 years of age. Males exhibit greater rates of growth compared to females. These variations in magnitude and timings are likely to be influenced by genetic ancestry as a result of population migration.

CONCLUSION

The midline points are a simple and valid method to assess the relative spatial positions of facial surface landmarks. This study confirms previous reports on the subtle differences in facial shapes and sizes of male and female children in different populations and also highlights the magnitudes and timings of growth for various midline landmark distances to the men point.

Age verification using random forests on facial 3D landmarks

Three-dimensional facial images are becoming more and more widespread. As such images provide more information about facial morphology than 2D imagery, they show great promise for use in future forensic applications, including age estimation and verification. This paper proposes an approach using random forests, a machine learning method, to develop and test models for classification of legal age thresholds (15 years and 18 years) using 3D facial landmarks. Our approach was developed on a set of 3D facial scans from 394 Czech individuals (194 males and 200 females) aged between 10 and 25 years. The dataset was retrieved from a sizable database of Central European faces - The FIDENTIS 3D Face Database. Three main types of input variables were processed using random forests: I) shape (size-invariant) coordinates of 3D landmarks, II) size and shape coordinates of 3D landmarks, and III) inter-landmark distances, angles and indices. The performance rates for the combinations of variables and age threshold were expressed in terms of sensitivity and specificity. The overall accuracy rates varied from 71.4%-91.5% (when the male and female samples were pooled). In general, higher accuracy was achieved for the age limit of 18 years than for 15 years. Whereas size-variant variables showed a better performance rate for the age limit of 15 years, the size-invariant variables (i.e., shape variables) were better for classifying individuals under 18 years. The verification models grounded on traditional variables (distances, angles, indices) yielded consistently higher performance rates on females than on males, whereas the inverse trend was observed for the models built on 3D coordinates. The results indicate that age verification based on 3D facial data with processing by the random forests method has high potential for further forensic or biometric applications.

The Use of Eye Tracking to Discern the Threshold at Which Metopic Orbitofrontal Deformity Attracts Attention

INTRODUCTION AND OBJECTIVES

Surgical treatment for trigonocephaly aims to eliminate a stigmatizing deformity, yet the severity that captures unwanted attention is unknown. Surgeons intervene at different points of severity, eliciting controversy. This study used eye tracking to investigate when deformity is perceived.

MATERIAL AND METHODS

Three-dimensional photogrammetric images of a normal child and a child with trigonocephaly were mathematically deformed, in 10% increments, to create a spectrum of 11 images. These images were shown to participants using an eye tracker. Participants' gaze patterns were analyzed, and participants were asked if each image looked "normal" or "abnormal."

RESULTS

Sixty-six graduate students were recruited. Average dwell time toward pathologic areas of interest (AOIs) increased proportionally, from 0.77 ± 0.33 seconds at 0% deformity to 1.08 ± 0.75 seconds at 100% deformity (P < .0001). A majority of participants did not agree an image looked "abnormal" until 90% deformity from any angle.

CONCLUSION

Eye tracking can be used as a proxy for attention threshold toward orbitofrontal deformity. The amount of attention toward orbitofrontal AOIs increased proportionally with severity. Participants did not generally agree there was "abnormality" until deformity was severe. This study supports the assertion that surgical intervention may be best reserved for more severe deformity.

Uniform 3D meshes to establish normative facial averages of healthy infants during the first year of life

Three-dimensional (3D) surface imaging systems are replacing direct anthropometry as the preferred method for capturing facial soft-tissues. Aims of this study were: (1) to develop normative average 3D faces of healthy infants aged 3, 6, 9, and 12 months and (2) to describe normative average 3D facial growth data in infants aged 3 to 12 months. Three-dimensional images of 50 healthy children were acquired at 3, 6, 9, and 12 months of age using the 3dMDcranial system. Four average faces with uniform meshes (3, 6, 9, and 12 months) were developed and registered based on the children’s reference frames. Distance maps of growth of the total facial surface and of the nose, upper lip, chin, forehead and cheeks for the intervals 3 to 6 months, 6 to 9 months, and 9 to 12 months of age were calculated. Mean growth of the total facial surface was 3.9 mm (standard deviation [SD] 1.2 mm), 3.5 mm (SD 0.9 mm), and 1.6 mm (SD 0.7 mm) at 3 to 6 months, 6 to 9 months, and 9 to 12 months, respectively. Regarding the selected regions of the face, the mean growth of the nose and upper lip were the largest (3.7 mm and 3.6 mm, respectively) between 6 and 9 months of age. The mean growth of the forehead, cheeks and chin were the largest (5.4 mm, 3.2, and 4.7 mm, respectively) between 3 and 6 months of age. For all facial regions, growth clearly diminished from 9 to 12 months of age. Normative data on the growth of the full face, nose, upper lip, chin, forehead and cheeks are presented. Such data can be used in future studies to identify the effectiveness of treatment of orofacial deformities such as orofacial clefts during the first year of life.

MeshMonk: Open-source large-scale intensive 3D phenotyping

Dense surface registration, commonly used in computer science, could aid the biological sciences in accurate and comprehensive quantification of biological phenotypes. However, few toolboxes exist that are openly available, non-expert friendly, and validated in a way relevant to biologists. Here, we report a customizable toolbox for reproducible high-throughput dense phenotyping of 3D images, specifically geared towards biological use. Given a target image, a template is first oriented, repositioned, and scaled to the target during a scaled rigid registration step, then transformed further to fit the specific shape of the target using a non-rigid transformation. As validation, we use n = 41 3D facial images to demonstrate that the MeshMonk registration is accurate, with 1.26 mm average error, across 19 landmarks, between placements from manual observers and using the MeshMonk toolbox. We also report no variation in landmark position or centroid size significantly attributable to landmarking method used. Though validated using 19 landmarks, the MeshMonk toolbox produces a dense mesh of vertices across the entire surface, thus facilitating more comprehensive investigations of 3D shape variation. This expansion opens up exciting avenues of study in assessing biological shapes to better understand their phenotypic variation, genetic and developmental underpinnings, and evolutionary history.

Estimation of age in forensic anthropology: historical perspective and recent methodological advances

Estimation of age represents a central focus of forensic anthropological analysis of human skeletal remains and of the living. Advances registered in recent research include the topics of taphonomic impact, new anatomical areas of interest, histology, population variation, the dental pulp chamber, technology, mathematical approaches, biochemical analysis and techniques specifically targeting the living. This article reviews the historical development of age estimation methods and considers likely future directions.

Simulation of facial growth based on longitudinal data: Age progression and age regression between 7 and 17 years of age using 3D surface data

Modelling of the development of facial morphology during childhood and adolescence is highly useful in forensic and biomedical practice. However, most studies in this area fail to capture the essence of the face as a three-dimensional structure. The main aims of our present study were (1) to construct ageing trajectories for the female and male face between 7 and 17 years of age and (2) to propose a three-dimensional age progression (age -regression) system focused on real growth-related facial changes. Our approach was based on an assessment of a total of 522 three-dimensional (3D) facial scans of Czech children (39 boys, 48 girls) that were longitudinally studied between the ages of 7 to 12 and 12 to 17 years. Facial surface scans were obtained using a Vectra-3D scanner and evaluated using geometric morphometric methods (CPD-DCA, PCA, Hotelling’s T² tests). We observed very similar growth rates between 7 and 10 years in both sexes, followed by an increase in growth velocity in both sexes, with maxima between 11 and 12 years in girls and 11 to 13 years in boys, which are connected with the different timing of the onset of puberty. Based on these partly different ageing trajectories for girls and boys, we simulated the effects of age progression (age regression) on facial scans. In girls, the mean error was 1.81 mm at 12 years and 1.7 mm at 17 years. In boys, the prediction system was slightly less successful: 2.0 mm at 12 years and 1.94 mm at 17 years. The areas with the greatest deviations between predicted and real facial morphology were not important for facial recognition. Changes of body mass index percentiles in children throughout the observation period had no significant influence on the accuracy of the age progression models for both sexes.

An overview of the latest developments in facial imaging

Facial imaging is a term used to describe methods that use facial images to assist or facilitate human identification. This pertains to two craniofacial identification procedures that use skulls and faces-facial approximation and photographic superimposition-as well as face-only methods for age progression/regression, the construction of facial graphics from eyewitness memory (including composites and artistic sketches), facial depiction, face mapping and newly emerging methods of molecular photofitting. Given the breadth of these facial imaging techniques, it is not surprising that a broad array of subject-matter experts participate in and/or contribute to the formulation and implementation of these methods (including forensic odontologists, forensic artists, police officers, electrical engineers, anatomists, geneticists, medical image specialists, psychologists, computer graphic programmers and software developers). As they are concerned with the physical characteristics of humans, each of these facial imaging areas also falls in the domain of physical anthropology, although not all of them have been traditionally regarded as such. This too offers useful opportunities to adapt established methods in one domain to others more traditionally held to be disciplines within physical anthropology (e.g. facial approximation, craniofacial superimposition and face photo-comparison). It is important to note that most facial imaging methods are not currently used for identification but serve to assist authorities in narrowing or directing investigations such that other, more potent, methods of identification can be used (e.g. DNA). Few, if any, facial imaging approaches can be considered honed end-stage scientific methods, with major opportunities for physical anthropologists to make meaningful contributions. Some facial imaging methods have considerably stronger scientific underpinnings than others (e.g. facial approximation versus face mapping), some currently lie entirely within the artistic sphere (facial depiction), and yet others are so aspirational that realistic capacity to obtain their aims has strongly been questioned despite highly advanced technical approaches (molecular photofitting). All this makes for a broad-ranging, dynamic and energetic field that is in a constant state of flux. This manuscript provides a theoretical snapshot of the purposes of these methods, the state of science as it pertains to them, and their latest research developments.