Recognition of the Cornelia de Lange syndrome phenotype with facial dysmorphology novel analysis

Accuracy and repeatability of fetal facial measurements in 3D ultrasound: A longitudinal study

OBJECTIVE

Fetal face measurements in prenatal ultrasound can aid in identifying craniofacial abnormalities in the developing fetus. However, the accuracy and reliability of ultrasound measurements can be affected by factors such as fetal position, image quality, and the sonographer's expertise. This study assesses the accuracy and reliability of fetal facial measurements in prenatal ultrasound. Additionally, the temporal evolution of measurements is studied, comparing prenatal and postnatal measurements.

METHODS

Three different experts located up to 23 facial landmarks in 49 prenatal 3D ultrasound scans from normal Caucasian fetuses at weeks 20, 26, and 35 of gestation. Intra- and inter-observer variability was obtained. Postnatal facial measurements were also obtained at 15 days and 1 month postpartum.

RESULTS

Most facial landmarks exhibited low errors, with overall intra- and inter-observer errors of 1.01 mm and 1.60 mm, respectively. Landmarks on the nose were found to be the most reliable, while the most challenging ones were those located on the ears and eyes. Overall, scans obtained at 26 weeks of gestation presented the best trade-off between observer variability and landmark visibility. The temporal evolution of the measurements revealed that the lower face area had the highest rate of growth throughout the latest stages of pregnancy.

CONCLUSIONS

Craniofacial landmarks can be evaluated using 3D fetal ultrasound, especially those located on the nose, mouth, and chin. Despite its limitations, this study provides valuable insights into prenatal and postnatal biometric changes over time, which could aid in developing predictive models for postnatal measurements based on prenatal data.

Artificial intelligence facial recognition system for diagnosis of endocrine and metabolic syndromes based on a facial image database

AIM

To build a facial image database and to explore the diagnostic efficacy and influencing factors of the artificial intelligence-based facial recognition (AI-FR) system for multiple endocrine and metabolic syndromes.

METHODS

Individuals with multiple endocrine and metabolic syndromes and healthy controls were included from public literature and databases. In this facial image database, facial images and clinical data were collected for each participant and dFRI (disease facial recognition intensity) was calculated to quantify facial complexity of each syndrome. AI-FR diagnosis models were trained for each disease using three algorithms: support vector machine (SVM), principal component analysis k-nearest neighbor (PCA-KNN), and adaptive boosting (AdaBoost). Diagnostic performance was evaluated. Optimal efficacy was achieved as the best index among the three models. Effect factors of AI-FR diagnosis were explored with regression analysis.

RESULTS

462 cases of 10 endocrine and metabolic syndromes and 2310 controls were included into the facial image database. The AI-FR diagnostic models showed diagnostic accuracies of 0.827-0.920 with SVM, 0.766-0.890 with PCA-KNN, and 0.818-0.935 with AdaBoost. Higher dFRI was associated with higher optimal area under the curve (AUC) (P = 0.035). No significant correlation was observed between the sample size of the training set and diagnostic performance.

CONCLUSIONS

A multi-ethnic, multi-regional, and multi-disease facial database for 10 endocrine and metabolic syndromes was built. AI-FR models displayed ideal diagnostic performance. dFRI proved associated with the diagnostic performance, suggesting inherent facial features might contribute to the performance of AI-FR models.

Application of the Face2Gene tool in an Italian dysmorphological pediatric clinic: Retrospective validation and future perspectives

Neurodevelopmental disorders exhibit recurrent facial features that can suggest the genetic diagnosis at a glance, but recognizing subtle dysmorphisms is a specialized skill that requires very long training. Face2Gene (FDNA Inc) is an innovative computer-aided phenotyping tool that analyses patient's portraits and suggests 30 candidate syndromes with similar morphology in a prioritized list. We hypothesized that the software could support even expert physicians in the diagnostic workup of genetic conditions. In this study, we assessed the performance of Face2Gene in an Italian dysmorphological pediatrics clinic. We uploaded two-dimensional face pictures of 145 children affected by genetic conditions with typical phenotypic traits. All diagnoses were previously confirmed by cytogenetic or molecular tests. Overall, the software's differential included the correct syndrome in most cases (98%). We evaluated the efficiency of the algorithm even considering the rareness of the genetic conditions. All "common" diagnoses were correctly identified, most of them with high diagnostic accuracy (93% in top-3 matches). Finally, the performance for the most common pediatric syndromes was calculated. Face2Gene performed well even for ultra-rare genetic conditions (75% within top-3 matches and 83% within top-10 matches). Expert geneticists maybe do not need computer support to recognize common syndromes, but our results prove that the tool can be useful not only for general pediatricians but also in dysmorphological clinics for ultra-rare genetic conditions.

An interactive atlas of three-dimensional syndromic facial morphology

Craniofacial phenotyping is critical for both syndrome delineation and diagnosis because craniofacial abnormalities occur in 30% of characterized genetic syndromes. Clinical reports, textbooks, and available software tools typically provide two-dimensional, static images and illustrations of the characteristic phenotypes of genetic syndromes. In this work, we provide an interactive web application that provides three-dimensional, dynamic visualizations for the characteristic craniofacial effects of 95 syndromes. Users can visualize syndrome facial appearance estimates quantified from data and easily compare craniofacial phenotypes of different syndromes. Our application also provides a map of morphological similarity between a target syndrome and other syndromes. Finally, users can upload 3D facial scans of individuals and compare them to our syndrome atlas estimates. In summary, we provide an interactive reference for the craniofacial phenotypes of syndromes that allows for precise, individual-specific comparisons of dysmorphology.

Deep-learning approach to detect childhood glaucoma based on periocular photograph

Childhood glaucoma is one of the major causes of blindness in children, however, its diagnosis is of great challenge. The study aimed to demonstrate and evaluate the performance of a deep-learning (DL) model for detecting childhood glaucoma based on periocular photographs. Primary gaze photographs of children diagnosed with glaucoma with appearance features (corneal opacity, corneal enlargement, and/or globe enlargement) were retrospectively collected from the database of a single referral center. DL framework with the RepVGG architecture was used to automatically recognize childhood glaucoma from photographs. The average receiver operating characteristic curve (AUC) of fivefold cross-validation was 0.91. When the fivefold result was assembled, the DL model achieved an AUC of 0.95 with a sensitivity of 0.85 and specificity of 0.94. The DL model showed comparable accuracy to the pediatric ophthalmologists and glaucoma specialists in diagnosing childhood glaucoma (0.90 vs 0.81, p = 0.22, chi-square test), outperforming the average of human examiners in the detection rate of childhood glaucoma in cases without corneal opacity (72% vs. 34%, p = 0.038, chi-square test), with a bilateral corneal enlargement (100% vs. 67%, p = 0.03), and without skin lesions (87% vs. 64%, p = 0.02). Hence, this DL model is a promising tool for diagnosing missed childhood glaucoma cases.

A Deep-Learning-Based Method Can Detect Both Common and Rare Genetic Disorders in Fetal Ultrasound

A global survey indicates that genetic syndromes affect approximately 8% of the population, but most genetic diagnoses can only be performed after babies are born. Abnormal facial characteristics have been identified in various genetic diseases; however, current facial identification technologies cannot be applied to prenatal diagnosis. We developed Pgds-ResNet, a fully automated prenatal screening algorithm based on deep neural networks, to detect high-risk fetuses affected by a variety of genetic diseases. In screening for Trisomy 21, Trisomy 18, Trisomy 13, and rare genetic diseases, Pgds-ResNet achieved sensitivities of 0.83, 0.92, 0.75, and 0.96, and specificities of 0.94, 0.93, 0.95, and 0.92, respectively. As shown in heatmaps, the abnormalities detected by Pgds-ResNet are consistent with clinical reports. In a comparative experiment, the performance of Pgds-ResNet is comparable to that of experienced sonographers. This fetal genetic screening technology offers an opportunity for early risk assessment and presents a non-invasive, affordable, and complementary method to identify high-risk fetuses affected by genetic diseases. Additionally, it has the capability to screen for certain rare genetic conditions, thereby enhancing the clinic's detection rate.

Chung-Jansen syndrome can mimic Cornelia de Lange syndrome: Another player among chromatinopathies?

Cornelia de Lange syndrome (CdLS) is a rare multisystem congenital neurodevelopmental disorder (NDD) characterized by distinctive facial anomalies, short stature, developmental delay, hirsutism, gastrointestinal abnormalities and upper limb reduction defects. CdLS syndrome is associated with causative variants in genes encoding for the cohesin complex, a cellular machinery involved in chromatid pairing, DNA repair and gene-expression regulation. In this report, we describe a familial case of a syndromic presentation in a 4-year-old patient (P1) and in his mother (P2). Trio-based Whole Exome Sequencing (WES) performed on P1 was first negative. Since his phenotypic evolution during the follow-up was reminiscent of the CdLS spectrum, a reanalysis of WES data, focused on CdLS-related genes, was requested. Although no alterations in those genes was detected, we identified the likely pathogenetic variant c.40G > A (p.Glu14Lys) in the PHIP gene, in the meanwhile associated with Chung-Jansen syndrome. Reverse phenotyping carried out in both patients confirmed the molecular diagnosis. CHUJANS belongs to NDDs, featuring developmental delay, mild-to-moderate intellectual disability, behavioral problems, obesity and facial dysmorphisms. Moreover, as here described, CHUJANS shows a significant overlap with the CdLS spectrum, with specific regard to facial gestalt. On the basis of our findings, we suggest to include PHIP among genes routinely analyzed in patients belonging to the CdLS spectrum.

Prediction of anemia using facial images and deep learning technology in the emergency department

Background

According to the WHO, anemia is a highly prevalent disease, especially for patients in the emergency department. The pathophysiological mechanism by which anemia can affect facial characteristics, such as membrane pallor, has been proven to detect anemia with the help of deep learning technology. The quick prediction method for the patient in the emergency department is important to screen the anemic state and judge the necessity of blood transfusion treatment.

Method

We trained a deep learning system to predict anemia using videos of 316 patients. All the videos were taken with the same portable pad in the ambient environment of the emergency department. The video extraction and face recognition methods were used to highlight the facial area for analysis. Accuracy and area under the curve were used to assess the performance of the machine learning system at the image level and the patient level.

Results

Three tasks were applied for performance evaluation. The objective of Task 1 was to predict patients' anemic states [hemoglobin (Hb) <13 g/dl in men and Hb <12 g/dl in women]. The accuracy of the image level was 82.37%, the area under the curve (AUC) of the image level was 0.84, the accuracy of the patient level was 84.02%, the sensitivity of the patient level was 92.59%, and the specificity of the patient level was 69.23%. The objective of Task 2 was to predict mild anemia (Hb <9 g/dl). The accuracy of the image level was 68.37%, the AUC of the image level was 0.69, the accuracy of the patient level was 70.58%, the sensitivity was 73.52%, and the specificity was 67.64%. The aim of task 3 was to predict severe anemia (Hb <7 g/dl). The accuracy of the image level was 74.01%, the AUC of the image level was 0.82, the accuracy of the patient level was 68.42%, the sensitivity was 61.53%, and the specificity was 83.33%.

Conclusion

The machine learning system could quickly and accurately predict the anemia of patients in the emergency department and aid in the treatment decision for urgent blood transfusion. It offers great clinical value and practical significance in expediting diagnosis, improving medical resource allocation, and providing appropriate treatment in the future.

Case Report: The success of face analysis technology in extremely rare genetic diseases in Korea: Tatton–Brown–Rahman syndrome and Say–Barber –Biesecker–Young–Simpson variant of ohdo syndrome

Tatton–Brown–Rahman syndrome (TBRS) and Say–Barber–Biesecker– Young–Simpson variant of Ohdo syndrome (SBBYSS) are extremely rare genetic disorders with less than 100 reported cases. Patients with these disorders exhibit a characteristic facial dysmorphism: TBRS is characterized by a round face, a straight and thick eyebrow, and prominent maxillary incisors, whereas SBBYSS is characterized by mask-like facies, blepharophimosis, and ptosis. The usefulness of Face2Gene as a tool for the identification of dysmorphology syndromes is discussed, because, in these patients, it suggested TBRS and SBBYSS within the top five candidate disorders. Face2Gene is useful for the diagnosis of extremely rare diseases in Korean patients, suggesting the possibility of expanding its clinical applications.

Cross-sectional observational analysis of the genetic referral practices across pediatric ophthalmology outpatient departments in an urban setting

Purpose

To analyze the genetic referral practices of pediatric ophthalmologists in an urban setting.

Methods

(1) The first limb of the study: cross-sectional, observational study among children visiting the outpatient department of pediatric ophthalmology across five centers in Mumbai. All pediatric patients were screened separately by pediatric ophthalmologists and a clinical geneticist for their ophthalmic and systemic complaints. Children were marked for referral to genetics (RTG) by both the specialists based on identification of distinctive features (red flag) and were requested to meet a local geneticist. (2a) Twenty-three months later, patients who had been marked for RTG were contacted telephonically to follow-up if they had met the geneticist. (2b) Additionally, the last 20 proformas from each center were checked retrospectively to note the RTG marked by the ophthalmologist alone.

Results

(1) In the first aspect of the study, 126 patients (male: female = 1.2:1) were included. Forty-nine (38.3%) patients were referred for genetic evaluation, of which three (6.1%), 31 (63.26%), and 15 (30.6%) cases were referred by the ophthalmologist alone, geneticist alone, and by both the specialists, respectively. Glaucoma (100%), nystagmus (86%), and leukocoria (83%) were the most prominent ocular diagnoses in cases referred for genetic evaluation. Facial dysmorphism (55.1%) and neurodevelopmental delays (51%) were among the most common systemic red flags found in patients referred to genetics. (2a) Twenty-three months later, on contacting the 49 patients marked for RTG, only one family had met the geneticist. (2b) Retrospective evaluation of 100 proformas: only three patients were marked for RTG by ophthalmologist alone.

Conclusion

This study found that the genetic referrals by pediatric ophthalmologist were far lesser than those by geneticist. The study highlights an area of knowledge gap among pediatric ophthalmologists, prompting a need for heightened awareness in this area.

Review on Facial-Recognition-Based Applications in Disease Diagnosis

Diseases not only manifest as internal structural and functional abnormalities, but also have facial characteristics and appearance deformities. Specific facial phenotypes are potential diagnostic markers, especially for endocrine and metabolic syndromes, genetic disorders, facial neuromuscular diseases, etc. The technology of facial recognition (FR) has been developed for more than a half century, but research in automated identification applied in clinical medicine has exploded only in the last decade. Artificial-intelligence-based FR has been found to have superior performance in diagnosis of diseases. This interdisciplinary field is promising for the optimization of the screening and diagnosis process and assisting in clinical evaluation and decision-making. However, only a few instances have been translated to practical use, and there is need of an overview for integration and future perspectives. This review mainly focuses on the leading edge of technology and applications in varieties of disease, and discusses implications for further exploration.

Cornelia de Lange Syndrome

Cornelia de Lange syndrome (CdLS) is a rare, multifactorial, multisystem disorder that affects approximately 1/10,000-100,000 newborns. Mutations and/or variants have been identified in seven genes that have been associated with the diagnosis of this disorder. As all of them affect the cohesin complex, CdLS is also referred to as a "transcriptomopathy" or "cohesinopathy." The phenotype and presentation vary greatly, though there is a classic phenotype that includes a distinctive craniofacial appearance and growth pattern in addition to limb malformations. Because there are multiple overlapping phenotypes with Cornelia de Lange syndrome and other syndromes and sequences, early diagnosis and management of Cornelia de Lange syndrome is imperative. This will enhance the quality of life for individuals with this disorder, as many are now likely to live well into adulthood.

Static and Motion Facial Analysis for Craniofacial Assessment and Diagnosing Diseases

Deviation from a normal facial shape and symmetry can arise from numerous sources, including physical injury and congenital birth defects. Such abnormalities can have important aesthetic and functional consequences. Furthermore, in clinical genetics distinctive facial appearances are often associated with clinical or genetic diagnoses; the recognition of a characteristic facial appearance can substantially narrow the search space of potential diagnoses for the clinician. Unusual patterns of facial movement and expression can indicate disturbances to normal mechanical functioning or emotional affect. Computational analyses of static and moving 2D and 3D images can serve clinicians and researchers by detecting and describing facial structural, mechanical, and affective abnormalities objectively. In this review we survey traditional and emerging methods of facial analysis, including statistical shape modeling, syndrome classification, modeling clinical face phenotype spaces, and analysis of facial motion and affect. Expected final online publication date for the Annual Review of Biomedical Data Science, Volume 5 is August 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Convolutional mesh autoencoders for the 3-dimensional identification of FGFR-related craniosynostosis

Clinical diagnosis of craniofacial anomalies requires expert knowledge. Recent studies have shown that artificial intelligence (AI) based facial analysis can match the diagnostic capabilities of expert clinicians in syndrome identification. In general, these systems use 2D images and analyse texture and colour. They are powerful tools for photographic analysis but are not suitable for use with medical imaging modalities such as ultrasound, MRI or CT, and are unable to take shape information into consideration when making a diagnostic prediction. 3D morphable models (3DMMs), and their recently proposed successors, mesh autoencoders, analyse surface topography rather than texture enabling analysis from photography and all common medical imaging modalities and present an alternative to image-based analysis. We present a craniofacial analysis framework for syndrome identification using Convolutional Mesh Autoencoders (CMAs). The models were trained using 3D photographs of the general population (LSFM and LYHM), computed tomography data (CT) scans from healthy infants and patients with 3 genetically distinct craniofacial syndromes (Muenke, Crouzon, Apert). Machine diagnosis outperformed expert clinical diagnosis with an accuracy of 99.98%, sensitivity of 99.95% and specificity of 100%. The diagnostic precision of this technique supports its potential inclusion in clinical decision support systems. Its reliance on 3D topography characterisation make it suitable for AI assisted diagnosis in medical imaging as well as photographic analysis in the clinical setting.

A deep learning-based diagnostic tool for identifying various diseases via facial images

With the current health crisis caused by the COVID-19 pandemic, patients have become more anxious about infection, so they prefer not to have direct contact with doctors or clinicians. Lately, medical scientists have confirmed that several diseases exhibit corresponding specific features on the face the face. Recent studies have indicated that computer-aided facial diagnosis can be a promising tool for the automatic diagnosis and screening of diseases from facial images. However, few of these studies used deep learning (DL) techniques. Most of them focused on detecting a single disease, using handcrafted feature extraction methods and conventional machine learning techniques based on individual classifiers trained on small and private datasets using images taken from a controlled environment. This study proposes a novel computer-aided facial diagnosis system called FaceDisNet that uses a new public dataset based on images taken from an unconstrained environment and could be employed for forthcoming comparisons. It detects single and multiple diseases. FaceDisNet is constructed by integrating several spatial deep features from convolutional neural networks of various architectures. It does not depend only on spatial features but also extracts spatial-spectral features. FaceDisNet searches for the fused spatial-spectral feature set that has the greatest impact on the classification. It employs two feature selection techniques to reduce the large dimension of features resulting from feature fusion. Finally, it builds an ensemble classifier based on stacking to perform classification. The performance of FaceDisNet verifies its ability to diagnose single and multiple diseases. FaceDisNet achieved a maximum accuracy of 98.57% and 98% after the ensemble classification and feature selection steps for binary and multiclass classification categories. These results prove that FaceDisNet is a reliable tool and could be employed to avoid the difficulties and complications of manual diagnosis. Also, it can help physicians achieve accurate diagnoses without the need for physical contact with the patients.

PURA-Related Developmental and Epileptic Encephalopathy: Phenotypic and Genotypic Spectrum

BACKGROUND AND OBJECTIVES

Purine-rich element-binding protein A (PURA) gene encodes Pur-α, a conserved protein essential for normal postnatal brain development. Recently, a PURA syndrome characterized by intellectual disability, hypotonia, epilepsy, and dysmorphic features was suggested. The aim of this study was to define and expand the phenotypic spectrum of PURA syndrome by collecting data, including EEG, from a large cohort of affected patients.

METHODS

Data on unpublished and published cases were collected through the PURA Syndrome Foundation and the literature. Data on clinical, genetic, neuroimaging, and neurophysiologic features were obtained.

RESULTS

A cohort of 142 patients was included. Characteristics of the PURA syndrome included neonatal hypotonia, feeding difficulties, and respiratory distress. Sixty percent of the patients developed epilepsy with myoclonic, generalized tonic-clonic, focal seizures, and/or epileptic spasms. EEG showed generalized, multifocal, or focal epileptic abnormalities. Lennox-Gastaut was the most common epilepsy syndrome. Drug refractoriness was common: 33.3% achieved seizure freedom. We found 97 pathogenic variants in PURA without any clear genotype-phenotype associations.

DISCUSSION

The PURA syndrome presents with a developmental and epileptic encephalopathy with characteristics recognizable from neonatal age, which should prompt genetic screening. Sixty percent have drug-resistant epilepsy with focal or generalized seizures. We collected more than 90 pathogenic variants without observing overt genotype-phenotype associations.

Using deep-neural-network-driven facial recognition to identify distinct Kabuki syndrome 1 and 2 gestalt

Kabuki syndrome (KS) is a rare genetic disorder caused by mutations in two major genes, KMT2D and KDM6A, that are responsible for Kabuki syndrome 1 (KS1, OMIM147920) and Kabuki syndrome 2 (KS2, OMIM300867), respectively. We lack a description of clinical signs to distinguish KS1 and KS2. We used facial morphology analysis to detect any facial morphological differences between the two KS types. We used a facial-recognition algorithm to explore any facial morphologic differences between the two types of KS. We compared several image series of KS1 and KS2 individuals, then compared images of those of Caucasian origin only (12 individuals for each gene) because this was the main ethnicity in this series. We also collected 32 images from the literature to amass a large series. We externally validated results obtained by the algorithm with evaluations by trained clinical geneticists using the same set of pictures. Use of the algorithm revealed a statistically significant difference between each group for our series of images, demonstrating a different facial morphotype between KS1 and KS2 individuals (mean area under the receiver operating characteristic curve = 0.85 [p = 0.027] between KS1 and KS2). The algorithm was better at discriminating between the two types of KS with images from our series than those from the literature (p = 0.0007). Clinical geneticists trained to distinguished KS1 and KS2 significantly recognised a unique facial morphotype, which validated algorithm findings (p = 1.6e-11). Our deep-neural-network-driven facial-recognition algorithm can reveal specific composite gestalt images for KS1 and KS2 individuals.

A Markerless 2D Video, Facial Feature Recognition-Based, Artificial Intelligence Model to Assist With Screening for Parkinson Disease: Development and Usability Study

Background

Masked face is a characteristic clinical manifestation of Parkinson disease (PD), but subjective evaluations from different clinicians often show low consistency owing to a lack of accurate detection technology. Hence, it is of great significance to develop methods to make monitoring easier and more accessible.

Objective

The study aimed to develop a markerless 2D video, facial feature recognition–based, artificial intelligence (AI) model to assess facial features of PD patients and investigate how AI could help neurologists improve the performance of early PD diagnosis.

Methods

We collected 140 videos of facial expressions from 70 PD patients and 70 matched controls from 3 hospitals using a single 2D video camera. We developed and tested an AI model that performs masked face recognition of PD patients based on the acquisition and evaluation of facial features including geometric and texture features. Random forest, support vector machines, and k-nearest neighbor were used to train the model. The diagnostic performance of the AI model was compared with that of 5 neurologists.

Results

The experimental results showed that our AI models can achieve feasible and effective facial feature recognition ability to assist with PD diagnosis. The accuracy of PD diagnosis can reach 83% using geometric features. And with the model trained by random forest, the accuracy of texture features is up to 86%. When these 2 features are combined, an F1 value of 88% can be reached, where the random forest algorithm is used. Further, the facial features of patients with PD were not associated with the motor and nonmotor symptoms of PD.

Conclusions

PD patients commonly exhibit masked facial features. Videos of a facial feature recognition–based AI model can provide a valuable tool to assist with PD diagnosis and the potential of realizing remote monitoring of the patient’s condition, especially during the COVID-19 pandemic.

Deep learning-based facial image analysis in medical research: a systematic review protocol

INTRODUCTION

Deep learning techniques are gaining momentum in medical research. Evidence shows that deep learning has advantages over humans in image identification and classification, such as facial image analysis in detecting people's medical conditions. While positive findings are available, little is known about the state-of-the-art of deep learning-based facial image analysis in the medical context. For the consideration of patients' welfare and the development of the practice, a timely understanding of the challenges and opportunities faced by research on deep-learning-based facial image analysis is needed. To address this gap, we aim to conduct a systematic review to identify the characteristics and effects of deep learning-based facial image analysis in medical research. Insights gained from this systematic review will provide a much-needed understanding of the characteristics, challenges, as well as opportunities in deep learning-based facial image analysis applied in the contexts of disease detection, diagnosis and prognosis.

METHODS

Databases including PubMed, PsycINFO, CINAHL, IEEEXplore and Scopus will be searched for relevant studies published in English in September, 2021. Titles, abstracts and full-text articles will be screened to identify eligible articles. A manual search of the reference lists of the included articles will also be conducted. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses framework was adopted to guide the systematic review process. Two reviewers will independently examine the citations and select studies for inclusion. Discrepancies will be resolved by group discussions till a consensus is reached. Data will be extracted based on the research objective and selection criteria adopted in this study.

ETHICS AND DISSEMINATION

As the study is a protocol for a systematic review, ethical approval is not required. The study findings will be disseminated via peer-reviewed publications and conference presentations.

PROSPERO REGISTRATION NUMBER

CRD42020196473.

Facial Recognition Intensity in Disease Diagnosis Using Automatic Facial Recognition

Artificial intelligence (AI) technology is widely applied in different medical fields, including the diagnosis of various diseases on the basis of facial phenotypes, but there is no evaluation or quantitative synthesis regarding the performance of artificial intelligence. Here, for the first time, we summarized and quantitatively analyzed studies on the diagnosis of heterogeneous diseases on the basis on facial features. In pooled data from 20 systematically identified studies involving 7 single diseases and 12,557 subjects, quantitative random-effects models revealed a pooled sensitivity of 89% (95% CI 82% to 93%) and a pooled specificity of 92% (95% CI 87% to 95%). A new index, the facial recognition intensity (FRI), was established to describe the complexity of the association of diseases with facial phenotypes. Meta-regression revealed the important contribution of FRI to heterogeneous diagnostic accuracy (p = 0.021), and a similar result was found in subgroup analyses (p = 0.003). An appropriate increase in the training size and the use of deep learning models helped to improve the diagnostic accuracy for diseases with low FRI, although no statistically significant association was found between accuracy and photographic resolution, training size, AI architecture, and number of diseases. In addition, a novel hypothesis is proposed for universal rules in AI performance, providing a new idea that could be explored in other AI applications.

Innovation in Informatics to Improve Clinical Care and Drug Accessibility for Rare Diseases in China

Background: In China, there are severe unmet medical needs of people living with rare diseases. Relatedly, there is a dearth of data to inform rare diseases policy. This is historically partially due to the lack of informatics infrastructure, including standards and terminology, data sharing mechanisms and network; and concerns over patient privacy protection.

Objective: This study aims to introduce the progress of China's rare disease informatics platform and knowledgebase, and to discuss critical enablers of rare disease informatics innovation, including: data standardization; knowledgebase construction; national policy support; and multi-stakeholder participation.

Methods: A systemic national strategy, delivered through multi-stakeholder engagement, has been implemented to create and accelerate the informatics infrastructure to support rare diseases management. This includes a disease registry system, together with more than 80 hospitals, to perform comprehensive research information collection, including clinical, genomic and bio-sample data. And a case reporting system, with a network of 324 hospitals, covering all mainland Chinese provinces, to further support reporting of rare diseases data. International standards were incorporated, and privacy issues were addressed through HIPAA compliant rules.

Results: The National Rare Diseases Registry System of China (NRDRS) now covers 166 rare diseases and more than 63,000 registered patients. The National Rare Diseases Case Reporting System of China (NRDCRS) was primarily founded on the National Network of Rare Diseases (NNRD) of 324 hospitals and focused on real-time rare diseases case reporting; more than 400,000 cases have been reported. Based on the data available in the two systems, the National Center for Health Technology Assessment (HTA) of Orphan Medicinal Products (OMP) has been established and the expert consensus on HTA of OMP was produced. The largest knowledgebase for rare disease in Chinese has also been developed.

Conclusion: A national strategy and the coordinating mechanism is the key to success in the improvement of Chinese rare disease clinical care and drug accessibility. Application of innovative informatics solutions can help accelerate the process, improve quality and increase efficiency.

Deep Learning-Based Analysis of Face Images as a Screening Tool for Genetic Syndromes

Approximately 4% of the world’s population suffers from rare diseases. A vast majority of these disorders have a genetic background. The number of genes that have been linked to human diseases is constantly growing, but there are still genetic syndromes that remain to be discovered. The diagnostic yield of genetic testing is continuously developing, and the need for testing is becoming more significant. Due to limited resources, including trained clinical geneticists, patients referred to clinical genetics units must be accurately selected. Around 30–40% of genetic disorders are associated with specific facial characteristics called dysmorphic features. As part of our research, we analyzed the performance of classifiers based on deep learning face recognition models in detecting dysmorphic features. We tested two classification problems: a multiclass problem (15 genetic disorders vs. controls) and a two-class problem (disease vs. controls). In the multiclass task, the best result reached an accuracy level of 84%. The best accuracy result in the two-class problem reached 96%. More importantly, the binary classifier detected disease features in patients with diseases that were not previously present in the training dataset. The classifier was able to generalize differences between patients and controls, and to detect abnormalities without information about the specific disorder. This indicates that a screening tool based on deep learning and facial recognition could not only detect known diseases, but also detect patients with diseases that were not previously known. In the future, this tool could help in screening patients before they are referred to the genetic unit.

ANKRD11 variants: KBG syndrome and beyond

Mutations affecting the transcriptional regulator Ankyrin Repeat Domain 11 (ANKRD11) are mainly associated with the multisystem developmental disorder known as KBG syndrome, but have also been identified in individuals with Cornelia de Lange syndrome (CdLS) and other developmental disorders caused by variants affecting different chromatin regulators. The extensive functional overlap of these proteins results in shared phenotypical features, which complicate the assessment of the clinical diagnosis. Additionally, re-evaluation of individuals at a later age occasionally reveals that the initial phenotype has evolved toward clinical features more reminiscent of a developmental disorder different from the one that was initially diagnosed. For this reason, variants in ANKRD11 can be ascribed to a broader class of disorders that fall within the category of the so-called chromatinopathies. In this work, we report on the clinical characterization of 23 individuals with variants in ANKRD11. The subjects present primarily with developmental delay, intellectual disability and dysmorphic features, and all but two received an initial clinical diagnosis of either KBG syndrome or CdLS. The number and the severity of the clinical signs are overlapping but variable and result in a broad spectrum of phenotypes, which could be partially accounted for by the presence of additional molecular diagnoses and distinct pathogenic mechanisms.

Computational diagnostic methods on 2D photographs: A review of the literature

Here we provide a literature review of all the methods reported to date for analyzing 2D pictures for diagnostic purposes. Pubmed was used to screen the MEDLINE database using MeSH (Medical Subject Heading) terms and keyworks. The different recognition steps and the main results were reported. All human studies involving 2D facial photographs used to diagnose one or several conditions in healthy populations or in patients were included. We included 1515 articles and 27 publications were finally retained. 67% of the articles aimed at diagnosing one particular syndrome versus healthy controls and 33% aimed at performing multi-class syndrome recognition. Data volume varied from 15 to 17,106 patient pictures. Manual or automatic landmarks were one of the most commonly used tools in order to extract morphological information from images, in 22/27 (81%) publications. Geometrical features were extracted from landmarks based on Procrustes superimposition in 4/27 (15%). Textural features were extracted in 19/27 (70%) publications. Features were then classified using machine learning methods in 89% of publications, while deep learning methods were used in 11%. Facial recognition tools were generally successful in identifying rare conditions in dysmorphic patients, with comparable or higher recognition accuracy than clinical experts.

The point-of-care use of a facial phenotyping tool in the genetics clinic: Enhancing diagnosis and education with machine learning

Computer-assisted pattern recognition platforms, such as Face2Gene® (F2G), can facilitate the diagnosis of children with rare genetic syndromes by comparing a patient's features to known genetic diagnoses. Our work designed, implemented, and evaluated an innovative model of care in clinical genetics in a heterogeneous and multicultural patient population that utilized this facial phenotyping software at the point-of-care. We assessed the performance of F2G by comparing the suggested diagnoses to the patient's confirmed molecular diagnosis. Providers' overall experiences with the technology and trainees' educational experiences were assessed with questionnaires. We achieved an overall diagnostic yield of 57%. This increased to 82% when cases diagnosed with syndromes not recognized by F2G were removed. The mean rank of a confirmed diagnosis in the top 10 was 2.3 (CI 1.5-3.2) and the mean gestalt score 37.6%. The most commonly suggested diagnoses were Noonan syndrome, mucopolysaccharidosis, and 22q11.2 deletion syndrome. Our qualitative assessment revealed that clinicians and trainees saw value using the tool in practice. Overall, this work helped to implement an innovative patient care delivery model in clinical genetics that utilizes a facial phenotyping tool at the point-of-care. Our data suggest that F2G has utility in the genetics clinic as a clinical decision support tool in diverse populations, with a majority of patients having their eventual diagnosis listed in the top 10 suggested syndromes based on a photograph alone. It shows promise for further integration into clinical care and medical education, and we advocate for its continued use, adoption and refinement along with transparent and accountable industrial partnerships.

Efficiency of Computer-Aided Facial Phenotyping (DeepGestalt) in Individuals With and Without a Genetic Syndrome: Diagnostic Accuracy Study

Background

Collectively, an estimated 5% of the population have a genetic disease. Many of them feature characteristics that can be detected by facial phenotyping. Face2Gene CLINIC is an online app for facial phenotyping of patients with genetic syndromes. DeepGestalt, the neural network driving Face2Gene, automatically prioritizes syndrome suggestions based on ordinary patient photographs, potentially improving the diagnostic process. Hitherto, studies on DeepGestalt’s quality highlighted its sensitivity in syndromic patients. However, determining the accuracy of a diagnostic methodology also requires testing of negative controls.

Objective

The aim of this study was to evaluate DeepGestalt's accuracy with photos of individuals with and without a genetic syndrome. Moreover, we aimed to propose a machine learning–based framework for the automated differentiation of DeepGestalt’s output on such images.

Methods

Frontal facial images of individuals with a diagnosis of a genetic syndrome (established clinically or molecularly) from a convenience sample were reanalyzed. Each photo was matched by age, sex, and ethnicity to a picture featuring an individual without a genetic syndrome. Absence of a facial gestalt suggestive of a genetic syndrome was determined by physicians working in medical genetics. Photos were selected from online reports or were taken by us for the purpose of this study. Facial phenotype was analyzed by DeepGestalt version 19.1.7, accessed via Face2Gene CLINIC. Furthermore, we designed linear support vector machines (SVMs) using Python 3.7 to automatically differentiate between the 2 classes of photographs based on DeepGestalt's result lists.

Results

We included photos of 323 patients diagnosed with 17 different genetic syndromes and matched those with an equal number of facial images without a genetic syndrome, analyzing a total of 646 pictures. We confirm DeepGestalt’s high sensitivity (top 10 sensitivity: 295/323, 91%). DeepGestalt’s syndrome suggestions in individuals without a craniofacially dysmorphic syndrome followed a nonrandom distribution. A total of 17 syndromes appeared in the top 30 suggestions of more than 50% of nondysmorphic images. DeepGestalt’s top scores differed between the syndromic and control images (area under the receiver operating characteristic [AUROC] curve 0.72, 95% CI 0.68-0.76; P<.001). A linear SVM running on DeepGestalt’s result vectors showed stronger differences (AUROC 0.89, 95% CI 0.87-0.92; P<.001).

Conclusions

DeepGestalt fairly separates images of individuals with and without a genetic syndrome. This separation can be significantly improved by SVMs running on top of DeepGestalt, thus supporting the diagnostic process of patients with a genetic syndrome. Our findings facilitate the critical interpretation of DeepGestalt’s results and may help enhance it and similar computer-aided facial phenotyping tools.

Analysis of clinical and genetic characteristics in 10 Chinese individuals with Cornelia de Lange syndrome and literature review

Background

Cornelia de Lange syndrome (CdLS) is a rare congenital developmental disorder with variable multisystem involvement and genetic heterogeneity. We aimed to analyze the clinical and genetic characteristics of Chinese individuals with CdLS.

Methods

We collected data regarding the neonatal period, maternal status, clinical manifestation, including facial dimorphisms and development, and follow‐up treatment for individuals diagnosed with CdLS. In individuals with suspected CdLS, high‐throughput sequencing, Sanger sequencing, and real‐time qualitative PCR were used to verify the diagnosis.

Results

Variants, including six that were novel, were concentrated in the NIPBL (70%), HDAC8 (20%), and SMC3 (10%) genes. We found two nonsense, three splicing, and two deletion variants in NIPBL; a missense variant and an absence variant in HDAC8; and a missense variant in SMC3. Eleven cardinal features of CdLS were present in more than 80% of Chinese individuals. Compared with non‐Chinese individuals of diverse ancestry, there were significant differences in the clinical characteristics of eight of these features.

Conclusion

Six novel pathological variants were identified; thus, the study expanded the gene variant spectrum. Furthermore, most cardinal features of CdLS found in Chinese individuals were also found in individuals from other countries. However, there were significant differences in eight clinical features.

Diagnosing Parkinson Disease Through Facial Expression Recognition: Video Analysis

BACKGROUND

The number of patients with neurological diseases is currently increasing annually, which presents tremendous challenges for both patients and doctors. With the advent of advanced information technology, digital medical care is gradually changing the medical ecology. Numerous people are exploring new ways to receive a consultation, track their diseases, and receive rehabilitation training in more convenient and efficient ways. In this paper, we explore the use of facial expression recognition via artificial intelligence to diagnose a typical neurological system disease, Parkinson disease (PD).

OBJECTIVE

This study proposes methods to diagnose PD through facial expression recognition.

METHODS

We collected videos of facial expressions of people with PD and matched controls. We used relative coordinates and positional jitter to extract facial expression features (facial expression amplitude and shaking of small facial muscle groups) from the key points returned by Face++. Algorithms from traditional machine learning and advanced deep learning were utilized to diagnose PD.

RESULTS

The experimental results showed our models can achieve outstanding facial expression recognition ability for PD diagnosis. Applying a long short-term model neural network to the positions of the key features, precision and F1 values of 86% and 75%, respectively, can be reached. Further, utilizing a support vector machine algorithm for the facial expression amplitude features and shaking of the small facial muscle groups, an F1 value of 99% can be achieved.

CONCLUSIONS

This study contributes to the digital diagnosis of PD based on facial expression recognition. The disease diagnosis model was validated through our experiment. The results can help doctors understand the real-time dynamics of the disease and even conduct remote diagnosis.

Diagnostic performance of artificial intelligence to detect genetic diseases with facial phenotypes: A protocol for systematic review and meta analysis

BACKGROUND

Many genetic diseases are known to have distinctive facial phenotypes, which are highly informative to provide an opportunity for automated detection. However, the diagnostic performance of artificial intelligence to identify genetic diseases with facial phenotypes requires further investigation. The objectives of this systematic review and meta-analysis are to evaluate the diagnostic accuracy of artificial intelligence to identify the genetic diseases with face phenotypes and then find the best algorithm.

METHODS

The systematic review will be conducted in accordance with the "Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols" guidelines. The following electronic databases will be searched: PubMed, Web of Science, IEEE, Ovid, Cochrane Library, EMBASE and China National Knowledge Infrastructure. Two reviewers will screen and select the titles and abstracts of the studies retrieved independently during the database searches and perform full-text reviews and extract available data. The main outcome measures include diagnostic accuracy, as defined by accuracy, recall, specificity, and precision. The descriptive forest plot and summary receiver operating characteristic curves will be used to represent the performance of diagnostic tests. Subgroup analysis will be performed for different algorithms aided diagnosis tests. The quality of study characteristics and methodology will be assessed using the Quality Assessment of Diagnostic Accuracy Studies 2 tool. Data will be synthesized by RevMan 5.3 and Meta-disc 1.4 software.

RESULTS

The findings of this systematic review and meta-analysis will be disseminated in a relevant peer-reviewed journal and academic presentations.

CONCLUSION

To our knowledge, there have not been any systematic review or meta-analysis relating to diagnosis performance of artificial intelligence in identifying the genetic diseases with face phenotypes. The findings would provide evidence to formulate a comprehensive understanding of applications using artificial intelligence in identifying the genetic diseases with face phenotypes and add considerable value in the future of precision medicine.

OSF REGISTRATION

DOI 10.17605/OSF.IO/P9KUH.

Differentiating molecular etiologies of Angelman syndrome through facial phenotyping using deep learning

Angelman syndrome (AS) is caused by several genetic mechanisms that impair the expression of maternally-inherited UBE3A through deletions, paternal uniparental disomy (UPD), UBE3A pathogenic variants, or imprinting defects. Current methods of differentiating the etiology require molecular testing, which is sometimes difficult to obtain. Recently, computer-based facial analysis systems have been used to assist in identifying genetic conditions based on facial phenotypes. We sought to understand if the facial-recognition system DeepGestalt could find differences in phenotype between molecular subtypes of AS. Images and molecular data on 261 individuals with AS ranging from 10 months through 32 years were analyzed by DeepGestalt in a cross-validation model with receiver operating characteristic (ROC) curves generated. The area under the curve (AUC) of the ROC for each molecular subtype was compared and ranked from least to greatest differentiable phenotype. We determined that DeepGestalt demonstrated a high degree of discrimination between the deletion subtype and UPD or imprinting defects, and a lower degree of discrimination with the UBE3A pathogenic variants subtype. Our findings suggest that DeepGestalt can recognize subclinical differences in phenotype based on etiology and may provide decision support for testing.

Diagnosis support systems for rare diseases: a scoping review

INTRODUCTION

Rare diseases affect approximately 350 million people worldwide. Delayed diagnosis is frequent due to lack of knowledge of most clinicians and a small number of expert centers. Consequently, computerized diagnosis support systems have been developed to address these issues, with many relying on rare disease expertise and taking advantage of the increasing volume of generated and accessible health-related data. Our objective is to perform a review of all initiatives aiming to support the diagnosis of rare diseases.

METHODS

A scoping review was conducted based on methods proposed by Arksey and O'Malley. A charting form for relevant study analysis was developed and used to categorize data.

RESULTS

Sixty-eight studies were retained at the end of the charting process. Diagnosis targets varied from 1 rare disease to all rare diseases. Material used for diagnosis support consisted mostly of phenotype concepts, images or fluids. Fifty-seven percent of the studies used expert knowledge. Two-thirds of the studies relied on machine learning algorithms, and one-third used simple similarities. Manual algorithms were encountered as well. Most of the studies presented satisfying performance of evaluation by comparison with references or with external validation. Fourteen studies provided online tools, most of which aimed to support the diagnosis of all rare diseases by considering queries based on phenotype concepts.

CONCLUSION

Numerous solutions relying on different materials and use of various methodologies are emerging with satisfying preliminary results. However, the variability of approaches and evaluation processes complicates the comparison of results. Efforts should be made to adequately validate these tools and guarantee reproducibility and explicability.

Shared facial phenotype of patients with mucolipidosis type IV: A clinical observation reaffirmed by next generation phenotyping

BACKGROUND

Mucolipidosis type IV (ML-IV) is a rare autosomal-recessive lysosomal storage disease, caused by mutations in MCOLN1. ML-IV manifests with developmental delay, esotropia and corneal clouding. While the clinical phenotype is well-described, the diagnosis of ML-IV is often challenging and elusive.

OBJECTIVE

Our experience with ML-IV patients brought to the clinical observation that they share common and identifiable facial features, not yet described in the literature to date. Here, we utilized a computerized facial analysis tool to establish this association.

METHODS

Using the DeepGestalt algorithm, 50 two-dimensional facial images of ten ML-IV patients were analyzed, and compared to unaffected controls (n = 98) and to individuals affected with other genetic disorders (n = 99). Results were expressed in terms of the area-under-the-curve (AUC) of the receiver-operating-characteristic curve (ROC).

RESULTS

When compared to unaffected cases and to cases diagnosed with syndromes other than ML-IV, the ML-IV cohort showed an AUC of 0.822 (p value < 0.01) and an AUC of 0.885 (p value < 0.001), respectively.

CONCLUSIONS

We describe recognizable facial features typical in patients with ML-IV. Reaffirmed by the DeepGestalt technology, the described common facial phenotype adds to the tools currently available for clinicians and may thus assist in reaching an earlier diagnosis of this rare and underdiagnosed disorder.

Clinical versus automated assessments of morphological variants in twins with and without neurodevelopmental disorders

Physical examinations are recommended as part of a comprehensive evaluation for individuals with neurodevelopmental disorders (NDDs), such as autism spectrum disorder (ASD) and attention-deficit/hyperactivity disorder. These examinations should include assessment for morphological variants. Previous studies have shown an increase in morphological variants in individuals with NDDs, particularly ASD, and that these variants may be present in greater amounts in individuals with genetic alterations. Unfortunately, assessment for morphological variants can be subjective and time-consuming, and require a high degree of clinical expertise. Therefore, objective, automated methods of morphological assessment are desirable. This study compared the use of Face2Gene, an automated tool to explore facial morphological variants, to clinical consensus assessment, using a cohort of N = 290 twins enriched for NDDs (n = 135 with NDD diagnoses). Agreement between automated and clinical assessments were satisfactory to complete (78.3-100%). In our twin sample, individuals with NDDs did not have greater numbers of facial morphological variants when compared to those with typical development, nor when controlling for shared genetic and environmental factors within twin pairs. Common facial morphological variants in those with and without NDDs were similar and included thick upper lip vermilion, abnormality of the nasal tip, long face, and upslanted palpebral fissure. We conclude that although facial morphological variants can be assessed reliably in NDDs with automated tools like Face2Gene, clinical utility is limited when just exploring the facial region. Therefore, currently, automated assessments may best complement, rather than replace, in-person clinical assessments.

Evaluating Face2Gene as a Tool to Identify Cornelia de Lange Syndrome by Facial Phenotypes

Characteristic or classic phenotype of Cornelia de Lange syndrome (CdLS) is associated with a recognisable facial pattern. However, the heterogeneity in causal genes and the presence of overlapping syndromes have made it increasingly difficult to diagnose only by clinical features. DeepGestalt technology, and its app Face2Gene, is having a growing impact on the diagnosis and management of genetic diseases by analysing the features of affected individuals. Here, we performed a phenotypic study on a cohort of 49 individuals harbouring causative variants in known CdLS genes in order to evaluate Face2Gene utility and sensitivity in the clinical diagnosis of CdLS. Based on the profile images of patients, a diagnosis of CdLS was within the top five predicted syndromes for 97.9% of our cases and even listed as first prediction for 83.7%. The age of patients did not seem to affect the prediction accuracy, whereas our results indicate a correlation between the clinical score and affected genes. Furthermore, each gene presents a different pattern recognition that may be used to develop new neural networks with the goal of separating different genetic subtypes in CdLS. Overall, we conclude that computer-assisted image analysis based on deep learning could support the clinical diagnosis of CdLS.

Videira P, Valadão G. Artificial Intelligence (AI) in Rare Diseases: Is the Future Brighter?

The amount of data collected and managed in (bio)medicine is ever-increasing. Thus, there is a need to rapidly and efficiently collect, analyze, and characterize all this information. Artificial intelligence (AI), with an emphasis on deep learning, holds great promise in this area and is already being successfully applied to basic research, diagnosis, drug discovery, and clinical trials. Rare diseases (RDs), which are severely underrepresented in basic and clinical research, can particularly benefit from AI technologies. Of the more than 7000 RDs described worldwide, only 5% have a treatment. The ability of AI technologies to integrate and analyze data from different sources (e.g., multi-omics, patient registries, and so on) can be used to overcome RDs’ challenges (e.g., low diagnostic rates, reduced number of patients, geographical dispersion, and so on). Ultimately, RDs’ AI-mediated knowledge could significantly boost therapy development. Presently, there are AI approaches being used in RDs and this review aims to collect and summarize these advances. A section dedicated to congenital disorders of glycosylation (CDG), a particular group of orphan RDs that can serve as a potential study model for other common diseases and RDs, has also been included.

Enabling Global Clinical Collaborations on Identifiable Patient Data: The Minerva Initiative

The clinical utility of computational phenotyping for both genetic and rare diseases is increasingly appreciated; however, its true potential is yet to be fully realized. Alongside the growing clinical and research availability of sequencing technologies, precise deep and scalable phenotyping is required to serve unmet need in genetic and rare diseases. To improve the lives of individuals affected with rare diseases through deep phenotyping, global big data interrogation is necessary to aid our understanding of disease biology, assist diagnosis, and develop targeted treatment strategies. This includes the application of cutting-edge machine learning methods to image data. As with most digital tools employed in health care, there are ethical and data governance challenges associated with using identifiable personal image data. There are also risks with failing to deliver on the patient benefits of these new technologies, the biggest of which is posed by data siloing. The Minerva Initiative has been designed to enable the public good of deep phenotyping while mitigating these ethical risks. Its open structure, enabling collaboration and data sharing between individuals, clinicians, researchers and private enterprise, is key for delivering precision public health.

Differentiation of MISSLA and Fanconi anaemia by computer-aided image analysis and presentation of two novel MISSLA siblings

Variants in DONSON were recently identified as the cause of microcephaly, short stature, and limb abnormalities syndrome (MISSLA). The clinical spectra of MISSLA and Fanconi anaemia (FA) strongly overlap. For that reason, some MISSLA patients have been clinically diagnosed with FA. Here, we present the clinical data of siblings with MISSLA featuring a novel DONSON variant and summarize the current literature on MISSLA. Additionally, we perform computer-aided image analysis using the DeepGestalt technology to test how distinct the facial features of MISSLA and FA patients are. We show that MISSLA has a specific facial gestalt. Notably, we find that also FA patients feature facial characteristics recognizable by computer-aided image analysis. We conclude that computer-assisted image analysis improves diagnostic precision in both MISSLA and FA.

Integrating Artificial and Human Intelligence: A Partnership for Responsible Innovation in Biomedical Engineering and Medicine

Historically, the term "artificial intelligence" dates to 1956 when it was first used in a conference at Dartmouth College in the US. Since then, the development of artificial intelligence has in part been shaped by the field of neuroscience. By understanding the human brain, scientists have attempted to build new intelligent machines capable of performing complex tasks akin to humans. Indeed, future research into artificial intelligence will continue to benefit from the study of the human brain. While the development of artificial intelligence algorithms has been fast paced, the actual use of most artificial intelligence (AI) algorithms in biomedical engineering and clinical practice is still markedly below its conceivably broader potentials. This is partly because for any algorithm to be incorporated into existing workflows it has to stand the test of scientific validation, clinical and personal utility, application context, and is equitable as well. In this context, there is much to be gained by combining AI and human intelligence (HI). Harnessing Big Data, computing power and storage capacities, and addressing societal issues emergent from algorithm applications, demand deploying HI in tandem with AI. Very few countries, even economically developed states, lack adequate and critical governance frames to best understand and steer the AI innovation trajectories in health care. Drug discovery and translational pharmaceutical research stand to gain from AI technology provided they are also informed by HI. In this expert review, we analyze the ways in which AI applications are likely to traverse the continuum of life from birth to death, and encompassing not only humans but also all animal, plant, and other living organisms that are increasingly touched by AI. Examples of AI applications include digital health, diagnosis of diseases in newborns, remote monitoring of health by smart devices, real-time Big Data analytics for prompt diagnosis of heart attacks, and facial analysis software with consequences on civil liberties. While we underscore the need for integration of AI and HI, we note that AI technology does not have to replace medical specialists or scientists and rather, is in need of such expert HI. Altogether, AI and HI offer synergy for responsible innovation and veritable prospects for improving health care from prevention to diagnosis to therapeutics while unintended consequences of automation emergent from AI and algorithms should be borne in mind on scientific cultures, work force, and society at large.

A genetic-phenotypic classification for syndromic micrognathia

Micrognathia is a common craniofacial deformity which represents hypoplastic development of the mandible, accompanied by retrognathia and consequent airway problems. Usually, micrognathia is accompanied by multiple systematic defects, known as syndromic micrognathia, and is in close association with genetic factors. Now, large quantities of pathogenic genes of syndromic micrognathia have been revealed. However, how these different pathogenic genes could lead to similar phenotypes, and whether there are some common characteristics among these pathogenic genes are still unknown. In this study, we proposed a genetic-phenotypic classification of syndromic micrognathia based on pathogenic genes information obtained from Phenolyzer, DAVID, OMIM, and PubMed database. Pathogenic genes of syndromic micrognathia could be divided into four groups based on gene function, including cellular processes and structures, cell metabolism, cartilage and bone development, and neuromuscular function. In addition, these four groups exhibited various clinical characteristics, and the affected systems, such as central nervous system, skeletal system, cardiovascular system, oral and dental system, respiratory system and muscle, were different in these four groups. This classification could provide meaningful insights into the pathogenesis of syndromic micrognathia, and offer some clues for understanding the molecular mechanism, as well as guiding precise clinical diagnosis and treatment for syndromic micrognathia.

Evaluation of Face2Gene using facial images of patients with congenital dysmorphic syndromes recruited in Japan

An increasing number of genetic syndromes present a challenge to clinical geneticists. A deep learning-based diagnosis assistance system, Face2Gene, utilizes the aggregation of "gestalt," comprising data summarizing features of patients' facial images, to suggest candidate syndromes. Because Face2Gene's results may be affected by ethnicity and age at which training facial images were taken, the system performance for patients in Japan is still unclear. Here, we present an evaluation of Face2Gene using the following two patient groups recruited in Japan: Group 1 consisting of 74 patients with 47 congenital dysmorphic syndromes, and Group 2 consisting of 34 patients with Down syndrome. In Group 1, facial recognition failed for 4 of 74 patients, while 13-21 of 70 patients had a diagnosis for which Face2Gene had not been trained. Omitting these 21 patients, for 85.7% (42/49) of the remainder, the correct syndrome was identified within the top 10 suggested list. In Group 2, for the youngest facial images taken for each of the 34 patients, Down syndrome was successfully identified as the highest-ranking condition using images taken from newborns to those aged 25 years. For the oldest facial images taken at ≥20 years in each of 17 applicable patients, Down syndrome was successfully identified as the highest- and second-highest-ranking condition in 82.2% (14/17) and 100% (17/17) of the patients using images taken from 20 to 40 years. These results suggest that Face2Gene in its current format is already useful in suggesting candidate syndromes to clinical geneticists, using patients with congenital dysmorphic syndromes in Japan.

The facial dysmorphology analysis technology in intellectual disability syndromes related to defects in the histones modifiers

Genetic syndromes are frequently associated with Intellectual Disability (ID), as well as craniofacial dysmorphisms. A group of ID syndromes with typical abnormal face related to chromatin remodeling defects, have been recognized, coining the term chromatinopathies. This is a molecular heterogeneous subset of congenital disorders caused by mutations of the various components of the Chromatin-Marking System (CMS), including modifiers of DNA and chromatin remodelers. We performed a phenotypic study on a sample of 120 individuals harboring variants in genes codifying for the histones enzymes, using the DeepGestalt technology. Three experiments (two multiclass comparison experiments and a frontal face-crop analysis) were conducted, analyzing respectively a total of 181 pediatric images in the first comparison experiment and 180 in the second, all individuals belonging predominantly to Caucasian population. The classification results were expressed in terms of the area under the curve (AUC) of the receiver-operating-characteristic curve (ROC). Significant values of AUC and low p-values were registered for all syndromes in the three experiments, in comparison with each other, with other ID syndromes characterized by recognizable craniofacial dysmorphisms and with unaffected controls. Final findings indicated that this group of diseases is characterized by distinctive dysmorphisms, which result pathognomonic. A correct interrogation and use of adequate informatics aids, could become a valid support for clinicians.

What Are Important Ethical Implications of Using Facial Recognition Technology in Health Care?

Applications of facial recognition technology (FRT) in health care settings have been developed to identify and monitor patients as well as to diagnose genetic, medical, and behavioral conditions. The use of FRT in health care suggests the importance of informed consent, data input and analysis quality, effective communication about incidental findings, and potential influence on patient-clinician relationships. Privacy and data protection are thought to present challenges for the use of FRT for health applications.

Identifying facial phenotypes of genetic disorders using deep learning

Syndromic genetic conditions, in aggregate, affect 8% of the population¹. Many syndromes have recognizable facial features² that are highly informative to clinical geneticists^3-5. Recent studies show that facial analysis technologies measured up to the capabilities of expert clinicians in syndrome identification^6-9. However, these technologies identified only a few disease phenotypes, limiting their role in clinical settings, where hundreds of diagnoses must be considered. Here we present a facial image analysis framework, DeepGestalt, using computer vision and deep-learning algorithms, that quantifies similarities to hundreds of syndromes. DeepGestalt outperformed clinicians in three initial experiments, two with the goal of distinguishing subjects with a target syndrome from other syndromes, and one of separating different genetic subtypes in Noonan syndrome. On the final experiment reflecting a real clinical setting problem, DeepGestalt achieved 91% top-10 accuracy in identifying the correct syndrome on 502 different images. The model was trained on a dataset of over 17,000 images representing more than 200 syndromes, curated through a community-driven phenotyping platform. DeepGestalt potentially adds considerable value to phenotypic evaluations in clinical genetics, genetic testing, research and precision medicine.

Cornelia de Lange syndrome in diverse populations

Cornelia de Lange syndrome (CdLS) is a dominant multisystemic malformation syndrome due to mutations in five genes-NIPBL, SMC1A, HDAC8, SMC3, and RAD21. The characteristic facial dysmorphisms include microcephaly, arched eyebrows, synophrys, short nose with depressed bridge and anteverted nares, long philtrum, thin lips, micrognathia, and hypertrichosis. Most affected individuals have intellectual disability, growth deficiency, and upper limb anomalies. This study looked at individuals from diverse populations with both clinical and molecularly confirmed diagnoses of CdLS by facial analysis technology. Clinical data and images from 246 individuals with CdLS were obtained from 15 countries. This cohort included 49% female patients and ages ranged from infancy to 37 years. Individuals were grouped into ancestry categories of African descent, Asian, Latin American, Middle Eastern, and Caucasian. Across these populations, 14 features showed a statistically significant difference. The most common facial features found in all ancestry groups included synophrys, short nose with anteverted nares, and a long philtrum with thin vermillion of the upper lip. Using facial analysis technology we compared 246 individuals with CdLS to 246 gender/age matched controls and found that sensitivity was equal or greater than 95% for all groups. Specificity was equal or greater than 91%. In conclusion, we present consistent clinical findings from global populations with CdLS while demonstrating how facial analysis technology can be a tool to support accurate diagnoses in the clinical setting. This work, along with prior studies in this arena, will assist in earlier detection, recognition, and treatment of CdLS worldwide.

Facial recognition software in clinical dysmorphology

PURPOSE OF REVIEW

The current review aims to discuss the incorporation of facial recognition software into the clinical practice of dysmorphology and medical genetics.

RECENT FINDINGS

Facial recognition software has improved the process of generating a differential diagnosis for rare genetic syndromes, and recent publications demonstrate utility in both research and clinical applications. Software programs are freely available to verified medical providers and can be incorporated into routine clinic encounters.

SUMMARY

As facial recognition software capabilities improve, two-dimensional image capture with artificial intelligence interpretation may become a useful tool within many areas of medicine. Geneticists and researchers can use such software to enhance their differential diagnoses, to study similarities and differences between patient cohorts, and to improve the interpretation of genomic data. Pediatricians and subspecialists may use tools to identify patients who may benefit from a genetic evaluation, and educators can use these tools to interest students in the study of dysmorphoplogy and genetic syndromes.

PubCaseFinder: A Case-Report-Based, Phenotype-Driven Differential-Diagnosis System for Rare Diseases

Recently, to speed up the differential-diagnosis process based on symptoms and signs observed from an affected individual in the diagnosis of rare diseases, researchers have developed and implemented phenotype-driven differential-diagnosis systems. The performance of those systems relies on the quantity and quality of underlying databases of disease-phenotype associations (DPAs). Although such databases are often developed by manual curation, they inherently suffer from limited coverage. To address this problem, we propose a text-mining approach to increase the coverage of DPA databases and consequently improve the performance of differential-diagnosis systems. Our analysis showed that a text-mining approach using one million case reports obtained from PubMed could increase the coverage of manually curated DPAs in Orphanet by 125.6%. We also present PubCaseFinder (see Web Resources), a new phenotype-driven differential-diagnosis system in a freely available web application. By utilizing automatically extracted DPAs from case reports in addition to manually curated DPAs, PubCaseFinder improves the performance of automated differential diagnosis. Moreover, PubCaseFinder helps clinicians search for relevant case reports by using phenotype-based comparisons and confirm the results with detailed contextual information.