Automatic recognition of the XLHED phenotype from facial images

Current and Future Advances in Surgical Therapy for Pituitary Adenoma

The vital physiological role of the pituitary gland, alongside its proximity to critical neurovascular structures, means that pituitary adenomas can cause significant morbidity or mortality. While enormous advancements have been made in the surgical care of pituitary adenomas, numerous challenges remain, such as treatment failure and recurrence. To meet these clinical challenges, there has been an enormous expansion of novel medical technologies (eg, endoscopy, advanced imaging, artificial intelligence). These innovations have the potential to benefit each step of the patient's journey, and ultimately, drive improved outcomes. Earlier and more accurate diagnosis addresses this in part. Analysis of novel patient data sets, such as automated facial analysis or natural language processing of medical records holds potential in achieving an earlier diagnosis. After diagnosis, treatment decision-making and planning will benefit from radiomics and multimodal machine learning models. Surgical safety and effectiveness will be transformed by smart simulation methods for trainees. Next-generation imaging techniques and augmented reality will enhance surgical planning and intraoperative navigation. Similarly, surgical abilities will be augmented by the future operative armamentarium, including advanced optical devices, smart instruments, and surgical robotics. Intraoperative support to surgical team members will benefit from a data science approach, utilizing machine learning analysis of operative videos to improve patient safety and orientate team members to a common workflow. Postoperatively, neural networks leveraging multimodal datasets will allow early detection of individuals at risk of complications and assist in the prediction of treatment failure, thus supporting patient-specific discharge and monitoring protocols. While these advancements in pituitary surgery hold promise to enhance the quality of care, clinicians must be the gatekeepers of the translation of such technologies, ensuring systematic assessment of risk and benefit prior to clinical implementation. In doing so, the synergy between these innovations can be leveraged to drive improved outcomes for patients of the future.

Assessing facial weakness in myasthenia gravis with facial recognition software and deep learning

OBJECTIVE

Myasthenia gravis (MG) is an autoimmune disease leading to fatigable muscle weakness. Extra-ocular and bulbar muscles are most commonly affected. We aimed to investigate whether facial weakness can be quantified automatically and used for diagnosis and disease monitoring.

METHODS

In this cross-sectional study, we analyzed video recordings of 70 MG patients and 69 healthy controls (HC) with two different methods. Facial weakness was first quantified with facial expression recognition software. Subsequently, a deep learning (DL) computer model was trained for the classification of diagnosis and disease severity using multiple cross-validations on videos of 50 patients and 50 controls. Results were validated using unseen videos of 20 MG patients and 19 HC.

RESULTS

Expression of anger (p = 0.026), fear (p = 0.003), and happiness (p < 0.001) was significantly decreased in MG compared to HC. Specific patterns of decreased facial movement were detectable in each emotion. Results of the DL model for diagnosis were as follows: area under the curve (AUC) of the receiver operator curve 0.75 (95% CI 0.65-0.85), sensitivity 0.76, specificity 0.76, and accuracy 76%. For disease severity: AUC 0.75 (95% CI 0.60-0.90), sensitivity 0.93, specificity 0.63, and accuracy 80%. Results of validation, diagnosis: AUC 0.82 (95% CI: 0.67-0.97), sensitivity 1.0, specificity 0.74, and accuracy 87%. For disease severity: AUC 0.88 (95% CI: 0.67-1.0), sensitivity 1.0, specificity 0.86, and accuracy 94%.

INTERPRETATION

Patterns of facial weakness can be detected with facial recognition software. Second, this study delivers a 'proof of concept' for a DL model that can distinguish MG from HC and classifies disease severity.

Protocol for the Phase 2 EDELIFE Trial Investigating the Efficacy and Safety of Intra-Amniotic ER004 Administration to Male Subjects with X-Linked Hypohidrotic Ectodermal Dysplasia

X-linked hypohidrotic ectodermal dysplasia (XLHED) is a rare genetic disorder characte-rised by abnormal development of the skin and its appendages, such as hair and sweat glands, the teeth, and mucous glands of the airways, resulting in serious, sometimes life-threatening complications like hyperthermia or recurrent respiratory infections. It is caused by pathogenic variants of the ectodysplasin A gene (EDA). Most affected males are hemizygous for EDA null mutations that lead to the absence or inactivity of the signalling protein ectodysplasin A1 (EDA1) and, thus, to the full-blown phenotype with inability to perspire and few if any teeth. There are currently no long-term treatment options for XLHED. ER004 represents a first-in-class protein replacement molecule designed for specific, high-affinity binding to the endogenous EDA1 receptor (EDAR). Its proposed mechanism of action is the replacement of missing EDA1 in yet unborn patients with XLHED. Once bound to EDAR, ER004 activates the EDA/NFκB signalling pathway, which triggers the transcription of genes involved in the normal development of multiple tissues. Following preclinical studies, named-patient use cases demonstrated significant potential of ER004 in affected males treated in utero during the late second and third trimesters of pregnancy. In order to confirm these results, we started the EDELIFE trial, a prospective, open-label, genotype-match controlled, multicentre clinical study to investigate the efficacy and safety of intra-amniotic ER004 administration as a prenatal treatment for male subjects with XLHED. This article summarises the rationale, the study protocol, ethical issues of the trial, and potential pitfalls.

Look-alike humans identified by facial recognition algorithms show genetic similarities

The human face is one of the most visible features of our unique identity as individuals. Interestingly, monozygotic twins share almost identical facial traits and the same DNA sequence but could exhibit differences in other biometrical parameters. The expansion of the world wide web and the possibility to exchange pictures of humans across the planet has increased the number of people identified online as virtual twins or doubles that are not family related. Herein, we have characterized in detail a set of "look-alike" humans, defined by facial recognition algorithms, for their multiomics landscape. We report that these individuals share similar genotypes and differ in their DNA methylation and microbiome landscape. These results not only provide insights about the genetics that determine our face but also might have implications for the establishment of other human anthropometric properties and even personality characteristics.

Review on Facial-Recognition-Based Applications in Disease Diagnosis

Diseases not only manifest as internal structural and functional abnormalities, but also have facial characteristics and appearance deformities. Specific facial phenotypes are potential diagnostic markers, especially for endocrine and metabolic syndromes, genetic disorders, facial neuromuscular diseases, etc. The technology of facial recognition (FR) has been developed for more than a half century, but research in automated identification applied in clinical medicine has exploded only in the last decade. Artificial-intelligence-based FR has been found to have superior performance in diagnosis of diseases. This interdisciplinary field is promising for the optimization of the screening and diagnosis process and assisting in clinical evaluation and decision-making. However, only a few instances have been translated to practical use, and there is need of an overview for integration and future perspectives. This review mainly focuses on the leading edge of technology and applications in varieties of disease, and discusses implications for further exploration.

A deep learning-based diagnostic tool for identifying various diseases via facial images

With the current health crisis caused by the COVID-19 pandemic, patients have become more anxious about infection, so they prefer not to have direct contact with doctors or clinicians. Lately, medical scientists have confirmed that several diseases exhibit corresponding specific features on the face the face. Recent studies have indicated that computer-aided facial diagnosis can be a promising tool for the automatic diagnosis and screening of diseases from facial images. However, few of these studies used deep learning (DL) techniques. Most of them focused on detecting a single disease, using handcrafted feature extraction methods and conventional machine learning techniques based on individual classifiers trained on small and private datasets using images taken from a controlled environment. This study proposes a novel computer-aided facial diagnosis system called FaceDisNet that uses a new public dataset based on images taken from an unconstrained environment and could be employed for forthcoming comparisons. It detects single and multiple diseases. FaceDisNet is constructed by integrating several spatial deep features from convolutional neural networks of various architectures. It does not depend only on spatial features but also extracts spatial-spectral features. FaceDisNet searches for the fused spatial-spectral feature set that has the greatest impact on the classification. It employs two feature selection techniques to reduce the large dimension of features resulting from feature fusion. Finally, it builds an ensemble classifier based on stacking to perform classification. The performance of FaceDisNet verifies its ability to diagnose single and multiple diseases. FaceDisNet achieved a maximum accuracy of 98.57% and 98% after the ensemble classification and feature selection steps for binary and multiclass classification categories. These results prove that FaceDisNet is a reliable tool and could be employed to avoid the difficulties and complications of manual diagnosis. Also, it can help physicians achieve accurate diagnoses without the need for physical contact with the patients.

Using deep-neural-network-driven facial recognition to identify distinct Kabuki syndrome 1 and 2 gestalt

Kabuki syndrome (KS) is a rare genetic disorder caused by mutations in two major genes, KMT2D and KDM6A, that are responsible for Kabuki syndrome 1 (KS1, OMIM147920) and Kabuki syndrome 2 (KS2, OMIM300867), respectively. We lack a description of clinical signs to distinguish KS1 and KS2. We used facial morphology analysis to detect any facial morphological differences between the two KS types. We used a facial-recognition algorithm to explore any facial morphologic differences between the two types of KS. We compared several image series of KS1 and KS2 individuals, then compared images of those of Caucasian origin only (12 individuals for each gene) because this was the main ethnicity in this series. We also collected 32 images from the literature to amass a large series. We externally validated results obtained by the algorithm with evaluations by trained clinical geneticists using the same set of pictures. Use of the algorithm revealed a statistically significant difference between each group for our series of images, demonstrating a different facial morphotype between KS1 and KS2 individuals (mean area under the receiver operating characteristic curve = 0.85 [p = 0.027] between KS1 and KS2). The algorithm was better at discriminating between the two types of KS with images from our series than those from the literature (p = 0.0007). Clinical geneticists trained to distinguished KS1 and KS2 significantly recognised a unique facial morphotype, which validated algorithm findings (p = 1.6e-11). Our deep-neural-network-driven facial-recognition algorithm can reveal specific composite gestalt images for KS1 and KS2 individuals.

Innovation in Informatics to Improve Clinical Care and Drug Accessibility for Rare Diseases in China

Background: In China, there are severe unmet medical needs of people living with rare diseases. Relatedly, there is a dearth of data to inform rare diseases policy. This is historically partially due to the lack of informatics infrastructure, including standards and terminology, data sharing mechanisms and network; and concerns over patient privacy protection.

Objective: This study aims to introduce the progress of China's rare disease informatics platform and knowledgebase, and to discuss critical enablers of rare disease informatics innovation, including: data standardization; knowledgebase construction; national policy support; and multi-stakeholder participation.

Methods: A systemic national strategy, delivered through multi-stakeholder engagement, has been implemented to create and accelerate the informatics infrastructure to support rare diseases management. This includes a disease registry system, together with more than 80 hospitals, to perform comprehensive research information collection, including clinical, genomic and bio-sample data. And a case reporting system, with a network of 324 hospitals, covering all mainland Chinese provinces, to further support reporting of rare diseases data. International standards were incorporated, and privacy issues were addressed through HIPAA compliant rules.

Results: The National Rare Diseases Registry System of China (NRDRS) now covers 166 rare diseases and more than 63,000 registered patients. The National Rare Diseases Case Reporting System of China (NRDCRS) was primarily founded on the National Network of Rare Diseases (NNRD) of 324 hospitals and focused on real-time rare diseases case reporting; more than 400,000 cases have been reported. Based on the data available in the two systems, the National Center for Health Technology Assessment (HTA) of Orphan Medicinal Products (OMP) has been established and the expert consensus on HTA of OMP was produced. The largest knowledgebase for rare disease in Chinese has also been developed.

Conclusion: A national strategy and the coordinating mechanism is the key to success in the improvement of Chinese rare disease clinical care and drug accessibility. Application of innovative informatics solutions can help accelerate the process, improve quality and increase efficiency.

Happy Cow or Thinking Pig? WUR Wolf—Facial Coding Platform for Measuring Emotions in Farm Animals

Emotions play an indicative and informative role in the investigation of farm animal behaviors. Systems that respond and can measure emotions provide a natural user interface in enabling the digitalization of animal welfare platforms. The faces of farm animals can be one of the richest channels for expressing emotions. WUR Wolf (Wageningen University & Research: Wolf Mascot), a real-time facial recognition platform that can automatically code the emotions of farm animals, is presented in this study. The developed Python-based algorithms detect and track the facial features of cows and pigs, analyze the appearance, ear postures, and eye white regions, and correlate these with the mental/emotional states of the farm animals. The system is trained on a dataset of facial features of images of farm animals collected in over six farms and has been optimized to operate with an average accuracy of 85%. From these, the emotional states of animals in real time are determined. The software detects 13 facial actions and an inferred nine emotional states, including whether the animal is aggressive, calm, or neutral. A real-time emotion recognition system based on YoloV3, a Faster YoloV4-based facial detection platform and an ensemble Convolutional Neural Networks (RCNN) is presented. Detecting facial features of farm animals simultaneously in real time enables many new interfaces for automated decision-making tools for livestock farmers. Emotion sensing offers a vast potential for improving animal welfare and animal–human interactions.

Clinical Exome Reanalysis: Current Practice and Beyond

Novel gene-disease discoveries, rapid advancements in technology, and improved bioinformatics tools all have the potential to yield additional molecular diagnoses through the reanalysis of exome sequencing data. Collaborations between clinical laboratories, ordering physicians, and researchers are also driving factors that can contribute to these new insights. Automation in ongoing natural history collection, evolving phenotype updates, advancements in processing next-generation sequencing data, and up-to-date variant-gene-disease databases are increasingly needed for systematic exome reanalysis. Here, we review some of the advantages and challenges for clinician-initiated and laboratory-initiated exome reanalysis, and we propose a model for the future that could potentially maximize the clinical utility of exome reanalysis by integrating information from electronic medical records and knowledge databases into routine clinical workflows.

Clinical application of an automatic facial recognition system based on deep learning for diagnosis of Turner syndrome

PURPOSE

Automated facial recognition technology based on deep learning has achieved high accuracy in diagnosing various endocrine diseases and genetic syndromes. This study attempts to establish a facial diagnostic system for Turner syndrome (TS) based on deep convolutional neural networks.

METHODS

Photographs of 207 TS patients and 1074 female controls were collected from July 2016 to April 2019. Finally, 170 patients diagnosed with TS and 1053 female controls were included. Deep convolutional neural networks were used to develop the facial diagnostic system. A prospective study, which included two TS patients and 35 controls, was conducted to test the efficacy in the real clinical setting.

RESULTS

The average areas under the curve (AUCs) in three different scenarios were 0.9540 ± 0.0223, 0.9662 ± 0.0108 and 0.9557 ± 0.0119, separately. The average sensitivity and specificity of the prospective study were 96.7% and 97.0%, respectively.

CONCLUSIONS

The facial diagnostic system achieved high accuracy. Prospective study results demonstrated the application value of this system, which is promising in the screening of Turner syndrome.

Efficiency of Computer-Aided Facial Phenotyping (DeepGestalt) in Individuals With and Without a Genetic Syndrome: Diagnostic Accuracy Study

Background

Collectively, an estimated 5% of the population have a genetic disease. Many of them feature characteristics that can be detected by facial phenotyping. Face2Gene CLINIC is an online app for facial phenotyping of patients with genetic syndromes. DeepGestalt, the neural network driving Face2Gene, automatically prioritizes syndrome suggestions based on ordinary patient photographs, potentially improving the diagnostic process. Hitherto, studies on DeepGestalt’s quality highlighted its sensitivity in syndromic patients. However, determining the accuracy of a diagnostic methodology also requires testing of negative controls.

Objective

The aim of this study was to evaluate DeepGestalt's accuracy with photos of individuals with and without a genetic syndrome. Moreover, we aimed to propose a machine learning–based framework for the automated differentiation of DeepGestalt’s output on such images.

Methods

Frontal facial images of individuals with a diagnosis of a genetic syndrome (established clinically or molecularly) from a convenience sample were reanalyzed. Each photo was matched by age, sex, and ethnicity to a picture featuring an individual without a genetic syndrome. Absence of a facial gestalt suggestive of a genetic syndrome was determined by physicians working in medical genetics. Photos were selected from online reports or were taken by us for the purpose of this study. Facial phenotype was analyzed by DeepGestalt version 19.1.7, accessed via Face2Gene CLINIC. Furthermore, we designed linear support vector machines (SVMs) using Python 3.7 to automatically differentiate between the 2 classes of photographs based on DeepGestalt's result lists.

Results

We included photos of 323 patients diagnosed with 17 different genetic syndromes and matched those with an equal number of facial images without a genetic syndrome, analyzing a total of 646 pictures. We confirm DeepGestalt’s high sensitivity (top 10 sensitivity: 295/323, 91%). DeepGestalt’s syndrome suggestions in individuals without a craniofacially dysmorphic syndrome followed a nonrandom distribution. A total of 17 syndromes appeared in the top 30 suggestions of more than 50% of nondysmorphic images. DeepGestalt’s top scores differed between the syndromic and control images (area under the receiver operating characteristic [AUROC] curve 0.72, 95% CI 0.68-0.76; P<.001). A linear SVM running on DeepGestalt’s result vectors showed stronger differences (AUROC 0.89, 95% CI 0.87-0.92; P<.001).

Conclusions

DeepGestalt fairly separates images of individuals with and without a genetic syndrome. This separation can be significantly improved by SVMs running on top of DeepGestalt, thus supporting the diagnostic process of patients with a genetic syndrome. Our findings facilitate the critical interpretation of DeepGestalt’s results and may help enhance it and similar computer-aided facial phenotyping tools.

Diagnostic performance of artificial intelligence to detect genetic diseases with facial phenotypes: A protocol for systematic review and meta analysis

BACKGROUND

Many genetic diseases are known to have distinctive facial phenotypes, which are highly informative to provide an opportunity for automated detection. However, the diagnostic performance of artificial intelligence to identify genetic diseases with facial phenotypes requires further investigation. The objectives of this systematic review and meta-analysis are to evaluate the diagnostic accuracy of artificial intelligence to identify the genetic diseases with face phenotypes and then find the best algorithm.

METHODS

The systematic review will be conducted in accordance with the "Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols" guidelines. The following electronic databases will be searched: PubMed, Web of Science, IEEE, Ovid, Cochrane Library, EMBASE and China National Knowledge Infrastructure. Two reviewers will screen and select the titles and abstracts of the studies retrieved independently during the database searches and perform full-text reviews and extract available data. The main outcome measures include diagnostic accuracy, as defined by accuracy, recall, specificity, and precision. The descriptive forest plot and summary receiver operating characteristic curves will be used to represent the performance of diagnostic tests. Subgroup analysis will be performed for different algorithms aided diagnosis tests. The quality of study characteristics and methodology will be assessed using the Quality Assessment of Diagnostic Accuracy Studies 2 tool. Data will be synthesized by RevMan 5.3 and Meta-disc 1.4 software.

RESULTS

The findings of this systematic review and meta-analysis will be disseminated in a relevant peer-reviewed journal and academic presentations.

CONCLUSION

To our knowledge, there have not been any systematic review or meta-analysis relating to diagnosis performance of artificial intelligence in identifying the genetic diseases with face phenotypes. The findings would provide evidence to formulate a comprehensive understanding of applications using artificial intelligence in identifying the genetic diseases with face phenotypes and add considerable value in the future of precision medicine.

OSF REGISTRATION

DOI 10.17605/OSF.IO/P9KUH.

Differentiating molecular etiologies of Angelman syndrome through facial phenotyping using deep learning

Angelman syndrome (AS) is caused by several genetic mechanisms that impair the expression of maternally-inherited UBE3A through deletions, paternal uniparental disomy (UPD), UBE3A pathogenic variants, or imprinting defects. Current methods of differentiating the etiology require molecular testing, which is sometimes difficult to obtain. Recently, computer-based facial analysis systems have been used to assist in identifying genetic conditions based on facial phenotypes. We sought to understand if the facial-recognition system DeepGestalt could find differences in phenotype between molecular subtypes of AS. Images and molecular data on 261 individuals with AS ranging from 10 months through 32 years were analyzed by DeepGestalt in a cross-validation model with receiver operating characteristic (ROC) curves generated. The area under the curve (AUC) of the ROC for each molecular subtype was compared and ranked from least to greatest differentiable phenotype. We determined that DeepGestalt demonstrated a high degree of discrimination between the deletion subtype and UPD or imprinting defects, and a lower degree of discrimination with the UBE3A pathogenic variants subtype. Our findings suggest that DeepGestalt can recognize subclinical differences in phenotype based on etiology and may provide decision support for testing.

Shared facial phenotype of patients with mucolipidosis type IV: A clinical observation reaffirmed by next generation phenotyping

BACKGROUND

Mucolipidosis type IV (ML-IV) is a rare autosomal-recessive lysosomal storage disease, caused by mutations in MCOLN1. ML-IV manifests with developmental delay, esotropia and corneal clouding. While the clinical phenotype is well-described, the diagnosis of ML-IV is often challenging and elusive.

OBJECTIVE

Our experience with ML-IV patients brought to the clinical observation that they share common and identifiable facial features, not yet described in the literature to date. Here, we utilized a computerized facial analysis tool to establish this association.

METHODS

Using the DeepGestalt algorithm, 50 two-dimensional facial images of ten ML-IV patients were analyzed, and compared to unaffected controls (n = 98) and to individuals affected with other genetic disorders (n = 99). Results were expressed in terms of the area-under-the-curve (AUC) of the receiver-operating-characteristic curve (ROC).

RESULTS

When compared to unaffected cases and to cases diagnosed with syndromes other than ML-IV, the ML-IV cohort showed an AUC of 0.822 (p value < 0.01) and an AUC of 0.885 (p value < 0.001), respectively.

CONCLUSIONS

We describe recognizable facial features typical in patients with ML-IV. Reaffirmed by the DeepGestalt technology, the described common facial phenotype adds to the tools currently available for clinicians and may thus assist in reaching an earlier diagnosis of this rare and underdiagnosed disorder.

Clinical versus automated assessments of morphological variants in twins with and without neurodevelopmental disorders

Physical examinations are recommended as part of a comprehensive evaluation for individuals with neurodevelopmental disorders (NDDs), such as autism spectrum disorder (ASD) and attention-deficit/hyperactivity disorder. These examinations should include assessment for morphological variants. Previous studies have shown an increase in morphological variants in individuals with NDDs, particularly ASD, and that these variants may be present in greater amounts in individuals with genetic alterations. Unfortunately, assessment for morphological variants can be subjective and time-consuming, and require a high degree of clinical expertise. Therefore, objective, automated methods of morphological assessment are desirable. This study compared the use of Face2Gene, an automated tool to explore facial morphological variants, to clinical consensus assessment, using a cohort of N = 290 twins enriched for NDDs (n = 135 with NDD diagnoses). Agreement between automated and clinical assessments were satisfactory to complete (78.3-100%). In our twin sample, individuals with NDDs did not have greater numbers of facial morphological variants when compared to those with typical development, nor when controlling for shared genetic and environmental factors within twin pairs. Common facial morphological variants in those with and without NDDs were similar and included thick upper lip vermilion, abnormality of the nasal tip, long face, and upslanted palpebral fissure. We conclude that although facial morphological variants can be assessed reliably in NDDs with automated tools like Face2Gene, clinical utility is limited when just exploring the facial region. Therefore, currently, automated assessments may best complement, rather than replace, in-person clinical assessments.

Dysmorphology in a Genomic Era

Dysmorphology is the practice of defining the morphologic phenotype of syndromic disorders. Genomic sequencing has advanced our understanding of human variation and molecular dysmorphology has evolved in response to the science of relating embryologic developmental implications of abnormal gene signaling pathways to the resultant phenotypic presentation. Machine learning has enabled the application of deep convoluted neural networks to recognize the comparative likeness of these phenotypes relative to the causal genotype or disrupted gene pathway.

Enabling Global Clinical Collaborations on Identifiable Patient Data: The Minerva Initiative

The clinical utility of computational phenotyping for both genetic and rare diseases is increasingly appreciated; however, its true potential is yet to be fully realized. Alongside the growing clinical and research availability of sequencing technologies, precise deep and scalable phenotyping is required to serve unmet need in genetic and rare diseases. To improve the lives of individuals affected with rare diseases through deep phenotyping, global big data interrogation is necessary to aid our understanding of disease biology, assist diagnosis, and develop targeted treatment strategies. This includes the application of cutting-edge machine learning methods to image data. As with most digital tools employed in health care, there are ethical and data governance challenges associated with using identifiable personal image data. There are also risks with failing to deliver on the patient benefits of these new technologies, the biggest of which is posed by data siloing. The Minerva Initiative has been designed to enable the public good of deep phenotyping while mitigating these ethical risks. Its open structure, enabling collaboration and data sharing between individuals, clinicians, researchers and private enterprise, is key for delivering precision public health.

Differentiation of MISSLA and Fanconi anaemia by computer-aided image analysis and presentation of two novel MISSLA siblings

Variants in DONSON were recently identified as the cause of microcephaly, short stature, and limb abnormalities syndrome (MISSLA). The clinical spectra of MISSLA and Fanconi anaemia (FA) strongly overlap. For that reason, some MISSLA patients have been clinically diagnosed with FA. Here, we present the clinical data of siblings with MISSLA featuring a novel DONSON variant and summarize the current literature on MISSLA. Additionally, we perform computer-aided image analysis using the DeepGestalt technology to test how distinct the facial features of MISSLA and FA patients are. We show that MISSLA has a specific facial gestalt. Notably, we find that also FA patients feature facial characteristics recognizable by computer-aided image analysis. We conclude that computer-assisted image analysis improves diagnostic precision in both MISSLA and FA.

Integrating Artificial and Human Intelligence: A Partnership for Responsible Innovation in Biomedical Engineering and Medicine

Historically, the term "artificial intelligence" dates to 1956 when it was first used in a conference at Dartmouth College in the US. Since then, the development of artificial intelligence has in part been shaped by the field of neuroscience. By understanding the human brain, scientists have attempted to build new intelligent machines capable of performing complex tasks akin to humans. Indeed, future research into artificial intelligence will continue to benefit from the study of the human brain. While the development of artificial intelligence algorithms has been fast paced, the actual use of most artificial intelligence (AI) algorithms in biomedical engineering and clinical practice is still markedly below its conceivably broader potentials. This is partly because for any algorithm to be incorporated into existing workflows it has to stand the test of scientific validation, clinical and personal utility, application context, and is equitable as well. In this context, there is much to be gained by combining AI and human intelligence (HI). Harnessing Big Data, computing power and storage capacities, and addressing societal issues emergent from algorithm applications, demand deploying HI in tandem with AI. Very few countries, even economically developed states, lack adequate and critical governance frames to best understand and steer the AI innovation trajectories in health care. Drug discovery and translational pharmaceutical research stand to gain from AI technology provided they are also informed by HI. In this expert review, we analyze the ways in which AI applications are likely to traverse the continuum of life from birth to death, and encompassing not only humans but also all animal, plant, and other living organisms that are increasingly touched by AI. Examples of AI applications include digital health, diagnosis of diseases in newborns, remote monitoring of health by smart devices, real-time Big Data analytics for prompt diagnosis of heart attacks, and facial analysis software with consequences on civil liberties. While we underscore the need for integration of AI and HI, we note that AI technology does not have to replace medical specialists or scientists and rather, is in need of such expert HI. Altogether, AI and HI offer synergy for responsible innovation and veritable prospects for improving health care from prevention to diagnosis to therapeutics while unintended consequences of automation emergent from AI and algorithms should be borne in mind on scientific cultures, work force, and society at large.

eDiVA-Classification and prioritization of pathogenic variants for clinical diagnostics

Mendelian diseases have shown to be an and efficient model for connecting genotypes to phenotypes and for elucidating the function of genes. Whole‐exome sequencing (WES) accelerated the study of rare Mendelian diseases in families, allowing for directly pinpointing rare causal mutations in genic regions without the need for linkage analysis. However, the low diagnostic rates of 20–30% reported for multiple WES disease studies point to the need for improved variant pathogenicity classification and causal variant prioritization methods. Here, we present the exome Disease Variant Analysis (eDiVA; http://ediva.crg.eu), an automated computational framework for identification of causal genetic variants (coding/splicing single‐nucleotide variants and small insertions and deletions) for rare diseases using WES of families or parent–child trios. eDiVA combines next‐generation sequencing data analysis, comprehensive functional annotation, and causal variant prioritization optimized for familial genetic disease studies. eDiVA features a machine learning‐based variant pathogenicity predictor combining various genomic and evolutionary signatures. Clinical information, such as disease phenotype or mode of inheritance, is incorporated to improve the precision of the prioritization algorithm. Benchmarking against state‐of‐the‐art competitors demonstrates that eDiVA consistently performed as a good or better than existing approach in terms of detection rate and precision. Moreover, we applied eDiVA to several familial disease cases to demonstrate its clinical applicability.

The facial dysmorphology analysis technology in intellectual disability syndromes related to defects in the histones modifiers

Genetic syndromes are frequently associated with Intellectual Disability (ID), as well as craniofacial dysmorphisms. A group of ID syndromes with typical abnormal face related to chromatin remodeling defects, have been recognized, coining the term chromatinopathies. This is a molecular heterogeneous subset of congenital disorders caused by mutations of the various components of the Chromatin-Marking System (CMS), including modifiers of DNA and chromatin remodelers. We performed a phenotypic study on a sample of 120 individuals harboring variants in genes codifying for the histones enzymes, using the DeepGestalt technology. Three experiments (two multiclass comparison experiments and a frontal face-crop analysis) were conducted, analyzing respectively a total of 181 pediatric images in the first comparison experiment and 180 in the second, all individuals belonging predominantly to Caucasian population. The classification results were expressed in terms of the area under the curve (AUC) of the receiver-operating-characteristic curve (ROC). Significant values of AUC and low p-values were registered for all syndromes in the three experiments, in comparison with each other, with other ID syndromes characterized by recognizable craniofacial dysmorphisms and with unaffected controls. Final findings indicated that this group of diseases is characterized by distinctive dysmorphisms, which result pathognomonic. A correct interrogation and use of adequate informatics aids, could become a valid support for clinicians.

Identifying facial phenotypes of genetic disorders using deep learning

Syndromic genetic conditions, in aggregate, affect 8% of the population¹. Many syndromes have recognizable facial features² that are highly informative to clinical geneticists^3-5. Recent studies show that facial analysis technologies measured up to the capabilities of expert clinicians in syndrome identification^6-9. However, these technologies identified only a few disease phenotypes, limiting their role in clinical settings, where hundreds of diagnoses must be considered. Here we present a facial image analysis framework, DeepGestalt, using computer vision and deep-learning algorithms, that quantifies similarities to hundreds of syndromes. DeepGestalt outperformed clinicians in three initial experiments, two with the goal of distinguishing subjects with a target syndrome from other syndromes, and one of separating different genetic subtypes in Noonan syndrome. On the final experiment reflecting a real clinical setting problem, DeepGestalt achieved 91% top-10 accuracy in identifying the correct syndrome on 502 different images. The model was trained on a dataset of over 17,000 images representing more than 200 syndromes, curated through a community-driven phenotyping platform. DeepGestalt potentially adds considerable value to phenotypic evaluations in clinical genetics, genetic testing, research and precision medicine.

Facial recognition software in clinical dysmorphology

PURPOSE OF REVIEW

The current review aims to discuss the incorporation of facial recognition software into the clinical practice of dysmorphology and medical genetics.

RECENT FINDINGS

Facial recognition software has improved the process of generating a differential diagnosis for rare genetic syndromes, and recent publications demonstrate utility in both research and clinical applications. Software programs are freely available to verified medical providers and can be incorporated into routine clinic encounters.

SUMMARY

As facial recognition software capabilities improve, two-dimensional image capture with artificial intelligence interpretation may become a useful tool within many areas of medicine. Geneticists and researchers can use such software to enhance their differential diagnoses, to study similarities and differences between patient cohorts, and to improve the interpretation of genomic data. Pediatricians and subspecialists may use tools to identify patients who may benefit from a genetic evaluation, and educators can use these tools to interest students in the study of dysmorphoplogy and genetic syndromes.

Reliability of prenatal detection of X-linked hypohidrotic ectodermal dysplasia by tooth germ sonography

OBJECTIVE

In X-linked hypohidrotic ectodermal dysplasia (XLHED), dysfunction of ectodysplasin A1 (EDA1) due to EDA mutations results in malformation of hair, teeth, and sweat glands. Hypohidrosis, which can cause life-threatening hyperthermia, is amenable to intrauterine therapy with recombinant EDA1. This study aimed at evaluating tooth germ sonography as a noninvasive means to identify affected fetuses in pregnant carrier women.

METHODS

Sonography, performed at 10 study sites between gestational weeks 18 and 28, led to the diagnosis of XLHED if fewer than six tooth germs were detected in mandible or maxilla. The assessment was verified postnatally by EDA sequencing and/or clinical findings. Estimated fetal weights and postnatal weight gain of boys with XLHED were assessed using appropriate growth charts.

RESULTS

In 19 of 38 sonographic examinations (23 male and 13 female fetuses), XLHED was detected prenatally. The prenatal diagnosis proved to be correct in 37 cases; one affected male fetus was missed. Specificity and positive predictive value were both 100%. Tooth counts obtained by clinical examination corresponded well with findings on panoramic radiographs. We observed no weight deficits of subjects with XLHED in utero but occasionally during infancy.

CONCLUSION

Tooth germ sonography is highly specific and reliable in detecting XLHED prenatally.