Automated sperm morpshology testing using artificial intelligence

Artificial Intelligence in Urology: Current Status and Future Perspectives

Surgical fields, especially urology, have shifted increasingly toward the use of artificial intelligence (AI). Advancements in AI have created massive improvements in diagnostics, outcome predictions, and robotic surgery. For robotic surgery to progress from assisting surgeons to eventually reaching autonomous procedures, there must be advancements in machine learning, natural language processing, and computer vision. Moreover, barriers such as data availability, interpretability of autonomous decision-making, Internet connection and security, and ethical concerns must be overcome.

Evolution of intracytoplasmic sperm injection: From initial challenges to wider applications

Background

In vitro fertilization (IVF) has revolutionized infertility treatment. Nevertheless, male infertility requires more effective solutions. In 1992, the first-ever case of human birth via intracytoplasmic sperm injection (ICSI) was reported. ICSI involves microscopically injecting a sperm into an ovum. Successful ICSI has become a reliable therapy for couples facing infertility, a significant milestone. However, it has also introduced various challenges. This study also delves into ethical dilemmas arising from widespread ICSI use.

Methods

This review traces the history of ICSI, presenting pioneering attempts, first successful attempts, and critical reports on account of the initial skepticism toward the technology. The review also focuses on chronological progress until ICSI was recognized as effective and became widely applied.

Main findings

The review reveals that ICSI, although transformative, presents challenges. Successes include addressing male infertility and aiding fertilization. However, concerns arise regarding optimal sperm and embryo selection, genetic mutations, and long-term health implications. Ethical considerations surrounding ICSI's broad applications also surface.

Conclusions

Despite its success and effectiveness, ICSI is still evolving as a therapeutic method. By comprehensively evaluating the historical progress and the current status of ICSI and exploring its future prospects, this study highlights the importance of ICSI in infertility treatment.

Artificial Intelligence in Andrology: From Semen Analysis to Image Diagnostics

Artificial intelligence (AI) in medicine has gained a lot of momentum in the last decades and has been applied to various fields of medicine. Advances in computer science, medical informatics, robotics, and the need for personalized medicine have facilitated the role of AI in modern healthcare. Similarly, as in other fields, AI applications, such as machine learning, artificial neural networks, and deep learning, have shown great potential in andrology and reproductive medicine. AI-based tools are poised to become valuable assets with abilities to support and aid in diagnosing and treating male infertility, and in improving the accuracy of patient care. These automated, AI-based predictions may offer consistency and efficiency in terms of time and cost in infertility research and clinical management. In andrology and reproductive medicine, AI has been used for objective sperm, oocyte, and embryo selection, prediction of surgical outcomes, cost-effective assessment, development of robotic surgery, and clinical decision-making systems. In the future, better integration and implementation of AI into medicine will undoubtedly lead to pioneering evidence-based breakthroughs and the reshaping of andrology and reproductive medicine.

Blastocyst Prediction of Day-3 Cleavage-Stage Embryos Using Machine Learning

Background: Embryo selection plays an important role in the success of in vitro fertilization (IVF). However, morphological embryo assessment has a number of limitations, including the time required, lack of accuracy, and inconsistency. This study determined whether a machine learning-based model could predict blastocyst formation using day-3 embryo images.

Methods: Day-3 embryo images from IVF/intracytoplasmic sperm injection (ICSI) cycles performed at My Duc Phu Nhuan Hospital between August 2018 and June 2019 were retrospectively analyzed to inform model development. Day-3 embryo images derived from two-pronuclear (2PN) zygotes with known blastocyst formation data were extracted from the CCM-iBIS time-lapse incubator (Astec, Japan) at 67 hours post ICSI, and labeled as blastocyst/non-blastocyst based on results at 116 hours post ICSI. Images were used as the input dataset to train (85%) and validate (15%) the convolutional neural network (CNN) model, then model accuracy was determined using the training and validation dataset. The performance of 13 experienced embryologists for predicting blastocyst formation based on 100 day-3 embryo images was also evaluated.

Results: A total of 1,135 images were allocated into training ([Formula: see text] 967) and validation ([Formula: see text] 168) sets, with an even distribution for blastocyst formation outcome. The accuracy of the final model for blastocyst formation was 97.72% in the training dataset and 76.19% in the validation dataset. The final model predicted blastocyst formation from day-3 embryo images in the validation dataset with an area under the curve of 0.75 (95% confidence interval [CI] 0.69–0.81). Embryologists predicted blastocyst formation with the accuracy of 70.07% (95% CI 68.12%–72.03%), sensitivity of 87.04% (95% CI 82.56%–91.52%), and specificity of 30.93% (95% CI 29.35%–32.51%).

Conclusions: The CNN-based machine learning model using day-3 embryo images predicted blastocyst formation more accurately than experienced embryologists. The CNN-based model is a potential tool to predict additional IVF outcomes.

Adaptive adversarial neural networks for the analysis of lossy and domain-shifted datasets of medical images

In machine learning for image-based medical diagnostics, supervised convolutional neural networks are typically trained with large and expertly annotated datasets obtained using high-resolution imaging systems. Moreover, the network's performance can degrade substantially when applied to a dataset with a different distribution. Here, we show that adversarial learning can be used to develop high-performing networks trained on unannotated medical images of varying image quality. Specifically, we used low-quality images acquired using inexpensive portable optical systems to train networks for the evaluation of human embryos, the quantification of human sperm morphology and the diagnosis of malarial infections in the blood, and show that the networks performed well across different data distributions. We also show that adversarial learning can be used with unlabelled data from unseen domain-shifted datasets to adapt pretrained supervised networks to new distributions, even when data from the original distribution are not available. Adaptive adversarial networks may expand the use of validated neural-network models for the evaluation of data collected from multiple imaging systems of varying quality without compromising the knowledge stored in the network.

Artificial Intelligence and Its Impact on Urological Diseases and Management: A Comprehensive Review of the Literature

Recent advances in artificial intelligence (AI) have certainly had a significant impact on the healthcare industry. In urology, AI has been widely adopted to deal with numerous disorders, irrespective of their severity, extending from conditions such as benign prostate hyperplasia to critical illnesses such as urothelial and prostate cancer. In this article, we aim to discuss how algorithms and techniques of artificial intelligence are equipped in the field of urology to detect, treat, and estimate the outcomes of urological diseases. Furthermore, we explain the advantages that come from using AI over any existing traditional methods.

Effect of deep transfer and multi-task learning on sperm abnormality detection

Analyzing the abnormality of morphological characteristics of male human sperm has been studied for a long time mainly because it has many implications on the male infertility problem, which accounts for approximately half of the infertility problems in the world. Yet, detecting such abnormalities by embryologists has several downsides. To clarify, analyzing sperms through visual inspection of an expert embryologist is a highly subjective and biased process. Furthermore, it takes much time for a specialist to make a diagnosis. Hence, in this paper, we proposed two deep learning algorithms that are able to automate this process. The first algorithm uses a network-based deep transfer learning approach, while the second technique, named Deep Multi-task Transfer Learning (DMTL), employs a novel combination of network-based deep transfer learning and multi-task learning to classify sperm's head, vacuole, and acrosome as either normal or abnormal. This DMTL technique is capable of classifying all the aforementioned parts of the sperm in a single prediction. Moreover, this is the first time that the concept of multi-task learning has been introduced to the field of Sperm Morphology Analysis (SMA). To benchmark our algorithms, we employed a freely-available SMA dataset named MHSMA. During our experiments, our algorithms reached the state-of-the-art results on the accuracy, precision, and f_0.5, as well as other important metrics, such as the Matthews Correlation Coefficient on one, two, or all three labels. Notably, our algorithms increased the accuracy of the head, acrosome, and vacuole by 6.66%, 3.00%, and 1.33%, and reached the accuracy of 84.00%, 80.66%, and 94.00% on these labels, respectively. Consequently, our algorithms can be used in health institutions, such as fertility clinics, with further recommendations to practically improve the performance of our algorithms.

Machine learning-enabled multiplexed microfluidic sensors

High-throughput, cost-effective, and portable devices can enhance the performance of point-of-care tests. Such devices are able to acquire images from samples at a high rate in combination with microfluidic chips in point-of-care applications. However, interpreting and analyzing the large amount of acquired data is not only a labor-intensive and time-consuming process, but also prone to the bias of the user and low accuracy. Integrating machine learning (ML) with the image acquisition capability of smartphones as well as increasing computing power could address the need for high-throughput, accurate, and automatized detection, data processing, and quantification of results. Here, ML-supported diagnostic technologies are presented. These technologies include quantification of colorimetric tests, classification of biological samples (cells and sperms), soft sensors, assay type detection, and recognition of the fluid properties. Challenges regarding the implementation of ML methods, including the required number of data points, image acquisition prerequisites, and execution of data-limited experiments are also discussed.

Recent advances in clinical diagnosis and treatment of male factor infertility

Infertility is a significant global health issue affecting around 8-12% of couples worldwide with male factor infertility accounting for a substantial proportion of these cases. Despite significant advances within the past few decades, an etiology for male factor infertility cannot be identified in up to 80% of patients and thus, this continues to be an area of active study. This review aims to provide an update on recent advances in the field of male infertility including semen analysis and at-home semen testing, genetics, DNA fragmentation, surgical approaches, and the rise of telemedicine in the era of COVID19.

Consistency and objectivity of automated embryo assessments using deep neural networks

OBJECTIVE

To evaluate the consistency and objectivity of deep neural networks in embryo scoring and making disposition decisions for biopsy and cryopreservation in comparison to grading by highly trained embryologists.

DESIGN

Prospective double-blind study using retrospective data.

SETTING

U.S.-based large academic fertility center.

PATIENTS

Not applicable.

INTERVENTION(S)

Embryo images (748 recorded at 70 hours postinsemination [hpi]) and 742 at 113 hpi) were used to evaluate embryologists and neural networks in embryo grading. The performance of 10 embryologists and a neural network were also evaluated in disposition decision making using 56 embryos.

MAIN OUTCOME MEASURES

Coefficients of variation (%CV) and measures of consistencies were compared.

RESULTS

Embryologists exhibited a high degree of variability (%CV averages: 82.84% for 70 hpi and 44.98% for 113 hpi) in grading embryo. When selecting blastocysts for biopsy or cryopreservation, embryologists had an average consistency of 52.14% and 57.68%, respectively. The neural network outperformed the embryologists in selecting blastocysts for biopsy and cryopreservation with a consistency of 83.92%. Cronbach's α analysis revealed an α coefficient of 0.60 for the embryologists and 1.00 for the network.

CONCLUSIONS

The results of our study show a high degree of interembryologist and intraembryologist variability in scoring embryos, likely due to the subjective nature of traditional morphology grading. This may ultimately lead to less precise disposition decisions and discarding of viable embryos. The application of a deep neural network, as shown in our study, can introduce improved reliability and high consistency during the process of embryo selection and disposition, potentially improving outcomes in an embryology laboratory.

Development and evaluation of inexpensive automated deep learning-based imaging systems for embryology

Embryo assessment and selection is a critical step in an in vitro fertilization (IVF) procedure. Current embryo assessment approaches such as manual microscopy analysis done by embryologists or semi-automated time-lapse imaging systems are highly subjective, time-consuming, or expensive. Availability of cost-effective and easy-to-use hardware and software for embryo image data acquisition and analysis can significantly empower embryologists towards more efficient clinical decisions both in resource-limited and resource-rich settings. Here, we report the development of two inexpensive (<$100 and <$5) and automated imaging platforms that utilize advances in artificial intelligence (AI) for rapid, reliable, and accurate evaluations of embryo morphological qualities. Using a layered learning approach, we have shown that network models pre-trained with high quality embryo image data can be re-trained using data recorded on such low-cost, portable optical systems for embryo assessment and classification when relatively low-resolution image data are used. Using two test sets of 272 and 319 embryo images recorded on the reported stand-alone and smartphone optical systems, we were able to classify embryos based on their cell morphology with >90% accuracy.

Bormann C, Kanakasabapathy MK, Thirumalaraju P, Kandula H, Yogesh V, Gudipati N, Natarajan V, C. Petrozza J, Shafiee H. Automated smartphone-based system for measuring sperm viability, DNA fragmentation, and hyaluronic binding assay score

The fundamental test for male infertility, semen analysis, is mostly a manually performed subjective and time-consuming process and the use of automated systems has been cost prohibitive. We have previously developed an inexpensive smartphone-based system for at-home male infertility screening through automatic and rapid measurement of sperm concentration and motility. Here, we assessed the feasibility of using a similar smartphone-based system for laboratory use in measuring: a) Hyaluronan Binding Assay (HBA) score, a quantitative score describing the sperm maturity and fertilization potential in a semen sample, b) sperm viability, which assesses sperm membrane integrity, and c) sperm DNA fragmentation that assesses the degree of DNA damage. There was good correlation between the manual analysis and smartphone-based analysis for the HBA score when the device was tested with 31 fresh, unprocessed human semen samples. The smartphone-based approach performed with an accuracy of 87% in sperm classification when the HBA score was set at manufacturer's threshold of 80. Similarly, the sperm viability and DNA fragmentation tests were also shown to be compatible with the smartphone-based system when tested with 102 and 47 human semen samples, respectively.

An inexpensive smartphone-based device for point-of-care ovulation testing

The ability to accurately predict ovulation at-home using low-cost point-of-care diagnostics can be of significant help for couples who prefer natural family planning. Detecting ovulation-specific hormones in urine samples and monitoring basal body temperature are the current commonly home-based methods used for ovulation detection; however, these methods, relatively, are expensive for prolonged use and the results are difficult to comprehend. Here, we report a smartphone-based point-of-care device for automated ovulation testing using artificial intelligence (AI) by detecting fern patterns in a small volume (<100 μL) of saliva that is air-dried on a microfluidic device. We evaluated the performance of the device using artificial saliva and human saliva samples and observed that the device showed >99% accuracy in effectively predicting ovulation.