Deep learning-based selection of human sperm with high DNA integrity

Evaluation of an artificial intelligence-facilitated sperm detection tool in azoospermic samples for use in ICSI

RESEARCH QUESTION

Can artificial intelligence (AI) improve the efficiency and efficacy of sperm searches in azoospermic samples?

DESIGN

This two-phase proof-of-concept study began with a training phase using eight azoospermic patients (>10,000 sperm images) to provide a variety of surgically collected samples for sperm morphology and debris variation to train a convolutional neural network to identify spermatozoa. Second, side-by-side testing was undertaken on two cohorts of non-obstructive azoospermia patient samples: an embryologist versus the AI identifying all the spermatozoa in the still images (cohort 1, n = 4), and a side-by-side test with a simulated clinical deployment of the AI model with an intracytoplasmic sperm injection microscope and the embryologist performing a search with and without the aid of the AI (cohort 2, n = 4).

RESULTS

In cohort 1, the AI model showed an improvement in the time taken to identify all the spermatozoa per field of view (0.02 ± 0.30  ×  10-5s versus 36.10 ± 1.18s, P < 0.0001) and improved recall (91.95 ± 0.81% versus 86.52 ± 1.34%, P < 0.001) compared with an embryologist. From a total of 2660 spermatozoa to find in all the samples combined, 1937 were found by an embryologist and 1997 were found by the AI in less than 1000th of the time. In cohort 2, the AI-aided embryologist took significantly less time per droplet (98.90 ± 3.19 s versus 168.7 ± 7.84 s, P < 0.0001) and found 1396 spermatozoa, while 1274 were found without AI, although no significant difference was observed.

CONCLUSIONS

AI-powered image analysis has the potential for seamless integration into laboratory workflows, to reduce the time to identify and isolate spermatozoa from surgical sperm samples from hours to minutes, thus increasing success rates from these treatments.

Artificial intelligence and porcine breeding

Livestock management is evolving into a new era, characterized by the analysis of vast quantities of data (Big Data) collected from both traditional breeding methods and new technologies such as sensors, automated monitoring system, and advanced analytics. Artificial intelligence (A-In), which refers to the capability of machines to mimic human intelligence, including subfields like machine learning and deep learning, is playing a pivotal role in this transformation. A wide array of A-In techniques, successfully employed in various industrial and scientific contexts, are now being integrated into mainstream livestock management practices. In the case of swine breeding, while traditional methods have yielded considerable success, the increasing amount of information requires the adoption of new technologies such as A-In to drive productivity, enhance animal welfare, and reduce environmental impact. Current findings suggest that these techniques have the potential to match or exceed the performance of traditional methods, often being more scalable in terms of efficiency and sustainability within the breeding industry. This review provides insights into the application of A-In in porcine breeding, from the perspectives of both sows (including welfare and reproductive management) and boars (including semen quality and health), and explores new approaches which are already being applied in other species.

An artificial intelligence tool predicts blastocyst development from static images of fresh mature oocytes

RESEARCH QUESTION

Can a deep learning image analysis model be developed to assess oocyte quality by predicting blastocyst development from images of denuded mature oocytes?

DESIGN

A deep learning model was developed utilizing 37,133 static oocyte images with associated laboratory outcomes from eight fertility clinics (six countries). A subset of data (n = 7807) was allocated to test model performance. External model validation was conducted to assess generalizability and robustness on new data (n = 12,357) from two fertility clinics (two countries). Performance was assessed by calculating area under the curve (AUC), balanced accuracy, specificity and sensitivity. Subgroup analyses were performed on the test dataset for age group, male factor and geographical location of the clinic. Model probabilities of the external dataset were converted to a 0-10 scoring scale to facilitate analysis of correlation with blastocyst development and quality.

RESULTS

The deep learning model demonstrated AUC of 0.64, balanced accuracy of 0.60, specificity of 0.55 and sensitivity of 0.65 on the test dataset. Subgroup analyses displayed the highest performance for age group 38-39 years (AUC 0.68), a negligible impact of male factor, and good model generalizability across geographical locations. Model performance was confirmed on external data: AUC of 0.63, balanced accuracy of 0.58, specificity of 0.57 and sensitivity of 0.59. Analysis of the scoring scale revealed that higher scoring oocytes correlated with higher likelihood of blastocyst development and good-quality blastocyst formation.

CONCLUSION

The deep learning model showed a favourable performance for the evaluation of oocytes in terms of competence to develop into a blastocyst, and when the predictions were converted into scores, they correlated with blastocyst quality. This represents a significant first step in oocyte evaluation for scientific and clinical applications.

Deep Learning Insights into the Dynamic Effects of Photodynamic Therapy on Cancer Cells

Photodynamic therapy (PDT) shows promise in tumor treatment, particularly when combined with nanotechnology. This study examines the impact of deep learning, particularly the Cellpose algorithm, on the comprehension of cancer cell responses to PDT. The Cellpose algorithm enables robust morphological analysis of cancer cells, while logistic growth modelling predicts cellular behavior post-PDT. Rigorous model validation ensures the accuracy of the findings. Cellpose demonstrates significant morphological changes after PDT, affecting cellular proliferation and survival. The reliability of the findings is confirmed by model validation. This deep learning tool enhances our understanding of cancer cell dynamics after PDT. Advanced analytical techniques, such as morphological analysis and growth modeling, provide insights into the effects of PDT on hepatocellular carcinoma (HCC) cells, which could potentially improve cancer treatment efficacy. In summary, the research examines the role of deep learning in optimizing PDT parameters to personalize oncology treatment and improve efficacy.

Microfluidics as an emerging paradigm for assisted reproductive technology: A sperm separation perspective

Millions of people are subject to infertility worldwide and one in every six people, regardless of gender, experiences infertility at some period in their life, according to the World Health Organization. Assisted reproductive technologies are defined as a set of procedures that can address the infertility issue among couples, culminating in the alleviation of the condition. However, the costly conventional procedures of assisted reproduction and the inherent vagaries of the processes involved represent a setback for its successful implementation. Microfluidics, an emerging tool for processing low-volume samples, have recently started to play a role in infertility diagnosis and treatment. Given its host of benefits, including manipulating cells at the microscale, repeatability, automation, and superior biocompatibility, microfluidics have been adopted for various procedures in assisted reproduction, ranging from sperm sorting and analysis to more advanced processes such as IVF-on-a-chip. In this review, we try to adopt a more holistic approach and cover different uses of microfluidics for a variety of applications, specifically aimed at sperm separation and analysis. We present various sperm separation microfluidic techniques, categorized as natural and non-natural methods. A few of the recent developments in on-chip fertilization are also discussed.

The prospect of artificial intelligence to personalize assisted reproductive technology

Infertility affects 1-in-6 couples, with repeated intensive cycles of assisted reproductive technology (ART) required by many to achieve a desired live birth. In ART, typically, clinicians and laboratory staff consider patient characteristics, previous treatment responses, and ongoing monitoring to determine treatment decisions. However, the reproducibility, weighting, and interpretation of these characteristics are contentious, and highly operator-dependent, resulting in considerable reliance on clinical experience. Artificial intelligence (AI) is ideally suited to handle, process, and analyze large, dynamic, temporal datasets with multiple intermediary outcomes that are generated during an ART cycle. Here, we review how AI has demonstrated potential for optimization and personalization of key steps in a reproducible manner, including: drug selection and dosing, cycle monitoring, induction of oocyte maturation, and selection of the most competent gametes and embryos, to improve the overall efficacy and safety of ART.

Current Updates on Involvement of Artificial Intelligence and Machine Learning in Semen Analysis

Background and Objectives: Infertility rates and the number of couples undergoing reproductive care have both increased substantially during the last few decades. Semen analysis is a crucial step in both the diagnosis and the treatment of male infertility. The accuracy of semen analysis results remains quite poor despite years of practice and advancements. Artificial intelligence (AI) algorithms, which can analyze and synthesize large amounts of data, can address the unique challenges involved in semen analysis due to the high objectivity of current methodologies. This review addresses recent AI advancements in semen analysis. Materials and Methods: A systematic literature search was performed in the PubMed database. Non-English articles and studies not related to humans were excluded. We extracted data related to AI algorithms or models used to evaluate semen parameters from the original studies, excluding abstracts, case reports, and meeting reports. Results: Of the 306 articles identified, 225 articles were rejected in the preliminary screening. The evaluation of the full texts of the remaining 81 publications resulted in the exclusion of another 48 articles, with a final inclusion of 33 original articles in this review. Conclusions: AI and machine learning are becoming increasingly popular in biomedical applications. The examination and selection of sperm by andrologists and embryologists may benefit greatly from using these algorithms. Furthermore, when bigger and more reliable datasets become accessible for training, these algorithms may improve over time.

Gaussian clustering and quantification of the sperm chromatin dispersion test using convolutional neural networks

Sperm DNA fragmentation is a sign of sperm nuclear damage. The sperm chromatin dispersion (SCD) test is a reliable and economical method for the evaluation of DNA fragmentation. However, the cut-off value for differentiation of DNA fragmented sperms is fixed at 1/3 with limited statistical justification, making the SCD test a semi-quantitative method that gives user-dependent results. We construct a collection of deep neural networks to automate the evaluation of bright-field images for SCD tests. The model can detect valid sperm nuclei and their locations from the input images captured with a 20× objective and predict the geometric parameters of the halo ring. We construct an annotated dataset consisting of N = 3120 images. The ResNet 18 based network reaches an average precision (AP50) of 91.3%, a true positive rate of 96.67%, and a true negative rate of 96.72%. The distribution of relative halo radii is fit to the multi-peak Gaussian function (p > 0.99). DNA fragmentation is regarded as those with a relative halo radius 1.6 standard deviations smaller than the mean of a normal cluster. In conclusion, we have established a deep neural network based model for the automation and quantification of the SCD test that is ready for clinical application. The DNA fragmentation index is determined using Gaussian clustering, reflecting the natural distribution of halo geometry and is more tolerable to disturbances and sample conditions, which we believe will greatly improve the clinical significance of the SCD test.

Artificial Intelligence in Andrology: From Semen Analysis to Image Diagnostics

Artificial intelligence (AI) in medicine has gained a lot of momentum in the last decades and has been applied to various fields of medicine. Advances in computer science, medical informatics, robotics, and the need for personalized medicine have facilitated the role of AI in modern healthcare. Similarly, as in other fields, AI applications, such as machine learning, artificial neural networks, and deep learning, have shown great potential in andrology and reproductive medicine. AI-based tools are poised to become valuable assets with abilities to support and aid in diagnosing and treating male infertility, and in improving the accuracy of patient care. These automated, AI-based predictions may offer consistency and efficiency in terms of time and cost in infertility research and clinical management. In andrology and reproductive medicine, AI has been used for objective sperm, oocyte, and embryo selection, prediction of surgical outcomes, cost-effective assessment, development of robotic surgery, and clinical decision-making systems. In the future, better integration and implementation of AI into medicine will undoubtedly lead to pioneering evidence-based breakthroughs and the reshaping of andrology and reproductive medicine.

Virtual staining for pixel-wise and quantitative analysis of single cell images

Immunocytochemical staining of microorganisms and cells has long been a popular method for examining their specific subcellular structures in greater detail. Recently, generative networks have emerged as an alternative to traditional immunostaining techniques. These networks infer fluorescence signatures from various imaging modalities and then virtually apply staining to the images in a digital environment. In numerous studies, virtual staining models have been trained on histopathology slides or intricate subcellular structures to enhance their accuracy and applicability. Despite the advancements in virtual staining technology, utilizing this method for quantitative analysis of microscopic images still poses a significant challenge. To address this issue, we propose a straightforward and automated approach for pixel-wise image-to-image translation. Our primary objective in this research is to leverage advanced virtual staining techniques to accurately measure the DNA fragmentation index in unstained sperm images. This not only offers a non-invasive approach to gauging sperm quality, but also paves the way for streamlined and efficient analyses without the constraints and potential biases introduced by traditional staining processes. This novel approach takes into account the limitations of conventional techniques and incorporates improvements to bolster the reliability of the virtual staining process. To further refine the results, we discuss various denoising techniques that can be employed to reduce the impact of background noise on the digital images. Additionally, we present a pixel-wise image matching algorithm designed to minimize the error caused by background noise and to prevent the introduction of bias into the analysis. By combining these approaches, we aim to develop a more effective and reliable method for quantitative analysis of virtually stained microscopic images, ultimately enhancing the study of microorganisms and cells at the subcellular level.

Ensembling noisy segmentation masks of blurred sperm images

BACKGROUND

Sperm tail morphology and motility have been demonstrated to be important factors in determining sperm quality for in vitro fertilization. However, many existing computer-aided sperm analysis systems leave the sperm tail out of the analysis, as detecting a few tail pixels is challenging. Moreover, some publicly available datasets for classifying morphological defects contain images limited only to the sperm head. This study focuses on the segmentation of full sperm, which consists of the head and tail parts, and appear alone and in groups.

METHODS

We re-purpose the Feature Pyramid Network to ensemble an input image with multiple masks from state-of-the-art segmentation algorithms using a scale-specific cross-attention module. We normalize homogeneous backgrounds for improved training. The low field depth of microscopes blurs the images, easily confusing human raters in discerning minuscule sperm from large backgrounds. We thus propose evaluation protocols for scoring segmentation models trained on imbalanced data and noisy ground truth.

RESULTS

The neural ensembling of noisy segmentation masks outperforms all single, state-of-the-art segmentation algorithms in full sperm segmentation. Human raters agree more on the head than tail masks. The algorithms also segment the head better than the tail.

CONCLUSIONS

The extensive evaluation of state-of-the-art segmentation algorithms shows that full sperm segmentation is challenging. We release the SegSperm dataset of images from Intracytoplasmic Sperm Injection procedures to spur further progress on full sperm segmentation with noisy and imbalanced ground truth. The dataset is publicly available at https://doi.org/10.34808/6wm7-1159.

Improving outcomes of assisted reproductive technologies using artificial intelligence for sperm selection

Within the field of assisted reproductive technology, artificial intelligence has become an attractive tool for potentially improving success rates. Recently, artificial intelligence-based tools for sperm evaluation and selection during intracytoplasmic sperm injection (ICSI) have been explored, mainly to improve fertilization outcomes and decrease variability within ICSI procedures. Although significant advances have been achieved in developing algorithms that track and rank single sperm in real-time during ICSI, the clinical benefits these might have in improving pregnancy rates from a single assisted reproductive technology cycle remain to be established.

Application of artificial intelligence in gametes and embryos selection

Gamete and embryo quality are critical to the success rate of Assisted Reproductive Technology (ART) cycles, but there remains a lack of methods to accurately measure the quality of sperm, oocytes and embryos. The ability of Artificial Intelligence (AI) technology to analyze large amounts of data, especially video and images, is particularly useful in gamete and embryo assessment and selection. The well-trained model has fast calculation speed and high accuracy, which can help embryologists to perform more objective gamete and embryo selection. Various artificial intelligence models have been developed for gamete and embryo assessment, some of which exhibit good performance. In this review, we summarize the latest applications of AI technology in semen analysis, as well as selection for sperm, oocyte and embryo, and discuss the existing problems and development directions of artificial intelligence in this field.

Deep Learning-Based Precision Analysis for Acrosome Reaction by Modification of Plasma Membrane in Boar Sperm

The analysis of AR is widely used to detect loss of acrosome in sperm, but the subjective decisions of experts affect the accuracy of the examination. Therefore, we develop an ARCS for objectivity and consistency of analysis using convolutional neural networks (CNNs) trained with various magnification images. Our models were trained on 215 microscopic images at 400× and 438 images at 1000× magnification using the ResNet 50 and Inception-ResNet v2 architectures. These models distinctly recognized micro-changes in the PM of AR sperms. Moreover, the Inception-ResNet v2-based ARCS achieved a mean average precision of over 97%. Our system's calculation of the AR ratio on the test dataset produced results similar to the work of the three experts and could do so more quickly. Our model streamlines sperm detection and AR status determination using a CNN-based approach, replacing laborious tasks and expert assessments. The ARCS offers consistent AR sperm detection, reduced human error, and decreased working time. In conclusion, our study suggests the feasibility and benefits of using a sperm diagnosis artificial intelligence assistance system in routine practice scenarios.

Machine Learning Approach for Muscovy Duck (Cairina moschata) Semen Quality Assessment

This study aimed to develop a comprehensive approach for assessing fresh ejaculate from Muscovy duck (Cairina moschata) drakes to fulfil the requirements of artificial insemination in farm practices. The approach combines sperm kinetics (CASA) with non-kinetic parameters, such as vitality, enzyme activities (alkaline phosphatase (AP), creatine kinase (CK), lactate dehydrogenase (LDH), and γ-glutamyl-transferase (GGT)), and total DNA methylation as training features for a set of machine learning (ML) models designed to enhance the predictive capacity of sperm parameters. Samples were classified based on their progressive motility and DNA methylation features, exhibiting significant differences in total and progressive motility, curvilinear velocity (VCL), velocity of the average path (VAP), linear velocity (VSL), amplitude of lateral head displacement (ALH), beat-cross frequency (BCF), and live normal sperm cells in favour of fast motility ones. Additionally, there were significant differences in enzyme activities for AP and CK, with correlations to LDH and GGT levels. Although motility showed no correlation with total DNA methylation, ALH, wobble of the curvilinear trajectory (WOB), and VCL were significantly different in the newly introduced classification for "suggested good quality", where both motility and methylation were high. The performance differences observed while training various ML classifiers using different feature subsets highlight the importance of DNA methylation for achieving more accurate sample quality classification, even though there is no correlation between motility and DNA methylation. The parameters ALH, VCL, triton extracted LDH, and VAP were top-ranking for "suggested good quality" predictions by the neural network and gradient boosting models. In conclusion, integrating non-kinetic parameters into machine-learning-based sample classification offers a promising approach for selecting kinetically and morphologically superior duck sperm samples that might otherwise be hindered by a predominance of lowly methylated cells.

VISEM-Tracking, a human spermatozoa tracking dataset

A manual assessment of sperm motility requires microscopy observation, which is challenging due to the fast-moving spermatozoa in the field of view. To obtain correct results, manual evaluation requires extensive training. Therefore, computer-aided sperm analysis (CASA) has become increasingly used in clinics. Despite this, more data is needed to train supervised machine learning approaches in order to improve accuracy and reliability in the assessment of sperm motility and kinematics. In this regard, we provide a dataset called VISEM-Tracking with 20 video recordings of 30 seconds (comprising 29,196 frames) of wet semen preparations with manually annotated bounding-box coordinates and a set of sperm characteristics analyzed by experts in the domain. In addition to the annotated data, we provide unlabeled video clips for easy-to-use access and analysis of the data via methods such as self- or unsupervised learning. As part of this paper, we present baseline sperm detection performances using the YOLOv5 deep learning (DL) model trained on the VISEM-Tracking dataset. As a result, we show that the dataset can be used to train complex DL models to analyze spermatozoa.

Microsystem Advances through Integration with Artificial Intelligence

Microfluidics is a rapidly growing discipline that involves studying and manipulating fluids at reduced length scale and volume, typically on the scale of micro- or nanoliters. Under the reduced length scale and larger surface-to-volume ratio, advantages of low reagent consumption, faster reaction kinetics, and more compact systems are evident in microfluidics. However, miniaturization of microfluidic chips and systems introduces challenges of stricter tolerances in designing and controlling them for interdisciplinary applications. Recent advances in artificial intelligence (AI) have brought innovation to microfluidics from design, simulation, automation, and optimization to bioanalysis and data analytics. In microfluidics, the Navier-Stokes equations, which are partial differential equations describing viscous fluid motion that in complete form are known to not have a general analytical solution, can be simplified and have fair performance through numerical approximation due to low inertia and laminar flow. Approximation using neural networks trained by rules of physical knowledge introduces a new possibility to predict the physicochemical nature. The combination of microfluidics and automation can produce large amounts of data, where features and patterns that are difficult to discern by a human can be extracted by machine learning. Therefore, integration with AI introduces the potential to revolutionize the microfluidic workflow by enabling the precision control and automation of data analysis. Deployment of smart microfluidics may be tremendously beneficial in various applications in the future, including high-throughput drug discovery, rapid point-of-care-testing (POCT), and personalized medicine. In this review, we summarize key microfluidic advances integrated with AI and discuss the outlook and possibilities of combining AI and microfluidics.

Looking with new eyes: advanced microscopy and artificial intelligence in reproductive medicine

Microscopy has long played a pivotal role in the field of assisted reproductive technology (ART). The advent of artificial intelligence (AI) has opened the door for new approaches to sperm and oocyte assessment and selection, with the potential for improved ART outcomes.

Deep Learning-Based Robust Automated System for Predicting Human Sperm DNA Fragmentation Index

Background

Determining the DNA fragmentation index (DFI) by the sperm chromatin dispersion (SCD) test involves manual counting of stained sperms with halo and no halo.

Aims

The aim of this study is to build a robust artificial intelligence-based solution to predict the DFI.

Settings and Design

This is a retrospective experimental study conducted in a secondary in vitro fertilisation setup.

Materials and Methods

We obtained 24,415 images from 30 patients after the SCD test using a phase-contrast microscope. We classified the dataset into two, binary (halo/no halo) and multiclass (big/medium/small halo/degraded (DEG)/dust). Our approach consists of a training and prediction phase. The 30 patients' images were divided into training (24) and prediction (6) sets. A pre-processing method M was developed to automatically segment the images to detect sperm-like regions and was annotated by three embryologists.

Statistical Analysis Used

To interpret the findings, the precision-recall curve and F1 score were utilised.

Results

Binary and multiclass datasets containing 8887 and 15,528 cropped sperm image regions showed an accuracy of 80.15% versus 75.25%. A precision-recall curve was determined and the binary and multiclass datasets obtained an F1 score of 0.81 versus 0.72. A confusion matrix was applied for predicted and actuals for the multiclass approach where small halo and medium halo confusion were found to be highest.

Conclusion

Our proposed machine learning model can standardise and aid in arriving at accurate results without using expensive software. It provides accurate information about healthy and DEG sperms in a given sample, thereby attaining better clinical outcomes. The binary approach performed better with our model than the multiclass approach. However, the multiclass approach can highlight the distribution of fragmented and non-fragmented sperms.

Sperm DNA fragmentation testing in clinical management of reproductive medicine

Background

Approximately 8%-12% of couples worldwide face infertility, with infertility of individuals assigned male at birth (AMAB) contributing to at least 50% of cases. Conventional semen analysis commonly used to detect sperm abnormalities is insufficient, as 30% of AMAB patients experiencing infertility show normal results in this test. From a genetic perspective, the assessment of sperm DNA fragmentation (SDF) is important as a parameter of sperm quality.

Methods

In this narrative study, we review and discuss pathophysiological causes, DNA repair mechanisms, and management of high SDF. We then summarize literature exploring the association between SDF and reproductive outcomes.

Main Findings

Recent systematic reviews and meta-analyses have revealed a significant association between high SDF in AMAB individuals and adverse reproductive outcomes including embryo development, natural conception, intrauterine insemination, and in vitro fertilization. However, the association with live birth rates and pregnancy rates following intracytoplasmic injection remains inconclusive. The disparities among quantitative assays, inconsistent reference range values, absent high-quality prospective clinical trials, and clinical heterogeneity in AMAB patients with elevated SDF represent the main limitations affecting SDF testing.

Conclusion

The evaluation and management of SDF plays an important role in a subset of AMAB infertility, but widespread integration into clinical guidelines will require future high-quality clinical trials and assay standardization.

Evolution of the basic semen analysis and processing sperm

PURPOSE OF REVIEW

The sixth edition of the World Health Organization (WHO) laboratory manual for the examination and processing of human semen was recently published with specific step-by-step instructions for semen evaluation and sperm processing. Point-of-care (POC) testing for semen evaluation and microfluidics for sperm processing are rapidly evolving technologies that could impact how we evaluate and process sperm. Understanding the updated manual in the context of these novel technologies is important.

RECENT FINDINGS

Proper standardization of semen evaluation and sperm processing will allow for consistent high-quality results among laboratories worldwide. POC testing could improve access to semen evaluations that generate referrals to male infertility specialists for further assessment. Microfluidics can select functional sperm with decreased DNA fragmentation in semen and testicular biopsy samples for assisted reproductive technology (ART). Clinical outcomes, such as pregnancy rates and live birth rates, have not been shown to be consistently improved with these technologies compared to conventional techniques, although high level evidence research in this area is limited.

SUMMARY

POC testing and microfluidics have the potential to be combined with machine learning technologies to improve fertility care. If these technologies are appropriately optimized, they could change how we evaluate and process sperm, and potentially lead to improved ART outcomes.

The role of spermatozoa-zona pellucida interaction in selecting fertilization-competent spermatozoa in humans

Human fertilization begins when a capacitated spermatozoon binds to the zona pellucida (ZP) surrounding a mature oocyte. Defective spermatozoa-ZP interaction contributes to male infertility and is a leading cause of reduced fertilization rates in assisted reproduction treatments (ARTs). Human ejaculate contains millions of spermatozoa with varying degrees of fertilization potential and genetic quality, of which only thousands of motile spermatozoa can bind to the ZP at the fertilization site. This observation suggests that human ZP selectively interacts with competitively superior spermatozoa characterized by high fertilizing capability and genetic integrity. However, direct evidence for ZP-mediated sperm selection process is lacking. This study aims to demonstrate that spermatozoa-ZP interaction represents a crucial step in selecting fertilization-competent spermatozoa in humans. ZP-bound and unbound spermatozoa were respectively collected by a spermatozoa-ZP coincubation assay. The time-course data demonstrated that ZP interacted with a small proportion of motile spermatozoa. Heat shock 70 kDa protein 2 (HSPA2) and sperm acrosome associated 3 (SPACA 3) are two protein markers associated with the sperm ZP-binding ability. Immunofluorescent staining indicated that the ZP-bound spermatozoa had significantly higher expression levels of HSPA2 and SPACA3 than the unbound spermatozoa. ZP-bound spermatozoa had a significantly higher level of normal morphology, DNA integrity, chromatin integrity, protamination and global methylation when compared to the unbound spermatozoa. The results validated the possibility of applying spermatozoa-ZP interaction to select fertilization-competent spermatozoa in ART. This highly selective interaction might also provide diagnostic information regarding the fertilization potential and genetic qualities of spermatozoa independent of those derived from the standard semen analysis.

Predicting RNA secondary structure by a neural network: what features may be learned?

Deep learning is a class of machine learning techniques capable of creating internal representation of data without explicit preprogramming. Hence, in addition to practical applications, it is of interest to analyze what features of biological data may be learned by such models. Here, we describe PredPair, a deep learning neural network trained to predict base pairs in RNA structure from sequence alone, without any incorporated prior knowledge, such as the stacking energies or possible spatial structures. PredPair learned the Watson-Crick and wobble base-pairing rules and created an internal representation of the stacking energies and helices. Application to independent experimental (DMS-Seq) data on nucleotide accessibility in mRNA showed that the nucleotides predicted as paired indeed tend to be involved in the RNA structure. The performance of the constructed model was comparable with the state-of-the-art method based on the thermodynamic approach, but with a higher false positives rate. On the other hand, it successfully predicted pseudoknots. t-SNE clusters of embeddings of RNA sequences created by PredPair tend to contain embeddings from particular Rfam families, supporting the predictions of PredPair being in line with biological classification.

Future of Male Infertility Evaluation and Treatment: Brief Review of Emerging Technology

Over the past few decades, there have been significant advances in male infertility, particularly in the development of novel diagnostic tools. Unfortunately, there remains a substantial number of patients that remain infertile despite these improvements. In this review, we take heed of the emerging technologies that will shape the future of male infertility diagnosis, evaluation and treatment. Improvement in computer-assisted semen analyses and portability allow males to obtain basic semen parameters from the comfort of their home. Additionally, breakthrough ultrasound technology allows for preoperative prediction of potential areas of spermatogenesis within the testes, high-resolution optics permits better visualization during microdissection testicular sperm extraction (mTESE), and artificial intelligence improves sperm selection and identification.

Automated rare sperm identification from low-magnification microscopy images of dissociated microsurgical testicular sperm extraction samples using deep learning

OBJECTIVE

To develop a machine learning algorithm to detect rare human sperm in semen and microsurgical testicular sperm extraction (microTESE) samples using bright-field (BF) microscopy for nonobstructive azoospermia patients.

DESIGN

Spermatozoa were collected from fertile men. Testis biopsies were collected from microTESE samples determined to be clinically negative for sperm. A convolutional neural network based on the U-Net architecture was trained using 35,761 BF image patches with fluorescent ground truth image pairs to segment sperm. The algorithm was validated using 7,663 image patches. The algorithm was tested using 7,663 image patches containing abundant sperm, as well as 7,985 image patches containing rare sperm.

SETTING

In vitro fertilization center and university laboratories.

PATIENT(S)

Normospermic and nonobstructive azoospermia patients.

INTERVENTION(S)

None.

MAIN OUTCOME MEASURE(S)

Precision (positive predictive value [PPV]), recall (sensitivity), and F1-score of detected sperm locations.

RESULT(S)

For sperm-only samples, our algorithm achieved 91% PPV, 95.8% sensitivity, and 93.3% F1-score at ×10 magnification. For dissociated microTESE samples doped with an abundant quantity of sperm, our algorithm achieved 84.0% PPV, 72.7% sensitivity, and 77.9% F1-score. For dissociated microTESE samples doped with rare sperm, our algorithm achieved 84.4% PPV, 86.1% sensitivity, and 85.2% F1-score.

CONCLUSION(S)

Rare sperm can be detected in patients' testis biopsy samples for potential subsequent use in in vitro fertilization-intracytoplasmic sperm injection. A machine learning algorithm can use BF images at ×10 magnification to accurately detect sperm locations using automated imaging.

Advanced molecular approaches in male infertility diagnosis

In the recent years a special attention has been given to a major health concern namely to male infertility, defined as the inability to conceive after 12 months of regular unprotected sexual intercourse, taken into account the statistics that highlight that sperm counts have dropped by 50-60% in recent decades. According to the WHO, infertility affects approximately 9% of couples globally, and the male factor is believed to be present in roughly 50% of cases, with exclusive responsibility in 30%. The aim of this manuscript is to present an evidence-based approach for diagnosing male infertility that includes finding new solutions for diagnosis and critical outcomes, retrieving up-to-date studies and existing guidelines. The diverse factors that induce male infertility generated in a vast amount of data that needed to be analysed by a clinician before a decision could be made for each individual. Modern medicine faces numerous obstacles as a result of the massive amount of data generated by the molecular biology discipline. To address complex clinical problems, vast data must be collected, analysed, and used, which can be very challenging. The use of artificial intelligence (AI) methods to create a decision support system can help predict the diagnosis and guide treatment for infertile men, based on analysis of different data as environmental and lifestyle, clinical (sperm count, morphology, hormone testing, karyotype, etc.) and "omics" bigdata. Ultimately, the development of AI algorithms will assist clinicians in formulating diagnosis, making treatment decisions, and predicting outcomes for assisted reproduction techniques.

High DNA stainability (HDS) should not be recommended as a marker for the detection of sperm DNA damage

There was a marker of high DNA stainability (HDS) in the detection of sperm DNA damage, which was defined as the sperm with high green stainability (HIGRN). The sperm with normal double-stranded DNA was stained green by acridine orange (AO). However, the sperm with high green fluorescence or HDS were thought of as immature sperm or the sperm with poor chromatin condensation. Some previous literature reported that the proportion of sperm with HDS increased with age, and had a certain correlation with the poor outcome of assisted reproductive technology. Recently, several articles reported that the marker of HDS decreased linearly with age, which was obviously inconsistent with that reported by the previous literature. In this case, what kind of marker is HDS? Is it worth studying? After extensively reading the literature related to HDS and flow cytometry related books and performing a series of studies related to the detection of sperm DNA damage, we believe that the establishment of HDS in the detection of sperm DNA damage has no theoretical basis and also no support of evidence-based medicine and that using HDS as a marker in the detection of sperm DNA integrity is inappropriate.

Exploiting machine learning for bestowing intelligence to microfluidics

Intelligent microfluidics is an emerging cross-discipline research area formed by combining microfluidics with machine learning. It uses the advantages of microfluidics, such as high throughput and controllability, and the powerful data processing capabilities of machine learning, resulting in improved systems in biotechnology and chemistry. Compared to traditional microfluidics using manual analysis methods, intelligent microfluidics needs less human intervention, and results in a more user-friendly experience with faster processing. There is a paucity of literature reviewing this burgeoning and highly promising cross-discipline. Therefore, we herein comprehensively and systematically summarize several aspects of microfluidic applications enabled by machine learning. We list the types of microfluidics used in intelligent microfluidic applications over the last five years, as well as the machine learning algorithms and the hardware used for training. We also present the most recent advances in key technologies, developments, challenges, and the emerging opportunities created by intelligent microfluidics.

Simulating nature in sperm selection for assisted reproduction

Sperm selection in the female reproductive tract (FRT) is sophisticated. Only about 1,000 sperm out of millions in an ejaculate reach the fallopian tube and thus have a chance of fertilizing an oocyte. In assisted reproduction techniques, sperm are usually selected using their density or motility, characteristics that do not reflect their fertilization competence and, therefore, might result in failure to fertilize the oocyte. Although sperm processing in in vitro fertilization (IVF) and intrauterine insemination (IUI) bypasses many of the selection processes in the FRT, selection by the cumulus mass and the zona pellucida remain intact. By contrast, the direct injection of a sperm into an oocyte in intracytoplasmic sperm injection (ICSI) bypasses all natural selection barriers and, therefore, increases the risk of transferring paternal defects such as fragmented DNA and genomic abnormalities in sperm to the resulting child. Research into surrogate markers of fertilization potential and into simulating the natural sperm selection processes has progressed. However, methods of sperm isolation - such as hyaluronic acid-based selection and microfluidic isolation based on sperm tactic responses - use only one or two parameters and are not comparable with the multistep sperm selection processes naturally occurring within the FRT. Fertilization-competent sperm require a panel of molecules, including zona pellucida-binding proteins and ion channel proteins, that enable them to progress through the FRT to achieve fertilization. The optimal artificial sperm selection method will, therefore, probably need to use a multiparameter tool that incorporates the molecular signature of sperm with high fertilization potential, and their responses to external cues, within a microfluidic system that can replicate the physiological processes of the FRT in vitro.

Advances in sperm analysis: techniques, discoveries and applications

Infertility affects one in six couples worldwide, and fertility continues to deteriorate globally, partly owing to a decline in semen quality. Sperm analysis has a central role in diagnosing and treating male factor infertility. Many emerging techniques, such as digital holography, super-resolution microscopy and next-generation sequencing, have been developed that enable improved analysis of sperm motility, morphology and genetics to help overcome limitations in accuracy and consistency, and improve sperm selection for infertility treatment. These techniques have also improved our understanding of fundamental sperm physiology by enabling discoveries in sperm behaviour and molecular structures. Further progress in sperm analysis and integrating these techniques into laboratories and clinics requires multidisciplinary collaboration, which will increase discovery and improve clinical outcomes.

Artificial intelligence in the fertility clinic: status, pitfalls and possibilities

In recent years, the amount of data produced in the field of ART has increased exponentially. The diversity of data is large, ranging from videos to tabular data. At the same time, artificial intelligence (AI) is progressively used in medical practice and may become a promising tool to improve success rates with ART. AI models may compensate for the lack of objectivity in several critical procedures in fertility clinics, especially embryo and sperm assessments. Various models have been developed, and even though several of them show promising performance, there are still many challenges to overcome. In this review, we present recent research on AI in the context of ART. We discuss the strengths and weaknesses of the presented methods, especially regarding clinical relevance. We also address the pitfalls hampering successful use of AI in the clinic and discuss future possibilities and important aspects to make AI truly useful for ART.

Pregnancy prediction performance of an annotation-free embryo scoring system on the basis of deep learning after single vitrified-warmed blastocyst transfer: a single-center large cohort retrospective study

OBJECTIVE

To analyze the performance of an annotation-free embryo scoring system on the basis of deep learning for pregnancy prediction after single vitrified blastocyst transfer (SVBT) compared with the performance of other blastocyst grading systems dependent on annotation or morphology scores.

DESIGN

A single-center large cohort retrospective study from an independent validation test.

SETTING

Infertility clinic.

PATIENT(S)

Patients who underwent SVBT cycles (3,018 cycles, mean ± SD patient age 39.3 ± 4.0 years).

INTERVENTION(S)

None.

MAIN OUTCOME MEASURE(S)

The pregnancy prediction performances of each embryo scoring model were compared using the area under curve (AUC) for predicting the fetal heartbeat status for each maternal age group.

RESULT(S)

The AUCs of the <35 years age group (n = 389) for pregnancy prediction were 0.72 for iDAScore, 0.66 for KIDScore, and 0.64 for the Gardner criteria. The AUC of iDAScore was significantly greater than those of the other two models. For the 35-37 years age group (n = 514), the AUCs were 0.68, 0.68, and 0.65 for iDAScore, KIDScore, and the Gardner criteria, respectively, and were not significantly different. The AUCs of the 38-40 years age group (n = 796) were 0.67 for iDAScore, 0.65 for KIDScore, and 0.64 for the Gardner criteria, and there were no significant differences. The AUCs of the 41-42 years age group (n = 636) were 0.66, 0.66, and 0.63 for iDAScore, KIDScore, and the Gardner criteria, respectively, and there were no significant differences among the pregnancy prediction models. For the >42 years age group (n = 389), the AUCs were 0.76 for iDAScore, 0.75 for KIDScore, and 0.75 for the Gardner criteria, and there were no significant differences. Thus, iDAScore AUC was either the highest or equal to the highest AUC for all age groups, although a significant difference was observed only in the youngest age group.

CONCLUSION(S)

Our results showed that objective embryo assessment by a completely automatic and annotation-free model, iDAScore, performed as well as or even better than more traditional embryo assessment or annotation-dependent ranking tools. iDAScore could be an optimal pregnancy prediction model after SVBT, especially in young patients.

Machine learning for sperm selection

Infertility rates and the number of couples seeking fertility care have increased worldwide over the past few decades. Over 2.5 million cycles of assisted reproductive technologies are being performed globally every year, but the success rate has remained at ~33%. Machine learning, an automated method of data analysis based on patterns and inference, is increasingly being deployed within the health-care sector to improve diagnostics and therapeutics. This technique is already aiding embryo selection in some fertility clinics, and has also been applied in research laboratories to improve sperm analysis and selection. Tremendous opportunities exist for machine learning to advance male fertility treatments. The fundamental challenge of sperm selection - selecting the most promising candidate from 10⁸ gametes - presents a challenge that is uniquely well-suited to the high-throughput capabilities of machine learning algorithms paired with modern data processing capabilities.

Novel methods to enhance surgical sperm retrieval: a systematic review

Objectives: To explore the use of novel technologies in sperm retrieval in men with azoospermia due to a production defect. Methods: We performed a Preferred Reporting Items for Systemic Reviews and Meta-Analysis (PRISMA)-compliant systemic literature review for manuscripts focussed on novel sperm-retrieval methods. We identified 30 studies suitable for qualitative analysis. Results and Conclusions: We identified multiple new promising technologies, each with its own distinct set of benefits and limitations, to enhance chances of sperm retrieval; these include the use of multiphoton microscopy, Raman spectroscopy, and full-field optical coherence tomography during a microdissection-testicular sperm extraction procedure. ORBEYE and ultrasonography technologies can also serve to better visualise areas of sperm production. Finally, artificial intelligence technology can play a role in the identification of sperm and, perhaps, better-quality sperm for use with assisted reproduction. Abbreviations: AI: artificial intelligence; ANN: artificial neural network; ART: assisted reproductive technology; 3D: three-dimensional; DNN: deep neural networks; FFOCT: full-field optical coherence tomography; H&E: haematoxylin and eosin; ICSI: intracytoplasmic sperm injection; IVF: in vitro fertilisation; MESA: micro-epididymal sperm aspiration; MeSH: Medical Subject Heading; MPM: multiphoton microscopy; (N)OA: (non-)obstructive azoospermia; SCO: Sertoli cell-only syndrome; SRR: sperm retrieval rates; TESA: testicular sperm aspiration; (micro-)TESE: (microdissection-) testicular sperm extraction; (CE)US: (contrast-enhanced) ultrasonography.

Artificial intelligence in human in vitro fertilization and embryology

Embryo evaluation and selection embody the aggregate manifestation of the entire in vitro fertilization (IVF) process. It aims to choose the "best" embryos from the larger cohort of fertilized oocytes, the majority of which will be determined to be not viable either as a result of abnormal development or due to chromosomal imbalances. Indeed, it is generally acknowledged that even after embryo selection based on morphology, time-lapse microscopic photography, or embryo biopsy with preimplantation genetic testing, implantation rates in the human are difficult to predict. Our pursuit of enhancing embryo evaluation and selection, as well as increasing live birth rates, will require the adoption of novel technologies. Recently, several artificial intelligence (AI)-based methods have emerged as objective, standardized, and efficient tools for evaluating human embryos. Moreover, AI-based methods can be implemented for other clinical aspects of IVF, such as assessing patient reproductive potential and individualizing gonadotropin stimulation protocols. As AI has the capability to analyze "big" data, the ultimate goal will be to apply AI tools to the analysis of all embryological, clinical, and genetic data in an effort to provide patient-tailored treatments. In this chapter, we present an overview of existing AI technologies in reproductive medicine and envision their potential future applications in the field.

Importance of real-time measurement of sperm head morphology in intracytoplasmic sperm injection

Intracytoplasmic sperm injection (ICSI) is an important technique in male infertility treatment. Currently, sperm selection for ICSI in human assisted reproductive technology (ART) is subjective, based on a visual assessment by the operator. Therefore, it is desirable to develop methods that can objectively provide an accurate assessment of the shape and size of sperm heads that use low-magnification microscopy available in most standard fertility clinics. Recent studies have shown a correlation between sperm head size and shape and chromosomal abnormalities, and fertilization rate, and various attempts have been made to establish automated computer-based measurement of the sperm head itself. For example, a dictionary-learning technique and a deep-learning-based method have both been developed. Recently, an automatic algorithm was reported that detects sperm head malformations in real time for selection of the best sperm for ICSI. These data suggest that a real-time sperm selection system for use in ICSI is necessary. Moreover, these systems should incorporate inverted microscopes (×400-600 magnification) but not the fluorescence microscopy techniques often used for a dictionary-learning technique and a deep-learning-based method. These advances are expected to improve future success rates of ARTs. In this review, we summarize recent reports on the assessment of sperm head shape, size, and acrosome status in relation to fertility, and propose further improvements that can be made to the ARTs used in infertility treatments.

Faster region convolutional neural network and semen tracking algorithm for sperm analysis

BACKGROUND AND OBJECTIVES

Semen analysis is a primary and mandatory procedure to evaluate the infertility during clinical examination. This procedure includes the analysis and classification of normal and abnormal Sperm, selection and efficient tracking of healthy sperm in the sample. Many methods were proposed earlier for the analysis of semen. The fast sperm movement and high dense cluster of sperm is a challenging task for researchers.

METHODS

The paper proposes a novel Faster Region Convolutional Neural Network (FRCNN) with Elliptic Scanning Algorithm (ESA) for classifying human sperm and a Novel Tail to Head movement algorithm (THMA) for the motility analysis and tracking. This proposed method improves the accuracy of computer assisted semen analysis (CASA).

RESULTS

The proposed method outperforms and provides better results than existing methods. Method provides better accuracy of 97.37%. Sperm detection and identifying the sperm motility in the group is performed with minimum execution time of 1.12 s.

CONCLUSIONS

A novel FRCNN with ESA detection algorithm is proposed for the analysis of human sperm classification. This method provides an accuracy of 97.37%. A Tail head movement-based (THMA) algorithm is explained for the motility analysis.

Deep Learning Based Evaluation of Spermatozoid Motility for Artificial Insemination

We propose a deep learning method based on the Region Based Convolutional Neural Networks (R-CNN) architecture for the evaluation of sperm head motility in human semen videos. The neural network performs the segmentation of sperm heads, while the proposed central coordinate tracking algorithm allows us to calculate the movement speed of sperm heads. We have achieved 91.77% (95% CI, 91.11-92.43%) accuracy of sperm head detection on the VISEM (A Multimodal Video Dataset of Human Spermatozoa) sperm sample video dataset. The mean absolute error (MAE) of sperm head vitality prediction was 2.92 (95% CI, 2.46-3.37), while the Pearson correlation between actual and predicted sperm head vitality was 0.969. The results of the experiments presented below will show the applicability of the proposed method to be used in automated artificial insemination workflow.

Machine learning-enabled multiplexed microfluidic sensors

High-throughput, cost-effective, and portable devices can enhance the performance of point-of-care tests. Such devices are able to acquire images from samples at a high rate in combination with microfluidic chips in point-of-care applications. However, interpreting and analyzing the large amount of acquired data is not only a labor-intensive and time-consuming process, but also prone to the bias of the user and low accuracy. Integrating machine learning (ML) with the image acquisition capability of smartphones as well as increasing computing power could address the need for high-throughput, accurate, and automatized detection, data processing, and quantification of results. Here, ML-supported diagnostic technologies are presented. These technologies include quantification of colorimetric tests, classification of biological samples (cells and sperms), soft sensors, assay type detection, and recognition of the fluid properties. Challenges regarding the implementation of ML methods, including the required number of data points, image acquisition prerequisites, and execution of data-limited experiments are also discussed.

Quantification of human sperm concentration using machine learning-based spectrophotometry

Spectrophotometry is an indirect non-invasive and quantitative method for specifying materials with unknown contents based on absorption behavior. This paper presents the first application of artificial neural network in spectrophotometry for quantification of human sperm concentration. A well-trained full spectrum neural network (FSNN) model is developed by examining the absorption response of sperm samples from 41 human subjects to different light spectra (wavelength from 390 to 1100 nm). It is shown that this FSNN accurately estimates sperm concentration based on the full absorption spectrum with over 93% prediction accuracy, and provides 100% agreement with clinical assessments in differentiating the samples of healthy donor from patient samples. We suggest the machine learning-based spectrophotometry approach with the trained FSNN model as a rapid, low-cost, and powerful technique to quantify sperm concentration. The performance of this technique is superior to available spectrophotometry methods currently used for semen analysis and will provide novel research and clinical opportunities for tackling male infertility.