1
|
Saadat H, Sepehri MM, Borna MR, Maleki B. A modified U-Net to detect real sperms in videos of human sperm cell. Front Artif Intell 2024; 7:1376546. [PMID: 39315244 PMCID: PMC11418809 DOI: 10.3389/frai.2024.1376546] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2024] [Accepted: 08/13/2024] [Indexed: 09/25/2024] Open
Abstract
Background This study delves into the crucial domain of sperm segmentation, a pivotal component of male infertility diagnosis. It explores the efficacy of diverse architectural configurations coupled with various encoders, leveraging frames from the VISEM dataset for evaluation. Methods The pursuit of automated sperm segmentation led to the examination of multiple deep learning architectures, each paired with distinct encoders. Extensive experimentation was conducted on the VISEM dataset to assess their performance. Results Our study evaluated various deep learning architectures with different encoders for sperm segmentation using the VISEM dataset. While each model configuration exhibited distinct strengths and weaknesses, UNet++ with ResNet34 emerged as a top-performing model, demonstrating exceptional accuracy in distinguishing sperm cells from non-sperm cells. However, challenges persist in accurately identifying closely adjacent sperm cells. These findings provide valuable insights for improving automated sperm segmentation in male infertility diagnosis. Discussion The study underscores the significance of selecting appropriate model combinations based on specific diagnostic requirements. It also highlights the challenges related to distinguishing closely adjacent sperm cells. Conclusion This research advances the field of automated sperm segmentation for male infertility diagnosis, showcasing the potential of deep learning techniques. Future work should aim to enhance accuracy in scenarios involving close proximity between sperm cells, ultimately improving clinical sperm analysis.
Collapse
Affiliation(s)
- Hanan Saadat
- Faculty of Industrial Engineering and Systems, Tarbiat Modares University, Tehran, Iran
| | | | - Mahdi-Reza Borna
- Department of IT Engineering, Faculty of Industrial and Systems Engineering, Tarbiat Modares University, Tehran, Iran
| | - Behnam Maleki
- Research and Clinical Center for Infertility, Yazd Reproductive Sciences Institute, Shahid Sadoughi University of Medical Sciences, Yazd, Iran
| |
Collapse
|
2
|
Lewandowska E, Węsierski D, Mazur-Milecka M, Liss J, Jezierska A. Ensembling noisy segmentation masks of blurred sperm images. Comput Biol Med 2023; 166:107520. [PMID: 37804777 DOI: 10.1016/j.compbiomed.2023.107520] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2023] [Revised: 08/11/2023] [Accepted: 09/19/2023] [Indexed: 10/09/2023]
Abstract
BACKGROUND Sperm tail morphology and motility have been demonstrated to be important factors in determining sperm quality for in vitro fertilization. However, many existing computer-aided sperm analysis systems leave the sperm tail out of the analysis, as detecting a few tail pixels is challenging. Moreover, some publicly available datasets for classifying morphological defects contain images limited only to the sperm head. This study focuses on the segmentation of full sperm, which consists of the head and tail parts, and appear alone and in groups. METHODS We re-purpose the Feature Pyramid Network to ensemble an input image with multiple masks from state-of-the-art segmentation algorithms using a scale-specific cross-attention module. We normalize homogeneous backgrounds for improved training. The low field depth of microscopes blurs the images, easily confusing human raters in discerning minuscule sperm from large backgrounds. We thus propose evaluation protocols for scoring segmentation models trained on imbalanced data and noisy ground truth. RESULTS The neural ensembling of noisy segmentation masks outperforms all single, state-of-the-art segmentation algorithms in full sperm segmentation. Human raters agree more on the head than tail masks. The algorithms also segment the head better than the tail. CONCLUSIONS The extensive evaluation of state-of-the-art segmentation algorithms shows that full sperm segmentation is challenging. We release the SegSperm dataset of images from Intracytoplasmic Sperm Injection procedures to spur further progress on full sperm segmentation with noisy and imbalanced ground truth. The dataset is publicly available at https://doi.org/10.34808/6wm7-1159.
Collapse
Affiliation(s)
| | - Daniel Węsierski
- Cameras and Algorithms Lab, Gdańsk University of Technology, Poland; Multimedia Systems Department, Faculty of Electronics, Telecommunication, and Informatics, Gdańsk University of Technology, Poland
| | - Magdalena Mazur-Milecka
- Department of Biomedical Engineering, Faculty of Electronics, Telecommunications, and Informatics, Gdańsk University of Technology, Poland
| | - Joanna Liss
- Invicta Research and Development Center, Sopot, Poland; Department of Medical Biology and Genetics, University of Gdańsk, Poland
| | - Anna Jezierska
- Cameras and Algorithms Lab, Gdańsk University of Technology, Poland; Department of Biomedical Engineering, Faculty of Electronics, Telecommunications, and Informatics, Gdańsk University of Technology, Poland; Department of Modelling and Optimization of Dynamical Systems, Systems Research Institute Warsaw, Poland.
| |
Collapse
|
3
|
GhoshRoy D, Alvi PA, Santosh KC. AI Tools for Assessing Human Fertility Using Risk Factors: A State-of-the-Art Review. J Med Syst 2023; 47:91. [PMID: 37610455 DOI: 10.1007/s10916-023-01983-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Accepted: 08/02/2023] [Indexed: 08/24/2023]
Abstract
Infertility has massively disrupted social and marital life, resulting in stressful emotional well-being. Early diagnosis is the utmost need for faster adaption to respond to these changes, which makes possible via AI tools. Our main objective is to comprehend the role of AI in fertility detection since we have primarily worked to find biomarkers and related risk factors associated with infertility. This paper aims to vividly analyse the role of AI as an effective method in screening, predicting for infertility and related risk factors. Three scientific repositories: PubMed, Web of Science, and Scopus, are used to gather relevant articles via technical terms: (human infertility OR human fertility) AND risk factors AND (machine learning OR artificial intelligence OR intelligent system). In this way, we systematically reviewed 42 articles and performed a meta-analysis. The significant findings and recommendations are discussed. These include the rising importance of data augmentation, feature extraction, explainability, and the need to revisit the meaning of an effective system for fertility analysis. Additionally, the paper outlines various mitigation actions that can be employed to tackle infertility and its related risk factors. These insights contribute to a better understanding of the role of AI in fertility analysis and the potential for improving reproductive health outcomes.
Collapse
Affiliation(s)
- Debasmita GhoshRoy
- School of Automation, Banasthali Vidyapith, 304022, Rajasthan, India
- Applied AI Research Lab, Vermillion, SD, 57069, USA
| | - P A Alvi
- Department of Physics, Banasthali Vidyapith, 304022, Rajasthan, India
| | - K C Santosh
- Department of Computer Science, University of South Dakota, Vermillion, SD, 57069, USA.
- Applied AI Research Lab, Vermillion, SD, 57069, USA.
| |
Collapse
|
4
|
Park M, Yoon H, Kang BH, Lee H, An J, Lee T, Cheong HT, Lee SH. Deep Learning-Based Precision Analysis for Acrosome Reaction by Modification of Plasma Membrane in Boar Sperm. Animals (Basel) 2023; 13:2622. [PMID: 37627413 PMCID: PMC10451478 DOI: 10.3390/ani13162622] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 08/11/2023] [Accepted: 08/12/2023] [Indexed: 08/27/2023] Open
Abstract
The analysis of AR is widely used to detect loss of acrosome in sperm, but the subjective decisions of experts affect the accuracy of the examination. Therefore, we develop an ARCS for objectivity and consistency of analysis using convolutional neural networks (CNNs) trained with various magnification images. Our models were trained on 215 microscopic images at 400× and 438 images at 1000× magnification using the ResNet 50 and Inception-ResNet v2 architectures. These models distinctly recognized micro-changes in the PM of AR sperms. Moreover, the Inception-ResNet v2-based ARCS achieved a mean average precision of over 97%. Our system's calculation of the AR ratio on the test dataset produced results similar to the work of the three experts and could do so more quickly. Our model streamlines sperm detection and AR status determination using a CNN-based approach, replacing laborious tasks and expert assessments. The ARCS offers consistent AR sperm detection, reduced human error, and decreased working time. In conclusion, our study suggests the feasibility and benefits of using a sperm diagnosis artificial intelligence assistance system in routine practice scenarios.
Collapse
Affiliation(s)
- Mira Park
- School of Information and Communication Technology, University of Tasmania, Hobart, TAS 7005, Australia
| | - Heemoon Yoon
- School of Information and Communication Technology, University of Tasmania, Hobart, TAS 7005, Australia
| | - Byeong Ho Kang
- School of Information and Communication Technology, University of Tasmania, Hobart, TAS 7005, Australia
| | - Hayoung Lee
- College of Animal Life Sciences, Kangwon National University, Chuncheon 24341, Republic of Korea
| | - Jisoon An
- College of Animal Life Sciences, Kangwon National University, Chuncheon 24341, Republic of Korea
| | - Taehyun Lee
- College of Animal Life Sciences, Kangwon National University, Chuncheon 24341, Republic of Korea
| | - Hee-Tae Cheong
- College of Veterinary Sciences, Kangwon National University, Chuncheon 24341, Republic of Korea
| | - Sang-Hee Lee
- College of Animal Life Sciences, Kangwon National University, Chuncheon 24341, Republic of Korea
| |
Collapse
|
5
|
Mahali MI, Leu JS, Darmawan JT, Avian C, Bachroin N, Prakosa SW, Faisal M, Putro NAS. A Dual Architecture Fusion and AutoEncoder for Automatic Morphological Classification of Human Sperm. SENSORS (BASEL, SWITZERLAND) 2023; 23:6613. [PMID: 37514907 PMCID: PMC10385996 DOI: 10.3390/s23146613] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/04/2023] [Revised: 07/16/2023] [Accepted: 07/20/2023] [Indexed: 07/30/2023]
Abstract
Infertility has become a common problem in global health, and unsurprisingly, many couples need medical assistance to achieve reproduction. Many human behaviors can lead to infertility, which is none other than unhealthy sperm. The important thing is that assisted reproductive techniques require selecting healthy sperm. Hence, machine learning algorithms are presented as the subject of this research to effectively modernize and make accurate standards and decisions in classifying sperm. In this study, we developed a deep learning fusion architecture called SwinMobile that combines the Shifted Windows Vision Transformer (Swin) and MobileNetV3 into a unified feature space and classifies sperm from impurities in the SVIA Subset-C. Swin Transformer provides long-range feature extraction, while MobileNetV3 is responsible for extracting local features. We also explored incorporating an autoencoder into the architecture for an automatic noise-removing model. Our model was tested on SVIA, HuSHem, and SMIDS. Comparison to the state-of-the-art models was based on F1-score and accuracy. Our deep learning results accurately classified sperm and performed well in direct comparisons with previous approaches despite the datasets' different characteristics. We compared the model from Xception on the SVIA dataset, the MC-HSH model on the HuSHem dataset, and Ilhan et al.'s model on the SMIDS dataset and the astonishing results given by our model. The proposed model, especially SwinMobile-AE, has strong classification capabilities that enable it to function with high classification results on three different datasets. We propose that our deep learning approach to sperm classification is suitable for modernizing the clinical world. Our work leverages the potential of artificial intelligence technologies to rival humans in terms of accuracy, reliability, and speed of analysis. The SwinMobile-AE method we provide can achieve better results than state-of-the-art, even for three different datasets. Our results were benchmarked by comparisons with three datasets, which included SVIA, HuSHem, and SMIDS, respectively (95.4% vs. 94.9%), (97.6% vs. 95.7%), and (91.7% vs. 90.9%). Thus, the proposed model can realize technological advances in classifying sperm morphology based on the evidential results with three different datasets, each having its characteristics related to data size, number of classes, and color space.
Collapse
Affiliation(s)
- Muhammad Izzuddin Mahali
- Department of Electronic and Computer Engineering, National Taiwan University of Science and Technology, Taipei City 10607, Taiwan
- Department of Electronic and Informatic Engineering Education, Universitas Negeri Yogyakarta, Yogyakarta 55281, Indonesia
| | - Jenq-Shiou Leu
- Department of Electronic and Computer Engineering, National Taiwan University of Science and Technology, Taipei City 10607, Taiwan
| | - Jeremie Theddy Darmawan
- Department of Electronic and Computer Engineering, National Taiwan University of Science and Technology, Taipei City 10607, Taiwan
- Department of Bioinformatics, Indonesia International Institute for Life Science, Jakarta 13210, Indonesia
| | - Cries Avian
- Department of Electronic and Computer Engineering, National Taiwan University of Science and Technology, Taipei City 10607, Taiwan
| | - Nabil Bachroin
- Departement of Electrical Engineering, National Taiwan University of Science and Technology, Taipei City 10607, Taiwan
| | - Setya Widyawan Prakosa
- Department of Electronic and Computer Engineering, National Taiwan University of Science and Technology, Taipei City 10607, Taiwan
| | - Muhamad Faisal
- Department of Electronic and Computer Engineering, National Taiwan University of Science and Technology, Taipei City 10607, Taiwan
| | - Nur Achmad Sulistyo Putro
- Department of Electronic and Computer Engineering, National Taiwan University of Science and Technology, Taipei City 10607, Taiwan
- Department of Computer Science and Electronics, Universitas Gadjah Mada, Yogyakarta 55281, Indonesia
| |
Collapse
|
6
|
Thambawita V, Hicks SA, Storås AM, Nguyen T, Andersen JM, Witczak O, Haugen TB, Hammer HL, Halvorsen P, Riegler MA. VISEM-Tracking, a human spermatozoa tracking dataset. Sci Data 2023; 10:260. [PMID: 37156762 PMCID: PMC10167330 DOI: 10.1038/s41597-023-02173-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2022] [Accepted: 04/20/2023] [Indexed: 05/10/2023] Open
Abstract
A manual assessment of sperm motility requires microscopy observation, which is challenging due to the fast-moving spermatozoa in the field of view. To obtain correct results, manual evaluation requires extensive training. Therefore, computer-aided sperm analysis (CASA) has become increasingly used in clinics. Despite this, more data is needed to train supervised machine learning approaches in order to improve accuracy and reliability in the assessment of sperm motility and kinematics. In this regard, we provide a dataset called VISEM-Tracking with 20 video recordings of 30 seconds (comprising 29,196 frames) of wet semen preparations with manually annotated bounding-box coordinates and a set of sperm characteristics analyzed by experts in the domain. In addition to the annotated data, we provide unlabeled video clips for easy-to-use access and analysis of the data via methods such as self- or unsupervised learning. As part of this paper, we present baseline sperm detection performances using the YOLOv5 deep learning (DL) model trained on the VISEM-Tracking dataset. As a result, we show that the dataset can be used to train complex DL models to analyze spermatozoa.
Collapse
Affiliation(s)
| | - Steven A Hicks
- Simula Metropolitan Center for Digital Engineering, Oslo, Norway
| | - Andrea M Storås
- Simula Metropolitan Center for Digital Engineering, Oslo, Norway
- Oslo Metropolitan University, Oslo, Norway
| | - Thu Nguyen
- Simula Metropolitan Center for Digital Engineering, Oslo, Norway
| | | | | | | | - Hugo L Hammer
- Simula Metropolitan Center for Digital Engineering, Oslo, Norway
- Oslo Metropolitan University, Oslo, Norway
| | - Pål Halvorsen
- Simula Metropolitan Center for Digital Engineering, Oslo, Norway
- Oslo Metropolitan University, Oslo, Norway
| | - Michael A Riegler
- Simula Metropolitan Center for Digital Engineering, Oslo, Norway
- Oslo Metropolitan University, Oslo, Norway
| |
Collapse
|
7
|
Meng F, Deng S, Wang L, Zhou Y, Zhao M, Li H, Liu D, Gao G, Liao X, Wang J. Bibliometric analysis and visualization of literature on assisted reproduction technology. Front Med (Lausanne) 2022; 9:1063040. [DOI: 10.3389/fmed.2022.1063040] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Accepted: 11/14/2022] [Indexed: 12/02/2022] Open
Abstract
IntroductionAssisted reproductive technology (ART) is a method that uses various techniques to process sperm or ova. Assisted reproductive technology involves removing ova from a woman's ovaries, combining them with sperm in the laboratory, and returning them to the woman's body or donating them to another woman.MethodsBased on the web of science core collection database, we firstly analyzed the quantity and quality of publications in the field of ART, secondly profiled the publishing groups in terms of country, institution, author's publication and cooperation network, and finally sorted out and summarized the hot topics of research.ResultsIn total, 6,288 articles on ART were published between 2001 and 2022 in 1,013 journals. Most of these published articles represent the global research status, potential hotspots and future research directions. Publications and citations of research on assisted reproductive technology have steadily increased over the past few decades. Academic institutions in Europe and the United States have been leading in assisted reproductive technology research. The countries, institutions, journals, and authors with the most published articles were the United States (1864), Harvard Univ (108), Fertility and Sterility (819), and Stern, Judy E. (64). The most commonly used keywords are Assisted reproductive technology (3303) and in-vitro Fertilization (2139), Ivf (1140), Pregnancy (1140), Women (769), Intracytoplasmic Sperm injection (644), In Fertilization (632), Risk (545), and Outcome (423).ConclusionFrozen embryo transfer, intracytoplasmic sperm injection, and in vitro fertilization are the main research topics and hotspots in the field of assisted reproductive technology.
Collapse
|
8
|
Morphometric evaluation of two-pronucleus zygote images using image-processing techniques. ZYGOTE 2022; 30:819-829. [PMID: 35974446 DOI: 10.1017/s0967199422000326] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Identifying embryos with a high potential for implementation remains a challenge in in vitro fertilization (IVF) cycles. Despite progress in IVF treatment, only a minority of generated embryos has the ability to implant. Another drawback of this practice is the high frequency of multiple pregnancies. This problem leads to economic and health problems. Therefore, the transfer of a single embryo with high implantation potential is the ideal strategy. Morphometric evaluation of two-pronucleus zygote images is a helpful technique when aiming to transfer a single embryo with a high implantation potential. In this study, an automated zygote morphometric evaluation algorithm, called the zygote morphology evaluation (ZME) algorithm, was created to analyze the zygote and provide morphological measurements. The first and most crucial step of the ZME algorithm is the noise reduction step, which was first applied to zygote images. After that, the proposed algorithm detects different parts of the zygote that are indicators of embryo viability and normality, that is the oolemma, perivitelline space, zona pellucida, and nucleolar precursor bodies (NPBs). In addition, a novel dataset was prepared for this task. This dataset consisted of 703 human zygote images, and called the human zygote morphometric evaluation dataset (HZME-DS). Our experimental results in the HZME-DS showed that the ZME algorithm was able to achieve 79.58% average accuracy in identifying the oolemma region, 79.40% average accuracy in determining the perivitelline space, and 79.72% accuracy in identifying the zona pellucida. To calculate the accuracy of identifying NPBs, the proposed algorithm uses Recall and Precision measures, and their harmonic average (F1 measure) reached values of 81.14% and 79.53%, respectively. These encouraging results for our proposed method, which is an automatic and very fast method, showed that the ZME algorithm could help embryologists to evaluate the best zygotes in real time and the best embryos subsequently.
Collapse
|
9
|
Lee R, Witherspoon L, Robinson M, Lee JH, Duffy SP, Flannigan R, Ma H. Automated rare sperm identification from low-magnification microscopy images of dissociated microsurgical testicular sperm extraction samples using deep learning. Fertil Steril 2022; 118:90-99. [PMID: 35562203 DOI: 10.1016/j.fertnstert.2022.03.011] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2021] [Revised: 03/15/2022] [Accepted: 03/18/2022] [Indexed: 01/16/2023]
Abstract
OBJECTIVE To develop a machine learning algorithm to detect rare human sperm in semen and microsurgical testicular sperm extraction (microTESE) samples using bright-field (BF) microscopy for nonobstructive azoospermia patients. DESIGN Spermatozoa were collected from fertile men. Testis biopsies were collected from microTESE samples determined to be clinically negative for sperm. A convolutional neural network based on the U-Net architecture was trained using 35,761 BF image patches with fluorescent ground truth image pairs to segment sperm. The algorithm was validated using 7,663 image patches. The algorithm was tested using 7,663 image patches containing abundant sperm, as well as 7,985 image patches containing rare sperm. SETTING In vitro fertilization center and university laboratories. PATIENT(S) Normospermic and nonobstructive azoospermia patients. INTERVENTION(S) None. MAIN OUTCOME MEASURE(S) Precision (positive predictive value [PPV]), recall (sensitivity), and F1-score of detected sperm locations. RESULT(S) For sperm-only samples, our algorithm achieved 91% PPV, 95.8% sensitivity, and 93.3% F1-score at ×10 magnification. For dissociated microTESE samples doped with an abundant quantity of sperm, our algorithm achieved 84.0% PPV, 72.7% sensitivity, and 77.9% F1-score. For dissociated microTESE samples doped with rare sperm, our algorithm achieved 84.4% PPV, 86.1% sensitivity, and 85.2% F1-score. CONCLUSION(S) Rare sperm can be detected in patients' testis biopsy samples for potential subsequent use in in vitro fertilization-intracytoplasmic sperm injection. A machine learning algorithm can use BF images at ×10 magnification to accurately detect sperm locations using automated imaging.
Collapse
Affiliation(s)
- Ryan Lee
- Department of Mechanical Engineering, University of British Columbia, Vancouver, British Columbia, Canada; Centre for Blood Research, University of British Columbia, Vancouver, British Columbia, Canada; Department of Urologic Sciences, University of British Columbia, Vancouver, British Columbia, Canada
| | - Luke Witherspoon
- Department of Urologic Sciences, University of British Columbia, Vancouver, British Columbia, Canada; Vancouver Prostate Centre, Vancouver General Hospital, Vancouver, British Columbia, Canada; Department of Urology, The Ottawa Hospital, Ottawa, Ontario, Canada
| | - Meghan Robinson
- Department of Urologic Sciences, University of British Columbia, Vancouver, British Columbia, Canada; Vancouver Prostate Centre, Vancouver General Hospital, Vancouver, British Columbia, Canada
| | - Jeong Hyun Lee
- Department of Mechanical Engineering, University of British Columbia, Vancouver, British Columbia, Canada; Centre for Blood Research, University of British Columbia, Vancouver, British Columbia, Canada
| | - Simon P Duffy
- Department of Mechanical Engineering, University of British Columbia, Vancouver, British Columbia, Canada; Centre for Blood Research, University of British Columbia, Vancouver, British Columbia, Canada
| | - Ryan Flannigan
- Department of Urologic Sciences, University of British Columbia, Vancouver, British Columbia, Canada; Vancouver Prostate Centre, Vancouver General Hospital, Vancouver, British Columbia, Canada; Department of Urology, Weill Cornell Medicine, New York, New York.
| | - Hongshen Ma
- Department of Mechanical Engineering, University of British Columbia, Vancouver, British Columbia, Canada; Centre for Blood Research, University of British Columbia, Vancouver, British Columbia, Canada; Department of Urologic Sciences, University of British Columbia, Vancouver, British Columbia, Canada; Vancouver Prostate Centre, Vancouver General Hospital, Vancouver, British Columbia, Canada; School of Biomedical Engineering, University of British Columbia, Vancouver, British Columbia, Canada.
| |
Collapse
|
10
|
Liu G, Shi H, Zhang H, Zhou Y, Sun Y, Li W, Huang X, Jiang Y, Fang Y, Yang G. Fast Noninvasive Morphometric Characterization of Free Human Sperms Using Deep Learning. MICROSCOPY AND MICROANALYSIS : THE OFFICIAL JOURNAL OF MICROSCOPY SOCIETY OF AMERICA, MICROBEAM ANALYSIS SOCIETY, MICROSCOPICAL SOCIETY OF CANADA 2022; 28:1-13. [PMID: 35748406 DOI: 10.1017/s1431927622012132] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
The selection of high-quality sperms is critical to intracytoplasmic sperm injection, which accounts for 70–80% of in vitro fertilization (IVF) treatments. So far, sperm screening is usually performed manually by clinicians. However, the performance of manual screening is limited in its objectivity, consistency, and efficiency. To overcome these limitations, we have developed a fast and noninvasive three-stage method to characterize morphology of freely swimming human sperms in bright-field microscopy images using deep learning models. Specifically, we use an object detection model to identify sperm heads, a classification model to select in-focus images, and a segmentation model to extract geometry of sperm heads and vacuoles. The models achieve an F1-score of 0.951 in sperm head detection, a z-position estimation error within ±1.5 μm in in-focus image selection, and a Dice score of 0.948 in sperm head segmentation, respectively. Customized lightweight architectures are used for the models to achieve real-time analysis of 200 frames per second. Comprehensive morphological parameters are calculated from sperm head geometry extracted by image segmentation. Overall, our method provides a reliable and efficient tool to assist clinicians in selecting high-quality sperms for successful IVF. It also demonstrates the effectiveness of deep learning in real-time analysis of live bright-field microscopy images.
Collapse
Affiliation(s)
- Guole Liu
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
- National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
| | - Hao Shi
- Sperm Capturer (Beijing) Biotechnology Co. Ltd., Beijing 100070, China
| | - Huan Zhang
- Reproductive Medicine Center, The First Affiliated Hospital of Wenzhou Medical University, Zhejiang 325000, China
| | - Yating Zhou
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
- National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
| | - Yujiao Sun
- State Key Laboratory of Molecular Developmental Biology, Institute of Genetics and Developmental Biology, Chinese Academy of Sciences, Beijing 100101, China
| | - Wei Li
- Beijing Children's Hospital, Capital Medical University, Beijing 100045, China
| | - Xuefeng Huang
- Reproductive Medicine Center, The First Affiliated Hospital of Wenzhou Medical University, Zhejiang 325000, China
| | - Yuqiang Jiang
- State Key Laboratory of Molecular Developmental Biology, Institute of Genetics and Developmental Biology, Chinese Academy of Sciences, Beijing 100101, China
| | - Yaliang Fang
- Sperm Capturer (Beijing) Biotechnology Co. Ltd., Beijing 100070, China
| | - Ge Yang
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
- National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
| |
Collapse
|
11
|
Chandra S, Gourisaria MK, Gm H, Konar D, Gao X, Wang T, Xu M. Prolificacy Assessment of Spermatozoan via State-of-the-Art Deep Learning Frameworks. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2022; 10:13715-13727. [PMID: 35291304 PMCID: PMC8920051 DOI: 10.1109/access.2022.3146334] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Childlessness or infertility among couples has become a global health concern. Due to the rise in infertility, couples are looking for medical supports to attain reproduction. This paper deals with diagnosing infertility among men and the major factor in diagnosing infertility among men is the Sperm Morphology Analysis (SMA). In this manuscript, we explore establishing deep learning frameworks to automate the classification problem in the fertilization of sperm cells. We investigate the performance of multiple state-of-the-art deep neural networks on the MHSMA dataset. The experimental results demonstrate that the deep learning-based framework outperforms human experts on sperm classification in terms of accuracy, throughput and reliability. We further analyse the sperm cell data by visualizing the feature activations of the deep learning models, providing a new perspective to understand the data. Finally, a comprehensive analysis is also demonstrated on the experimental results obtained and attributing them to pertinent reasons.
Collapse
Affiliation(s)
- Satish Chandra
- School of Computer Engineering, KIIT Deemed to be University, Bhubaneswar, Odisha 751024, India
| | | | - Harshvardhan Gm
- School of Computer Engineering, KIIT Deemed to be University, Bhubaneswar, Odisha 751024, India
| | - Debanjan Konar
- CASUS-Center for Advanced Systems Understanding, Helmholtz-Zentrum Dresden-Rossendorf (HZDR), 02826 Görlitz, Germany
| | - Xin Gao
- Computer, Electrical and Mathematical Science and Engineering Division, King Abdullah University of Science and Technology, Thuwal 23955, Saudi Arabia
| | - Tianyang Wang
- Department of Computer Science & Information Technology, Austin Peay State University, Clarksville, TN 37044, USA
| | - Min Xu
- Computational Biology Department, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA 15213, USA
| |
Collapse
|
12
|
Chen A, Li C, Zou S, Rahaman MM, Yao Y, Chen H, Yang H, Zhao P, Hu W, Liu W, Grzegorzek M. SVIA dataset: A new dataset of microscopic videos and images for computer-aided sperm analysis. Biocybern Biomed Eng 2022. [DOI: 10.1016/j.bbe.2021.12.010] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
|
13
|
An Improved U-Net for Human Sperm Head Segmentation. Neural Process Lett 2021. [DOI: 10.1007/s11063-021-10643-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
14
|
You JB, McCallum C, Wang Y, Riordon J, Nosrati R, Sinton D. Machine learning for sperm selection. Nat Rev Urol 2021; 18:387-403. [PMID: 34002070 DOI: 10.1038/s41585-021-00465-1] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/30/2021] [Indexed: 02/04/2023]
Abstract
Infertility rates and the number of couples seeking fertility care have increased worldwide over the past few decades. Over 2.5 million cycles of assisted reproductive technologies are being performed globally every year, but the success rate has remained at ~33%. Machine learning, an automated method of data analysis based on patterns and inference, is increasingly being deployed within the health-care sector to improve diagnostics and therapeutics. This technique is already aiding embryo selection in some fertility clinics, and has also been applied in research laboratories to improve sperm analysis and selection. Tremendous opportunities exist for machine learning to advance male fertility treatments. The fundamental challenge of sperm selection - selecting the most promising candidate from 108 gametes - presents a challenge that is uniquely well-suited to the high-throughput capabilities of machine learning algorithms paired with modern data processing capabilities.
Collapse
Affiliation(s)
- Jae Bem You
- Department of Mechanical & Industrial Engineering, University of Toronto, Toronto, ON, Canada.,Department of Chemical Engineering, Kyungpook National University, Daegu, Republic of Korea
| | - Christopher McCallum
- Department of Mechanical & Industrial Engineering, University of Toronto, Toronto, ON, Canada
| | - Yihe Wang
- Department of Mechanical & Industrial Engineering, University of Toronto, Toronto, ON, Canada
| | - Jason Riordon
- Department of Mechanical & Industrial Engineering, University of Toronto, Toronto, ON, Canada
| | - Reza Nosrati
- Department of Mechanical & Aerospace Engineering, Monash University, Clayton, VIC, Australia
| | - David Sinton
- Department of Mechanical & Industrial Engineering, University of Toronto, Toronto, ON, Canada.
| |
Collapse
|
15
|
Abstract
Intracytoplasmic sperm injection (ICSI) is an important technique in male infertility treatment. Currently, sperm selection for ICSI in human assisted reproductive technology (ART) is subjective, based on a visual assessment by the operator. Therefore, it is desirable to develop methods that can objectively provide an accurate assessment of the shape and size of sperm heads that use low-magnification microscopy available in most standard fertility clinics. Recent studies have shown a correlation between sperm head size and shape and chromosomal abnormalities, and fertilization rate, and various attempts have been made to establish automated computer-based measurement of the sperm head itself. For example, a dictionary-learning technique and a deep-learning-based method have both been developed. Recently, an automatic algorithm was reported that detects sperm head malformations in real time for selection of the best sperm for ICSI. These data suggest that a real-time sperm selection system for use in ICSI is necessary. Moreover, these systems should incorporate inverted microscopes (×400-600 magnification) but not the fluorescence microscopy techniques often used for a dictionary-learning technique and a deep-learning-based method. These advances are expected to improve future success rates of ARTs. In this review, we summarize recent reports on the assessment of sperm head shape, size, and acrosome status in relation to fertility, and propose further improvements that can be made to the ARTs used in infertility treatments.
Collapse
|
16
|
Abbasi A, Miahi E, Mirroshandel SA. Effect of deep transfer and multi-task learning on sperm abnormality detection. Comput Biol Med 2020; 128:104121. [PMID: 33246195 DOI: 10.1016/j.compbiomed.2020.104121] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2020] [Revised: 11/16/2020] [Accepted: 11/16/2020] [Indexed: 11/26/2022]
Abstract
Analyzing the abnormality of morphological characteristics of male human sperm has been studied for a long time mainly because it has many implications on the male infertility problem, which accounts for approximately half of the infertility problems in the world. Yet, detecting such abnormalities by embryologists has several downsides. To clarify, analyzing sperms through visual inspection of an expert embryologist is a highly subjective and biased process. Furthermore, it takes much time for a specialist to make a diagnosis. Hence, in this paper, we proposed two deep learning algorithms that are able to automate this process. The first algorithm uses a network-based deep transfer learning approach, while the second technique, named Deep Multi-task Transfer Learning (DMTL), employs a novel combination of network-based deep transfer learning and multi-task learning to classify sperm's head, vacuole, and acrosome as either normal or abnormal. This DMTL technique is capable of classifying all the aforementioned parts of the sperm in a single prediction. Moreover, this is the first time that the concept of multi-task learning has been introduced to the field of Sperm Morphology Analysis (SMA). To benchmark our algorithms, we employed a freely-available SMA dataset named MHSMA. During our experiments, our algorithms reached the state-of-the-art results on the accuracy, precision, and f0.5, as well as other important metrics, such as the Matthews Correlation Coefficient on one, two, or all three labels. Notably, our algorithms increased the accuracy of the head, acrosome, and vacuole by 6.66%, 3.00%, and 1.33%, and reached the accuracy of 84.00%, 80.66%, and 94.00% on these labels, respectively. Consequently, our algorithms can be used in health institutions, such as fertility clinics, with further recommendations to practically improve the performance of our algorithms.
Collapse
Affiliation(s)
- Amir Abbasi
- Department of Computer Engineering, Faculty of Engineering, University of Guilan, Rasht, Iran.
| | - Erfan Miahi
- Department of Computer Engineering, Faculty of Engineering, University of Guilan, Rasht, Iran.
| | | |
Collapse
|
17
|
Zahiri Z, Ghasemian F. Is it necessary to focus on morphologically normal acrosome of sperm during intracytoplasmic sperm injection? Indian J Med Res 2020; 150:477-485. [PMID: 31939391 PMCID: PMC6977361 DOI: 10.4103/ijmr.ijmr_866_18] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
Abstract
Background & objectives: The detailed assessment of sperm morphology is important in the semen of infertile men because there is a low proportion of normal spermatozoa. One of the parameters of such sperm morphology is the acrosome, and its effect on assisted reproductive outcomes is controversial. This study was undertaken to evaluate the association between different forms of acrosome on the chromatin status and the assisted reproductive outcomes. Methods: A total of 1587 unstained sperms from 514 infertile men were captured and analyzed for different acrosome forms (normal, large, small, skew, amorphous acrosome and without acrosome) in real time during intracytoplasmic sperm injection into oocytes. The association between the percentage of sperms with atypical acrosome and head shapes and the sperm chromatin status was studied. Fertilization, zygote and embryo quality and clinical pregnancy rates were calculated for different groups of sperms. Results: The highest frequency of irregular shapes of acrosomes, such as small, large and amorphous, was observed in abnormal ellipticity, anteroposterior symmetry and angularity parameters, respectively (P<0.05). The fertilization rate of injected sperms with large (P<0.01) and small (P=0.001) acrosomes and without acrosome (P=0.001) was significantly lower in comparison with normal acrosomes. The quality of zygotes (Z3, P=0.05), embryos (grade C, P<0.05) and the pregnancy rate (P=0.001) from injected sperms with large acrosomes were significantly lower compared with normal acrosomes. Interpretation & conclusions: Our findings showed that the different sperm acrosome morphologies (e.g., large, small, and without acrosome) might negatively relate with chromatin integrity and decrease the sperm's fertility potential and pregnancy rate during intracytoplasmic sperm injection (ICSI) cycles.
Collapse
Affiliation(s)
- Ziba Zahiri
- Reproductive Health Research Center (IVF Center), Alzahra Educational & Remedial Center, Guilan University of Medical Sciences, Rasht, Iran
| | - Fatemeh Ghasemian
- Department of Biology, Faculty of Science, University of Guilan, Rasht, Iran
| |
Collapse
|
18
|
周 泉, 齐 素, 肖 斌, 李 乔, 孙 朝, 李 林. [Artificial intelligence empowers laboratory medicine in Industry 4.0]. NAN FANG YI KE DA XUE XUE BAO = JOURNAL OF SOUTHERN MEDICAL UNIVERSITY 2020; 40:287-296. [PMID: 32376538 PMCID: PMC7086124 DOI: 10.12122/j.issn.1673-4254.2020.02.23] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 02/17/2020] [Indexed: 01/23/2023]
Abstract
Since 2017, China, the United States, and the European Union have successively issued national-level artificial intelligence (AI) strategic development plans, and the human history is about to witness the 4th industrial revolution with the theme of "intelligence". In the field of medical testing, the explosive growth of AI theories and technologies also provide a new direction for the development of medical testing theory, methods and applications. We review the evolution of AI and the recent progress in three major elements of AI, namely algorithms, data and computing power, and elaborate on the combined innovation of "AI + testing" in light of the key application dimensions of medical testing. The major applications include specimen collection robots, sample dilution robots and sample transfer robots involved in the processing of test specimens; test item mining such as tumor markers and pharmacogenomics; cytomorphology, laboratory medicine data processing, auxiliary diagnostic models, and internet-based medical tests. With the advent of the era of Industry 4.0, AI technology will promote the development of medical testing from automation to a highly intelligent stage.
Collapse
Affiliation(s)
- 泉 周
- 中国人民解放军南部战区总医院检验科,广东 广州 510010Department of Medical Laboratory, General Hospital of Southern Theater of PLA, Guangzhou 51010, China
| | - 素文 齐
- 深圳大学生物医学工程学院体外诊断系,广东 深圳 518037Department of In vitro Diagnostics, School of Biomedical Engineering, Shenzhen University, Shenzhen 518037, China
| | - 斌 肖
- 中国人民解放军南部战区总医院检验科,广东 广州 510010Department of Medical Laboratory, General Hospital of Southern Theater of PLA, Guangzhou 51010, China
| | - 乔亮 李
- 深圳大学生物医学工程学院体外诊断系,广东 深圳 518037Department of In vitro Diagnostics, School of Biomedical Engineering, Shenzhen University, Shenzhen 518037, China
| | - 朝晖 孙
- 中国人民解放军南部战区总医院检验科,广东 广州 510010Department of Medical Laboratory, General Hospital of Southern Theater of PLA, Guangzhou 51010, China
| | - 林海 李
- 中国人民解放军南部战区总医院检验科,广东 广州 510010Department of Medical Laboratory, General Hospital of Southern Theater of PLA, Guangzhou 51010, China
| |
Collapse
|
19
|
Machine Learning-Based Analysis of Sperm Videos and Participant Data for Male Fertility Prediction. Sci Rep 2019; 9:16770. [PMID: 31727961 PMCID: PMC6856178 DOI: 10.1038/s41598-019-53217-y] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2019] [Accepted: 10/24/2019] [Indexed: 01/12/2023] Open
Abstract
Methods for automatic analysis of clinical data are usually targeted towards a specific modality and do not make use of all relevant data available. In the field of male human reproduction, clinical and biological data are not used to its fullest potential. Manual evaluation of a semen sample using a microscope is time-consuming and requires extensive training. Furthermore, the validity of manual semen analysis has been questioned due to limited reproducibility, and often high inter-personnel variation. The existing computer-aided sperm analyzer systems are not recommended for routine clinical use due to methodological challenges caused by the consistency of the semen sample. Thus, there is a need for an improved methodology. We use modern and classical machine learning techniques together with a dataset consisting of 85 videos of human semen samples and related participant data to automatically predict sperm motility. Used techniques include simple linear regression and more sophisticated methods using convolutional neural networks. Our results indicate that sperm motility prediction based on deep learning using sperm motility videos is rapid to perform and consistent. Adding participant data did not improve the algorithms performance. In conclusion, machine learning-based automatic analysis may become a valuable tool in male infertility investigation and research.
Collapse
|
20
|
McCallum C, Riordon J, Wang Y, Kong T, You JB, Sanner S, Lagunov A, Hannam TG, Jarvi K, Sinton D. Deep learning-based selection of human sperm with high DNA integrity. Commun Biol 2019; 2:250. [PMID: 31286067 PMCID: PMC6610103 DOI: 10.1038/s42003-019-0491-6] [Citation(s) in RCA: 43] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2018] [Accepted: 06/05/2019] [Indexed: 12/13/2022] Open
Abstract
Despite the importance of sperm DNA to human reproduction, currently no method exists to assess individual sperm DNA quality prior to clinical selection. Traditionally, skilled clinicians select sperm based on a variety of morphological and motility criteria, but without direct knowledge of their DNA cargo. Here, we show how a deep convolutional neural network can be trained on a collection of ~1000 sperm cells of known DNA quality, to predict DNA quality from brightfield images alone. Our results demonstrate moderate correlation (bivariate correlation ~0.43) between a sperm cell image and DNA quality and the ability to identify higher DNA integrity cells relative to the median. This deep learning selection process is directly compatible with current, manual microscopy-based sperm selection and could assist clinicians, by providing rapid DNA quality predictions (under 10 ms per cell) and sperm selection within the 86th percentile from a given sample.
Collapse
Affiliation(s)
- Christopher McCallum
- Department of Mechanical and Industrial Engineering, University of Toronto, 5 King’s College Road, Toronto, ON Canada M5S 3G8
| | - Jason Riordon
- Department of Mechanical and Industrial Engineering, University of Toronto, 5 King’s College Road, Toronto, ON Canada M5S 3G8
| | - Yihe Wang
- Department of Mechanical and Industrial Engineering, University of Toronto, 5 King’s College Road, Toronto, ON Canada M5S 3G8
| | - Tian Kong
- Department of Mechanical and Industrial Engineering, University of Toronto, 5 King’s College Road, Toronto, ON Canada M5S 3G8
| | - Jae Bem You
- Department of Mechanical and Industrial Engineering, University of Toronto, 5 King’s College Road, Toronto, ON Canada M5S 3G8
| | - Scott Sanner
- Department of Mechanical and Industrial Engineering, University of Toronto, 5 King’s College Road, Toronto, ON Canada M5S 3G8
| | - Alexander Lagunov
- Hannam Fertility Centre, 160 Bloor St. East, Toronto, ON Canada M4W 3R2
| | - Thomas G. Hannam
- Hannam Fertility Centre, 160 Bloor St. East, Toronto, ON Canada M4W 3R2
| | - Keith Jarvi
- Department of Surgery, Division of Urology, Mount Sinai Hospital, University of Toronto, 60 Murray Street, 6th Floor, Toronto, ON Canada M5T 3L9
| | - David Sinton
- Department of Mechanical and Industrial Engineering, University of Toronto, 5 King’s College Road, Toronto, ON Canada M5S 3G8
| |
Collapse
|
21
|
Javadi S, Mirroshandel SA. A novel deep learning method for automatic assessment of human sperm images. Comput Biol Med 2019; 109:182-194. [DOI: 10.1016/j.compbiomed.2019.04.030] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2018] [Revised: 04/22/2019] [Accepted: 04/22/2019] [Indexed: 10/26/2022]
|
22
|
Santana VP, Miranda-Furtado CL, Pedroso DCC, Eiras MC, Vasconcelos MAC, Ramos ES, Calado RT, Ferriani RA, Esteves SC, dos Reis RM. The relationship among sperm global DNA methylation, telomere length, and DNA fragmentation in varicocele: a cross-sectional study of 20 cases. Syst Biol Reprod Med 2019; 65:95-104. [DOI: 10.1080/19396368.2018.1557762] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Affiliation(s)
- Viviane Paiva Santana
- Department of Gynecology and Obstetrics, Ribeirão Preto Medical School, University of São Paulo, Ribeirão Preto, São Paulo, Brazil
| | | | - Daiana Cristina Chielli Pedroso
- Department of Gynecology and Obstetrics, Ribeirão Preto Medical School, University of São Paulo, Ribeirão Preto, São Paulo, Brazil
| | - Matheus Credendio Eiras
- Department of Gynecology and Obstetrics, Ribeirão Preto Medical School, University of São Paulo, Ribeirão Preto, São Paulo, Brazil
- Department of Genetics, Ribeirão Preto Medical School, University of São Paulo, Ribeirão Preto, São Paulo, Brazil
| | | | - Ester Silveira Ramos
- Department of Genetics, Ribeirão Preto Medical School, University of São Paulo, Ribeirão Preto, São Paulo, Brazil
| | - Rodrigo Tocantins Calado
- Department of Internal Medicine, Ribeirão Preto Medical School, University of São Paulo, Ribeirão Preto, São Paulo, Brazil
| | - Rui Alberto Ferriani
- Department of Gynecology and Obstetrics, Ribeirão Preto Medical School, University of São Paulo, Ribeirão Preto, São Paulo, Brazil
| | | | - Rosana Maria dos Reis
- Department of Gynecology and Obstetrics, Ribeirão Preto Medical School, University of São Paulo, Ribeirão Preto, São Paulo, Brazil
| |
Collapse
|
23
|
Dai C, Zhang Z, Huang J, Wang X, Ru C, Pu H, Xie S, Zhang J, Moskovtsev S, Librach C, Jarvi K, Sun Y. Automated Non-Invasive Measurement of Single Sperm's Motility and Morphology. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:2257-2265. [PMID: 29993571 DOI: 10.1109/tmi.2018.2840827] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Measuring cell motility and morphology is important for revealing their functional characteristics. This paper presents automation techniques that enable automated, non-invasive measurement of motility and morphology parameters of single sperm. Compared to the status quo of qualitative estimation of single sperm's motility and morphology manually, the automation techniques provide quantitative data for embryologists to select a single sperm for intracytoplasmic sperm injection. An adapted joint probabilistic data association filter was used for multi-sperm tracking and tackled challenges of identifying sperms that intersect or have small spatial distances. Since the standard differential interference contrast (DIC) imaging method has side illumination effect which causes inherent inhomogeneous image intensity and poses difficulties for accurate sperm morphology measurement, we integrated total variation norm into the quadratic cost function method, which together effectively removed inhomogeneous image intensity and retained sperm's subcellular structures after DIC image reconstruction. In order to relocate the same sperm of interest identified under low magnification after switching to high magnification, coordinate transformation was conducted to handle the changes in the field of view caused by magnification switch. The sperm's position after magnification switch was accurately predicted by accounting for the sperm's swimming motion during magnification switch. Experimental results demonstrated an accuracy of 95.6% in sperm motility measurement and an error <10% in morphology measurement.
Collapse
|
24
|
Ilhan HO, Aydin N. A novel data acquisition and analyzing approach to spermiogram tests. Biomed Signal Process Control 2018. [DOI: 10.1016/j.bspc.2017.11.009] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
25
|
Shaker F, Monadjemi SA, Alirezaie J, Naghsh-Nilchi AR. A dictionary learning approach for human sperm heads classification. Comput Biol Med 2017; 91:181-190. [DOI: 10.1016/j.compbiomed.2017.10.009] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2017] [Revised: 10/08/2017] [Accepted: 10/09/2017] [Indexed: 10/18/2022]
|
26
|
Domínguez C, Heras J, Pascual V. IJ-OpenCV: Combining ImageJ and OpenCV for processing images in biomedicine. Comput Biol Med 2017; 84:189-194. [PMID: 28390286 DOI: 10.1016/j.compbiomed.2017.03.027] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2016] [Revised: 03/28/2017] [Accepted: 03/28/2017] [Indexed: 12/27/2022]
Abstract
BACKGROUND AND OBJECTIVE The effective processing of biomedical images usually requires the interoperability of diverse software tools that have different aims but are complementary. The goal of this work is to develop a bridge to connect two of those tools: ImageJ, a program for image analysis in life sciences, and OpenCV, a computer vision and machine learning library. METHODS Based on a thorough analysis of ImageJ and OpenCV, we detected the features of these systems that could be enhanced, and developed a library to combine both tools, taking advantage of the strengths of each system. The library was implemented on top of the SciJava converter framework. We also provide a methodology to use this library. RESULTS We have developed the publicly available library IJ-OpenCV that can be employed to create applications combining features from both ImageJ and OpenCV. From the perspective of ImageJ developers, they can use IJ-OpenCV to easily create plugins that use any functionality provided by the OpenCV library and explore different alternatives. From the perspective of OpenCV developers, this library provides a link to the ImageJ graphical user interface and all its features to handle regions of interest. CONCLUSIONS The IJ-OpenCV library bridges the gap between ImageJ and OpenCV, allowing the connection and the cooperation of these two systems.
Collapse
Affiliation(s)
- César Domínguez
- Department of Mathematics and Computer Science, University of La Rioja, Logroño, Spain
| | - Jónathan Heras
- Department of Mathematics and Computer Science, University of La Rioja, Logroño, Spain.
| | - Vico Pascual
- Department of Mathematics and Computer Science, University of La Rioja, Logroño, Spain.
| |
Collapse
|
27
|
Chang V, Garcia A, Hitschfeld N, Härtel S. Gold-standard for computer-assisted morphological sperm analysis. Comput Biol Med 2017; 83:143-150. [DOI: 10.1016/j.compbiomed.2017.03.004] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2016] [Revised: 01/31/2017] [Accepted: 03/01/2017] [Indexed: 10/20/2022]
|
28
|
Maroto-Morales A, García-Álvarez O, Ramón M, Martínez-Pastor F, Fernández-Santos MR, Soler AJ, Garde JJ. Current status and potential of morphometric sperm analysis. Asian J Androl 2017; 18:863-870. [PMID: 27678465 PMCID: PMC5109877 DOI: 10.4103/1008-682x.187581] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022] Open
Abstract
The spermatozoon is the most diverse cell type known and this diversity is considered to reflect differences in sperm function. How the diversity in sperm morphology arose during speciation and what role the different specializations play in sperm function, however, remain incompletely characterized. This work reviews the hypotheses proposed to explain sperm morphological evolution, with a focus on some aspects of sperm morphometric evaluation; the ability of morphometrics to predict sperm cryoresistance and male fertility is also discussed. For this, the evaluation of patterns of change of sperm head morphometry throughout a process, instead of the study of the morphometric characteristics of the sperm head at different stages, allows a better identification of the males with different sperm cryoconservation ability. These new approaches, together with more studies employing a greater number of individuals, are needed to obtain novel results concerning the role of sperm morphometry on sperm function. Future studies should aim at understanding the causes of sperm design diversity and the mechanisms that generate them, giving increased attention to other sperm structures besides the sperm head. The implementation of scientific and technological advances could benefit the simultaneous examination of sperm phenotype and sperm function, demonstrating that sperm morphometry could be a useful tool for sperm assessment.
Collapse
Affiliation(s)
| | - Olga García-Álvarez
- SaBio IREC (CSIC - UCLM - JCCM), Albacete, Spain.,Biomedical Center, Medical Faculty in Pilsen, Charles University in Prague, Pilsen, Czech Republic
| | - Manuel Ramón
- Regional Center of Animal Selection and Reproduction (CERSYRA) JCCM, Valdepeñas, Spain
| | - Felipe Martínez-Pastor
- Institute for Animal Health and Cattle Development, University of León, León, Spain.,Department of Molecular Biology, University of León, León, Spain
| | | | | | | |
Collapse
|
29
|
Nissen MS, Krause O, Almstrup K, Kjærulff S, Nielsen TT, Nielsen M. Convolutional Neural Networks for Segmentation and Object Detection of Human Semen. IMAGE ANALYSIS 2017. [DOI: 10.1007/978-3-319-59126-1_33] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/11/2023]
|
30
|
Mirroshandel SA, Ghasemian F, Monji-Azad S. Applying data mining techniques for increasing implantation rate by selecting best sperms for intra-cytoplasmic sperm injection treatment. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2016; 137:215-229. [PMID: 28110726 DOI: 10.1016/j.cmpb.2016.09.013] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/16/2016] [Revised: 08/15/2016] [Accepted: 09/18/2016] [Indexed: 06/06/2023]
Abstract
BACKGROUND AND OBJECTIVE Aspiration of a good-quality sperm during intracytoplasmic sperm injection (ICSI) is one of the main concerns. Understanding the influence of individual sperm morphology on fertilization, embryo quality, and pregnancy probability is one of the most important subjects in male factor infertility. Embryologists need to decide the best sperm for injection in real time during ICSI cycle. Our objective is to predict the quality of zygote, embryo, and implantation outcome before injection of each sperm in an ICSI cycle for male factor infertility with the aim of providing a decision support system on the sperm selection. METHODS The information was collected from 219 patients with male factor infertility at the infertility therapy center of Alzahra hospital in Rasht from 2012 through 2014. The prepared dataset included the quality of zygote, embryo, and implantation outcome of 1544 injected sperms into the related oocytes. In our study, embryo transfer was performed at day 3. Each sperm was represented with thirteen clinical features. Data preprocessing was the first step in the proposed data mining algorithm. After applying more than 30 classifiers, 9 successful classifiers were selected and evaluated by 10-fold cross validation technique using precision, recall, F1, and AUC measures. Another important experiment was measuring the effect of each feature in prediction process. RESULTS In zygote and embryo quality prediction, IBK and RandomCommittee models provided 79.2% and 83.8% F1, respectively. In implantation outcome prediction, KStar model achieved 95.9% F1, which is even better than prediction of human experts. All these predictions can be done in real time. CONCLUSIONS A machine learning-based decision support system would be helpful in sperm selection phase of ICSI cycle to improve the success rate of ICSI treatment.
Collapse
Affiliation(s)
| | | | - Sara Monji-Azad
- Department of Computer Engineering, University of Guilan, Rasht, Iran
| |
Collapse
|