Around one in seven couples have trouble conceiving, which means there is a high demand for solutions such as in vitro fertilization, also known as IVF. This process involves fertilizing and developing embryos in the laboratory and then selecting a few to implant into the womb of the patient. IVF, however, only has a 30% success rate, is expensive and can be both mentally and physically taxing for patients. Selecting the right embryos to implant is therefore extremely important, as this increases the chance of success, minimizes complications and ensures the baby will be healthy.

Currently the tools available for making this decision are limited, highly subjective, time-consuming, and often extremely expensive. As a result, embryologists often rely on their experience and observational skills when choosing which embryos to implant, which can lead to a lot of variability. An automated system based on artificial intelligence (AI) could therefore improve IVF success rates by assisting embryologists with this decision and ensuring more consistent results. The AI system could learn how embryos develop over time and then uses this information to select the best embryos to implant from just a single image. This would offer a cheaper alternative to current analysis tools that are only available at the most expensive IVF clinics.

Now, Bormann, Kanakasabapathy, Thirumalaraj et al. have developed an AI system for IVF based on thousands of images of embryos. Using individual images, the system selected embryos of a comparable quality to those selected by a human specialist. It also showed a greater ability to identify embryos that will lead to successful implantation. Indeed, the software outperformed 15 embryologists from five different centers across the United States in detecting which embryos were most likely to implant out of a group of high-quality embryos with few visible differences.

Artificial intelligence has many potential applications to support expert clinical decision-making. Systems like these could improve success, reduce errors and lead to faster, cheaper and more accessible results. Beyond immediate IVF applications, this system could also be used in research and industry to help understand differences in embryo quality.

Assisted reproductive technologies (ART) such as in vitro fertilization (IVF), while a solution to many infertile couples have been inefficient with an average success rate of approximately 30% reported in 2015 in the US (CDC, 2015). IVF is also an expensive solution costing patients well over $10,000 out-of-pocket for each ART cycle in the US with many patients requiring multiple cycles to achieve successful pregnancy (CDC, 2015; Birenbaum-Carmeli, 2004; Toner, 2002). Although multiple factors such as maternal age, medical diagnosis, gamete and embryo quality, and endometrium receptivity determine the success of ART cycles, the challenge of non-invasive selection of the highest available quality from a patient’s cohort of embryos (top-quality embryo) for transfer remains as one of the most important factors in achieving successful ART outcomes (Vaegter et al., 2017; Barash et al., 2017; Conaghan et al., 2013; Wong et al., 2013; Racowsky et al., 2015; Filho et al., 2010; Machtinger and Racowsky, 2013; Demko et al., 2016; Einarsson et al., 2017; Hill et al., 1989; Erenus et al., 1991; Paulson et al., 1990; Osman et al., 2015).

Traditional methods of embryo selection rely on visual embryo morphological assessment and are highly practice-dependent and subjective (Storr et al., 2017; Baxter Bendus et al., 2006; Paternot et al., 2009). Fully automated assessments of embryos are challenging owing to the complexity of embryo morphologies. Emulating the skill of highly trained embryologists in efficient embryo assessment in a fully automated system is a major challenge in all of the previous work done in computer-aided assessments of embryos due to focus on measuring specific expert-defined parameters such as zona pellucida thickness variation, number of blastomeres, degree of cell symmetry and cytoplasmic fragmentation, etc. (Rocha et al., 2017a; Rocha et al., 2017b).

Machine learning is loosely defined as a computer program that learns a given task over time through experience and improves itself to achieve the best possible task performance. In the past decade, advances in hardware compute performance and machine learning techniques have significantly improved their applicability in real-world medical and non-medical problems. Recently, machine learning has been proposed as a solution for automated analysis of embryo morphologies (Rocha et al., 2017b; Bormann et al., 2020; Dimitriadis et al., 2019; Thirumalaraju et al., 2019; Khosravi et al., 2019; Kanakasabapathy et al., 2019a). This work makes use of a deep convolutional neural network (CNN), a representation learning technique, that has been proven to be effective in image classification tasks. Unlike most prior computer-aided algorithms, including some techniques of machine learning used for embryo assessment, the reported CNN architecture allows automated embryo feature selection and analysis at the pixel level without any interference by an embryologist (Rocha et al., 2017a; Rocha et al., 2017b). Such networks do not depend on human-specified features and can develop an ability to evaluate embryos categorically through iterative learning from thousands of examples. The use of deep-learning in IVF has also been explored; however, these recent neural network-based approaches have focused on either classifying embryos based on morphological quality and were not evaluated for transfer outcomes, or were developed with the use of time-lapse series of images toward the evaluation of implantation (Khosravi et al., 2019; Tran et al., 2019). It is important to emphasize here that most fertility centers do not possess time-lapse imaging hardware even in the United States of America (Dolinko et al., 2017). The lack of availability of such hardware limits an otherwise promising technology mostly to resource-rich settings and fail to improve quality of and access to care in resource-constrained settings where such advances are sorely needed (Wahl et al., 2018; Hosny and Aerts, 2019). Furthermore, in current clinical practice, embryos with the highest morphological grades (top-quality) are the first to be transferred, however, clinically these decisions are performed manually, even with time-lapse imaging systems. The development of networks that can measure an embryo’s potential for implantation and help in rank ordering embryos in a patient embryo cohort for transfer have utility in virtually all fertility centers.

Conventionally, embryo transfers are performed at the cleavage or the blastocyst stage of development. Embryos are at the cleavage stage 2–3 days after fertilization and develop further in suitable culture conditions to reach the blastocyst stage 5–7 days after fertilization. Blastocyst embryo transfers, in particular, have been associated with better implantation rates and have helped lower the number of embryos transferred at a time (De Croo et al., 2019). Therefore, in this study, we have investigated the use of a CNN pre-trained with 1.4 million ImageNet images and transfer-learned using 2440 static human embryo images recorded at a single time-point of 113 hr post insemination (hpi) for the development of neural networks that can help identify embryos capable of implantation and for identifying the top quality embryos (Figure 1). The top-quality embryos were identified by combining a previously developed network (Xception architecture) trained to classify embryos based on its blastocyst quality with a genetic algorithm scheme (Figure 1; Thirumalaraju et al., 2020). The original neural network was trained on a hierarchical system of categorization, derived from a clinical Gardener-based grading system, to minimize data sparsity and improve overall network learning (Kanakasabapathy et al., 2019a; Thirumalaraju et al., 2020; Kanakasabapathy et al., 2019b; Esteva et al., 2017). The two major categories of non-blastocysts and blastocysts made up the inference classes, which included the training classes 1, 2, and 3, 4, 5, respectively (Figure 1). Pre-training with a large dataset of images from ImageNet honed the ability of the developed CNN to identify the shape, structure, and texture variations between morphologically complex embryos with minimal data requirements while the genetic algorithm helped in rank ordering embryos by generating unified scores (Figure 1). The developed network was evaluated using an independent test set comprising of 97 patient-embryo cohorts. Embryos of the highest quality that were selected from the patient cohorts were evaluated using known implantation outcomes.

Figure 1

Download asset Open asset

Additionally, we also investigated if the neural network can be trained to directly differentiate between embryos based on their potential for implantation (Figure 1). Our tests with patient cohorts using the algorithm does not account for the ploidy status of the embryos. Since pre-implantation genetic screened (PGS) euploid embryos are associated with higher implantation chance, we also designed a neural network to evaluate the network performance in refining the screened embryos based on their implantation potential. The evaluations using the patient cohorts tend to yield embryo selections with unknown outcomes or ploidy status, therefore, for this section of the study, we utilized a test set of 97 euploid embryos with known implantation outcomes. The CNN was trained and evaluated in identifying euploid embryos capable of implantation and the performance was compared against those of 15 embryologists from five different fertility centers across the United States of America.

Deep neural networks hold value in aiding clinical decision making and have received significant attention from the IVF community. The deep-neural network-based approach showcased here is an objective approach to one of the more subjective but important parts of a clinical IVF process-embryo selections for transfer (Bormann et al., 2020). Since over 80% of fertility clinics rely on non-time lapse imaging systems as part of their clinical processes, such neural network-based algorithms that rely purely on static single timepoint images can effectively assist in decision making (Dolinko et al., 2017). In our study, we have evaluated two neural network-based approaches for improving embryo selection.

Firstly, we have demonstrated that a deep-neural network in combination with a genetic algorithm (CNNg) can yield a continuous score that represents the quality of the embryo and that objective orders of transfer can be determined for a given set of embryos using such scores. The ranking algorithm studied here was able to consistently select embryos of the highest available morphological quality. Although the network was trained to classify embryos based on their quality, it performed well even in differentiating between embryos of the same class when combined with a genetic algorithm. The benefit of such systems is particularly evident in cases where selections made by the clinic/embryologist, although of similar grade, resulted in lower overall transfer success rates. Our networks only focused on the morphological features for embryo quality assessments due to data scarcity. The network’s learning can be compounded with data from additional timepoints, morphokinetics, and patient and cycle-specific information for more personalized IVF predictions and outcomes. Recently, Tran et al. studied the use of a deep-learning model (IVY) that can analyze whole time-lapse videos instead of specific time points for fetal heartbeat prediction (Tran et al., 2019). However, the study was flawed since embryos with unknown outcomes (non-transferred embryos) were considered as negative outcome cases, which made up most of their dataset (~90%). The heavy class bias in their dataset and improper study design severely limits any conclusions that can be drawn from the work. A major hurdle for the development of networks capable of analyzing multi-timepoint images and with additional patient-specific information is the limited availability of diversified data with known clinical outcomes. During training, the lack of availability of such data prevents the networks from effectively learning relevant outcome-associated patterns in data. The need for data scales with the complexity of the task and the number of variables introduced. While this work focuses primarily on the utility of deep-learning algorithm for embryo evaluations at 113 hpi, it is also possible to develop similar networks for embryo evaluations at different timepoints, provided that sufficient data with matched outcomes/annotations are available. We have evaluated a similar network for use with cleavage-stage embryos (70 hpi) and showed that deep-learning approaches can outperform trained embryologists in certain tasks such as embryo selection (Thirumalaraju et al., 2019; Kanakasabapathy et al., 2020).

A major concern in any clinical practice, however, is the loss of viable embryos due to system errors. Therefore, the AI-based embryo selection algorithm reported here does not make any suggestion on discarding embryos. All embryos assessed by the CNNg in the selection process may be cryopreserved as per clinical practice. Thereby, our approach will not negatively affect the cumulative pregnancy rate since viable embryos will not be lost. However, it may improve the pregnancy rate as the system may be able to improve the chance of achieving a pregnancy faster with fewer embryos transferred. Furthermore, it is important to note that in its current stage this system is intended to act only as an assistive tool for embryologists. The embryologists can include the system’s prediction to make better judgments during embryo selection. The scores provided by the algorithm are continuous, but it can also be easily modified to present its scoring results in both binary and a more categorical format.

Clinically, besides morphological features, various other important metrics and parameters are considered by embryologists at the time of decision making such as taking into account the ploidy status of the transferable embryos. PGS verified euploid embryos have been shown to possess a higher probability of successful outcome but cost a hefty premium on top of the cycle costs at most fertility centers in the United States (Drazba et al., 2014). Furthermore, for patients with two or more euploid embryos, additional assessments of embryo morphology are required to select the best embryo based on their morphology for transfer, since euploids do not inherently guarantee implantation. Thus far, to the best of our knowledge, no system, deep-learning-based or otherwise, has been shown to be capable of differentiating between euploid blastocysts based on their capacity for implantation. Euploid embryos are usually of the highest available quality and differentiating between them objectively and reliably through manual analysis can be extremely challenging. The CNN-based approach, through direct estimations of implantation potential from 113 hpi embryo morphology, outperformed trained embryologists in identifying implanting embryos from a set of PGS euploid embryos. This accomplishment exhibits the potential of artificial intelligence-based approaches to improve success rates in the IVF lab. Our observations indicated that the system performed with a significantly better agreement with the actual implantation outcome for embryos with implantation scores closer to 1 or 0 (Higher confidence). Furthermore, the comparison between the decisions made by 15 embryologists from different fertility centers in the US and the deep-neural network showcased that neural networks can outperform embryologists in identifying embryos capable of implantation. Hence, by applying the suggestions of a CNN, a trained embryologist can improve their selection of the embryo with the highest implantation potential.

Advances in artificial intelligence have fostered numerous applications that have the potential to improve standard-of-care in the different fields of medicine. While other groups have also evaluated different use cases for machine learning in assisted reproductive medicine, this approach is novel in how it used a CNN trained on a large dataset to make predictions based on static images. The approach has shown the potential of CNNs to be used in aiding embryologists to select the embryo with the highest implantation potential, especially amongst high-quality euploid embryos. Although the current retrospective study shows that these systems can perform better than highly-trained embryologists, randomized control trials are required before routine use in clinical practice is adopted.

Patients did not explicitly consent to their data being made public and access is therefore restricted. Requests for the anonymized data should be made to Charles Bormann (cbormann@partners.org) and Hadi Shafiee (hshafiee@bwh.harvard.edu). Requests will be reviewed by a data access committee, taking into account the research proposal and intended use of the data. Requestors are required to sign a data-sharing agreement to ensure patients' confidentiality is maintained prior to the release of any data.

1. 1. Barash O
   2. Ivani K
   3. Huen N
   4. Willman S
   5. Weckstein L

   (2017) Morphology of the blastocysts is the single most important factor affecting clinical pregnancy rates in IVF PGS cycles with single embryo transfers

   Fertility and Sterility 108:e99.

   https://doi.org/10.1016/j.fertnstert.2017.07.301

   • Google Scholar
2. 1. Baxter Bendus AE
   2. Mayer JF
   3. Shipley SK
   4. Catherino WH

   (2006) Interobserver and intraobserver variation in day 3 embryo grading

   Fertility and Sterility 86:1608–1615.

   https://doi.org/10.1016/j.fertnstert.2006.05.037

   • PubMed
   • Google Scholar
3. 1. Birenbaum-Carmeli D

   (2004) 'Cheaper than a newcomer': on the social production of IVF policy in Israel

   Sociology of Health and Illness 26:897–924.

   https://doi.org/10.1111/j.0141-9889.2004.00422.x

   • PubMed
   • Google Scholar
4. 1. Bormann CL
   2. Thirumalaraju P
   3. Kanakasabapathy MK
   4. Kandula H
   5. Souter I
   6. Dimitriadis I
   7. Gupta R
   8. Pooniwala R
   9. Shafiee H

   (2020) Consistency and objectivity of automated embryo assessments using deep neural networks

   Fertility and Sterility 113:781–787.

   https://doi.org/10.1016/j.fertnstert.2019.12.004

   • PubMed
   • Google Scholar
5. Report

   1. CDC

   (2015) 2017 Assisted Reproductive Technology Fertility Clinic Success Rates Report

   Centers for Disease Control and Prevention.

   https://www.cdc.gov/art/reports/2017/fertility-clinic.html

   • Google Scholar
6. 1. Conaghan J
   2. Chen AA
   3. Willman SP
   4. Ivani K
   5. Chenette PE
   6. Boostanfar R
   7. Baker VL
   8. Adamson GD
   9. Abusief ME
   10. Gvakharia M
   11. Loewke KE
   12. Shen S

   (2013) Improving embryo selection using a computer-automated time-lapse image analysis test plus day 3 morphology: results from a prospective multicenter trial

   Fertility and Sterility 100:412–419.

   https://doi.org/10.1016/j.fertnstert.2013.04.021

   • PubMed
   • Google Scholar
7. 1. De Croo I
   2. Colman R
   3. De Sutter P
   4. Tilleman K

   (2019)

   Blastocyst transfer for all? higher cumulative live birth chance in a blastocyst-stage transfer policy compared to a cleavage-stage transfer policy

   Facts, Views & Vision in ObGyn 11:169–176.

   • PubMed
   • Google Scholar
8. 1. Demko ZP
   2. Simon AL
   3. McCoy RC
   4. Petrov DA
   5. Rabinowitz M

   (2016) Effects of maternal age on euploidy rates in a large cohort of embryos analyzed with 24-chromosome single-nucleotide polymorphism-based preimplantation genetic screening

   Fertility and Sterility 105:1307–1313.

   https://doi.org/10.1016/j.fertnstert.2016.01.025

   • PubMed
   • Google Scholar
9. 1. Dimitriadis I
   2. Bormann CL
   3. Thirumalaraju P
   4. Kanakasabapathy M
   5. Gupta R
   6. Pooniwala R
   7. Souter I
   8. Hsu JY
   9. Rice ST
   10. Bhowmick P
   11. Shafiee H

   (2019) Artificial intelligence-enabled system for embryo classification and selection based on image analysis

   Fertility and Sterility 111:e21.

   https://doi.org/10.1016/j.fertnstert.2019.02.064

   • Google Scholar
10. 1. Dolinko AV
    2. Farland LV
    3. Kaser DJ
    4. Missmer SA
    5. Racowsky C

    (2017) National survey on use of time-lapse imaging systems in IVF laboratories

    Journal of Assisted Reproduction and Genetics 34:1167–1172.

    https://doi.org/10.1007/s10815-017-0964-9

    • PubMed
    • Google Scholar
11. 1. Drazba KT
    2. Kelley MA
    3. Hershberger PE

    (2014) A qualitative inquiry of the financial concerns of couples opting to use preimplantation genetic diagnosis to prevent the transmission of known genetic disorders

    Journal of Genetic Counseling 23:202–211.

    https://doi.org/10.1007/s10897-013-9638-7

    • PubMed
    • Google Scholar
12. 1. Einarsson S
    2. Bergh C
    3. Friberg B
    4. Pinborg A
    5. Klajnbard A
    6. Karlström PO
    7. Kluge L
    8. Larsson I
    9. Loft A
    10. Mikkelsen-Englund AL
    11. Stenlöf K
    12. Wistrand A
    13. Thurin-Kjellberg A

    (2017) Weight reduction intervention for obese infertile women prior to IVF: a randomized controlled trial

    Human Reproduction 32:1621–1630.

    https://doi.org/10.1093/humrep/dex235

    • PubMed
    • Google Scholar
13. 1. Erenus M
    2. Zouves C
    3. Rajamahendran P
    4. Leung S
    5. Fluker M
    6. Gomel V

    (1991) The effect of embryo quality on subsequent pregnancy rates after in vitro fertilization

    Fertility and Sterility 56:707–710.

    https://doi.org/10.1016/S0015-0282(16)54603-2

    • PubMed
    • Google Scholar
14. 1. Esteva A
    2. Kuprel B
    3. Novoa RA
    4. Ko J
    5. Swetter SM
    6. Blau HM
    7. Thrun S

    (2017) Dermatologist-level classification of skin Cancer with deep neural networks

    Nature 542:115–118.

    https://doi.org/10.1038/nature21056

    • PubMed
    • Google Scholar
15. 1. Filho ES
    2. Noble JA
    3. Wells D

    (2010) A review on automatic analysis of human embryo microscope images

    The Open Biomedical Engineering Journal 4:170–177.

    https://doi.org/10.2174/1874120701004010170

    • PubMed
    • Google Scholar
16. 1. Hill GA
    2. Freeman M
    3. Bastias MC
    4. Rogers BJ
    5. Herbert CM
    6. Osteen KG
    7. Wentz AC

    (1989) The influence of oocyte maturity and embryo quality on pregnancy rate in a program for in vitro fertilization-embryo transfer

    Fertility and Sterility 52:801–806.

    https://doi.org/10.1016/s0015-0282(16)61034-8

    • PubMed
    • Google Scholar
17. 1. Hosny A
    2. Aerts H

    (2019) Artificial intelligence for global health

    Science 366:955–956.

    https://doi.org/10.1126/science.aay5189

    • PubMed
    • Google Scholar
18. 1. Kanakasabapathy MK
    2. Thirumalaraju P
    3. Bormann CL
    4. Kandula H
    5. Dimitriadis I
    6. Souter I
    7. Yogesh V
    8. Kota Sai Pavan S
    9. Yarravarapu D
    10. Gupta R
    11. Pooniwala R
    12. Shafiee H

    (2019a) Development and evaluation of inexpensive automated deep learning-based imaging systems for embryology

    Lab on a Chip 19:4139–4145.

    https://doi.org/10.1039/C9LC00721K

    • PubMed
    • Google Scholar
19. 1. Kanakasabapathy M
    2. Dimitriadis I
    3. Thirumalaraju P
    4. Bormann CL
    5. Souter I
    6. Hsu J
    7. Thatcher ML
    8. Veiga C
    9. Shafiee H

    (2019b) An inexpensive, automated artificial intelligence (AI) system for human embryo morphology evaluation and transfer selection

    Fertility and Sterility 111:e11.

    https://doi.org/10.1016/j.fertnstert.2019.02.047

    • Google Scholar
20. Preprint

    1. Kanakasabapathy MK
    2. Thirumalaraju P
    3. Bormann CL
    4. Gupta R
    5. Pooniwala R
    6. Kandula H

    (2020) Deep learning mediated single time-point image-based prediction of embryo developmental outcome at the cleavage stage

    arXiv.

    https://arxiv.org/abs/2006.08346

    • Google Scholar
21. 1. Khosravi P
    2. Kazemi E
    3. Zhan Q
    4. Malmsten JE
    5. Toschi M
    6. Zisimopoulos P
    7. Sigaras A
    8. Lavery S
    9. Cooper LAD
    10. Hickman C
    11. Meseguer M
    12. Rosenwaks Z
    13. Elemento O
    14. Zaninovic N
    15. Hajirasouliha I

    (2019) Deep learning enables robust assessment and selection of human blastocysts after in vitro fertilization

    Npj Digital Medicine 2:21.

    https://doi.org/10.1038/s41746-019-0096-y

    • PubMed
    • Google Scholar
22. 1. Machtinger R
    2. Racowsky C

    (2013) Morphological systems of human embryo assessment and clinical evidence

    Reproductive BioMedicine Online 26:210–221.

    https://doi.org/10.1016/j.rbmo.2012.10.021

    • PubMed
    • Google Scholar
23. 1. Martins WP
    2. Nastri CO
    3. Rienzi L
    4. van der Poel SZ
    5. Gracia C
    6. Racowsky C

    (2017) Blastocyst vs cleavage-stage embryo transfer: systematic review and meta-analysis of reproductive outcomes

    Ultrasound in Obstetrics & Gynecology 49:583–591.

    https://doi.org/10.1002/uog.17327

    • PubMed
    • Google Scholar
24. 1. Osman A
    2. Alsomait H
    3. Seshadri S
    4. El-Toukhy T
    5. Khalaf Y

    (2015) The effect of sperm DNA fragmentation on live birth rate after IVF or ICSI: a systematic review and meta-analysis

    Reproductive BioMedicine Online 30:120–127.

    https://doi.org/10.1016/j.rbmo.2014.10.018

    • PubMed
    • Google Scholar
25. 1. Paternot G
    2. Devroe J
    3. Debrock S
    4. D'Hooghe TM
    5. Spiessens C

    (2009) Intra- and inter-observer analysis in the morphological assessment of early-stage embryos

    Reproductive Biology and Endocrinology 7:105.

    https://doi.org/10.1186/1477-7827-7-105

    • Google Scholar
26. 1. Paulson RJ
    2. Sauer MV
    3. Lobo RA

    (1990) Embryo implantation after human in vitro fertilization: importance of endometrial receptivity

    Fertility and Sterility 53:870–874.

    https://doi.org/10.1016/S0015-0282(16)53524-9

    • PubMed
    • Google Scholar
27. 1. Practice Committee of the American Society for Reproductive Medicine. Electronic address: ASRM@asrm.org
    2. Practice Committee of the Society for Assisted Reproductive Technology

    (2017) Guidance on the limits to the number of embryos to transfer: a committee opinion

    Fertility and Sterility 107:901–903.

    https://doi.org/10.1016/j.fertnstert.2017.02.107

    • PubMed
    • Google Scholar
28. 1. Racowsky C
    2. Kovacs P
    3. Martins WP

    (2015) A critical appraisal of time-lapse imaging for embryo selection: where are we and where do we need to go?

    Journal of Assisted Reproduction and Genetics 32:1025–1030.

    https://doi.org/10.1007/s10815-015-0510-6

    • PubMed
    • Google Scholar
29. 1. Rocha JC
    2. Passalia FJ
    3. Matos FD
    4. Takahashi MB
    5. Maserati MP
    6. Alves MF
    7. de Almeida TG
    8. Cardoso BL
    9. Basso AC
    10. Nogueira MFG

    (2017a) Automatized image processing of bovine blastocysts produced in vitro for quantitative variable determination

    Scientific Data 4:170192.

    https://doi.org/10.1038/sdata.2017.192

    • PubMed
    • Google Scholar
30. 1. Rocha JC
    2. Passalia FJ
    3. Matos FD
    4. Takahashi MB
    5. Ciniciato DS
    6. Maserati MP
    7. Alves MF
    8. de Almeida TG
    9. Cardoso BL
    10. Basso AC
    11. Nogueira MFG

    (2017b) A method based on artificial intelligence to fully automatize the evaluation of bovine blastocyst images

    Scientific Reports 7:7659.

    https://doi.org/10.1038/s41598-017-08104-9

    • PubMed
    • Google Scholar
31. 1. Storr A
    2. Venetis CA
    3. Cooke S
    4. Kilani S
    5. Ledger W

    (2017) Inter-observer and intra-observer agreement between embryologists during selection of a single day 5 embryo for transfer: a multicenter study

    Human Reproduction 32:307–314.

    https://doi.org/10.1093/humrep/dew330

    • PubMed
    • Google Scholar
32. 1. Thirumalaraju P
    2. Hsu JY
    3. Bormann CL
    4. Kanakasabapathy M
    5. Souter I
    6. Dimitriadis I
    7. Dickinson KA
    8. Pooniwala R
    9. Gupta R
    10. Yogesh V
    11. Shafiee H

    (2019) Deep learning-enabled blastocyst prediction system for cleavage stage embryo selection

    Fertility and Sterility 111:e29.

    https://doi.org/10.1016/j.fertnstert.2019.02.077

    • Google Scholar
33. Preprint

    1. Thirumalaraju P
    2. Kanakasabapathy MK
    3. Bormann CL
    4. Gupta R
    5. Pooniwala R
    6. Kandula H

    (2020) Evaluation of deep convolutional neural networks in classifying human embryo images based on their morphological quality

    arXiv.

    https://arxiv.org/abs/2005.10912

    • Google Scholar
34. 1. Toner JP

    (2002) Progress we can be proud of: U.S. trends in assisted reproduction over the first 20 years

    Fertility and Sterility 78:943–950.

    https://doi.org/10.1016/S0015-0282(02)04197-3

    • PubMed
    • Google Scholar
35. 1. Tran D
    2. Cooke S
    3. Illingworth PJ
    4. Gardner DK

    (2019) Deep learning as a predictive tool for fetal heart pregnancy following time-lapse incubation and blastocyst transfer

    Human Reproduction 34:1011–1018.

    https://doi.org/10.1093/humrep/dez064

    • PubMed
    • Google Scholar
36. 1. Vaegter KK
    2. Lakic TG
    3. Olovsson M
    4. Berglund L
    5. Brodin T
    6. Holte J

    (2017) Which factors are most predictive for live birth after in vitro fertilization and intracytoplasmic sperm injection (IVF/ICSI) treatments? Analysis of 100 prospectively recorded variables in 8,400 IVF/ICSI single-embryo transfers

    Fertility and Sterility 107:641–648.

    https://doi.org/10.1016/j.fertnstert.2016.12.005

    • PubMed
    • Google Scholar
37. 1. Wahl B
    2. Cossy-Gantner A
    3. Germann S
    4. Schwalbe NR

    (2018) Artificial intelligence (AI) and global health: how can AI contribute to health in resource-poor settings?

    BMJ Global Health 3:e000798.

    https://doi.org/10.1136/bmjgh-2018-000798

    • PubMed
    • Google Scholar
38. 1. Wong C
    2. Chen AA
    3. Behr B
    4. Shen S

    (2013) Time-lapse microscopy and image analysis in basic and clinical embryo development research

    Reproductive BioMedicine Online 26:120–129.

    https://doi.org/10.1016/j.rbmo.2012.11.003

    • PubMed
    • Google Scholar

Author details

1. Charles L Bormann

   1. Division of Reproductive Endocrinology and Infertility, Department of Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, Boston, United States
   2. Harvard Medical School, Boston, United States

   Contribution

   Conceptualization, Investigation, Data curation, Funding Acquisition, Project administration, Supervision, Validation, Formal analysis, Supervision, Methodology, Writing - original draft

   Contributed equally with

   Manoj Kumar Kanakasabapathy and Prudhvi Thirumalaraju

   Competing interests

   Charles L Bormann, Ph.D has a patent WO2019068073A1 pending.

2. Manoj Kumar Kanakasabapathy

   Division of Engineering in Medicine, Department of Medicine, Brigham and Women’s Hospital, Harvard Medical School, Boston, United States

   Contribution

   Conceptualization, Investigation, Data curation, Funding Acquisition, Project administration, Supervision, Validation, Formal analysis, Supervision, Methodology, Writing - original draft

   Contributed equally with

   Charles L Bormann and Prudhvi Thirumalaraju

   Competing interests

   Manoj Kumar Kanakasabapathy has a patent WO2019068073A1 pending.

   "This ORCID iD identifies the author of this article:" 0000-0002-0756-8585

3. Prudhvi Thirumalaraju

   Division of Engineering in Medicine, Department of Medicine, Brigham and Women’s Hospital, Harvard Medical School, Boston, United States

   Contribution

   Conceptualization, Investigation, Validation, Software, Formal analysis, Methodology

   Contributed equally with

   Charles L Bormann and Manoj Kumar Kanakasabapathy

   Competing interests

   Prudhvi Thirumalaraju has a patent WO2019068073A1 pending.

   "This ORCID iD identifies the author of this article:" 0000-0002-0573-0243

4. Raghav Gupta

   Division of Engineering in Medicine, Department of Medicine, Brigham and Women’s Hospital, Harvard Medical School, Boston, United States

   Contribution

   Data curation, Software, Methodology, Formal analysis

   Competing interests

   No competing interests declared

5. Rohan Pooniwala

   Division of Engineering in Medicine, Department of Medicine, Brigham and Women’s Hospital, Harvard Medical School, Boston, United States

   Contribution

   Data curation, Software, Methodology, Formal analysis

   Competing interests

   No competing interests declared

6. Hemanth Kandula

   Division of Engineering in Medicine, Department of Medicine, Brigham and Women’s Hospital, Harvard Medical School, Boston, United States

   Contribution

   Data curation, Software, Methodology, Validation, Formal analysis

   Competing interests

   No competing interests declared

7. Eduardo Hariton

   Division of Reproductive Endocrinology and Infertility, Department of Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, Boston, United States

   Contribution

   Data curation, Writing - review and editing

   Competing interests

   No competing interests declared

8. Irene Souter

   1. Division of Reproductive Endocrinology and Infertility, Department of Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, Boston, United States
   2. Harvard Medical School, Boston, United States

   Contribution

   Resources, Data curation

   Competing interests

   No competing interests declared

9. Irene Dimitriadis

   1. Division of Reproductive Endocrinology and Infertility, Department of Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, Boston, United States
   2. Harvard Medical School, Boston, United States

   Contribution

   Resources, Data curation, Writing - review and editing

   Competing interests

   No competing interests declared

10. Leslie B Ramirez

    Extend Fertility, New York, United States

    Contribution

    Resources, Supervision, Writing - review and editing

    Competing interests

    No competing interests declared

11. Carol L Curchoe

    1. San Diego Fertility Center, San Diego, United States
    2. Colorado Center for Reproductive Medicine IVF Laboratory Network, Englewood, United States

    Contribution

    Resources, Supervision, Writing - review and editing

    Competing interests

    No competing interests declared

12. Jason Swain

    Colorado Center for Reproductive Medicine IVF Laboratory Network, Englewood, United States

    Contribution

    Resources, Supervision, Writing - review and editing

    Competing interests

    No competing interests declared

13. Lynn M Boehnlein

    Division of Reproductive Endocrinology and Infertility, Department of Obstetrics and Gynecology, University of Wisconsin, Madison, United States

    Contribution

    Resources, Supervision, Writing - review and editing

    Competing interests

    No competing interests declared

14. Hadi Shafiee

    1. Harvard Medical School, Boston, United States
    2. Division of Engineering in Medicine, Department of Medicine, Brigham and Women’s Hospital, Harvard Medical School, Boston, United States

    Contribution

    Conceptualization, Resources, Supervision, Project Administration, Funding acquisition, Methodology, Writing - review and editing

    For correspondence

    HSHAFIEE@BWH.HARVARD.EDU

    Competing interests

    Dr. Shafiee has a patent WO2019068073A1 pending.

    "This ORCID iD identifies the author of this article:" 0000-0003-2240-7648

• 5,016

  views

• 838

  downloads

• 91

  citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.