DEEP LEARNING DEVELOPMENTAL MODEL FOR EMBRYO GRADING IN THAI POPULATION
DOI:
https://doi.org/10.55766/sujst-2024-04-e05589Keywords:
Infertility, In Vitro Fertilization, Embryo Grading, Deep Learning, ClassificationAbstract
In light of the growing challenges associated with infertility, an increasing number of researchers are resorting to assisted reproductive technologies such as In Vitro Fertilization (IVF). Embryo grading is a crucial step in the IVF process that requires embryologists’ expertise. However, their limited availability has led to the exploration of technological alternatives. This study aims to use deep learning for human embryo grading, with models specifically designed for the dataset in Thailand at Vajira Hospital. The process of IVF at Vajira Hospital presents its own set of challenges since its embryo classification extends beyond the Istanbul consensus. Furthermore, classes that occur infrequently are removed and classes with similarities are merged. We apply transfer learning to pretrained deep learning models like VGG19, VGG16, ResNet152, Resnet101, Xception, InceptionV3, and EfficientNet, to create a system capable of accurately classifying embryo quality scores. Experimental results from the embryo dataset collected from Vajira Hospital in Thailand demonstrate the proposed classifier’s accuracy, precision, recall, f1-score, and AUC superiority. This research contributes to the field of IVF in Thailand by potentially reducing human errors and addressing the demand for skilled embryologists.
References
Arsalan, M., Haider, A., Choi, J., and Park, K.R. (2022). Detecting blastocyst components by artificial intelligence for human embryological analysis to improve success rate of in vitro fertilization. Journal of Personalized Medicine, 12(2):124. https://doi.org/10.3390/jpm12020124
Barnes, J., Brendel, M., Gao, V.R., Rajendran, S., Kim, J., Li, Q., Malmsten, J.E., Sierra, J.T., Zisimopoulos, P., Sigaras, A., Khosravi, P., Meseguer, M., Zhan, Q., Rosenwaks, Z., Elemento, O., Zaninovic, N., and Hajirasouliha, I. (2023). A non-invasive artificial intelligence approach for the prediction of human blastocyst ploidy: a retrospective model development and validation study. Lancet Digit Health, 5(1):e28-e40. https://doi.org/10.1016/S2589-7500(22)00213-8
Basari, I. and Gunawan, D. (2019). Automated detection of human blastocyst quality using convolutional neural network and edge detector. Proceedings of the 2019 1st International Conference on Cybernetics and Intelligent Systems (ICORIS); August 22-23, 2019; Denpasar, Indonesia, p. 181-184.
Berman, A., Anteby, R., Efros, O., Klang, E., and Soffer, S. (2023). Deep learning for embryo evaluation using time-lapse: a systematic review of diagnostic test accuracy. American Journal of Obstetrics & Gynecology, 229(5):490-501. https://doi.org/10.1016/j.ajog.2023.04.027
Berntsen, J., Rimestad, J., Lassen, J.T., Tran, D., and Kragh, M.F. (2022). Robust and generalizable embryo selection based on artificial intelligence and time-lapse image sequences. PLoS One, 17(2):e0262661. https://doi.org/10.1371/journal.pone.0262661
Chavez-Badiola, A., Flores-Saiffe-Farías, A., Mendizabal-Ruiz, G., Drakeley, A.J., and Cohen, J. (2020). Embryo ranking intelligent classification algorithm (ERICA): artificial intelligence clinical assistant predicting embryo ploidy and implantation. Reprod Biomed Online, 41(4):585-593. https://doi.org/10.1016/j.rbmo.2020.07.003
Chéles, D.S., Ferreira, A.S., de Jesus, I.S., Fernandez, E.I., Pinheiro, G.M., Dal Molin, E.A., Alves, W., de Souza, R.C.M., Bori, L., Meseguer, M., Rocha, J.C, and Nogueira, M.F.G. (2022). An image processing protocol to extract variables predictive of human embryo fitness for assisted reproduction. Applied Sciences, 12(7):3,531. https://doi.org/10.3390/app12073531
Chollet, F. (2017). Xception: Deep learning with depthwise separable convolutions. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR); July 21-26, 2017; Honolulu, HI, USA, p. 1800-1807. https://doi.org/10.1109/CVPR.2017.195
Coward, K. and Wells, D. (2013). Textbook of Clinical Embryology. 1st ed. Cambridge University Press, New York, 342p. https://doi.org/10.1017/CBO9781139192736
Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning Illustrated. MIT Press, Massachusetts, 775p.
Harun, M.Y., Rahman, M.A., Mellinger, J., Chang, W., Huang, T., Walker, B., Hori, K., Ohta, A.T., Harun, M.Y., Rahman, A., Mellinger, J., Chang, W., Huang, T., Walker, B., Hori, K., and Ohta, A. (2019). Image segmentation of zona-ablated human blastocysts. Proceedings of the IEEE International Conference on Nano/Molecular Medicine and Engineering (NANOMED); November 21-24, 2019; Gwangju, Republic of Korea, p. 208-213. https://doi.org/10.1109/NANOMED49242.2019.9130621
He, K., Zhang, X., Ren, S., and Sun, J. (2016). Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR); June 27-30, 2016; Las Vegas, NV, USA, p. 770-778. https://doi.org/10.1109/CVPR.2016.90
Hu, J., Wang, H., Wang, J., Wang, Y., He, F., and Zhang, J. (2021). SA-Net: A scale-attention network for medical image segmentation. PLoS One, 16(4):e0247388. https://doi.org/10.1371/journal.pone.0247388
Kan-Tor, Y., Zabari, N., Erlich, I., Szeskin, A., Amitai, T., Richter, D., Or, Y., Shoham, Z., Hurwitz, A., Har-Vardi, I., Gavish, M., Ben-Meir, A., and Buxboim, A. (2020). Automated evaluation of human embryo blastulation
and implantation potential using deep-learning.
Advanced Intelligent Systems, 2(2):2000080. https://doi.org/10.1002/aisy.202000080
Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). ImageNet classification with deep convolutional neural networks. Proceedings of the 2012 Advances in Neural Information Processing Systems 25 (NIPS 2012); December 3-8, 2012; Lake Tahoe, NV, USA, p. 84-90.
Lecun, Y., Bottou, L., Bengio, Y., and Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2,278-2,324. https://doi.org/10.1109/5.726791
Liao, Q., Zhang, Q., Feng, X., Huang, H., Xu, H., Tian, B., Liu, J., Yu, Q., Guo, N., Liu, Q., Huang, B., Ma, D., Ai, J., Xu, S., and Li, K. (2021). Development of deep learning algorithms for predicting blastocyst formation and quality by time-lapse monitoring. communications biology, 4(1):415. https://doi.org/10.1038/s42003-021-01937-1
Liu, H., Zhang, Z., Gu, Y., Dai, C., Shan, G., Song, H., Li, D., Chen, W., Lin, G., and Sun, Y. (2023). Development and evaluation of a live birth prediction model for evaluating human blastocysts from a retrospective study. eLife, 12:e83662. https://doi.org/10.7554/eLife.83662
Loewke, K., Cho, J.H., Brumar, C.D., Maeder-York, P., Barash, O., Malmsten, J.E., Zaninovic, N., Sakkas, D., Miller, K.A., Levy, M., and VerMilyea, M.D. (2022). Characterization of an artificial intelligence model for ranking static images of blastocyst stage embryos. Fertility and Sterility, 117(3):528-535. https://doi.org/10.1016/j.fertnstert.2021.11.022
Milyea, M.V., Hall, J.M.M., Diakiw, S.M., Johnston, A., Nguyen, T., Perugini, D., Miller, A., Picou, A., Murphy, A.P., and Perugini, M. (2021). Development of an artificial intelligence-based assessment model for prediction of embryo viability using static images captured by optical light microscopy during IVF. Human Reproduction, 35(4):770-784. https://doi.org/10.1093/humrep/deaa013
Pan, S.J. and Yang, Q. (2010). A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22(10):1,345-1,359. https://doi.org/10.1109/TKDE.2009.191
Rad, R.M., Saeedi, P., Au, J., and Havelock, J. (2019). BLAST-NET: Semantic segmentation of human blastocyst components via cascaded atrous pyramid and dense progressive upsampling. 2019 IEEE International Conference on Image Processing (ICIP); September 22-25, 2019; Taipei, Taiwan, p.1865-1869. https://doi.org/10.1109/ICIP.2019.8803139
Radford, A., Narasimhan, K., Salimans, T., and Sutskever, I. (2018). Improving language understanding by generative pre-training. OpenAI.
Simonyan, K. and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv, 1409.
Srivastava, R., Greff, K., and Schmidhuber, J. (2015). Highway networks. arXiv, 1505.00387.
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2015). Rethinking the inception architecture for computer vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR); June 27-30, 2016; Las Vegas, NV, USA, p. 2,818-2,826. https://doi.org/10.1109/CVPR.2016.308
Tan, M. and Le, Q.V. (2019). EfficientNet: Rethinking model scaling for convolutional neural networks. In Proceedings of the 36th International Conference on Machine Learning (ICML 2019); June 9-15, 2019; Long Beach, CA, USA, p. 6105-6114.
Zeiler, M.D. and Fergus, R. (2014). Visualizing and understanding convolutional networks. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds) Computer Vision - ECCV 2014. LNCS, 8,689. https://doi.org/10.1007/978-3-319-10590-1_53
