Retinal Blood Vessel Segmentation on Style-augmented Images

  • M.D. Toth ELTE Eotvos Lorand University, Budapest, Hungary
  • A. Kiss J. Selye University, Komarno, Slovakia

Abstract

The average human lifespan increased dramatically in the second half of 20th century. It was mainly due to technological improvements, which were driven by the continuous war preparations, and while humans have got another 20 years to live, unfortunately there are some sad side effects added to the elderly life. Various diseases can attack the eye, our major organ responsible for receiving information, therefore many researches were devoted to examine these diseases, their early signs, and how could they be stopped. From the start of 21th century, methods aided by computer were more and more involved in these processes, up to the current trend of using Convolutional Neural Networks (CNNs). While supervised methods, CNNs do achieve accuracy which can be compared to a skilled ophtalmologist, they require a tremendous amount of labeled data which is sparse in medical fields because the amount of time and resources needed to create them. One natural solution is to augment the data present, that is, copying the distribution while adding a small variety, like coloring an image differently. That is, what our paper aims to explore, whether a texturing algorithm, the Neural Style Transfery can be used to make a data set richer, and therefore helping a classifier CNN to achieve better results.

References

[1] Al-Rawi, M., Qutaishat, M., and Arrar, M. An improved matched filter for blood vessel detection of digital retinal images. Computers in biology and medicine 37, 2 (2007), 262–267.
[2] Chaudhuri, S., Chatterjee, S., Katz, N., Nelson, M., and Goldbaum, M. Detection of blood vessels in retinal images using two-dimensional matched filters. IEEE Transactions on medical imaging 8, 3 (1989), 263–269.
[3] Drive: Digital retinal images for vessel extraction. https://drive.grand-challenge.org/.
[4] Fraz, M. M., Remagnino, P., Hoppe, A., Uyyanonvara, B., Rudnicka, A. R., Owen, C. G., and Barman, S. A. Blood vessel segmentation methodologies in retinal images–a survey. Computer methods and programs in biomedicine 108, 1 (2012), 407–
433.
[5] Gatys, L. A., Ecker, A. S., and Bethge, M. A neural algorithm of artistic style. arXiv preprint arXiv:1508.06576 (2015).
[6] Gatys, L. A., Ecker, A. S., and Bethge, M. Image style transfer using convolutional neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (2016), pp. 2414–2423.
[7] Gatys, L. A., Ecker, A. S., Bethge, M., Hertzmann, A., and Shechtman, E. Controlling perceptual factors in neural style transfer. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017), pp. 3985–3993.
[8] Jing, Y., Yang, Y., Feng, Z., Ye, J., Yu, Y., and Song, M. Neural style transfer: A review. IEEE transactions on visualization and computer graphics (2019).
[9] Johnson, J., Alahi, A., and Fei-Fei, L. Perceptual losses for real-time style transfer and super-resolution. In European conference on computer vision (2016), Springer, pp. 694–711.
[10] Li, Y., Wang, N., Liu, J., and Hou, X. Demystifying neural style transfer. arXiv preprint arXiv:1701.01036 (2017).
[11] Mar´ın, D., Aquino, A., Gegundez-Arias, M. E., and Bravo, J. M. ´ A new supervised method for blood vessel segmentation in retinal images by using gray-level and moment invariants-based features. IEEE Transactions on medical imaging 30, 1 (2010), 146–158.
[12] Nguyen, U. T., Bhuiyan, A., Park, L. A., and Ramamohanarao, K. An effective retinal blood vessel segmentation method using multi-scale line detection. Pattern recognition 46, 3 (2013), 703–715.
[13] Ny´ıri, T., and Kiss, A. Style transfer for dermatological data augmentation. In Proceedings of SAI Intelligent Systems Conference (2019), Springer, pp. 915–923.
[14] Orobix: Retina u-net. https://github.com/orobix/retina-unet.
[15] Risser, E., Wilmot, P., and Barnes, C. Stable and controllable neural texture synthesis and style transfer using histogram losses. arXiv preprint arXiv:1701.08893 (2017).
[16] Ronneberger, O., Fischer, P., and Brox, T. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention (2015), Springer, pp. 234–241.
[17] Simonyan, K., and Zisserman, A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014).
[18] Wang, C., Zhao, Z., Ren, Q., Xu, Y., and Yu, Y. Dense u-net based on patch-based learning for retinal vessel segmentation. Entropy 21, 2 (2019), 168.
[19] Zhang, B., Zhang, L., Zhang, L., and Karray, F. Retinal vessel extraction by matched filter with first-order derivative of gaussian. Computers in biology and medicine 40, 4 (2010), 438–445.
[20] Zheng, X., Chalasani, T., Ghosal, K., Lutz, S., and Smolic, A. Stada: Style transfer as data augmentation. arXiv preprint arXiv:1909.01056 (2019)
Published
2021-07-01
How to Cite
TOTH, M.D.; KISS, A.. Retinal Blood Vessel Segmentation on Style-augmented Images. Studia Universitatis Babeș-Bolyai Informatica, [S.l.], v. 66, n. 1, p. 74-85, july 2021. ISSN 2065-9601. Available at: <https://www.cs.ubbcluj.ro/~studia-i/journal/journal/article/view/65>. Date accessed: 30 nov. 2021. doi: https://doi.org/10.24193/subbi.2021.1.05.
Section
Articles