Improving Font Effect Generation based on Pyramid Style Feature

doi:10.23940/ijpe.20.08.p14.12711278

Int J Performability Eng ›› 2020, Vol. 16 ›› Issue (8): 1271-1278.doi: 10.23940/ijpe.20.08.p14.12711278

Previous Articles Next Articles

Improving Font Effect Generation based on Pyramid Style Feature

Feiyu Zhang^a,b, Yi Yang^b, Weixing Huang^b, Guigang Zhang^b, and Jian Wang^b,*

^aSchool of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100049, China;
^bInstitute of Automation, Chinese Academy of Sciences, Beijing, 100190, China

Submitted on ; Revised on ; Accepted on
Contact: *E-mail address: jian.wang@ia.ac.cn
About author:yu Zhang is a graduate student at the University of Chinese Academy of Sciences. His research interests include style transfer and deep learning.Yi Yang is an Assistant professor at the Institute of Automation, Chinese Academy of Sciences. His research interests include data mining and visualization.Weixing Huang is an Assistant professor at the Institute of Automation, Chinese Academy of Sciences. Her research interests include literature digitization.Guigang Zhang is a Professor at the Institute of Automation, Chinese Academy of Sciences. His research interests include prognostics and health management.Jian Wang is a Professor at the Institute of Automation, Chinese Academy of Sciences. His research interests include deep learning and control theory.

Abstract

Abstract: The task of font effect generation is stylizing the shape and texture of style images into font images. There exist some methods to handle this task. However, stylized font images become unrecognized when the glyph structure is quite complicated. This paper proposes a font effect generation model based on pyramid style feature. Morphology operations are utilized to improve the transferring effect. Experiments show that our proposed method is more suitable for stylizing complex glyph images than other state-of-the-arts methods.

Key words: font effect generation, pyramid feature, complex glyph

Feiyu Zhang, Yi Yang, Weixing Huang, Guigang Zhang, and Jian Wang. Improving Font Effect Generation based on Pyramid Style Feature [J]. Int J Performability Eng, 2020, 16(8): 1271-1278.

Add to citation manager EndNote|Reference Manager|ProCite|BibTeX|RefWorks

References

1. S. Yang, Z. Wang, Z. Wang, N. Xu, J. Liu,Z. Guo, “Controllable Artistic Text Style Transfer via Shape-Matching GAN,” in Proceedings of2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 4441-4450, Seoul, Korea(South), 2019
2. P. Isola, J. Zhu, T. Zhou,A. A. Efros, “Image-to-Image Translation with Conditional Adversarial Networks,” inProceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5967-5976, Honolulu, HI, 2017
3. J. Zhu, T. Park, P. Isola,A. A. Efros, “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks,” inProceedings of 2017 IEEE International Conference on Computer Vision (ICCV), pp. 2242-2251, Venice, 2017
4. J. Zhu, R. Zhang, D. Pathak, T. Darrell, A. A. Efros, O. Wang, et al., “Toward Multimodal Image-to-Image Translation,” inProceedings of Advances in Neural Information Processing Systems Conference, pp. 465-476, 2017
5. X. Huang, M. Liu, S. Belongie,J. Kautz, “Multimodal Unsupervised Image-to-Image Translation,” inProceedings of the European Conference on Computer Vision (ECCV), pp. 172-189, 2018
6. Y. Choi, Y. Uh, J. Yoo,J. W. Ha, “Stargan v2: Diverse Image Synthesis for Multiple Domains,” in Proceedings of2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 8188-8197, 2020
7. L. A. Gatys, A. S. Ecker,M. Bethge, “Image Style Transfer using Convolutional Neural Networks,” inProceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2414-2423, Las Vegas, NV, 2016
8. C. Li and M. Wand, “Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis,” inProceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2479-2486, Las Vegas, NV, 2016
9. J. Johnson, A. Alahi,F. Li, “Perceptual Losses for Real-Time Style Transfer and Super-Resolution,” inProceedings of the European Conference on Computer Vision (ECCV), pp. 694-711, 2016
10. D. Ulyanov, V. Lebedev, A. Vedaldi,V. S. Lempitsky, “Texture Networks: Feed-forward Synthesis of Textures and Stylized Images,” ICML, Vol. 1, No.2, p. 4, 2016
11. Y. Li, C. Fang, J. Yang, Z. Wang, X. Lu,M. Yang, “Diversified Texture Synthesis with Feed-Forward Networks,” inProceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 266-274, Honolulu, HI, 2017
12. X. Huang and S. Belongie, “Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization,” inProceedings of 2017 IEEE International Conference on Computer Vision (ICCV), pp. 1510-1519, Venice, 2017
13. Y. Li, C. Fang, J. Yang, Z. Wang, X. Lu,M. H. Yang, “Universal Style Transfer via Feature Transforms,” inProceedings of Advances in Neural Information Processing Systems Conference, pp. 386-396, 2017
14. S. Yang, J. Liu, Z. Lian,Z. Guo, “Awesome Typography: Statistics-based Text Effects Transfer,” inProceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2886-2895, Honolulu, HI, 2017
15. S. Azadi, M. Fisher, V. Kim, Z. Wang, E. Shechtman,T. Darrell, “Multi-Content GAN for Few-Shot Font Style Transfer,” inProceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7564-7573, Salt Lake City, UT, 2018
16. Y. Men, Z. Lian, Y. Tang,J. Xiao, “A Common Framework for Interactive Texture Transfer,” inProceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6353-6362, Salt Lake City, UT, 2018
17. Y. Men, Z. Lian, Y. Tang,J. Xiao, “DynTypo: Example-based Dynamic Text Effects Transfer,” inProceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5863-5872, Long Beach, CA, USA, 2019
18. S. Yang, J. Liu, W. Wang,Z. Guo, “TET-GAN: Text Effects Transfer via Stylization and Destylization,” in Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33, No. 1, pp. 1238-1245, July 2019
19. Y. Gao, Y. Guo, Z. Lian, Y. Tang,J. Xiao, “Artistic Glyph Image Synthesis via One-Stage Few-Shot Learning,” ACM Transactions on Graphics, Vol. 38, No. 6, pp. 1-12, November 2019
20. K. He, X. Zhang, S. Ren,J. Sun, “Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 37, No. 9, pp. 1904-1916, September 2015
21. S. Yang, W. Wang,J. Liu, “TE141K: Artistic Text Benchmark for Text Effect Transfer,”IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020

Improving Font Effect Generation based on Pyramid Style Feature

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 0

Recommended 0