Image Colorization Algorithm based on Dense Neural Network
Volume 15, Number 1, January 2019, pp. 270-280 DOI: 10.23940/ijpe.19.01.p27.270280
Pinle Qin, Na Zhang, Jianchao Zeng, and Yulong Song
School of Data Science and Technology, North University of China, Taiyuan, 030051, China (Submitted on October 21, 2018; Revised on November 23, 2018; Accepted on December 24, 2018)
Abstract:
In most scenes, color images have richer information than grayscale images. This paper presents a method of grayscale image pseudo coloring that constructed and trained an end-to-end deep learning model based on dense neural network aims to extract all kinds of information and features (such as classification information and detail feature information). Entering a grayscale picture to the trained network can generate a full and vibrant vivid color picture. By constantly training the entire network on a wide variety of data sets, you will get the most adaptable, high-performance pseudo color network. The experiments show that the method proposed has a higher utilization of features and can obtain a satisfactory coloring effect. Compared with the current advanced pseudo color methods, it has also made remarkable improvements, and to a certain extent, the problem during the coloring processing have been improved, such as color overflow, loss of details, low contrast etc.
References: 28
- R. Gonzalez and R. Woods, “Digital Image Processing,” Publishing House of Electronics Industry, Beijing, 2011
- A. Levin, D. Lischinski, and Y. Weiss, “Colorization using Optimization,” ACM SIGGRAPH, Vol. 23, No. 3, pp. 689-694, 2004
- P. Lagodziński and B. Smolka, “Medical Image Colorization,” Journal of Medical Informatics & Technologies, Vol. 11, pp. 47-57, November 2007
- A. A. Shah, M. Gandhi, and K. M. Shah, “Medical Image Colorization using Optimization Technique,” Acta Medica Okayama, Vol. 62, No. 141, pp. 235-248, 2013
- F. Li, L. Zhu, L. Zhang, Y. Liu, and A. Wang, “Pseudo-Colorization of Medical Images based on Two-Stage Transfer Model,” Chinese Journal of Stereology & Image Analysis, Vol. 18, No. 2, pp. 135-144, February 2013
- T. Welsh, M. Ashikhmin, and K. Mueller, “Transferring Color to Grayscale Images,” Acm Transactions on Graphics, Vol. 21, No. 3, pp. 277-280, July 2002
- X. Liu, L. Wan, Y. Qu, T. T. Wong, and S. Lin, “Intrinsic Colorization,” Acm Siggraph Asia, Vol. 27, No. 5, pp. 1-9, December 2008
- Y. Liu, C. Michael, U. Matt, and R. Szymon, “AutoStyle: Automatic Style Transfer from Image Collections to Users’ Images,” Eurographics Symposium on Rendering Eurographics Association, Vol. 33, No. 4, pp. 21-31, July 2014
- Y. Morimoto, Y. Taguchi, and T. Naemura, “Automatic Colorization of Grayscale Images using Multiple Images on the Web,” in Proceedings of the SIGGRAPH 2009: Talks ACM, pp. 1-1, New York, USA, August 2009
- R. Irony, D. Cohen-Or, and D. Lischinski, “Colorization by Example,” Eurographics Symposium on Rendering Techniques, Konstanz, Germany, Vol. 5, No. 10, pp. 201-210, June 2005
- Z. Cheng, Q. Yang, and B. Sheng, “Deep Colorization,” in Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), pp. 415-423, Santiago, Chile, December 2015
- A. Deshpande, J. Rock, and D. Forsyth, “Learning Large-Scale Automatic Image Colorization,” in Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), pp. 567-575, Santiago, Chile, 2015
- R. Zhang, P. Isola, and A. A. Efros, “Colorful Image Colorization,” in Proceedings of the European Conference on Computer Vision (ECCV), pp. 649-666, Amsterdam, The Netherlands, October 2016
- K. Simonyan and A. Zisserman, “Very Deep Convolutional Networks for Large-Scale Image Recognition,” arXiv Preprint arXiv: 1409.1556, September 2014
- O. Ronneberger, P. Fischer, and T. Brox, “U-Net: Convolutional Networks for Biomedical Image Segmentation,” in Proceedings of the 2015 International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 234-241, Munich, Germany, October 2015
- R. Zhang, J. Y. Zhu, P. Isola, X. Geng, A. S. Lin, T. Yu, et al., “Real-Time User-Guided Image Colorization with Learned Deep priors,” Acm Transactions on Graphics, Vol. 36, No. 4, pp. 119:1-119:11, July 2017
- S. Lizuka, E. Simo-Serra, and H. Ishikawa, “Let There Be Color!: Joint End-to-End Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification,” Acm Transactions on Graphics, Vol. 35, No. 4, pp. 1-11, July 2016
- P. Qin, Z. Cheng, Y. Cui, J. Zhang, and Q. Miao, “Research on Image Colorization Algorithm based on Residual Neural Network,” in Proceedings of the CCF Chinese Conference on Computer Vision, pp. 608-621, Tianjin, China, October 2017
- K. He, X. Zhang, S. Ren, and J. Sun, “Deep Residual Learning for Image Recognition,” in Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770-778, Las Vegas, USA, June 2016
- G. Huang, Z. Liu, and K. Q. Weinberger, “Densely Connected Convolutional Networks,” in Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1-9, Honolulu, Hawaii, USA, July 2017
- A. Krizhevsky, I. Sutskever, and G. E. Hinton, “ImageNet Classification with Deep Convolutional Neural Networks,” in Proceedings of the 25th International Conference on Neural Information Processing Systems, pp. 1097-1105, Nevada, December 2012
- C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, et al., “Going Deeper with Convolutions,” in Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1-9, Boston, MA, USA, June 2015
- R. K. Srivastava, K. Greff, and J. Schmidhuber, “Highway Networks,” arXiv Preprint arXiv:1505.00387, May 2015
- G. Huang, Y. Sun, Z. Liu, D. Sedra, and K. Q. Weinberger, “Deep Networks with Stochastic Depth,” in Proceedings of the 2016 European Conference on Computer Vision (ECCV), pp. 646-661, Amsterdam, Netherlands, October 2016
- G. Larsson, M. Maire, and G. Shakhnarovich, “FractalNet: Ultra-Deep Neural Networks without Residuals,” arXiv Preprint arXiv:1605.07648, May 2016
- B. Zhou, A. L. Garcia, J. Xiao. A. Torralba, and A. Oliva, “Learning Deep Features for Scene Recognition using Places Database,” in Proceedings of the 27th International Conference on Neural Information Processing Systems, pp. 487-495, Montréal, CANADA, December 2014
- J. Deng, W. Dong, R. Socher, L. J. Li, K. Li, and F. Li, “ImageNet: A Large-Scale Hierarchical Image Database,” in Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 248-255, Florida, USA, August 2009
- M. Abadi, A. Agarwal, P. Barham. E. Brevdo, and Z. F. Chen, C. Citro, et al., “Tensorflow: Large-Scale Machine Learning on Heterogeneous Distributed Systems,” arXiv Preprint arXiv:1603.04467, March 2016
Please note : You will need Adobe Acrobat viewer to view the full articles. |