International Journal of Advanced Culture Technology

The International Promotion Agency of Culture Technology (국제문화기술진흥원)
권호 표지
DOI QR코드

DOI QR Code

Hair Segmentation using Optimized Fully Connected Network and 3D Hair Style

  • Kim, Junghyun (Department of Media Software, Sungkyul University, XICOM LAB) ;
  • Lee, Yunhwan (Department of Media Software, Sungkyul University, XICOM LAB) ;
  • Chin, Seongah (Department of Media Software, Sungkyul University, XICOM LAB)
  • Received : 2021.11.26
  • Accepted : 2021.12.07
  • Published : 2021.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

3D modeling of the human body is an integral part of computer graphics. Among them, several studies have been conducted on hair modeling, but there are generally few studies that effectively implement hair and face modeling simultaneously. This study has the originality of providing users with customized face modeling and hair modeling that is different from previous studies. For realistic hair styling, We design and realize hair segmentation using FCN, and we select the most appropriate model through comparing PSPNet, DeepLab V3+, and MobileNet. In this study, we use the open dataset named Figaro1k. Through the analysis of iteration and epoch parameters, we reach the optimized values of them. In addition, we experiment external parameters about the location of the camera, the color of the lighting, and the presence or absence of accessories. And the environmental analysis factors of the avatar maker were set and solutions to problems derived during the analysis process were presented.

Keywords

Acknowledgement

This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science and ICT (No. 2021R1F1A104540111).

References

  1. Jahanzeb Hafeez, Seunghyun Lee, Soonchul Kwon, and Alaric Hamacher, "Image Based 3D Reconstruction of Texture-less Objects for VR Contents," The International Journal of Advanced Smart Convergence, 6(1), 9-17, 2017. DOI: 10.7236/IJASC.2017.6.1.9
  2. Y. S. Kang, J. Y. Kang, H. Y. Yoon, J. J. Hwang, Y. H. Chang, and C. B. Ko, "A Study on the AR Game Analysis and Business Model," The Journal of the Convergence on Culture Technology, 2(4), 49-54, 2016. DOI: 10.17703/JCCT.2016.2.4.49
  3. M. Chai, T. Shao, H. Wu, Y. Weng, and K. Zhou, "Autohair: Fully automatic hair modeling from a single image," ACM Transactions on Graphics, 35(4), 1-12, 2016. DOI: 10.1145/2897824.2925961
  4. S. Lee, "Deep structured learning: architectures and applications," International Journal of Advanced Culture Technology, 6(4), 262-265, 2018. DOI: 10.17703//IJACT2018.6.4.262
  5. Sung-Ho Kim, "Development of the 3D Hair Style Simulator using Augmented Reality," Journal of Digital Convergence, 13(1), 249-255, 2015. DOI: 10.14400/JDC.2015.13.1.249
  6. Y. Huang and J. Y. Song, "Recognition model of road signs using image segmentation algorithm," The Journal of The Institute of Internet, Broadcasting and Communication, 13(2), 233-237, 2013. DOI: 10.7236/JIIBC.2013.13.2.233
  7. J. W. Lee and I. K. Park, "Retrieval-Based Hair Model Augmentation for 3D Face Modeling," Journal of KIISE, 46(5), 405-412, 2019. DOI: 10.5626/JOK.2019.46.5.405
  8. Unity Asset Store. https://assetstore.unity.com/packages/tools/modeling/avatar-maker-pro-3d-avatar-from-a-single-selfie-134800
  9. H. Kim, and Y. Chung, "Effect of Input Data Video Interval and Input Data Image Similarity on Learning Accuracy in 3D-CNN," International Journal of Internet, Broadcasting and Communication, 13(2), 208-217, 2021. DOI: 10.7236/IJIBC.2021.13.2.208
  10. J. Long, E. Shelhamer, and T. Darrell, "Fully convolutional networks for semantic segmentation," Proc. of IEEE Conference on Computer Vision and Pattern Recognition, 3431-3440, 2015. DOI: 10.1109/tpami.2016.2572683
  11. Share Your Project. http://projects.i-ctm.eu/it/progetto/figaro-1k
  12. H. Zhao, J. Shi, X. Qi, X. Wang, and J. Jia, "Pyramid Scene Parsing Network," Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2881-2890, 2017. DOI: 10.1109/CVPR.2017.660
  13. B. Yu, L. Yang and F. Chen, "Semantic Segmentation for High Spatial Resolution Remote Sensing Images Based on Convolution Neural Network and Pyramid Pooling Module," IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 11(9), 3252-3261, 2018. DOI: 10.1109/JSTARS.2018.2860989
  14. L. C. Chen, Y. Zhu, G. Papandreou, F. Schroff and H. Adam, "Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation," Proceedings of the European Conference on Computer Vision (ECCV), 801-818, 2018. DOI: 10.1007/978-3-030-01234-2_49
  15. M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L. C. Chen, "MobileNetV2: Inverted Residuals and Linear Bottlenecks," The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 4510-4520, 2018. DOI: 10.1109/CVPR.2018.00474
  16. H. S. Hwang, J. W. Jung, Y. H. Kim and Y. S. Choe, "A Study on Improving Speed of Interesting Region Detection Based on Fully Convolutional Network," Proc. of the Conference of The Korea Society of Broad Engineers, 322-325, 2018.