ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Spectrum-Based Color Reproduction Algorithm for Makeup Simulation of 3D Facial Avatar

  • Jang, In-Su (Creative Content Research Laboratory, ETRI) ;
  • Kim, Jae Woo (Creative Content Research Laboratory, ETRI) ;
  • You, Ju-Yeon (Creative Content Research Laboratory, ETRI) ;
  • Kim, Jin Seo (Creative Content Research Laboratory, ETRI)
  • Received : 2013.04.15
  • Accepted : 2013.09.23
  • Published : 2013.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Various simulation applications for hair, clothing, and makeup of a 3D avatar can provide more useful information to users before they select a hairstyle, clothes, or cosmetics. To enhance their reality, the shapes, textures, and colors of the avatars should be similar to those found in the real world. For a more realistic 3D avatar color reproduction, this paper proposes a spectrum-based color reproduction algorithm and color management process with respect to the implementation of the algorithm. First, a makeup color reproduction model is estimated by analyzing the measured spectral reflectance of the skin samples before and after applying the makeup. To implement the model for a makeup simulation system, the color management process controls all color information of the 3D facial avatar during the 3D scanning, modeling, and rendering stages. During 3D scanning with a multi-camera system, spectrum-based camera calibration and characterization are performed to estimate the spectrum data. During the virtual makeup process, the spectrum data of the 3D facial avatar is modified based on the makeup color reproduction model. Finally, during 3D rendering, the estimated spectrum is converted into RGB data through gamut mapping and display characterization.

Keywords

References

  1. A. Mansouri et al. "Representation and Estimation of Spectral Reflectances Using Projection on PCA and Wavelet Bases," Color Research Appl., vol. 33, no. 6, 2008, pp. 485-493. https://doi.org/10.1002/col.20442
  2. A. Mansouri, F. Marzani, and P. Gouto, "Neural Networks in Cascade Schemes for Spectral Reflectance Reconstruction," IEEE Int. Conf. Image Process. II, Genova, Italy, 2005, pp. 718-721.
  3. J.Y. Hardeberg, Acquisition and Reproduction of. Color Images: Colorimetric and Multispectral Approaches, doctoral dissertation, Ecole Nationale Superieure des Telecommunications, France, 2001.
  4. S. Tominaga and Y. Moriuchi, "Principal Component Analysis- Based Reflectance Analysis/Synthesis of Cosmetic Foundation," J. Imaging Sci. Technol., vol. 53, no. 6, 2009, pp. 060403_1-060403_8.
  5. S. Tominaga and Y. Moriuchi, "PCA-Based Reflectance Analysis/Synthesis of Cosmetic Foundation," 16th Color Imaging Conf., 2008, pp. 195-198.
  6. N. Ikeda et al., "Reflection Measurement and Visual Evaluation of the Luminosity of Skin Coated with Power Foundation," Color Research Appl., early view (online version), 2012.
  7. A.M. Rahman et al., "Augmented Rendering of Makeup Features in a Smart Interactive Mirror System for Decision Support in Cosmetic Products Selection," 14th IEEE/ACM Symp. Distrib. Simulation Real-Time Appl., 2010, pp. 203-206.
  8. K. Scherbaum et al., "Computer-Suggested Facial Makeup," Eurograph., vol. 30, no. 2, 2011, pp. 485-492.
  9. N. Tsumura et al., "Image-Based Skin Color and Texture Analysis/Synthesis by Extracting Hemoglobin and Melanin Information in the Skin," ACM Trans. Graph., vol. 22, 2003, pp. 770-779. https://doi.org/10.1145/882262.882344
  10. I. Jang et al., "User-Configured Monitor-to-Printer Color Reproduction," J. Imaging Sci. Technol., vol. 55, no. 2, 2011, pp. 020506_1-020506_10.
  11. H. Zeng and M. Nielsen, "Color Transformation Accuracy and Efficiency in ICC Color Management," Proc. IS&T/SID 9th Color Imaging Conf., IS&T, Springfield, VA, USA, 2001, pp. 224-232.
  12. ICC specification of International Color Consortium. http://www.color.org/specification/ICC1v43_2010-12.pdf
  13. S. Westland, C. Ripamonti, and V. Cheung, Computational Colour Science Using MATLAB, 2nd ed., Chichester: John Wiley & Sons, Ltd., 2012.
  14. J. Morovic, Color Gamut Mapping, Chichester: John Wiley & Sons, Ltd., 2008.
  15. B. Kang et al., "Gamut Compression and Extension Algorithms Based on Observer Experimental Data," ETRI J., vol. 25, no. 3, June 2003, pp. 156-170. https://doi.org/10.4218/etrij.03.0102.3315
  16. C. Sano et al., "Colour Difference for Complex Images," 11th Color Imaging Conf., pp. 121-125.

Cited by

  1. 다수의 인조피부를 이용한 파우더 고유색 측정 및 도포 패턴 표현이 가능한 메이크업 시뮬레이션 vol.19, pp.8, 2015, https://doi.org/10.6109/jkiice.2015.19.8.1859
  2. 3D bioprinting of skin: a state-of-the-art review on modelling, materials, and processes vol.8, pp.3, 2013, https://doi.org/10.1088/1758-5090/8/3/032001