Journal of the Korean Society for Computer Game (한국컴퓨터게임학회논문지)

Korean Society for Computer Game (한국컴퓨터게임학회)
권호 표지

Acquisition of stereo composite images by depth keying in three dimensional space

3차원 공간에서의 깊이 키잉 방식을 이용한 스테레오 합성 영상 획득

  • Kwon, Soon-Chul (Dept. of 3D Contents, Graduate School of Information Contents Kwangwoon University) ;
  • Kim, Ji-Hyun (Dept. of 3D Contents, Graduate School of Information Contents Kwangwoon University) ;
  • Son, Kwang-Chul (Dept. of 3D Contents, Graduate School of Information Contents Kwangwoon University) ;
  • Hamacher, Alaric (Dept. of 3D Contents, Graduate School of Information Contents Kwangwoon University)
  • Received : 2013.03.03
  • Accepted : 2013.06.08
  • Published : 2013.06.30
⟨ Previous Next ⟩

Abstract

Chroma key technique which composes images by separating an object from its background in specific color has restrictions on color and space. Especially, unlike general chroma key technique, image composition for stereo 3D display requires natural image composition method in 3D space. The thesis attempted to compose images in 3D space using depth keying method which uses depth information of Microsoft Kinect. Object was converted into point cloud type in 3D space after separating it from its background according to depth information. The image in which 3D virtual background and object are composed obtained and played stereo 3D images using a virtual camera. The research showed naturally composed stereo 3D images as well as the feasibility of applying stereoscopic 3D mixed reality image technology.

Keywords

References

  1. B. Julesz, "Binocular depth perception of computer generated images", Bell Syst. Tech. J., Vol.39, No.5, pp. 1125-1163, 1960. https://doi.org/10.1002/j.1538-7305.1960.tb03954.x
  2. A. Smolic, P. Kauff, S. Knorr, A. Hornung, M. Kunter, M. Mueller, and M. Lang., "Three-Dimensional Video Postproduction and Processing", Proceedings of the IEEE, Vol.99, No.4, pp. 607-625, 2011. https://doi.org/10.1109/JPROC.2010.2098350
  3. Jisoo Kim, "A Study on 3D Stereoscopic Production Method and its Production", Journal of The Korean Society for Computer Game, Vol.2, No.20, pp. 25-32, 2010.
  4. Ilseok Won, Daewoong Rhee, "A Study on the Design of Fire-fighting Practice Serious Game Using Virtual Reality", Journal of The Korean Society for Computer Game, Vol.2, No.23, pp. 183-191, 2010.
  5. K. Fukui, M. Hayashi, and Y. Yamanouchi, "A virtual studio system for TV program production", SMPTE Journal, Vol.103, No. 6, pp. 386-390, 1994. https://doi.org/10.5594/J09670
  6. A.R. Smith, and J.F. Blinn, "Blue screen matting", SIGGRAPH 96 Conference Proceedings, pp 259-268, 1996.
  7. G.J. Iddan, and G. Yahav, "3D imaging in the studio", Proc. Of SPIE, Vol.4298 pp. 48-55, 2001. https://doi.org/10.1117/12.424913
  8. Francis, S.L.X., Anavatti, S.G., and Garratt, M., "Reconstructing the geometry of an bject using 3D TOF Camera", Merging Fields Of Computational Intelligence And Sensor Technology, pp. 13-17, 2011.
  9. Jing Zhang, Liang-Hao Wang, Dong-Xiao Li, and Ming Zhang, "High quality depth maps from stereo matching and ToF camera", Soft Computing and Pattern Recognition, pp.68-72, 2011.
  10. Jea-Doug Yoo, Cho, J.-H., In-Yeop Jang, and Lee, K.H., "3D content generation using a TOF camera and HDR light information", 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video, pp. 1-4, 2011.
  11. K. Khoshelham and S. O. Elberink, "Accuracy and resolution of kinect depth data for indoor mapping applications", Sensor, Vol. 12, No.2, pp.1437-1454, 2012. https://doi.org/10.3390/s120201437
  12. Soon Chul Kwon, Sung Jin Lee, Kwang Chul Son, Yeong Hu Jeong, and Seung Hyun Lee, "High resolution 3D object generation with a DSLR and depth information by Kinect", Journal of The Korean Society for Computer Game, Vol.26, No.1, pp.221-227, 2013.
  13. http://www.extremetech.com/gaming/148842-kinect-2-0-for-xbox-720- specs-leaked-1080p-camera-larger-field-of-view-usb-3-0
  14. Lie, W.-N., Chen, C.-Y., and Chen, W.-C., "2D to 3D video conversion with key-frame depth propagation and trilateral filtering", Electronics Letters, Vol. 47, No. 5, pp. 319-321, 2011. https://doi.org/10.1049/el.2010.2912
  15. Yang Lei, Song Xiaowei, Hou Chunping, Guo Jichang, Li Sumei, and Zhou Yuan, "A general multiview LCD stereo image composition method based on optical plate technology", 3DTV Conference: The True Vision, pp.1-4, 2009.