Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

An Efficient Analysis Method of Multiple View Images for Motion Capture

모션 캡쳐를 위한 다시점 영상의 효율적인 분석법

  • Seo, Yung-Ho (Dept. of Image Engineering, GSAIM, Chung-Ang University) ;
  • Park, You-Shin (Dept. of Image Engineering, GSAIM, Chung-Ang University) ;
  • Koo, Ddeo-Ol-Ra (Dept. of Image Engineering, GSAIM, Chung-Ang University) ;
  • Doo, Kyoung-Soo (Dept. of Image Engineering, GSAIM, Chung-Ang University) ;
  • Choi, Jong-Soo (Dept. of Image Engineering, GSAIM, Chung-Ang University)
  • 서융호 (중앙대학교 첨단 영상대학원 영상학과) ;
  • 박유신 (중앙대학교 첨단 영상대학원 영상학과) ;
  • 구떠올라 (중앙대학교 첨단 영상대학원 영상학과) ;
  • 두경수 (중앙대학교 첨단 영상대학원 영상학과) ;
  • 최종수 (중앙대학교 첨단 영상대학원 영상학과)
  • Published : 2008.11.25
Download PDF
⟨ Previous Next ⟩

Abstract

Previous hardware devices to capture human motion have many limitations; expensive equipment, complexity of manipulation or constraints of human motion. In order to overcome these problems, real-time motion capture algorithms based on computer vision have been actively proposed. This paper presents an efficient analysis method of multiple view images for real-time motion capture. First, we detect the skin color regions of human being, and then correct the image coordinates of the regions by using camera calibration and epipolar geometry. Finally, we track the human body part and capture human motion using kalman filter. Experimental results show that the proposed algorithm can estimate a precise position of the human body.

기존 모션 캡쳐의 경우, 고가의 장비나 사용의 복잡도, 동작자의 움직임 제한 등 모션 캡쳐의 어려움이 있었다. 최근 실시간으로 모션 캡쳐가 가능한 컴퓨터 비젼 기반 시스템에 대한 연구가 활발히 진행되고 있다. 본 논문에서는 다시점 영상으로부터 쉽고, 빠르게 추출할 수 있는 피부색과 정확한 3차원 복원을 위한 2차원 영상 좌표 보정을 사용하여 효율적인 다시점 영상 분석 알고리즘을 제안한다. 동작자와 피부색을 검출하고, 카메라 보정 및 에피폴라 기하학 정보를 이용하여 보다 정확한 영상 분석, 그리고 칼만 필터(Kalman filter)를 사용한 추적 등을 통해 보다 안정적인 모션 캡쳐가 가능하게 된다. 실험결과를 통하여, 제안된 방법은 보다 정확한 위치 추정 및 실시간 모션 캡쳐를 위한 알고리즘임을 보여주고 있다.

Keywords

References

  1. T. B. Moeslund, A. Hilton, V. Kruger, "A survey of advances in vision-based human motion capture and analysis," Int. J. Computer Vision and Image Understaning, Vol. 104, Issues 2-3, pp. 90-126, 2006 https://doi.org/10.1016/j.cviu.2006.08.002
  2. R. Poppe, "Vision-based human motion analysis: An overview," Int. J. Computer Vision and Image Understanding, Vol. 108, Issues 1-2, pp. 4-18, 2007 https://doi.org/10.1016/j.cviu.2006.10.016
  3. 이민기, 박성규, 박근표, 양선우, 이범렬, "모션캡처 기술 동향," 전자통신동향분석, 제22권, 제4호, 2007
  4. A. Agarwal, B. Triggs, "Recovering 3D Human Pose from Monocular Images," IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 28, No. 1, pp. 44-58, Jan. 2006 https://doi.org/10.1109/TPAMI.2006.21
  5. G. Rogez,, C. Orrite-Urunuela, and J. Martinez del Rincon, "A spatio-temporal 2D-models framework for human pose recovery in monocular sequences," Pattern Recognition, Vol. 41, pp. 2926-2944,, 2008 https://doi.org/10.1016/j.patcog.2008.02.012
  6. C. Smininchisescu, A. Telea, "Human pose Estimation From Silhouette: A Consistent Approach Using Distanace Level Sets," Int. Conf. on Computer Graphics, Visualization and Computer Vision, 2002
  7. M. W. Lee, R. Nevatia, "Integrating Component Cues for Human Pose Tracking," Int Workshop on VS-PETS, pp. 41-48, Oct. 2005
  8. T. Chaichana, M. Sangworasil, C. Pintavisrooj, S. Aootaphao, "Acclerate a Dlt Motion Capture System With Quad-Tree Searching Scheme," Int. Sym. on Communications and Information Technologies, pp. 1035-1038, Oct. 2006
  9. S. E. Kim, C. J. Park, I. H. Lee, "A Tracking Method of End-effectors in a Vision-based Marker-free Motion Capture System," Int. Conf. on Cybernatics and Intelligent Systems, pp. 129-134, Dec. 2004
  10. N. Date, H. Yoshimoto, D. Arita, R. I. Taniquchi, "Real-time Human Motion Sensing based on Vision-based Inverse Kinematics for Interactive Applications," Int. Conf. on Pattern Recognition, Vol. 3, pp. 318-321, Aug. 2004
  11. A. Sundaresan, R. Chellappa, "Model driven segmentation of articulating humans in Laplacian Eigenspace," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 30, Issue 8, 2008
  12. F. Guo, G. Qian, "Human Pose Inference from Stereo Cameras," IEEE Workshop on Applications of Computer Vision, pp. 37-37, Feb. 2007
  13. G. Welch, G. Bishop, "An Introduction to the Kalman Filter," UNC-Chapel Hill, TR 95-041, July, 2006
  14. R. Hartley, A. Zisserman, "Multiple View Geometry," Cambridge Univ. Press, 2000
  15. 한윤상, 서융호, 두경수, 김진태, 최종수, "실세계 3차원 기하학 정보를 이용한 지시영역 추정 시스템의 구현 및 응용," 대한전자공학회논문지, 제45권 SP편 제2호, 2008년 3월
  16. Z. Zhang, "A flexible new technique for camera calibration," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 22, No. 11, 1330-1334, 2000 https://doi.org/10.1109/34.888718
  17. P. Azad, A. Ude, T. Asfour, G. Cheng, and R. Dillmann, "Stereo-based Markerless Human Motion Capture for Humanoid Robot Systems," IEEE Int. Conf. on Robotics and Automation, pp. 3951-3956, April, 2007
  18. E. Aguiar, C. Theobalt, C. Stoll, H. P. Seidel, "Marker-less 3D Feature Tracking for Mesh-based Human Motion Capture," Workshop on Human Motion, LNCS 4814, pp. 1-15, 2007
  19. L. Sigal, S. Sclaroff, V. Athitsos, "Estimation and Prediction of Evolving Color Distributions for Skin Segmentation Under Varying Illumination," IEEE Conf. on Computer Vision and Pattern Recognition, Vol. 2, pp. 152-159, June. 2000
  20. S. K. Singh, D. S. Chauhan, M. Vatsa, R. Singh, "A Robust Skin Color Based Face Detection Algorithm," Tamkang J. of Science and Engineering, Vol. 6, No. 4, pp. 227-234, 2003
  21. J. Yang, W. Lu, A. Waibel, "Skin-Color Modeling and Adaptation," Asian Conf. on Computer Vision, Vol. 2, pp. 687-694, Jan. 1998
  22. Q. Zhu, C. T. Wu, K. T. Cheng, Y. L. Wu, "An Adaptive Skin Model and Its Application to Objectionable Image Filtering," ACM Int. Conf. on Multimedia, pp. 56-63, Oct. 2004
  23. J. Heikkila, O. Silven, "A Four-step Camera Calibration Procedure with Implicit Image Correction," IEEE Conf. on Computer Vision and Pattern Recognition, pp. 1106-1112, Jun. 1997
  24. H. Ohbuch, J. K. Tan, S. Ishikawa, "Reconvering Human Actions Using Eigenspace," Int. Joint Conf. SICE-ICASE, pp. 2698-2701, Oct. 2006
  25. Y. H. Seo, S. H. Kim, K. S. Doo, J. S. Choi, "Optimal keyframe selection algorithm for three-dimensional reconstruction in uncalibrated multiple images," Optical Engineering, Vol. 47, Issue 5, May, 2008