Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Motion Capture using both Human Structural Characteristic and Inverse Kinematics

인체의 구조적 특성과 역운동학을 이용한 모션 캡처

  • Seo, Yung-Ho (School of Electronics and Computer Engineering, Chonnam National University) ;
  • Doo, Kyoung-Soo (Dept. of Image Engineering, Graduate School of Advanced Image Science, Multimedia, and film, Chung-Ang University) ;
  • Choi, Jong-Soo (Dept. of Image Engineering, Graduate School of Advanced Image Science, Multimedia, and film, Chung-Ang University) ;
  • Lee, Chil-Woo (School of Electronics and Computer Engineering, Chonnam National University)
  • 서융호 (전남대학교 전자컴퓨터공학부) ;
  • 두경수 (중앙대학교 첨단영상대학원 영상학과) ;
  • 최종수 (중앙대학교 첨단영상대학원 영상학과) ;
  • 이칠우 (전남대학교 전자컴퓨터공학부)
  • Published : 2010.03.25
Download PDF
⟨ Previous Next ⟩

Abstract

Previous hardware devices to capture human motion have many limitations; expensive equipment, complexity of manipulation or constraints of human motion. In order to overcome these problems, real-time motion capture algorithms based on computer vision have been actively proposed. This paper presents an efficient analysis method of multiple view images for real-time motion capture. First, we detect the skin color regions of human being, and then correct the image coordinates of the regions by using camera calibration and epipolar geometry. Finally, we track the human body part and capture human motion using kalman filter. Experimental results show that the proposed algorithm can estimate a precise position of the human body.

기존 모션 캡쳐의 경우, 고가의 장비나 사용의 복잡도, 동작자의 움직임 제한 등 모션 캡쳐의 어려움이 있었다. 최근 실시간으로 모션 캡쳐가 가능한 컴퓨터 비젼 기반 시스템에 대한 연구가 활발히 진행되고 있다. 본 논문에서는 다시점 영상으로부터 쉽고, 빠르게 추출할 수 있는 피부색과 정확한 3차원 복원을 위한 2차원 영상 좌표 보정을 사용하여 효율적인 다시점 영상 분석 알고리즘을 제안한다. 동작자의 피부색을 검출하고, 카메라 보정 및 에피폴라 기하학 정보를 이용하여 보다 정확한 영상 분석, 그라고 칼만 필터(Kalman filter)를 사용한 추적 등을 통해 보다 안정적인 모션 캡쳐가 가능하게 된다. 실험결과를 통하여, 제안된 방법은 보다 정확한 위치 추정 및 살시간 모션 캡쳐를 위한 알고리즘임을 보여주고 있다.

Keywords

References

  1. http://www.xbox.com/en-US/live/projectnatal/
  2. T. B. Moreslund, A. Hilton, V. Kruger, "A survey of advances in vision-based human motion capture and analysis," Int. J. Computer Vision and Image Understanding, Vol. 104, Issues 2-3, pp. 90-126, 2006. https://doi.org/10.1016/j.cviu.2006.08.002
  3. R. Poppe, "Vision-based human motion analysis: An overview," Int. J. Computer Vision and Image Understanding, Vol. 108, Issues 1-2, pp. 4-18, 2007. https://doi.org/10.1016/j.cviu.2006.10.016
  4. 이민기, 박성규, 박근표, 양선우, 이범렬, "모션캡처 기술 동향," ETRI-전자통신동향분석, 제22권, 제4호, 2007.
  5. A. Menache, "Understanding Motion Capture for Computer Animation and Video Games," Morgan Kaufmann Publishers, 2000.
  6. 이민기, "디지털 3D애니메이션지원을 위한 첨단영상제작장비 활용방안 연구," 세종대학교 영상대학원, 2003.
  7. A. Agarwal, B. Triggs, "Recovering 3D Human Pose from Monocular Images," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 28, No. 1, pp. 44-58, Jan. 2006. https://doi.org/10.1109/TPAMI.2006.21
  8. C. Smininchisescu, A. Telea, "Human Pose Estimation from Silhouette: A Consistent Approach Using Distance Level Sets," Int. Conf. on Computer Graphics, Visualization and Computer Vision, 2002.
  9. Y. Kameda, "Human Pose and Motion Estimation with a Three Dimensional Articulated Object Model," Ph. D. dissertation, Kyoto University, Kyoto, 1999.
  10. M. Tong, Y. Liu, T. S. Huang, "3D Human Model and Joint Parameter Estimation from Monocular Image," Pattern Recognition Letters, Vol. 28, No. 7, pp. 797-805, May, 2007. https://doi.org/10.1016/j.patrec.2006.11.011
  11. M. W. Lee, R. Nevatia, "Integrating Component Cues for Human Pose Tracking," Int. Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, pp. 41-48, Oct. 2005.
  12. P. Correa, J. Czyz, F. Marques, T. Umeda, X. Marichal, B. Macq, "Bayesian Approach for Morphology-Based 2-D Human Motion Capture," IEEE Trans. on Multimedia, Vol. 9, No. 4, pp. 754-765, June, 2007. https://doi.org/10.1109/TMM.2007.893342
  13. 서융호, 박유신, 구떠올라, 두경수, 최종수, "모션 캡처를 위한 다시점 영상의 효율적인 분석법," 대한전자공학회논문지, 제45권 SP편 제6호, pp. 44-56, 2008년 11월.
  14. T. Chaichana, M. Sangworasil, C. Pintavisrooj, S. Aootaphao, "Accelerate a Dlt Motion Capture System with Quad-Tree Searching Scheme," Int. Sym. on Communications and Information Technologies, pp. 1035-1038, Oct. 2006.
  15. S. E. Kim, C. J. Park, I. H. Lee, "A Tracking Method of End-effectors in a Vision-based Marker-free Motion Capture System," Int. Conf. on Cybernatcis and Intelligent Systems, pp. 129-134, Dec. 2004.
  16. F. Guo, G. Qian, "Human Pose Inference from Stereo Cameras," IEEE Workshop on Applications of Computer Vision, pp. 37-37, Feb. 2007.
  17. A. Sundaresan, R. Chellappa, "Model Driven Segmentation of Articulating Humans in Laplacian Eigenspace," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 30, No. 10, pp. 1771-1785, Oct. 2008. https://doi.org/10.1109/TPAMI.2007.70823
  18. H. Ohbuch, J. K. Tan, S. Ishikawa, "Recovering Huamn Actions using Eigenspace," Int. Joint Conf. on Society of Instrument and Control Engineers/Institute of Control, Aumation and System Engineers, pp. 2698-2701, Oct. 2006.
  19. R. Hartley, A. Zisserman, "Multiple View Geometry," Cambridge University Press, 2000.
  20. D. Tolani, A. Goswami, N. I. Badler, "Real-time Inverse Kinematics Techniques for anthropomorphic limbs," Graphical Models and Image Processing, Vol. 62, Issues 5, pp. 353-388, Sept. 2000. https://doi.org/10.1006/gmod.2000.0528
  21. J. U. Korein, N. I. Balder, "Techniques for Generating the Goal-Directed Motion of Articulated Structures," IEEE Computer Graphics and Applications, Vol. 2, Issues 9, pp. 71-81, Nov. 1982.
  22. http://www.nbb.cornell.edu/neurobio/land/OldStudentProjects/cs490-97to98/yen/
  23. W. H. Press, S. A. Teukolosky, W. T. Vetterling, B. P. Flannery, "Numerical Recipes in C++," Cambridge University Press, 2002.
  24. P. Peer, J. Kovac, F. Solina, "Human skin colour clustering for face detection," IEEE Conf. on Computer as a Tool EUROCON2003, Vol. 2, pp. 144-148, Sept. 2003.