KIPS Transactions on Software and Data Engineering (정보처리학회논문지:소프트웨어 및 데이터공학)

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

An Implementation of Real-Time Numeral Recognizer Based on Hand Gesture Using Both Gradient and Positional Information

기울기와 위치 정보를 이용한 손동작기반 실시간 숫자 인식기 구현

  • Received : 2012.08.01
  • Accepted : 2012.11.29
  • Published : 2013.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

An implementation method of real-time numeral recognizer based on gesture is presented in this paper for various information devices. The proposed algorithm steadily captures the motion of a hand on 3D open space with the Kinect sensor. The captured hand motion is simplified with PCA, in order to preserve the trace consistency and to minimize the trace variations due to noises and size changes. In addition, we also propose a new HMM using both the gradient and the positional features of the simplified hand stroke. As the result, the proposed algorithm has robust characteristics to the variations of the size and speed of hand motion. The recognition rate is increased up to 30%, because of this combined model. Experimental results showed that the proposed algorithm gives a high recognition rate about 98%.

본 논문에서는 다양한 정보단말기에 활용될 수 있는 손동작기반의 실시간 숫자 인식기 구현 기법을 제안한다. 제안한 알고리즘은 키넥트 센서를 활용하여 3차원 공간에서 손의 움직임을 획득한다. 획득한 손의 궤적은 잡음과 제스처의 크기 변화에 의한 궤적 변화를 최소화하고 일관성 있는 추적을 유지하기 위해 주성분 분석으로 단순화 된다. 또한, 기울기와 위치정보 특징을 동시에 고려한 새로운 특징 기반 은닉 마르코프 모델을 제시한다. 그 결과 제안한 기법은 손동작의 크기와 움직임 속도에 강인한 실시간 인식기를 구현하였다. 실험을 통하여 기존의 기울기 정보만을 사용하였을 때 보다 30% 이상의 높은 인식률을 보였으며, 98%의 높은 숫자 인식률을 나타내었다.

Keywords

References

  1. D. Hong, W. Woo, "Recent Research Trend of Gesture-based User Interfaces," Telecommunications Review, Vol.18, No.3, pp.403-413, 2008.
  2. A. Sears, J. Feng, K. Oseitutu, and C.-M. Karat, "Hands-Free, Speech-Based Navigation During Dictation: Difficulties, Consequences, and Solutions," Human-Computer Interaction Journal, Vol.18, No.3, pp.229-257, 2003. https://doi.org/10.1207/S15327051HCI1803_2
  3. D. J. Sturman and D. Zeltzer, "A Survey of Glove-based Input," IEEE Computer Graphics and Applications, Vol.14, No.1, pp.30-39, 1994. https://doi.org/10.1109/38.250916
  4. T. B. Moeslund and E. Granum, "A Survey of Computer Vision-Based Human Motion Capture," Computer Vision and Image Understanding, Vol.81, No.3, pp.231-268, 2001. https://doi.org/10.1006/cviu.2000.0897
  5. J. Yun, C. Lee, "Design of Computer Vision Interface by Recognizing Hand Motion," Journal of IEEK, Vol.47, No.3, pp.256-265, 2010.
  6. http://www.xbox.com/ko-KR/Kinect
  7. http://www.openni.org/
  8. Y. Jang, J. Park, "A Development on Gesture Recognition Interface System and Non-Contact Mouse Device Using a Stereo Camera," Journal of KIIT, Vol.7 No.3, pp.244-252, 2009.
  9. L. R. Rabiner, "A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition," Proceedings of the IEEE, Vol.77, No.2, pp.257-286, Feb., 1989. https://doi.org/10.1109/5.18626
  10. M. Elmezain, A. Al-Hamadi, B. Michaelis, "Hand Trajectory-based Gesture Spotting and Recognition Using HMM," IESK Conference, pp.3577-3580, 2009.
  11. H. Yoon, J. Soh, B. Min, "Alphabetical Gesture Recognition using HMM," KIISE, Vol.25, No.2, pp.384-386, 1998.
  12. A. Weingessel and K. Hornik, "Local PCA Algorithms," IEEE Transactions on Neural Networks, Vol.11, No.6, pp.1242-1250, Nov., 2000. https://doi.org/10.1109/72.883408
  13. A. M. Martinez and A. C. Kak, "PCA versus LDA", IEEE Trans. on PAMI, Vol.23, No.2, pp.228-233, Feb., 2001. https://doi.org/10.1109/34.908974
  14. H. Lee, J. Kim, "An HMM-based threshold model approach for gesture recognition," IEEE Trans. on PAMI, Vol.21, pp.961-973, 1999. https://doi.org/10.1109/34.799904
  15. D. Kim, J. Song, and D. Kim, "Simultaneous Gesture Segmentation and Recognition Based on Forward Spotting Accumlative HMMs," Pattern Recognition, Vol.40, pp.3012-3026, 2007. https://doi.org/10.1016/j.patcog.2007.02.010
  16. T. Wakahara and H. Murase, "On-Line Handwriting Recognition," Proceedings of the IEEE, Vol.80, No.7, pp.1181-1194, July, 1992. https://doi.org/10.1109/5.156478
  17. http://web.mit.edu/-rsalakhu/www/DBM.html, Matlab source code provided by Ruslan Salakhutdinov
  18. http://www.ee.columbia.edu/-dpwe/resources/matlab/dtw/, Matlab source code provided by Dan Ellis

Cited by

  1. Motion Recognition for Kinect Sensor Data Using Machine Learning Algorithm with PNF Patterns of Upper Extremities vol.27, pp.4, 2015, https://doi.org/10.18857/jkpt.2015.27.4.214
  2. Region-growing based Hand Segmentation Algorithm using Skin Color and Depth Information vol.16, pp.9, 2013, https://doi.org/10.9717/kmms.2013.16.9.1031