Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Hand Motion Design for Performance Enhancement of Vision Based Hand Signal Recognizer

영상기반의 안정적 수신호 인식기를 위한 손동작 패턴 설계 방법

  • Shon, Su-Won (Dept. of Electrical Engineering, Korea University) ;
  • Beh, Joung-Hoon (University of Maryland Institute for Advanced Computer Studies) ;
  • Yang, Cheol-Jong (Dept. of Electrical Engineering, Korea University) ;
  • Wang, Han (Dept. of Electrical Engineering, Korea University) ;
  • Ko, Han-Seok (Dept. of Electrical Engineering, Korea University)
  • 손수원 (고려대학교 전기전자전파공학과) ;
  • 배정훈 ;
  • 양철종 (고려대학교 전기전자전파공학과) ;
  • 왕한 (고려대학교 전기전자전파공학과) ;
  • 고한석 (고려대학교 전기전자전파공학과)
  • Received : 2010.11.24
  • Accepted : 2011.04.02
  • Published : 2011.07.25
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes a language set of hand motions for enhancing the performance of vision-based hand signal recognizer. Based on the statistical analysis of the angular tendency of hand movements in sign language and the hand motions in practical use, we construct four motion primitives as building blocks for basic hand motions. By combining these motion primitives, we design a discernable 'fundamental hand motion set' toward increasing the hand signal recognition. To demonstrate the validity of proposed designing method, we develop a 'fundamental hand motion set' recognizer based on hidden Markov model (HMM). The recognition system showed 99.01% recognition rate on the proposed language set. This result validates that the proposed language set enhances discernaility among the hand motions such that the performance of hand signal recognizer is improved.

본 논문에서는 수신호 인식기에 쓰이기 위한 분별성 있는 손동작을 만드는 방법을 제안한다. 기존의 수화DB에서 손의 움직임을 분석하여 기본 동작이 되는 4가지의 모션 프리미티브를 선정하였으며, 선정된 모션 프리미티브를 조합하여 구별성 있는 '기본 손동작 집합'을 제작하였다. 제안하는 '기본 손동작 집합' 의 구별성을 증명하기 위하여 '기본 손동작 집합' 인식기를 만들고 인식결과를 확인하였다. 사용된 인식기는 hidden Markov model (HMM) 을 기반으로 제작되었다. 기본 손동작 인식 task에 대한 성능평가 결과 99.01%로써 각 모델 간에 높은 구별성을 보이는 것을 확인할 수 있었다.

Keywords

References

  1. Schlömer, T. et al, "Gesture Recognition with a Wii Controller.", Proceedings of the Second International Conference on Tangible and Embedded Interaction (TEI'08), pp. 11-14 Bonn, Germany. Feb 2008.
  2. Jacob, R.J.K., "The Use of Eye-Movements in Human-Computer Interaction Techniques - What You Look at Is What You Get.", Acm Transactions on Information Systems, vol. 9, no. 2, pp. 152-169, Apr 1991 https://doi.org/10.1145/123078.128728
  3. Jia, P., et al., "Head gesture recognition for hands-free control of an intelligent wheelchair.", Industrial Robot-an International Journal, vol 34, no. 1, pp. 60-68, 2007 https://doi.org/10.1108/01439910710718469
  4. Park, H.S., et al., "HMM-based gesture recognition for robot control.", Pattern Recognition and Image Analysis, Pt 1, Proceedings, vol 3522, pp. 607-614, 2005
  5. Lee, J.T. and T.L. Kunii, "Model-Based Analysis of Hand Posture.", IEEE Computer Graphics and Applications, vol. 15, no. 5, pp. 77-86, Sep 1991.
  6. James, D. and S. Mubarak, "Recognizing Hand Gestures.", European Conference on Computer Vision, pp. 331-340, Stockholm, Sweden, May 1994.
  7. Starner, T. and A. Pentland, "Real-time American Sign Language recognition from video using hidden Markov models.", International Symposium on Computer Vision, pp. 265-270, Coral Gables, FL, USA, Nov 1995.
  8. Christian, V. and M. Dimitris, "Parallel hidden markov models for american sign language recognition.", International Conference on Computer Vision, pp. 116-122, Kerkyra, Greece, Sep 1999.
  9. Just, A. and S. Marcel, "A comparative study of two state-of-the-art sequence processing techniques for hand gesture recognition.", Computer Vision and Image Understanding, vol. 113, no. 4, pp. 532-543, Apr 2009 https://doi.org/10.1016/j.cviu.2008.12.001
  10. Yanghee, N. and W. KwangYun, "Recognition of Space-Time Hand-Gestures using Hidden Markov Model.", ACM symposium on Virtual reality software and Technology, pp. 51-58, Hong Kong, China, 1996.
  11. Lee, H.K. and J.H. Kim, "An HMM-based threshold model approach for gesture recognition.", Ieee Transactions on Pattern Analysis and Machine Intelligence, vol. 21, no.10, pp. 961-973, Oct 1999. https://doi.org/10.1109/34.799904
  12. Eickeler, S., A. Kosmala, and G. Rigoll, "Hidden Markov Model based continuous online gesture recognition.", Fourteenth International Conference on Pattern Recognition, vol. 1, no. 2, pp. 1206-1208, Aug 1999
  13. Kang, H., W.L. Chang, and K.C. Jung, "Recognition-based gesture spotting in video games.", Pattern Recognition Letters, vol. 25, no. 15, pp 1701-1714, 2004. https://doi.org/10.1016/j.patrec.2004.06.016
  14. Kortenkamp, D., E. Huber, and R.P. Bonasso, "Recognizing and interpreting gestures on a mobile robot.", Proceedings of the Thirteenth National Conference on Artificial Intelligence and the Eighth Innovative Applications of Artificial Intelligence Conference, vol. 1, no. 2, pp. 915-921, 1996.
  15. 박혜선, 김은이 ,김항준, "제스처 인식을 위한 은닉마르코프 모델", 대한전자공학회 논문지 제 43권 CI편, 제 1호, 17-26쪽, 2006년.
  16. Rabiner, L.R., "A Tutorial on Hidden Markov-Models and Selected Applications in Speech Recognition.", Proceedings of the Ieee, vol. 77, no. 2, pp. 257-286, 1989. https://doi.org/10.1109/5.18626
  17. Waldherr, S., R. Romero, and S. Thrun, "A gesture based interface for human-robot interaction.", Autonomous Robots, vol. 9, no. 2, pp. 151-173, 2000. https://doi.org/10.1023/A:1008918401478
  18. Eddy, S.R., "Profile hidden Markov models.", Bioinformatics, vol. 14, no. 9, pp755-763, 1998. https://doi.org/10.1093/bioinformatics/14.9.755
  19. Soding, J., "Protein homology detection by HMM-HMM comparison.", Bioinformatics, vol. 21, no. 7, pp. 951-960, 2005 https://doi.org/10.1093/bioinformatics/bti125
  20. Young, S., et al, "The HTK Book (for HTK version 3.4).", http:/ /htk.eng.cam.ack.uk, 2009
  21. McNeill, D., "Hand and mind : what gestures reveal about thought.", Chicago: University of Chicago Press, pp. 117, 1992.
  22. Baum, L.E., "An inequality and associated maximization technique in statistical estimation for probabilistic functions of Markov processes.", Inequalities, vol. 3, no. 9, pp. 1-8, 1972.
  23. Rigoll, G., A. Kosmala, and S. Eickeler, "High Performance Real-Time Gesture Recognition Using Hidden Markov Models.", Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction, pp. 69-80, Bielefeld, Germany, 1998,
  24. Dreuw, P., et al., "Speech Recognition Techniques for a Sign Language Recognition System.", Interspeech, pp. 705-708, Antwerp, Belgium, Aug 2007.
  25. L.Neitzel, R., N.S. Seixas, and K.K. Ren, "A review of crane safety in the construction industry.", Applied Occupational and Enviromental Hygiene, vol. 16, no. 12, pp 1106-1117, 2001. https://doi.org/10.1080/10473220127411
  26. "Law 5. The Referee", Federation Internationale de Football Association, www.fifa.com, 2010.
  27. "Official Referee Hand Signals", National Basketball Association, www.nba.com, 2010
  28. "NFL Official Rule Book", National Football League, www.mfl.com, 2010.
  29. "Official Rules", National Hockey League, www.nhl.com, 2010.