DOI QR코드

DOI QR Code

Recognition of 3D hand gestures using partially tuned composite hidden Markov models

  • Kim, In Cheol (Communications Engineering Branch, Lister Hill National Center for Biomedical Communications National Library of Medicine)
  • Published : 2004.09.01

Abstract

Stroke-based composite HMMs with articulation states are proposed to deal with 3D spatio-temporal trajectory gestures. The direct use of 3D data provides more naturalness in generating gestures, thereby avoiding some of the constraints usually imposed to prevent performance degradation when trajectory data are projected into a specific 2D plane. Also, the decomposition of gestures into more primitive strokes is quite attractive, since reversely concatenating stroke-based HMMs makes it possible to construct a new set of gesture HMMs without retraining their parameters. Any deterioration in performance arising from decomposition can be remedied by a partial tuning process for such composite HMMs.

Keywords

References

  1. T.S. Huang and V.l. Pavlovic, 'Hand gesture modeling, analysis, and synthesis,' Proc. Int. Workshop Automatic Face- and Gesture-Recognition, Zurich, pp. 73-79, 1995
  2. Y. Wu and T.S. Huang, 'Vision-based gesture recognition: A review,' Proc. GW'99, Lecture Notes in Artificial Intelligence, Springer, vol. 1739, pp. 103-116,1999
  3. T. Starner and A. Pentland, 'Visual recognition of American Sign Language using hidden Markov models,' Proc. Int. Workshop Automatic Face- and Gesture-Recognition, Zurich, pp. 189-194, 1995
  4. C. Lee and Y. Xu, 'Online, interactive learning of gestures for human/robot interfaces,' Proc. IEEE Conf. Robotics and Automation, Minneapolis, MN, vol. 4 pp. 2982-2987, 1996
  5. S.S. Fels and G.E. Hinton, 'Glove-Talk II a neural-network interface which maps gestures to parallel formant speech synthesizer controls,' IEEE Trans. Neural Networks, vol. 8, no. 5, pp. 977-984, 1997 https://doi.org/10.1109/72.623199
  6. J.C. Goble, K. Hinckley, R. Pausch, J.W. Snell, and N.F. Kassell, 'Two-handed spatial interface tools for neurosurgical planning,' IEEE Computers, vol. 28, pp.20-26, July 1995
  7. D.J. Sturman and D. Zeltzer, 'A survey of glove-based input,' IEEE Computer Graphics and Applications, vol. 4, pp. 30-39, 1994
  8. L.R. Rabiner and B.H. Juang, 'An introduction to hidden Markov models,' IEEE ASSP Magazine, vol. 3, no. 1, pp. 4-16, 1986 https://doi.org/10.1109/MASSP.1986.1165342
  9. R. Cardin, Y. Normandin, and E. Millien, 'Inter- word coarticulation modeling and MMIE training for improved connected digit recognition,' Proc. IEEE Conf. Acoustics, Speech, and Signal Processing, vol. 2 pp. 243-246, 1993 https://doi.org/10.1109/ICASSP.1993.319280
  10. E.P. Giachin, C.H. Lee, L.R Rabiner, A.E. Rosenberg, and R.H. Pieraccini, 'On the use of inter-word context-dependent units for word juncture modeling,' Computer Speech and Language, vol. 6, pp. 197-213, 1992 https://doi.org/10.1016/0885-2308(92)90017-X
  11. B.K. Sin and J.H. Kim, 'Ligature modeling for online cursive script recognition,' IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 6 pp. 623-633, 1997 https://doi.org/10.1109/34.601250

Cited by

  1. Robust Video-Based Barcode Recognition via Online Sequential Filtering vol.14, pp.1, 2014, https://doi.org/10.5391/IJFIS.2014.14.1.8
  2. Motion Control of a Mobile Robot Using Natural Hand Gesture vol.24, pp.1, 2014, https://doi.org/10.5391/JKIIS.2014.24.1.064