Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Frequency Estimation of Human Movements Using Kinect and Its Application

키넥트를 이용한 인간 움직임의 주파수 예측 및 이를 활용한 응용 프로그램 구현

  • Seo, Myoung-Gyu (Department of Computer Engineering, Pukyong National University) ;
  • Kim, Sang-Yeob (Department of Computer Engineering, Pukyong National University) ;
  • Ju, Jang-Bok (Department of Computer Engineering, Pukyong National University) ;
  • Lee, Chul (Department of Computer Engineering, Pukyong National University)
  • Received : 2017.07.17
  • Accepted : 2017.07.31
  • Published : 2017.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

We propose a frequency estimation algorithm of human movements using Kinect. We collect the 3D coordinates of the joints of a human body and then obtain the frequency-domain description of the movements using the discrete Fourier transform (DFT). By choosing the frequency with the biggest magnitude in the selected frequencies of each of human's joint, we obtain the major beat of the human movements. Experimental results show that the proposed algorithm accurately estimates the frequency of human movements. We expect that the proposed algorithm would be applied to many AR and VR applications as a preprocessing.

Keywords

References

  1. J. Han, L. Shao, D. Xu, and J. Shotton, "Enhanced Computer Vision with Microsoft Kinect Sensor: A Review," IEEE Transactions on Cybernetics, Vol. 43, No. 5, pp. 1318-1334, 2013. https://doi.org/10.1109/TCYB.2013.2265378
  2. S. Laraba and J. Tilmanne, “Dance Performance Evaluation Using Hidden Markov Models,” Computer Animation and Virtual Worlds, Vol. 27, No. 3-4, pp. 321-329, 2016. https://doi.org/10.1002/cav.1715
  3. F. Ofli, G. Kurillo, S. Obdrzalek, R. Bajcsy, H. B. Jimison, and M. Pavel, "Design and Evaluation of an Interactive Exercise Coaching System for Older Adults: Lessons Learned," IEEE Journal of Biomedical and Health Informatics, Vol. 20, No. 1, pp. 201-212, 2016. https://doi.org/10.1109/JBHI.2015.2391671
  4. P. Phamduy, M. DeBellis, and M. Porfiri, “Controlling a Robotic Fish Via a Natural User Interface for Informal Science Education,” IEEE Transactions on Multimedia, Vol. 17, No. 12, pp. 2328-2337, 2015. https://doi.org/10.1109/TMM.2015.2480226
  5. Z. Saenz-de-Urturi and B.G.Z. Soto, “Kinect-Based Virtual Game for the Elderly That Detects Incorrect Body Postures in Real Time,” Sensors, Vol. 16, No. 5, pp. 1-15, 2016. https://doi.org/10.1109/JSEN.2016.2616227
  6. M. Parajuli, D. Tran, W. Ma, and D. Sharma, "Senior Health Monitoring Using Kinect," Proceeding of International Conference on Communications and Electronics, pp. 309-312, 2012.
  7. K. Cheoi and J. Han, “A Novel Door Security System using Hand Gesture Recognition,” Jounal of Korea Multimedia Society, Vol. 19, No. 8, pp. 1320-1328, 2016. https://doi.org/10.9717/kmms.2016.19.8.1320
  8. M.I. Quraishi, K.G. Dhal, J.P. Choudhury, P. Ghosh, P. Sai, and M. De, "A Novel Human Hand Finger Gesture Recognition Using Machine Learning," Proceeding of IEEE International Conference on Parallel Distrib uted and Grid Computing, pp. 882-887, 2012.
  9. A. Jana, Kinect for Windows SDK Programming Guide, Packt Publishing, Birmingham UK, 2012.
  10. Kinect for Windows Human Interface Guidelines v2.0, https://go.microsoft.com/fwlink/p/?LinkID=403900 (accessed Aug., 01, 2017).
  11. J.W. Cooley and J.W. Tukey, "An Algorithm for the Machine Calculation of Complex Fourier Series," Mathematics of Computation, Vol. 19, pp. 297-301, 1965. https://doi.org/10.1090/S0025-5718-1965-0178586-1
  12. T. Frankel, The Geometry of Physics: An Introduction, Cambridge University Press, 3rd Edition, Cambridge, UK, 2011.
  13. M.G. Seo, S.Y. Kim, J.B. Ju, and C. Lee, "Beat Estimation of Non-Periodic Human Movements Using Kinect," Proceeding of IEEE/IEIE International Conference on Consumer Electronics-Asia, pp. 547-548, 2016.
  14. Unity, https://unity3d.com/ (accessed Aug., 01, 2017).