Journal of the Korean Institute of Intelligent Systems (한국지능시스템학회논문지)

Korean Institute of Intelligent Systems (한국지능시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Analyzing Human's Motion Pattern Using Sensor Fusion in Complex Spatial Environments

복잡행동환경에서의 센서융합기반 행동패턴 분석

  • Tark, Han-Ho (Dept. of Electronics Engineering, Gyongnam National University of Science and Technology) ;
  • Jin, Taeseok (Dept. of Mechatronics Engineering, Dongseo University)
  • 탁한호 (경남과학기술대학교 전자공학과) ;
  • 진태석 (동서대학교 전자공학과)
  • Received : 2014.07.07
  • Accepted : 2014.12.15
  • Published : 2014.12.25
Download PDF
⟨ Previous Next ⟩

Abstract

We propose hybrid-sensing system for human tracking. This system uses laser scanners and image sensors and is applicable to wide and crowded area such as hallway of university. Concretely, human tracking using laser scanners is at base and image sensors are used for human identification when laser scanners lose persons by occlusion, entering room or going up stairs. We developed the method of human identification for this system. Our method is following: 1. Best-shot images (human images which show human feature clearly) are obtained by the help of human position and direction data obtained by laser scanners. 2. Human identification is conducted by calculating the correlation between the color histograms of best-shot images. It becomes possible to conduct human identification even in crowded scenes by estimating best-shot images. In the experiment in the station, some effectiveness of this method became clear.

본 논문은 대학의 복도와 같은 넓고 복잡한 환경에서 레이저 스캐너와 이미지 센서와 같은 다중센서 데이터 융합을 이용한 복수의 사람들에 대한 동작 인식 및 패턴 분석을 소개하였다. 제안한 방법의 인식 시스템은 첫째, 인물 추적을 위한 전 처리 기능과 둘째 이동궤적 특징, 보행특징, 이미지 특징, 환경(글로벌) 특징을 요구하는 특징부 추출에 대한 이론적 근거를 제시하였다. 최적의 영상을 기반으로 한 복잡환경 내에서의 복수의 사람들을 인식하고 움직임에 대한 패턴은 HMM과 SVM을 통한 학습 및 식별을 수행하였다. 학습 및 식별에서는 HMM을 이용한 이동 경로의 추정과 SVM을 이용한 비정상 보행 검색의 실례를 제시하였다. 또한 제안 방법을 검증하기 위하여 대학교의 복도에서 실시한 실험결과를 통해 타당성을 검증하였다.

Keywords

References

  1. D.M., Gavrila, "The analysis of human motion and its application for visual surveillance" in proceeding of the 2nd International workshop on visual surveillance, 1999.
  2. P. Perez, C. Hue, J. Vermaak, M. Gangnet, "Color-Based Probabilistic Tracking," Proc. of European Conference on Computer Vision, Copenhagen, 27 May- 2 June 2002.
  3. Zhao, H. and Shibasaki, R., "A Novel System for Tracking Pedestrians using Multiple Single-Row Laser Range Scanners," IEEE Transactions on Systems, Man and Cybernetics-part A, Vol. 35, No. 2, pp. 283-291, 2005. https://doi.org/10.1109/TSMCA.2005.843396
  4. Yang, J., Xu, Y. and Chen, C. S., "Human action learning via hidden Markov model," IEEE Transactions on Systems, Man and Cybernetics-part A, vol. 27, no. 1, pp. 34-44, 1997. https://doi.org/10.1109/3468.553220
  5. Chan, M. T., Hoogs, A., Schmiederer, J. and Peterson, M.: Detecting Rare Events in Video Using Semantic Primitives with HMM, in Proceedings of the 17th International Conference on Pattern Recognition (ICPR) , Vol. 4, pp. 150-154, 2004.
  6. H. E. Lee, Y.H. Kim, K..H. Park, Y.S. Kim, J.W. Jung, J.M. Cho, M.G. Kim, Z. Zenn Bien, "Fuzzy Inductive Learning System for Learning Preference of the User's Behavior Pattern," Journal of Korean Institute of Intelligent Systems, Vol.15, No.7, pp. 805-812, 2005.
  7. Nguyen, N. T., Phung, D. Q. and Venkatesh, S., "Learning and Detecting Activities from Movement Trajectories Using the Hierarchical Hidden Markov Model," in Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Vol. 2, pp. 955-960, 2005.
  8. K.H. Jung, J.M. Kim, J.J Park, S.S. Kim, S.I Bae, "Line Tracking Method of AGV using Sensor Fusion," Journal of Korean Institute of Intelligent Systems, Vol.20, No.1, pp. 54-59, 2010.. https://doi.org/10.5391/JKIIS.2010.20.1.054
  9. Jain, A. K., Duin, R. P. W. and Mao, J. "Statistical Pattern Recognition: A Review," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, no. 1, pp. 4-37, 2000. https://doi.org/10.1109/34.824819
  10. Taeseok Jin, and Hideki Hashimoto, "3D walking human detection and tracking based on the IMPRESARIO Framework," International Journal of Fuzzy Logic and Intelligent Systems, Vol. 8, no. 3, pp. 163-169, 2008. https://doi.org/10.5391/IJFIS.2008.8.3.163
  11. Kirsten Gotz-Neumann, "Gehen verstehen Ganganalyse in der Physiotherapie" IGAKU SHOIN Ltd, 2005.
  12. Shao, X., Zhao, H., Nakamura, K., Shibasaki, R., Zhang, R. and Liu, Z., "Analyzing Pedestrian's Walking Pattern Using Single-Row Laser Range Scanners," in Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Vol. 2, pp. 1202-1207, 2006.
  13. B.H. Choi, B.S. Kim, E.T. Kim, "Location Estimation and Obstacle tracking using Laser Scanner for Indoor Mobile Robots," Journal of Korean Institute of Intelligent Systems, Vol.21, No.3, pp. 329-334, 2011. https://doi.org/10.5391/JKIIS.2011.21.3.329
  14. K.E. Ko, S.M. Park, J.Y. Kim, K.B. Sim, "HMM-based Intent Recognition System using 3D Image Reconstruction Data," Journal of Korean Institute of Intelligent Systems, Vol.22, No.2, pp. 135-140, 2012. https://doi.org/10.5391/JKIIS.2012.22.2.135

Cited by

  1. Development of the Context-Aware System for Senior Citizen based on Case-Based Reasoning vol.25, pp.5, 2015, https://doi.org/10.5391/JKIIS.2015.25.5.419