DOI QR코드

DOI QR Code

Development of Gesture Recognition-Based 3D Serious Games

치매 예방을 위한 제스처 인식 기반 3D 기능성 게임 개발

  • He, Guan-Feng (Dept. of Computer Engineering, Wonkwang Univ.) ;
  • Park, Jin-Woong (Dept. of Computer Engineering, Wonkwang Univ.) ;
  • Kang, Sun-Kyung (Dept. of Computer Engineering, Wonkwang Univ.) ;
  • Jung, Sung-Tae (Dept. of Computer Engineering, Research Institute of Engineering Technology Development, Wonkwang Univ.)
  • 하관봉 (원광대학교 컴퓨터공학과) ;
  • 박진웅 (원광대학교 컴퓨터공학과) ;
  • 강선경 (원광대학교 컴퓨터공학과) ;
  • 정성태 (원광대학교 컴퓨터공학과, 공업기술개발연구소)
  • Received : 2011.11.04
  • Accepted : 2011.11.16
  • Published : 2011.12.20

Abstract

In this paper, we propose gesture recognition based 3D Serious Games to prevent dementia. These games are designed to enhance the effect of preventing dementia by helping increase brain usage and physical activities of users by the entire body gesture recognition. The existing cameras used for gesture recognition technology are limited in terms of recognition ratio and operation range. For more stable recognition of the body gestures, we recognized users with a 3D depth camera, obtained joint data of users, and analyzed joint motions to recognize gestures of the body. Game contents were designed to practice memory, reasoning, calculation, and spatial recognition focusing on the atrophy of brain cells as a major cause of dementia. Game results of each user were saved and analyzed to measure how their recognition skills improved.

본 논문은 치매 예방을 위한 제스처 인식 기반 3D기능성 게임을 제안한다. 제안된 기능성 게임은 전신 제스처 인식을 이용함으로써 사용자의 두뇌 사용능력과 신체활동성을 증가시켜 치매 예방의 효과를 향상시킬 수 있도록 하였다. 기존에 개발된 제스처 인식 기술에 사용된 카메라들은 인식률과 가동영역이 한계적이다. 보다 안정적인 전신 제스처인식을 위해 3D depth 카메라로부터 사용자를 인식하고 사용자의 관절 정보를 획득하였으며 관절의 움직임을 분석하여 전신 제스처를 인식하였다. 게임 콘텐츠로는 치매의 대표적인 원인인 뇌세포의 퇴화에 초점을 맞춰 기억력, 논리력, 산술능력, 공간인지능력 등을 훈련할 수 있도록 구성하였다. 사용자 별로 게임 결과를 저장하고 분석하여 인지능력 향상 정도를 측정할 수 있도록 하였다.

Keywords

References

  1. M,H, Tabert, X, Liu, R,L. Doty, M. Serby, D, Zamora, G.H. Pelton, K. Marder, M.W Albers, Y. Stern, and D.P. Devanand, "A 10-item smell identification scale related to risk for Alzheimer's disease", Annals of neurology, Vol.58 No.1, pp. 155-160, 2005. https://doi.org/10.1002/ana.20533
  2. G. Waldemar, B. Dubois, and M. Emre, "Recommendations for the diagnosis and management of Alzheimer's disease and other disorders associated with dementia: EFNS guideline", European Journal of Neurology, Vol. 14(1), pp. 1-26, Jan. 2007. https://doi.org/10.1111/j.1468-1331.2006.01549.x
  3. Pei-Ying Chiang, May-chen Kuo, Lee, J., Kuo, C.-C.J., "WiiStick: Enhancing motion recognition capability for Wii systems", Circuits and Systems, 2009. ISCAS 2009. IEEE International Symposium on, ISBN: 978-1-4244-3827-3, pp. 1445-1448, May 2009
  4. IPoint 3D: Using Your Fingers As A Remote Control, http://www.sciencedaily. com/releases/ 2009/02/090220075312.htm
  5. Siddiqui, M., Medioni, G., "Human pose estimation from a single view point, real-time range sensor", Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on, ISBN: 978-1-4244-7029-7, pp 1-8, June 2010
  6. http://www.primesense.com.
  7. L.P. Morency, A. Rahimi, and T. Darrellm, "Adaptive view-based appearance model", Proceedings of IEEE Computer Vision and Pattern Recognition, pp. 803-810, 2003
  8. R.M. Taylor, T.C. Hudson, A. Seeger, H. Weber, J. Juliano, and A.T. Helser, "VRPN: a device-independent, network-transparent VR peripheral system", Proceeding of ACM Virtual Reality Software & Technology, pp. 55-61, 2001.
  9. 한승훈, 김은주, "자바를 이용한 2.5D 메타버스게임 엔진 설계 및 구현", 한국멀티미디어학회,Vol. 10, No.2, pp. 260-268, 2007
  10. 우상혁, 박병관, 이하령, 박동규, "OpenGL ES기반의 모바일 3D 레이싱 게임 엔진", 한국멀티미디어학회, Vol. 2005, No. 1, pp. 867-870,2005
  11. Peker, A.G., Can, T., "A design goal and design pattern based approach for development of game engines for mobile platforms", Computer Games (CGAMES), 2011 16th International Conference on, ISBN: 978-1-4577-1451-1, pp. 114-120, July 2011
  12. B.J Small, A. Herlitz, L. Fratiglioni, O. Almkvist, L. Bäckman, "Cognitive predictors of incident Alzheimer's disease: A prospective longitudinal study," Neuropsychology, Vol. 11(3), pp. 413-420, Jul. 1997. https://doi.org/10.1037/0894-4105.11.3.413