Journal of the Korea Society of Computer and Information (한국컴퓨터정보학회논문지)

Korean Society of Computer Information (한국컴퓨터정보학회)
권호 표지
DOI QR코드

DOI QR Code

A Design and Implementation of Fitness Application Based on Kinect Sensor

  • Lee, Won Joo (Dept. of Computer Science, InHa Technical College)
  • Received : 2020.11.30
  • Accepted : 2020.12.28
  • Published : 2021.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we design and implement KITNESS, a windows application that feeds back the accuracy of fitness motions based on Kinect sensors. The feature of this application is to use Kinect's camera and joint recognition sensor to give feedback to the user to exercise in the correct fitness position. At this time, the distance between the user and the Kinect is measured using Kinect's IR Emitter and IR Depth Sensor, and the joint, which is the user's joint position, and the Skeleton data of each joint are measured. Using this data, a certain distance is calculated for each joint position and posture of the user, and the accuracy of the posture is determined. And it is implemented so that users can check their posture through Kinect's RGB camera. That is, if the user's posture is correct, the skeleton information is displayed as a green line, and if it is not correct, the inaccurate part is displayed as a red line to inform intuitively. Through this application, the user receives feedback on the accuracy of the exercise position, so he can exercise himself in the correct position. This application classifies the exercise area into three areas: neck, waist, and leg, and increases the recognition rate of Kinect by excluding positions that Kinect does not recognize due to overlapping joints in the position of each exercise area. And at the end of the application, the last exercise is shown as an image for 5 seconds to inspire a sense of accomplishment and to continuously exercise.

본 논문에서는 키넥트 센서를 기반으로 한 휘트니스(Fitness) 동작의 정확성을 피드백 하는 윈도우 애플리케이션 KITNESS를 설계하고 구현한다. 이 애플리케이션의 특징은 키넥트의 카메라와 관절 인식 센서를 활용하여 사용자가 정확한 휘트니스 자세로 운동할 수 있도록 피드백을 주는 것이다. 이때 키넥트의 IR Emitter와 IR Depth Sensor를 이용하여 사용자와 키넥트 간의 거리를 측정하고, 사용자의 관절 위치인 조인트(Joint)와 각 관절의 스켈레톤(Skeleton) 데이터를 측정한다. 이러한 데이터를 이용하여 사용자의 관절 위치와 자세마다 일정 거리를 계산하고 자세의 정확도를 판단한다. 그리고 키넥트의 RGB 카메라를 통해 사용자가 본인의 자세를 확인할 수 있도록 구현한다. 즉, 사용자의 자세가 정확하면 스켈레톤 정보를 초록색 선으로 표시하고, 정확하지 않으면 정확하지 않은 부분을 빨간색 선으로 표시하여 직관적으로 알려준다. 사용자는 이 애플리케이션을 통하여 운동하는 자세의 정확도를 피드백 받기 때문에 혼자서도 정확한 자세로 운동할 수 있다. 이 애플리케이션은 운동 부위를 목, 허리, 다리 세 가지 영역으로 분류하고, 각 운동 부위의 자세에서 관절이 겹쳐서 키넥트가 인식하지 못하는 자세를 제외함으로써 키넥트의 인식률을 높인다. 그리고 애플리케이션 종료 시에는 마지막 운동 모습을 이미지로 5초간 보여줌으로써 성취감을 고취시키고 지속적으로 운동할 수 있도록 구현한다.

Keywords

References

  1. Korea Health Promotion Institute, Press release of survey results on physical activity of office workers, https://www.khealth.or.kr/board/view?menuId=MENU00907&linkId=501805.
  2. Nielsen, A healthy habit of taking care of my body, home training, http://www.koreanclick.com/insights/newsletter_view.html ?&id=464.
  3. TrendMonitor, 2018 U&A survey on exercise experience and home training in daily life, https://www.trendmonitor.co.kr/tmweb/trend/allTrend/detail.do?bIdx=1677&trendType=CKOREA
  4. Microsoft, Kinect for Windows Sensor Components and Specifications, https://docs.microsoft.com/en-us/previous-versions/windows/kinect-1.8/jj131033(v=ieb.10).
  5. Leepooiye, Differences between Kinect with Kinect 2.0, https://myleepy.wordpress.com/2018/07/16/week-2-kniect/.
  6. Suharjito, Suharjito & Anderson, Ricky & Wiryana, Fanny & Ariesta, Meita & Kusuma Negara, I Gede Putra, "Sign Language Recognition Application Systems for Deaf-Mute People: A Review Based on Input-Process-Output," Procedia Computer Science. Vol.116. pp. 441-448, Oct. 2017. DOI:10.1016/j.procs.2017.10.028
  7. Microsoft, Microsoft.Kinect Namespace, https://docs.microsoft.com/en-us/previous-versions/windows/kinect-1.8/hh855419(v=ieb.10).
  8. J. K. Ko, "Kinect Programing," Korea Electronics Association, 2012.
  9. Yun, Hye-Jeong, Kim, Kwang-Il, Lee, Jeong-Hun, and Lee, Hae-Yeoun, "Development of Experience Dance Game using Kinect Motion Capture," KIPS transactions on software and data engineering, Vol. 3, No. 1, pp. 49-56, Jan. 2014. DOI:10.3745/KTSDE.2014.3.1.49
  10. Park, Kyoung Shin, "Development of Kinect-Based Pose Recognition Model for Exercise Game," KIPS transactions on computer and communication systems, Vol. 5, No. 10, pp. 303-310, Oct. 2016. DOI:10.3745/KTCCS.2016.5.10.303
  11. Kim, ChangGeol and Song, Byung-Seop, "Development of Home Training System with Self-Controlled Feedback for Stroke Patients," Journal of the Korea Industrial Information Systems Research, Vol. 18, No. 1, pp. 37-45, Feb. 2013. DOI:10.9723/JKSIIS.2013.18.1.037