Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Interaction Augmented Reality System using a Hand Motion

손동작을 이용한 상호작용 증강현실 시스템

  • 최광운 (중앙대학교 첨단영상대학원) ;
  • 정다운 (중앙대학교 첨단영상대학원) ;
  • 이석한 (중앙대학교 첨단영상대학원) ;
  • 최종수 (중앙대학교 첨단영상대학원)
  • Received : 2011.09.09
  • Accepted : 2012.02.01
  • Published : 2012.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, We propose Augmented Reality (AR) System for the interaction between user's hand motion and virtual object motion based on computer vision. The previous AR system provides inconvenience to user because the users have to control the marker and the sensor like a tracker. We solved the problem through hand motion and provide the convenience to the user. Also the motion of virtual object using a physical phenomenon gives a reality. The proposed system obtains geometrical information by the marker and hand. The system environments like virtual space of moving virtual ball and bricks are made by using the geometrical information and user's hand motion is obtained from the hand's information with extracted feature point through the taping hand. And it registers a virtual plane stably by getting movement of the feature points. The movement of the virtual ball basically is parabolic motion with a parabolic equation. When the collision occurs either the planes or the bricks, we show movement of the virtual ball with ball position and normal vector of plane and the ball position is faulted. So we showed corrected ball position through experiment. and we proved that this system can replaced the marker system to compare to jitter of augmented virtual object and progress speed with it.

본 논문에서는 컴퓨터 비전 기술 기반으로 사용자의 손 움직임과 가상객체 사이의 자연스러운 상호작용을 위한 증강현실 시스템을 제안한다. 기존의 증강현실 시스템은 마커를 이용하거나 트랙커 같은 센서를 직접 조작해야 했기 때문에 사용자에게 불편함을 제공한다. 우리는 이러한 문제점을 해결하기 위해서 손 움직임을 증강현실 시스템에 적용한다. 또한 가상객체의 움직임에 물리적 현상을 적용하여 현실감을 부여한다. 제안한 시스템은 마커를 이용하여 기하학적 정보를 얻어 가상의 공이 움직이는 가상공간, 벽돌 등의 시스템 환경을 구성하였으며, 사용자의 손 움직임은 테이핑을 통하여 특징점을 추출하여 정보를 얻는다. 이 특징점을 이용하여 손 위에 가상 평면을 안정적으로 정합한다. 가상의 공의 움직임은 포물선 방정식을 이용하여 기본적으로 포물선 움직임을 보이고, 평면 또는 벽돌에 충돌이 발생할 경우에는 가상 공의 위치와 평면의 법선벡터를 이용하여 가상 공의 움직임을 보였다. 실험을 통해 충돌 시 발생되는 잘못된 공의 위치에 대해 보정되는 과정을 보였고, 증강된 가상객체의 떨림과 수행속도에 대해 마커를 이용한 시스템과 비교하여 제안한 시스템으로 대체할 수 있다는 것을 확인하였다.

Keywords

References

  1. R.T. Azuma, "A Survey of Augmented Reality," Presence, Teleoperators and Virtual Environments, Vol.6, No.4, pp. 355-385, 1997. https://doi.org/10.1162/pres.1997.6.4.355
  2. S. Vogt, A. Khamene, F. Sauer, A. Keil, and H. Niemann, "A High Performance AR System for Medical Applications," ISMAR 2003, pp. 270-271, 2003.
  3. C. Bichlmeier, S.M. Heining, M. Feuerstein, and N. Navab, "The Virtual Mirror: A New Interaction Paradigm for Augmented Reality Environments," IEEE Transactions on Medical Imageing, Vol.28, No.9, pp. 1498-1510, 2009. https://doi.org/10.1109/TMI.2009.2018622
  4. D. Wagner and I. Barakonyi, "Augmented Reality Kanji Learning," ISMAR 2003, pp. 335, 2003.
  5. T. Miyashita, P. Meier, T. Tachikawa, S. Orlic, T. Eble, V. Scholz, A. Gapel, O. Gerl, S. Arnaudov, and S. Lieberknecht, "An Augmented Reality Museum guide," ISMAR 2008, pp. 103-106, 2008.
  6. Z. Szalavari, E. Eckstein, and M. Gervautz, "Collaborative Gaming in Augmented Reality," Proceedings of the ACM Symposium on Virtual Reality Software and Technology, pp. 195-204, 2008.
  7. B. Thomas, B. Close, J. Donoghue, J. Squires, P. deBondi , M. Morris, and W. Piekarski, "ARQuake: An Outdoor/Indoor Augmented Reality First Person Application," Proceeedings of the 4th IEEE International Symposium on Wearable Computers, pp. 139-146, 2000.
  8. T. Ohshima, K. Satoh, H. Yamamoto, and H. Tamura, "AR2Hockey: A Case Study of Collaborative Augmented Reality," Proceedings of the Virtual Reality Annual International Symposium, pp. 268-275, 1998.
  9. D.G. Lowe, "Distinve Image Features from Scale-Invarinat Keypoints," International Journal of Computer Vision, Vol.60, No.2, pp. 90-110, 2004.
  10. J. Shi and C. Tomasi, "Good Features to Track," IEEE Conference on Computer Vision and Pattern Recognition, pp. 593-600, 1994.
  11. H. Bay, A. Ess, T. Tuytelaars, and L.V. Gool, "SURF: Speeded Up Robust Features," Computer Vision and Image Understanding, Vol 110, No.3, pp. 346-359, 2008. https://doi.org/10.1016/j.cviu.2007.09.014
  12. M. Leotta and K. Boyle, "Plausible Physics in Augmented Images," ACM SIGGRAPH 2005, pp. 53, 2005.
  13. H. Kato and M. Billinghurst, "Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System," Proceedings of the 2nd International Workshop on Augmented Reality, pp. 85-94. 1999.
  14. Li. Yingzhu, L.-K. Shark, S.J. Hobbs, and J. Ingham, "Real-Time Immersive Table Tennis Game for Two Players with Motion Tracking," International Conference Information Visualisation, pp. 500-505, 2010.
  15. B.H. Thomas and W. Piekarski, "Glove Based User Interaction Techniques for Augmented Reality in an Outdoor Environment," Virtual Reality: Research, Development, and Applications, Vol.6, No.3, pp. 167-180, 2002. https://doi.org/10.1007/s100550200017
  16. S.H. Lee and J.S. Choi, "AR Squash Game," ISMAR 2007, pp. 4-8, 2007.
  17. M. Imura, T. Amada, Y. Yasumuro, and Y. Manabe, "Synthetic Representation of Virtual Fluid for Mixed Reality," International Conference on Virtual Reality, pp. 135-142, 2006.
  18. O. Bergig, N. Hagbi, and J. El-Sana, "In-Place 3D Sketching for Authoring and Augmenting Mechanical Systems," IEEE International Symposium on Mixed and Augmented Reality, pp. 87-94, 2009.
  19. Y. Uematsu and H. Saito, "Interactive AR Bowling System by Vision-Based Tracking," Proceedings of the International Conference on Advances in Computer Entertainment Technology, pp. 236-237, 2007.
  20. H. Kaufmann and B. Meyer, "Simulating Educational Physical Experiments in Augmented reality," ACM SIGGRAPH ASIA 2008, pp. 1-8, 2008.
  21. C. Chae and K. Ko, "Introduction of Physics Simulation in Augmented Reality," International Symposium on Ubiquitous Virtual Reality, pp. 37-40, 2008.
  22. C.S. Chua, H. Guan, and Y.K. Ho, "Model- Based 3D Hand Posture Estimation from a Single 2D Image," Image and Vision Computing, Vol.20, No.3, pp. 191-202, 2002. https://doi.org/10.1016/S0262-8856(01)00094-4
  23. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, Cambridge Univ. Press, London, 2003.
  24. 이정진, 김종호, 김태영, "증강현실 응용을 위한 손 끝점 추출과 손 동작 인식 기법," 한국멀티미디어학회 논문지, 13권, 2호, pp. 316-323, 2010.

Cited by

  1. Performance Analysis of Modified LLAH Algorithm under Gaussian Noise vol.18, pp.8, 2015, https://doi.org/10.9717/kmms.2015.18.8.901
  2. Augmented Reality Authoring Tool with Marker & Gesture Interactive Features vol.16, pp.6, 2013, https://doi.org/10.9717/kmms.2013.16.6.720
  3. 폐곡선의 수에 따른 3차원 물체의 좌표 복원 정확도 관계 도출 vol.20, pp.7, 2017, https://doi.org/10.9717/kmms.2017.20.7.1004
  4. 다수 마커를 활용한 영상 기반 다중 사용자 증강현실 시스템 vol.21, pp.10, 2018, https://doi.org/10.9717/kmms.2018.21.10.1162