Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Motion Estimation Method by Using Depth Camera

깊이 카메라를 이용한 움직임 추정 방법

  • Kwon, Soon-Kak (Dept. of Computer Software Engineering, Dongeui University) ;
  • Kim, Seong-Woo (Dept. of Computer Software Engineering, Dongeui University)
  • 권순각 (동의대학교 컴퓨터소프트웨어공학과) ;
  • 김성우 (동의대학교 컴퓨터소프트웨어공학과)
  • Received : 2012.05.14
  • Accepted : 2012.07.03
  • Published : 2012.07.30
Download PDF
⟨ Previous Next ⟩

Abstract

Motion estimation in video coding greatly affects implementation complexity. In this paper, a reducing method of the complexity in motion estimation is proposed by using both the depth and color cameras. We obtain object information with video sequence from distance information calculated by depth camera, then perform labeling for grouping pixels within similar distances as the same object. Three search regions (background, inside-object, boundary) are determined adaptively for each of motion estimation blocks within current and reference pictures. If a current block is the inside-object region, then motion is searched within the inside-object region of reference picture. Also if a current block is the background region, then motion is searched within the background region of reference picture. From simulation results, we can see that the proposed method compared to the full search method remains the almost same as the motion estimated difference signal and significantly reduces the searching complexity.

동영상 부호화에서 움직임 추정은 구현 복잡도에 가장 크게 영향을 미친다. 본 논문에서는 깊이 카메라와 색상 카메라를 동시에 이용하여 움직임 추정의 복잡도를 줄이는 방법을 제안한다. 깊이 카메라로부터 얻어진 거리 정보로 동영상내 객체 정보를 얻고, 비슷한 거리에 있는 화소들을 그룹화하여 동일한 객체로 라벨링을 수행한다. 라벨링된 현재 및 참조 화면내에서 움직임 추정 블록을 세부분(배경, 객체내부, 경계)의 탐색영역으로 구분하여 적응적으로 판단한다. 현재 블록이 객체내부영역이면 참조 화면에서 객체내부영역에만 움직임 추정을 탐색하고, 배경영역이면 블록은 참조 화면에서 배경영역에만 탐색한다. 모의실험을 바탕으로 전역탐색방법에 비하여 제안된 방법은 움직임 추정 차신호가 동일하게 유지되면서 탐색 복잡도가 크게 줄어듬을 확인할 수 있다.

Keywords

References

  1. S.-k. Kwon, A. Tamhankar, K. R. Rao, "Overview of H.264/MPEG-4 Part 10", Journal of Visual Communications and Image Representation, Vol. 17, No. 2, pp. 186-216, 2006. https://doi.org/10.1016/j.jvcir.2005.05.010
  2. K. Ugur, K. Andersson, A. Fuldseth, G. Bjontegaard, L. P. Endresen, J. Lainema, A. Hallapuro, J. Ridge, D. Rusanovskyy, C. Zhang, A. Norkin, C. Priddle, T. Rusert, J. Samuelsson, R. Sjoberg, Z. Wu, "High Performance, Low Complexity Video Coding and the Emerging HEVC Standard", IEEE Trans. Circuit Syst. Video Technology, Vol. 20, No. 12, pp.1688-1697, 2010. https://doi.org/10.1109/TCSVT.2010.2092613
  3. W.-J. Han, J. Min, I.-K. Kim, E. Alshina, A. Alshin, T. Lee, J. Chen, V. Seregin, S. Lee, Y. M. Hong, M.-S. Cheon, N. Shlyakhov, K. McCann, T. Davies, J.-H. Park, "Improved Video Compression Efficiency through Flexible Unit Representation and Corresponding Extension of Coding Tools", IEEE Trans. Circuit Syst. Video Technology, Vol. 20, No. 12, pp.1709-1720, 2010. https://doi.org/10.1109/TCSVT.2010.2092612
  4. F. Bossen, V. Drugeon, E. Francois, J. Jung, S. Kanumuri, M. Narroschke, H. Sasai, J. Sole, Y. Suzuki, T. K. Tan, T. Wedi, S. Wittmann, P. Yin, Y. Zheng, "Video Coding using a Simplified Block Structure and Advanced Coding Techniques", IEEE Trans. Circuit Syst. Video Technology, Vol. 20, No. 12, pp.1667-1675, 2010. https://doi.org/10.1109/TCSVT.2010.2092616
  5. S. Zhu, K.-K. Ma, "A New Diamond Search Algorithm for Fast Block-Matching Motion Estimation", IEEE Trans. Circuit Syst. Video Technology, Vol. 10, No. 2, pp.287-290, 2000.
  6. C. Zhu, X. Lin, L.-P. Chau, "Hexagon-based Search Pattern for Fast Block Motion Estimation", IEEE Trans. Circuit Syst. Video Technology, Vol. 12, No. 5, pp.349-355, 2002. https://doi.org/10.1109/TCSVT.2002.1003474
  7. X. Jing, L. P. Chau, "An Efficient Three-step Search Algorithm for Block Motion Estimation", IEEE Trans. Multimedia, Vol. 6, No. 3, pp.435-438, 2004. https://doi.org/10.1109/TMM.2004.827517
  8. M. Ezhilarasan P. Thambidurai, "Simplified Block Matching Algorithm for Fast Motion Estimation in Video Compression", Journal of Computer Science, Vol. 4, pp. 282-289, 2008. https://doi.org/10.3844/jcssp.2008.282.289
  9. Y. Nie, K.-K. Ma, "Adaptive irregular pattern search with matching prejudgment for fast block-matching motion estimation", IEEE Trans. Circuit Syst. Video Technology, Vol. 15, No. 6, pp.789-794, 2005. https://doi.org/10.1109/TCSVT.2005.848305
  10. L. Yang, K. Yu, J. Li, S. Li, "An Effective Variable Block-size Early Termination Algorithm for H.264 Video Coding", IEEE Trans. Circuit Syst. Video Technology, Vol. 15, No. 6, pp.784-788, 2005. https://doi.org/10.1109/TCSVT.2005.848306
  11. J.-F. Yang, S.-H. Chang, C.-Y. Chen, "Computation Reduction for Motion Search in Low Rate Video Coders", IEEE Trans. Circuit Syst. Video Technology, Vol. 12, No. 10, pp.948-951, 2002. https://doi.org/10.1109/TCSVT.2002.804892
  12. http://www.microsoft.com/en-us/default.aspx
  13. http://openni.org

Cited by

  1. A Study on High Speed Face Tracking using the GPGPU-based Depth Information vol.17, pp.5, 2013, https://doi.org/10.6109/jkiice.2013.17.5.1119
  2. Template-Matching-based High-Speed Face Tracking Method using Depth Information vol.18, pp.3, 2013, https://doi.org/10.5909/JBE.2013.18.3.349
  3. Presentation Method Using Depth Information vol.18, pp.3, 2013, https://doi.org/10.5909/JBE.2013.18.3.409
  4. Touch Pen Using Depth Information vol.18, pp.11, 2015, https://doi.org/10.9717/kmms.2015.18.11.1313
  5. A Recognition Method for Moving Objects Using Depth and Color Information vol.19, pp.4, 2016, https://doi.org/10.9717/kmms.2016.19.4.681