Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Depth Map Upsampling with Improved Sharpness

선명도를 향상시킨 깊이맵 업샘플링 방법

  • 장성은 (강원대학교 컴퓨터정보통신공학과) ;
  • 이동우 (강원대학교 컴퓨터정보통신공학과) ;
  • 김성열 (광주과학기술원) ;
  • 최황규 (강원대학교 컴퓨터정보통신공학과) ;
  • 김만배 (강원대학교 컴퓨터정보통신공학과)
  • Received : 2012.09.03
  • Accepted : 2012.10.18
  • Published : 2012.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a new method to convert a low-resolution depth map into its high-resolution one called distance transform-based bilateral upsampling. Since the proposed method controls the spatial domain weighting function based on distance transform values of the depth map, it increases the input depth map resolution while preserving edge sharpness. The proposed method is composed of three main steps: distance transform, spatial weighting control, and image interpolation. Experimental results show that our method outperforms the conventional bilateral upsampling in terms of the quality of output depth maps.

본 논문은 저해상도의 깊이맵을 고해상도의 깊이맵으로 변환하는 새로운 방법인 거리 변환 기반의 양측 업샘플링 기법을 제안한다. 제안하는 방법은 깊이맵의 거리변환 값에 따라 공간 도메인 가중치 함수를 조절하기 때문에 에지의 선명도를 유지하면서 깊이맵의 해상도를 증가시킨다. 이를 위해, 제안하는 방법은 거리 변환 단계, 공간 가중치 조절 단계, 영상 보간 단계를 거친다. 다양한 실험 깊이 맵을 통한 실험에서 제안하는 방법이 기존의 양측 업샘플링 방법보다 출력 깊이맵의 화질 관점에서 성능이 좋아짐을 확인했다.

Keywords

References

  1. O. P. Gangwal and R. P. Benetty, "Depth map post-processing for 3D-TV," IEEE Trans. on Consumer Electronics, pp. 1-2, 2009.
  2. Y. Li, L. Sun, "A novel upsampling scheme for depth map compression in 3DTV system," Picture Coding Symposium(PCS), pp. 186-189, Dec. 2010.
  3. J. Park, H. Kim, Y. Tai, M. Brown, I. Kweon, "High quality depth map upsampling for 3D-TOF cameras," IEEE International Conference on Computer Vision (ICCV), pp. 1623-6630, Nov. 2011.
  4. R. G. Keys, "Cubic Convolution Interpolation for Digital Image Processing," IEEE Trans. on Acoustics, Speech and Signal Processing, vol. ASSP-29, no. 6, pp. 1153-1160, 1981.
  5. J. Kopf, M. Cohen, D. Kischinski, and M. Uyttendaele, "Joint Bilateral Upsampling," ACM Trans. on Graphics, vol.23, no.3, article 96, pp.2:1-2:9, 2007.
  6. Q. Yang, R. Yang, J. Davis, and D. Nister, "Spatial-depth super resolution for range images," Proc. of IEEE Conference on Computer Vision and Pattern Recognition, pp.1-8, 2007.
  7. J. Diebel and S. Thrun, "An application of markov random fields to range sensing," in NIPS, pp. 291-298, 2005.
  8. E. Lee, S. Kim, Y. Jung, Y. Ho, "High-resolution depth map generation by applying stereo matching based on initial depth information," 3DTV Conference, pp. 201-204, May 2008.
  9. G. Borgefors, "Hierarchical chamfer matching: a parametric edge matching algorithm," IEEE T. Patten Anal. Mach. Intell., 10(6), pp.849-865, 1988. https://doi.org/10.1109/34.9107
  10. Tomasi, C., and Manduchi, R. "Bilateral filtering for gray and color images," In Proc. IEEE Int. Conf. on Computer Vision, 836-846, 1998.
  11. D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms," International Journal of Computer Vision, vol. 47, no. 1-3, pp. 7-42, 2002. https://doi.org/10.1023/A:1014573219977

Cited by

  1. Analysis of Relationship between Objective Performance Measurement and 3D Visual Discomfort in Depth Map Upsampling vol.19, pp.1, 2014, https://doi.org/10.5909/JBE.2014.19.1.31