Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Precise Rectification of Misaligned Stereo Images for 3D Image Generation

입체영상 제작을 위한 비정렬 스테레오 영상의 정밀편위수정

  • Kim, Jae-In (Department of Geoinformatic Engineering, Inha University) ;
  • Kim, Tae-Jung (Department of Geoinformatic Engineering, Inha University)
  • 김재인 (인하대학교 지리정보공학과) ;
  • 김태정 (인하대학교 지리정보공학과)
  • Received : 2012.02.21
  • Accepted : 2012.03.23
  • Published : 2012.03.30
Download PDF
⟨ Previous Next ⟩

Abstract

The stagnant growth in 3D market due to 3D movie contents shortage is encouraging development of techniques for production cost reduction. Elimination of vertical disparity generated during image acquisition requires heaviest time and effort in the whole stereoscopic film-making process. This matter is directly related to competitiveness in the market and is being dealt with as a very important task. The removal of vertical disparity, i.e. image rectification has been treated for a long time in the photogrammetry field. While computer vision methods are focused on fast processing and automation, photogrammetry methods on accuracy and precision. However, photogrammetric approaches have not been tried for the 3D film-making. In this paper, proposed is a photogrammetry-based rectification algorithm that enable to eliminate the vertical disparity precisely by reconstruction of geometric relationship at the time of shooting. Evaluation of proposed algorithm was carried out by comparing the performance with two existing computer vision algorithms. The epipolar constraint satisfaction, epipolar line accuracy and vertical disparity of result images were tested. As a result, the proposed algorithm showed excellent performance than the other algorithms in term of accuracy and precision, and also revealed robustness about position error of tie-points.

3D 입체영상 콘텐츠 부족현상에 따른 3D 산업시장의 성장정체는 콘텐츠 제작비용 절감을 위한 관련기술 개발의 촉진을 야기하고 있다. 3D 입체영상 제작에서 가장 많은 시간과 노력을 요구하는 부분은 촬영 과정에서 발생된 수직시차의 제거라 할 수 있으며, 이는 시장 경쟁력과 직접적으로 관계되는 사안이라 매우 중요한 작업으로 다루어지고 있다. 비 정렬된 스테레오 영상의 수직시차 보정 즉, 편위수정(Rectification)은 사진측량분야에서 오랫동안 다루어 오던 문제로 컴퓨터 비전방식이 빠른 처리속도와 자동화에 초점이 맞추어져 있다면, 사진측량방식에서는 정확도와 정밀도 확보에 목적을 두고 있다. 허나 입체영화 제작에 있어 사진측량학적 관점으로 문제를 해결하려 한 시도는 그 사례를 찾아보기가 매우 힘들다. 이에 본 논문에서는 사진측량방식의 기술을 도입하여 촬영 당시의 기하학적 관계를 복원하고 이를 통해 수직시차를 제거할 수 있는 정밀 편위수정 알고리즘을 제안하고자한다 알고리즘의 성능평가는 기존 컴퓨터비전 알고리즘 두 가지와 성능비교를 통해 수행되었으며, 에피폴라 제약조건 만족도와 에피폴라 라인의 추정정확도, 그리고 정합점 간의 수직시차 측정을 통한 에피폴라 리샘플링의 정확도 등이 분석되었다. 실험결과, 제안 알고리즘은 정확도 및 정밀도 측면에서 비교 알고리즘들 보다 우수한 성능을 나타내었으며, 정합점 위치오차에 대해서도 강인함을 보여주었다.

Keywords

References

  1. T. M. Lambooij, W. A. Ijsselsteijn and I. Heynderickx, "Visual discomfort in stereoscopic displays: A review," in Proc. SPIE, vol. 6490, pp. 64900I, Jan. 2007.
  2. Y.-S. Kang and Y.-S. Ho, "An efficient image rectification method for parallel multi-camera arrangement," IEEE Trans. Consumer Electronics, vol. 57, no. 3, pp. 1041-1048, Aug. 2011. https://doi.org/10.1109/TCE.2011.6018853
  3. Z. Zhang, "A flexible new technique for camera calibration," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.22, no.11, pp.1330-1334, Nov. 2000. https://doi.org/10.1109/34.888718
  4. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd Ed., New York: Cambridge, 2003.
  5. H. C. Longuet-Higgins, "A Computer Algorithm for Reconstructing a Scene from Two Projections", Nature, vol. 293, pp. 133-135, 1981. https://doi.org/10.1038/293133a0
  6. R. I. Hartley, "In defence of the eight-point algorithm," Proc. of IEEE International Conference on Computer Vision, pp.1064-1070, Jun. 1995.
  7. T. Kim and I. Dowman, 2006. "Comparison of two physical sensor models for satellite images: position-rotation model and orbit-attitude model," The Photogrammetric Record, Vol. 21, No. 114, pp. 110-123, June 2006. https://doi.org/10.1111/j.1477-9730.2006.00363.x
  8. T. Kim, H. Kim and S. Rhee, "Investigation of Physical Sensor Models for Modelling SPOT 3 Orbits," The Photogrammetric Record, Vol. 22, No. 119, pp. 257-273, Sep. 2007. https://doi.org/10.1111/j.1477-9730.2007.00441.x
  9. T. Kim and J. Jeong, 2011. "DEM matching for bias compensation of rigorous pushbroom sensor models," ISPRS Journal of Photogrammetry and Remote Sensing, vol. 66, no. 5, pp. 692-699, Spe. 2011. https://doi.org/10.1016/j.isprsjprs.2011.06.002
  10. T. Kim, "A study on the epipolarity of linear pushbroom images," Photogrammetric Engineering and Remote Sensing, Vol. 66, No. 8, pp.961-966, Aug. 2000.
  11. H. Bay, A. Ess, T. Tuytelaars, L. V. Gool, "SURF: Speeded up robust features," Computer Vision and Image Understanding, vol.110, no.3, pp.346-359, Sep. 2008 https://doi.org/10.1016/j.cviu.2007.09.014
  12. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," International Journal of Computer Vistion, vol.60, no.2, pp.91-110, Nov. 2004. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  13. P. R. Wolf and B. A. Dewitt, Elements of photogrammetry with application in GIS, 3rd Ed., New York: McGraw-Hill, 2000.
  14. OpenCV library, http://sourceforge.net/projects/opencvlibrary.

Cited by

  1. Development of Photogrammetric Rectification Method Applying Bayesian Approach for High Quality 3D Contents Production vol.18, pp.1, 2013, https://doi.org/10.5909/JBE.2013.18.1.31
  2. Automated Image Alignment and Monitoring Method for Efficient Stereoscopic 3D Contents Production vol.19, pp.2, 2014, https://doi.org/10.5909/JBE.2014.19.2.205
  3. Hybrid Camera System with a TOF and DSLR Cameras vol.19, pp.4, 2014, https://doi.org/10.5909/JBE.2014.19.4.533
  4. 3D Accuracy Analysis of Mobile Phone-based Stereo Images vol.19, pp.5, 2014, https://doi.org/10.5909/JBE.2014.19.5.677