KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Regional Linear Warping for Image Stitching with Dominant Edge Extraction

  • Yoo, Jisung (Department of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST)) ;
  • Hwang, Sung Soo (Department of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST)) ;
  • Kim, Seong Dae (Department of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST)) ;
  • Ki, Myung Seok (Broadcasting & Telecommunications Convergence Media Research Department, Electronics and Telecommunications Research Institute (ETRI)) ;
  • Cha, Jihun (Broadcasting & Telecommunications Convergence Media Research Department, Electronics and Telecommunications Research Institute (ETRI))
  • Received : 2012.11.07
  • Accepted : 2013.01.25
  • Published : 2013.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

Image stitching techniques produce an image with a wide field-of-view by aligning multiple images with a narrow field-of-view. While conventional algorithms successfully stitch images with a small parallax, structure misalignment may occur when input images contain a large parallax. This paper presents an image stitching algorithm that aligns images with a large parallax by regional linear warping. To this end, input images are first approximated as multiple planar surfaces, and different linear warping is applied to each planar surface. For approximating input images as multiple planar surfaces, the concept of dominant edges is introduced. Dominant edges are defined as conspicuous edges of lines in input images, and extracted dominant edges identify the boundaries of each planar surface. Dominant edge extraction is conducted by detecting distinct changes of local characteristics around strong edge pixels. Experimental results show that the proposed algorithm successfully stitches images with a large parallax without structure misalignment.

Keywords

References

  1. M. Brown et al., "Automatic panoramic image stitching using invariant features," International Journal of Computer Vision, vol. 74, no. 1, 2007, pp. 59-73. https://doi.org/10.1007/s11263-006-0002-3
  2. P. Burt et al., "A multiresolution spline with applications to image mosaics," ACM Transactions on Graphics, vol. 2, no. 4, 1983, pp. 217-236. https://doi.org/10.1145/245.247
  3. J. Jia and C.-K. Tang, "Image stitching using structure deformation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 4, 2008, pp. 617-631. https://doi.org/10.1109/TPAMI.2007.70729
  4. A. Levin, A. Zomet, S. Peleg, and Y. Weiss, "Seamless image stitching in the gradient domain," in Proc. European Conference on Computer Vision, 2006. 4.
  5. M. Uyttendaele, et al., "Eliminating ghosting and exposure artifacts in image mosaics," in Proc. of IEEE Computer Vision and Pattern Recognition, 2001, pp. 509-516.
  6. S.B. Kang, et al., Seamless Stitching using Multi-Perspective Plane Sweep, Technical Report MSR-TR-2004-48, Microsoft Research, 2004.
  7. Q. Zhi and J.R. Cooperstock. "Toward Dynamic Image Mosaic Generation With Robustness to Parallax," IEEE Transactions on Image Processing, vol. 21, no. 1, Jan. 2012, pp. 366-378. https://doi.org/10.1109/TIP.2011.2162743
  8. J. Gao, S.J. Kim, and M. S. Brown, "Constructing Image Panoramas using Dual-Homography Warping," in Proc. of IEEE Computer Vision and Pattern Recognition, 2011.
  9. C.-K. Tang, "Eliminating structure and intensity misalignment in image stitching," in Proc. of IEEE International Conference on Computer Vision, 2005.
  10. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd Ed., Cambridge University Press, 2003.
  11. David G. Lowe, "Distinctive image features from scale-invariant keypoints," International Journal of Computer Vision, 60, 2 (2004), pp. 91-110. Article (CrossRef Link) https://doi.org/10.1023/B:VISI.0000029664.99615.94
  12. http://cs.unc.edu/-ccwu/siftgpu/
  13. Microsoft Image Composite Editor, http://resear ch.microsoft.com/enus/um/redmond/groups/ivm /ICE/
  14. http://www.adobe.com/products/ photoshop.
  15. http://cvlab.epfl.ch/brown/autostitch/autostitch .html.

Cited by

  1. Visual-Attention-Aware Progressive RoI Trick Mode Streaming in Interactive Panoramic Video Service vol.36, pp.2, 2013, https://doi.org/10.4218/etrij.14.2113.0012
  2. Fast image stitching method for handling dynamic object problems in Panoramic Images vol.11, pp.11, 2013, https://doi.org/10.3837/tiis.2017.11.013