IEMEK Journal of Embedded Systems and Applications (대한임베디드공학회논문지)

Institute of Embedded Engineering of Korea (대한임베디드공학회)
권호 표지
DOI QR코드

DOI QR Code

An Implementation of Real-time Image Warping Using FPGA

FPGA를 이용한 실시간 영상 워핑 구현

  • Received : 2014.07.08
  • Accepted : 2014.10.14
  • Published : 2014.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

As a kind of 2D spatial coordinate transform, image warping is a basic image processing technique utilized in various applications. Though image warping algorithm is composed of relatively simple operations such as memory accesses and computations of weighted average, real-time implementations on embedded vision systems suffer from limited computational power because the simple operations are iterated as many times as the number of pixels. This paper presents a real-time implementation of a look-up table(LUT)-based image warping using an FPGA. In order to ensure sufficient data transfer rate from memories storing mapping LUT and image data, appropriate memory devices are selected by analyzing memory access patterns in an LUT-based image warping using backward mapping. In addition, hardware structure of a parallel and pipelined architecture is proposed for fast computation of bilinear interpolation using fixed-point operations. Accuracy of the implemented hardware is verified using a synthesized test image, and an application to real-time lens distortion correction is exemplified.

Keywords

References

  1. S.-M. Lee, "Fast laser triangular measurement system using ARM and FPGA," IEMEK J. Embed. Sys. Appl., Vol. 8, No. 1, pp. 25-29, 2013 (in Korean).
  2. J. Park, S.-C. Byun, B.-U. Lee, "Lens distortion correction using ideal image coordinates," IEEE Transactions on Consumer Electronics, Vol. 55, No. 3, pp. 987-991, 2009. https://doi.org/10.1109/TCE.2009.5278053
  3. Z. Chen, C. Wu, H.T. Tsui, "A new image rectification algorithm," Pattern Recognition Letters, Vol. 24, No. 1-3, pp. 251-260, 2003. https://doi.org/10.1016/S0167-8655(02)00239-8
  4. M. Brown, D.G. Lowe, "Automatic panoramic image stitching using invariant features," International Journal of Computer Vision, Vol. 74, No. 1, pp. 59-73, 2007. https://doi.org/10.1007/s11263-006-0002-3
  5. W. Yu, "An embedded camera lens distortion correction method for mobile computing applications," IEEE Transactions on Consumer Electronics, Vol. 49, No. 4, pp. 894-901, 2003. https://doi.org/10.1109/TCE.2003.1261171
  6. K.T. Gribbon, C.T. Johnston, D.G. Bailey, "A real-time FPGA implementation of a barrel distortion correction algorithm with bilinear interpolation," Proc. of the Image and Vision Computing New Zealand 2003, pp. 408-413, 2003.
  7. C. Vancea, S. Nedevschi, "LUT-based image rectification module implemented in FPGA," Proceedings of IEEE International Conference on Intelligent Computer Communication and Processing, pp. 147-154, 2007.
  8. S. Oh, G. Kim, "FPGA-based fast image warping with data-parallelization schemes," IEEE Transactions on Consumer Electronics, Vol. 54, No. 4, pp. 2053-2059, 2008. https://doi.org/10.1109/TCE.2008.4711272
  9. A. Serguienko, Evaluation of image warping algorithms for implementation in FPGA, Master thesis, Linkopings universitet, Sweden, 2008.
  10. P. Greisen, S. Heinzle, M. Gross, A. P Burg, "An FPGA-based processing pipeline for high-definition stereo video," Journal of Image and Video Processing, Vol. 2011, No. 18, pp. 1-13, 2011.
  11. P. Giacon, S. Saggin, G. Tommasi, M. Busti, "Implementing DSP Algorithms Using Spartan-3 FPGAs," DPS Magazine, Issue 1, pp. 16-19, 2005.
  12. D.-J. Kim, Y.-S. Park, "An implementation of FPGA embedded system for real-time SONAR signal display using the triple buffering method," IEMEK J. Embed. Sys. Appl., Vol. 9, No. 3, pp. 173-182, 2014 (in Korean). https://doi.org/10.14372/IEMEK.2014.9.3.173
  13. E.L. Oberstar, "Fixed-point representation & fractional math," Tech. Report, Oberstar Consulting, 2007.
  14. M.D. Ciletti, Advanced Digital Design with the Verilog HDL, Prentice Hall, 2010.
  15. Y. Hwang, M. Song, "Design of a CMOS image sensor based on a 10-bit two-step single-slope ADC," Journal of Semiconductor Technology and Science, Vol. 14, No. 2, pp. 246-251, 2014. https://doi.org/10.5573/JSTS.2014.14.2.246
  16. J. Weng, P. Cohen, M. Herniou, "Camera calibration with distortion models and accuracy evaluation," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 14, No. 10, pp. 965-980, 1992. https://doi.org/10.1109/34.159901

Cited by

  1. Image Cache for FPGA-based Real-time Image Warping vol.53, pp.6, 2016, https://doi.org/10.5573/ieie.2016.53.6.091