Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Spatially Adaptive Color Demosaicing of Noisy Bayer Data

잡음을 고려한 공간적응적 색상 보간

  • Kim, Chang-Won (Institute of TMS Information Technology, Yonsei University) ;
  • Yoo, Du-Sic (Institute of TMS Information Technology, Yonsei University) ;
  • Kang, Moon-Gi (Institute of TMS Information Technology, Yonsei University)
  • 김창원 (연세대학교 TMS 정보기술사업단) ;
  • 유두식 (연세대학교 TMS 정보기술사업단) ;
  • 강문기 (연세대학교 TMS 정보기술사업단)
  • Published : 2010.03.25
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose spatially adaptive color demosaicing of noisy Bayer data. When sensor noises are not considered in demosaicing, they may degrade result image. In order to obtain high resolution image, sensor noises are considered in the color demosaicing step. We identify flat, edge and pattern regions at each pixel location to improve the performance of the algorithm and to reduce complexity. Based on the pre-classified regions, the demosaicing of the G channel is performed using the local statistics to reduce the interpolation error. The sensor noise is simultaneously removed by a modified version of non-local mean filter in the green and in the color difference domain. The R and B channels are interpolated easily using fully interpolated and denoised G and color difference values. Experimental results show that the proposed method achieves a significant improvement in terms of visual and numerical criteria, when compared to conventional methods.

본 논문은 잡음을 고려한 공간적응적 색상 보간 방법을 제안한다. 센서의 잡음은 색상 보간 과정에 영향을 미쳐서 결과 영상의 열화를 초래하기 때문에 센서의 잡음이 색상 보간 방법에 고려됨으로써 고해상도의 영상을 획득할 수 있다. 알고리즘의 성능 향상과 연산량의 효율성을 높이기 위해서 베이어 화소에서 평탄, 에지, 패턴 에지 영역으로 각각 구분한다. 영역에 따라 다른 마스크를 이용하여 국부 통계치를 계산하게 되고, 이를 이용해서 보간 오류가 최소화 되도록 G 색상을 보간한다. 잡음제거를 위해서는 수정된 Non-Local 평균 필터가 사용된나. R파 B 색상은 잡응이 제거되고 보간된 G 색상파 색차값을 이용해서 쉽게 보간된다. 제안된 알고리즘은 기존 알고리즘에 비해 주관적 및 객관적인 변에서 모두 뛰어난 결과를 보임을 실험을 통해 확인 할 수 있다.

Keywords

References

  1. B. E. Bayer, "Color imaging array," U.S. Patent 3 971 065, Jul. 1976.
  2. E. Choi, J. Choi, and M. G. Kang, "Super-Resolution Approach to Overcome Physical Limitations of Imaging Sensors : An Overview," International Journal of Imaging Systems and Technology, Wiley, vol. 14, issue 2, pp. 36-46, Aug. 2004. https://doi.org/10.1002/ima.20006
  3. J. F. Hamilton Jr. and J. E. Adams, "Adaptive color plane interpolation in single sensor color electronic camera," U.S. Patent 5 629 734, May 1997.
  4. R. Kimmel, "Demosaicing: Image reconstruction from color CCD samples,"IEEE Trans. Image Processing, vol. 8, no. 9, pp. 1221-1228, Sep. 1999. https://doi.org/10.1109/83.784434
  5. S. C. Pei and I. K. Tam, "Effective color interpolation in CCD color filter arrays using signal correlation," IEEE Trans. Circuits and systems for video technology, vol. 13, no. 6, pp. 503-513, Jun. 2003. https://doi.org/10.1109/TCSVT.2003.813422
  6. W. Lu and Y. Tan, "Color filter array demosaicking: New method and performance measures," IEEE Trans. Image Processing, vol. 12, no. 10, pp. 1194-210, Oct. 2003. https://doi.org/10.1109/TIP.2003.816004
  7. 김창원, 오현묵, 강문기, "영역 적응적 컬러보간 알고리듬", 대한전자공학회 하계종합학술대회, 용평리조트, 2008년 6월
  8. 오현묵, 강문기, "채널 간 국부 상관도에 기반 한 에지 적응적 컬러 보간", 대한전자공학회 하계종합학술대회, 용평리조트, 2008년 6월
  9. D. T. Kuan, A. A. Sawchuk, T. C. Strand, and P. Chavel, "Adaptive noise smoothing filter for images with signal-dependent noise," IEEE Trans. Pattern analysis and machine intelligence, vol PAMI-7, no. 2, Mar. 1985.
  10. O. Kalevo and H. Rantanen, "Noise Reduction Techniques for Bayer-Matrix Images," Proc. SPIE, vol. 4669, pp. 348-359, Apr. 2002.
  11. A. Buades, B. Coll, and J. M. Morel, "A non-local algorithm for image denoising," Proc. IEEE CVPR, vol. 2, pp. 60-65, 2005.
  12. C. Kim and M. G. Kang, "Noise Insensitive High Resolution Color Interpolation Scheme Considering Cross-Channel Correlation," SPIE Optical Engineering, vol. 44, issue 12, pp.127006-1-127006-15 , Dec. 2005. https://doi.org/10.1117/1.2149382
  13. K. Hirakawa and T. W. Parks, "Joint Demosaicing and Denoising," IEEE Trans. Image Processing, vol. 15, no. 8, pp. 2146-2157, Aug. 2006.
  14. L. Zhang, X. Wu, and D. Zhang "Color Reproduction From Noisy CFA Data of Single Sensor Digital Cameras," IEEE Trans. Image Processing, vol. 16, no. 9, pp. 2184-2197, Sep. 2007.
  15. D. Paliy, M. Trimeche, V. Katkovnik, and S. Alenius, "Spatially Adaptive Color Filter Array Interpolation for Noiseless and Noisy Data," International Journal of Imaging Systems and Technology (IJISP), Special Issue on Applied Color Image Processing, vol. 17, iss. 3, pp. 105-122, October 2007.