Journal of the Korean Institute of Intelligent Systems (한국지능시스템학회논문지)

Korean Institute of Intelligent Systems (한국지능시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Design of an observer-based decentralized fuzzy controller for discrete-time interconnected fuzzy systems

얼굴영상과 예측한 열 적외선 텍스처의 융합에 의한 얼굴 인식

  • Kong, Seong G. (Department of Computer Engineering, Sejong University)
  • 공성곤 (세종대학교 컴퓨터공학과)
  • Received : 2015.03.16
  • Accepted : 2015.05.13
  • Published : 2015.10.25
Download PDF
⟨ Previous Next ⟩

Abstract

This paper presents face recognition based on the fusion of visible image and thermal infrared (IR) texture estimated from the face image in the visible spectrum. The proposed face recognition scheme uses a multi- layer neural network to estimate thermal texture from visible imagery. In the training process, a set of visible and thermal IR image pairs are used to determine the parameters of the neural network to learn a complex mapping from a visible image to its thermal texture in the low-dimensional feature space. The trained neural network estimates the principal components of the thermal texture corresponding to the input visible image. Extensive experiments on face recognition were performed using two popular face recognition algorithms, Eigenfaces and Fisherfaces for NIST/Equinox database for benchmarking. The fusion of visible image and thermal IR texture demonstrated improved face recognition accuracies over conventional face recognition in terms of receiver operating characteristics (ROC) as well as first matching performances.

이 논문에서는 가시광선 얼굴영상과 그로부터 예측한 열 적외선 텍스처의 데이터 융합에 의한 얼굴인식 방법에 관하여 연구하였다. 제안하는 얼굴인식 기법은 가시광선 얼굴영상과 열 적외선 텍스처를 PCA에 의하여 낮은 차원의 특징공간에서 특징벡터로 변환한 다음, 다층 신경회로망을 사용하여 가시광선 영상 특징으로부터 얼굴의 열적외선 특징을 예측하여 열 적외선 텍스처를 생성하였다. 학습과정에서는 주어진 개체로부터 획득한 한 쌍의 가시광선 및 열 적외선 영상에 대해서 PCA를 이용하여 낮은 차원의 특징공간으로 변환한 다음, 가시광선 영상특징으로부터 열 분포 특징으로 매핑시키는 비선형 함수에 해당하는 신경회로망의 내부 파라미터를 결정한다. 학습된 신경회로망은 입력 가시광선 얼굴 특징으로부터 열 에너지 분포 특성의 PCA계수를 예측하고, 이로부터 열 적외선 텍스처를 생성한다. 대표적인 두 가지 얼굴인식 알고리즘 Eigenfaces와 Fisherfaces을 사용하여 NIST/Equinox 데이터베이스에 대하여 얼굴인식에 관한 실험을 수행하였다. 예측한 열 적외선 텍스처와 가시광선 얼굴영상의 데이터 융합결과는 가시광선 얼굴영상만을 사용한 경우에 비해서 얼굴인식의 성능이 개선되었음을 수신자 조작특성 (ROC) 및 첫 번째 매칭성능에 의하여 검증하였다.

Keywords

References

  1. W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld, "Face recognition: A literature survey," ACM Computing Surveys, Vol. 35, No. 4, pp.399-458, 2003. https://doi.org/10.1145/954339.954342
  2. I. Pavlidis and P. Symosek, "The imaging issue in an automatic face/disguise detection system," Proc. IEEE Workshop on Computer Vision Beyond the Visible Spectrum, pp.15-24, 2000.
  3. S. G. Kong, J. Heo, B. R. Abidi, J. Paik, and M. A. Abidi, "Recent advances in visual and infrared face recognition - A review," Computer Vision and Image Understanding, Vol. 97, No. 1, pp.103-135, 2005. https://doi.org/10.1016/j.cviu.2004.04.001
  4. S. G. Kong, J. Heo, F. Boughorbel, Y. Zheng, B. R. Abidi, A. Koschan, M. Yi, and M. A. Abidi, "Multiscale fusion of visible and thermal IR images for illumination-invariant face recognition," International Journal of Computer Vision, Vol. 71, No. 2, pp.215-233, 2007. https://doi.org/10.1007/s11263-006-6655-0
  5. G. Bebis, A. Gyaourova, S. Singh, and I. Pavlidis, "Face recognition by fusing thermal infrared and visible imagery," Image and Vision Computing, Vol. 24, No. 7, pp.727-742, 2006. https://doi.org/10.1016/j.imavis.2006.01.017
  6. M. Reiter, R. Donner, G. Langs, and H. Bischof, "3D and Infrared Face Reconstruction from RGB data using Canonical Correlation Analysis," Proc. Int. Conf. Pattern Recognition, Vol. 1, pp.425-428, 2006.
  7. J. Li, P. Hao, C. Zhang, and M. Dou, "Hallucinating faces from thermal infrared images," Proc. IEEE Int. Conf. Image Processing, pp.465-468, 2008.
  8. A. C. S. Chung and H. C. Shen, "Entropy-based Markov chains for multisensor fusion," Journal of Intelligent and Robotic Systems, Vol. 29, No. 2, pp.161-189, 2000. https://doi.org/10.1023/A:1008138126506
  9. K. Hornik, M. Stinchcombe, and H. White, "Multilayer feedforward networks are universal approximators," Neural Networks, Vol. 2, No. 5, pp.359-366, 1989. https://doi.org/10.1016/0893-6080(89)90020-8
  10. M. Turk and A. Pentland, "Eigenfaces for recognition," J. Cognitive Neuroscience, Vol. 3, No. 1, pp.71-86, 1991. https://doi.org/10.1162/jocn.1991.3.1.71
  11. J. S. Park, Y. H. Oh, S. C. Ahn, and S.-W. Lee, "Glasses removal from facial image using recursive error compensation," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 27, No. 5, pp.805-811, 2005. https://doi.org/10.1109/TPAMI.2005.103
  12. Y. S. Russell and C. Eberhart, "Particle swarm optimization: developments, applications and resources," Proc. 2001 Congress on Evolutionary Computation, Vol. 1, pp.81-86, 2001.
  13. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. Fisherfaces: recognition using class specific linear projection," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 19, No. 7, pp.711-720, 1997. https://doi.org/10.1109/34.598228
  14. J. Lu, K. N. Plataniotis, and A. N. Venetsano-poulos, "Face recognition using kernel direct discriminant analysis algorithms," IEEE Trans. on Neural Networks, Vol. 14, No. 1, pp.117-126, 2003. https://doi.org/10.1109/TNN.2002.806629
  15. X. He, S. Yan, Y. Hu, P. Niyogi, and H.-J. Zhang, "Face recognition using Laplacianfaces," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 27, No. 3, pp.328-340, 2005. https://doi.org/10.1109/TPAMI.2005.55
  16. http://www.equinoxsensors.com/products/HID.html
  17. A. S. Georghiades, P. N. Belhumeur, and D. J. Kriegman, "From few to many: illumination cone models for face recognition under variable lighting and pose," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 23, No. 6, pp.643-660, 2001. https://doi.org/10.1109/34.927464
  18. K. C. Lee, J. Ho, and D. J. Kriegman, "Acquiring linear subspaces for face recognition under variable lighting," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 27, No. 5, pp.684-698, 2005. https://doi.org/10.1109/TPAMI.2005.92
  19. J. R. Beveridge, D. Bolme, B. A. Draper, and M. Teixeira, "The CSU face identification evaluation system," Machine Vision and Applications, Vol. 16, No. 2, pp.128-138, 2005. https://doi.org/10.1007/s00138-004-0144-7
  20. S. Yeom, "Multi-frame Face Classification with Decision Level Fusion based on Photon Counting," Int'l Journal of Fuzzy Logic and Intelligent Systems, Vol. 14, No. 4, pp.332-339, Dec. 2014. https://doi.org/10.5391/IJFIS.2014.14.4.332