The Journal of Korea Robotics Society (로봇학회논문지)

Korea Robotics Society (한국로봇학회)
권호 표지
DOI QR코드

DOI QR Code

Facial Feature Tracking Using Adaptive Particle Filter and Active Appearance Model

Adaptive Particle Filter와 Active Appearance Model을 이용한 얼굴 특징 추적

  • Cho, Durkhyun (Department of Electronics and Computer Engineering, Hanyang University) ;
  • Lee, Sanghoon (Department of Intelligent Robot Engineering, Hanyang University) ;
  • Suh, Il Hong (Department of Computer Sciences and Engineering, College of Engineering, Hanyang University)
  • Received : 2012.12.21
  • Accepted : 2013.05.10
  • Published : 2013.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

For natural human-robot interaction, we need to know location and shape of facial feature in real environment. In order to track facial feature robustly, we can use the method combining particle filter and active appearance model. However, processing speed of this method is too slow. In this paper, we propose two ideas to improve efficiency of this method. The first idea is changing the number of particles situationally. And the second idea is switching the prediction model situationally. Experimental results is presented to show that the proposed method is about three times faster than the method combining particle filter and active appearance model, whereas the performance of the proposed method is maintained.

Keywords

References

  1. A. Mehrabian, "Communication without words," Psychological Today, vol. 2, pp. 53-55, 1968.
  2. P. Ekman and H. Oster, "Facial expressions of emotion," Annual review of psychology, 30(1), pp. 527-554, 1979. https://doi.org/10.1146/annurev.ps.30.020179.002523
  3. I Eibl-Eibesfeldt, "The Expressive Behaviour of the Deaf-and-Blind-Born," Social communication and movement, 1973.
  4. T.F. Cootes, G.J. Edwards, and C.J. Taylor, "Active appearance models," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 681-685, 2001. https://doi.org/10.1109/34.927467
  5. T.F. Cootes and C.J. Taylor, "Statistical models of appearance for computer vision," Online technical report, 2004.
  6. D. Tao, M. Song, X. Li, J. Shen, J. Sun, X. Wu, C. Faloutsos, and S. Maybank, "Bayesian tensor approach for 3-D face modeling," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 10, pp. 1397-1410, 2008. https://doi.org/10.1109/TCSVT.2008.2002825
  7. J. Liebelt, X. Jing, and Y. Jie, "Robust aam fitting by fusion of images and disparity data," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., pp. 2483-2490, 2006.
  8. G.J. Edwards, C.J. Taylor, and T.F. Cootes, "Interpreting face images using active appearance models," in Proc. IEEE Int. Conf. Autom. Face and Gesture Recog., pp. 300-305, 1998.
  9. G.J. Edwards, T.F. Cootes, and C.J Taylor, "Face recognition using active appearance models," in ECCV, 1998.
  10. L. Wiskott, J.M. Fellous, N. Kruger, and C.von der Malsburg, "Face recognition by elastic bunch graph matching," in ICIP, 1997.
  11. J. Wan, X. Renm, and G. Hu, "Automatic red-eyes detection based on AAM," in Proc. IEEE Int. Conf. Syst., Man Cybern., vol. 7, pp. 6337-6341, 2004.
  12. S.C. Mitchel, B.P.F. Lelieveldt, R.J. van der Geest, H.G. Bosch, J.H.C. Reiver, and M. Sonka, "Multistage hybrid active appearance model matching: Segmentation of left and right ventricles in cardiac MR images," IEEE Trans. Med. Imag., vol. 20, no. 5, pp. 415-423, 2001. https://doi.org/10.1109/42.925294
  13. G. Dedeoglu, S. Baker, and T. Kanade, "Resolution-aware fitting of active appearance models to low-resolution images," in ECCV, pp. 83-97, 2006.
  14. T.F. Cootes, G.V. Wheeler, K.N. Walker, and C.J. Taylor, "View-based active appearance models," in Proc. IEEE Int. Conf. Autom. Face Gesture Recog., pp. 227-232, 2000.
  15. X. Hou, S. Li, H. Zhang, and Q. Cheng, "Direct appearance models," In CVPR, vol. 1, pp. 828-833, 2001.
  16. C. Liu, H-Y. Shum, and C. Zhang, "Hierarchical shape modeling for automatic face localization," In ECCV, pp. 687-703, 2002.
  17. L. Liang, F. Wen, Y.-Q. Xu, X. Tang, and H.-Y. Shum, "Accurate face alignment using shape constrained markov network," in CVPR, vol. 1, pp. 1313-1319, 2006.
  18. L. Gu and T. Kanade, "3d alignment of face in a single image," in CVPR, pp. 1305-1312, 2006.
  19. X. Liu, "Generic face alignment using boosted appearance model," in CVPR, pp. 1-8, 2007.
  20. M.B. Stegmann, "Object tracking using active appearance models," In Proc. 10th Danish Conference on Pattern recognition and Image Analysis, vol. 1, pp. 54-60, 2001.
  21. A. Doucet, N. Freitas, and N. Gordon, "Sequential Monte Carlo Methods in Practice," Springer-Verlag, 2001.
  22. M. Isard and A. Blake, "CONDENSATION - Conditional Density Propagation for Visual Tracking," International Journal of Computer Vision, vol. 29, no. 1, pp. 5-28, 1998. https://doi.org/10.1023/A:1008078328650
  23. S. Fleck, M. Hoffmann, K. Hunter, and A. Schilling, "PFAAM-An Active Appearance Model based Particle Filter for both Robust and Precise Tracking," in fourth Canadian Conference on Computer and Robot Vision, 2007.
  24. S. Hamlaoui and F. Davoine, "Facial Action Tracking Using an AAM-Based Condensation Approach," in IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005.
  25. L. Zhao and J. Tao, "Fast Facial Feature Tracking with Multi-Cue Particle Filter," in International Conference on Image and Vision Computing. Hamilton, New Zealand, pp. 7-12, 2007.
  26. C. Goodall, "Procrustes methods in the statistical analysis of shape," J. Roy. Statist. Soc. B, vol. 53, no. 2, pp. 285-339, 1991.
  27. I. Jolliffe, "Principal Component Analysis," Encyclopedia of Statistics in Behavioral Science, 2005.
  28. D. Fox, "Adapting the Sample Size in Particle Filters Through KLD-Sampling," The International Journal of Robotics Research, vol. 22, no. 12, pp. 985-1003, 2003. https://doi.org/10.1177/0278364903022012001
  29. J.A. Rice, "Mathematical Statistics and Data Analysis," 2nd edition, Duxbury Press, Belmont, CA, 1995.
  30. N. Johnson, S. Kotz, and N. Balakrishnan, "Continuous Univariate Distributions," vol. 1, Wiley, New York, 1994.

Cited by

  1. A Study on Facial Wrinkle Detection using Active Appearance Models vol.12, pp.7, 2014, https://doi.org/10.14400/JDC.2014.12.7.239
  2. 윤곽선의 선분 근사화를 활용한 양팔 화가 로봇의 개발 vol.9, pp.3, 2013, https://doi.org/10.7746/jkros.2014.9.3.140
  3. 감시경계 로봇의 그래픽 사용자 인터페이스 설계 vol.10, pp.1, 2013, https://doi.org/10.7746/jkros.2015.10.1.024
  4. 능동적 윤곽 모델과 색상 기반 파티클 필터를 결합한 얼굴 추적 vol.40, pp.10, 2015, https://doi.org/10.7840/kics.2015.40.10.2090