DOI QR코드

DOI QR Code

Development of Facial Expression Recognition System based on Bayesian Network using FACS and AAM

FACS와 AAM을 이용한 Bayesian Network 기반 얼굴 표정 인식 시스템 개발

  • 고광은 (중앙대학교 전자전기공학부) ;
  • 심귀보 (중앙대학교 전자전기공학부)
  • Received : 2009.04.06
  • Accepted : 2009.06.13
  • Published : 2009.08.25

Abstract

As a key mechanism of the human emotion interaction, Facial Expression is a powerful tools in HRI(Human Robot Interface) such as Human Computer Interface. By using a facial expression, we can bring out various reaction correspond to emotional state of user in HCI(Human Computer Interaction). Also it can infer that suitable services to supply user from service agents such as intelligent robot. In this article, We addresses the issue of expressive face modeling using an advanced active appearance model for facial emotion recognition. We consider the six universal emotional categories that are defined by Ekman. In human face, emotions are most widely represented with eyes and mouth expression. If we want to recognize the human's emotion from this facial image, we need to extract feature points such as Action Unit(AU) of Ekman. Active Appearance Model (AAM) is one of the commonly used methods for facial feature extraction and it can be applied to construct AU. Regarding the traditional AAM depends on the setting of the initial parameters of the model and this paper introduces a facial emotion recognizing method based on which is combined Advanced AAM with Bayesian Network. Firstly, we obtain the reconstructive parameters of the new gray-scale image by sample-based learning and use them to reconstruct the shape and texture of the new image and calculate the initial parameters of the AAM by the reconstructed facial model. Then reduce the distance error between the model and the target contour by adjusting the parameters of the model. Finally get the model which is matched with the facial feature outline after several iterations and use them to recognize the facial emotion by using Bayesian Network.

얼굴 표정은 사람의 감정을 전달하는 핵심 메커니즘으로 이를 적절하게 활용할 경우 Robotics의 HRI(Human Robot Interface)와 같은 Human Computer Interaction에서 큰 역할을 수행할 수 있다. 이는 HCI(Human Computing Interface)에서 사용자의 감정 상태에 대응되는 다양한 반응을 유도할 수 있으며, 이를 통해 사람의 감정을 통해 로봇과 같은 서비스 에이전트가 사용자에게 제공할 적절한 서비스를 추론할 수 있도록 하는 핵심요소가 된다. 본 논문에서는 얼굴표정에서의 감정표현을 인식하기 위한 방법으로 FACS(Facial Action Coding System)와 AAM(Active Appearance Model)을 이용한 특징 추출과 Bayesian Network 기반 표정 추론 기법이 융합된 얼굴표정 인식 시스템의 개발에 대한 내용을 제시한다.

Keywords

References

  1. Ekman, P. & Friesen, W. V, 'The repertoire of nonverbal behavior : Categories, origins, usage, and coding. Semiotica, 1, pp. 49-98
  2. Mark Weiser, 'The Computer for 21st Century', ACM SIGMOBILE Mobile Computing and Communications Review archive, Vol 3, Issue 3, pp.3-11, July 1999 https://doi.org/10.1145/329124.329126
  3. Shi Yi-Bin, Zhang Jian-Ming, Tian Jian-Hua, Zhou Geng-Tao, 'An improved facial feature localization method based on ASM,' Computer-Aided Industrial design and Conceptual design, 2006, CAIDCD '06 7th international conference on
  4. Seiji Kobayasho and Shuji Hashimoto, Automated feature extraction of face image and its applications, in: International workshop on Robot and Human Communication, pp. 164-169
  5. T.F Cootes, G.J. Edwards and C.J. Taylor, 'Active Appearance Model,' IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.23, No.6, June 2001, pp. 681-685 https://doi.org/10.1109/34.927467
  6. 박지형, '유비쿼터스 환경에서의 상황 인지 시스템 –연구 활동 소개 도우미–', 한국정밀공학회지, 제21권, 제11호 pp. 31-37, 2004. 11
  7. 황금성, 조성배, '베이지안 네트워크의 학습', 로봇공학회지, 제3권, 제4호, pp.15-17, 2006. 10
  8. P. Ekman and W. Friesen. Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto, 1978

Cited by

  1. System Development for Measuring Group Engagement in the Art Center vol.20, pp.3, 2014, https://doi.org/10.13088/jiis.2014.20.3.045
  2. A Face Expression Recognition Method using Histograms vol.20, pp.5, 2014, https://doi.org/10.5302/J.ICROS.2014.14.9030