Journal of IKEEE (전기전자학회논문지)

Institute of Korean Electrical and Electronics Engineers (한국전기전자학회)
권호 표지
DOI QR코드

DOI QR Code

Smart Emotion Management System based on multi-biosignal Analysis using Artificial Intelligence

인공지능을 활용한 다중 생체신호 분석 기반 스마트 감정 관리 시스템

  • Noh, Ayoung (Dept. of Computer Science and Engineering, Koreatech University) ;
  • Kim, Youngjoon (Dept. of Computer Science and Engineering, Koreatech University) ;
  • Kim, Hyeong-Su (Dept. of Computer Science and Engineering, Koreatech University) ;
  • Kim, Won-Tae (Dept. of Computer Science and Engineering, Koreatech University)
  • Received : 2017.11.18
  • Accepted : 2017.12.08
  • Published : 2017.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

In the modern society, psychological diseases and impulsive crimes due to stress are occurring. In order to reduce the stress, the existing treatment methods consisted of continuous visit counseling to determine the psychological state and prescribe medication or psychotherapy. Although this face-to-face counseling method is effective, it takes much time to determine the state of the patient, and there is a problem of treatment efficiency that is difficult to be continuously managed depending on the individual situation. In this paper, we propose an artificial intelligence emotion management system that emotions of user monitor in real time and induced to a table state. The system measures multiple bio-signals based on the PPG and the GSR sensors, preprocesses the data into appropriate data types, and classifies four typical emotional states such as pleasure, relax, sadness, and horror through the SVM algorithm. We verify that the emotion of the user is guided to a stable state by providing a real-time emotion management service when the classification result is judged to be a negative state such as sadness or fear through experiments.

현대사회에서 스트레스로 인한 심리적 질병과 충동적 범죄들이 발생하고 있다. 스트레스를 줄이기 위한 기존 치료방법은 지속적인 방문 상담을 통해 심리상태를 파악하고, 약물치료나 심리치료로 처방하였다. 이러한 대면 상담 치료 방법은 효과적지만, 환자의 상태 판단에 많은 시간이 소요되며, 개인의 상황에 따라서 지속적인 관리가 어려운 치료 효율성의 문제가 있다. 본 논문에서 시청각적 스트레스에 의해 유발된 감정 상태를 실시간으로 분류하고, 사용자의 감정을 안정적인 상태로 유도하는 인공지능 감정 관리 시스템을 제안한다. 본 시스템은 PPG와 GSR를 이용하여 다중 생체신호를 측정하고, 적합한 데이터 형태로 변환하는 전처리 과정을 거쳐 SVM 알고리즘을 통해 기쁨, 진정, 슬픔, 두려움 등 대표적인 4가지의 감정 상태를 분류한다. 분류결과가 슬픔이나 두려움과 같은 부정적 상태로 판단되면, 실시간 감정관리 서비스를 제공하여 사용자의 감정이 안정적인 상태로 유도됨을 실험을 통해 검증한다.

Keywords

References

  1. J. H. Ha, S. H. An, "The Verification of a Structural Relationship Model of Suicidal Ideation to Stress, Coping Styles, Perfectionism, Depression, and Impulsivity," The Korean Journal of Counseling and Psychotherapy, vol. 20, no. 4, pp.1149-1171, 2008.
  2. D. H. Lee, J. Y. Kim and J. J. Kim, "An Exploratory Study on the Possibilities and Limitations of Online Psychotherapy," The Korean Journal of Counseling and Psychotherapy, vol. 27, no. 3, pp.543-582, 2015. https://doi.org/10.23844/kjcp.2015.08.27.3.543
  3. P. B. Koff, R. H. Jones, J. M. Cashman, N. F. Voelkel and R. W. Vandivier, "Proactive integrated care improves quality of life in patients with COPD," European Respiratory Journal, 33, pp.1031-1038, 2009. DOI: 10.1183/09031936.00063108
  4. K. H. Chon, J. Y. Oh, S. H. Park, Y. M. Jeong and D. I. Yang, "A Study on Algorithm of Emotion Analysis using EEG and HRV," Journal of the Korea Society of Computer and Information, vol. 15, no. 10, 2010, pp.105-112. DOI : 10.9708/jksci.2010.15.10.105
  5. J. H. Kim, Andre E, "Emotion recognition based on physiological changes in music listening," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 12, 2008, pp. 2067-2083. DOI: 10.1109/TPAMI.2008.26
  6. C. J. Kim, M. Whang and E. C. Lee, "Identification of arousal and relaxation by using SVM-based fusion of PPG Features," World Academy of Science, Engineering and Technology International Journal of Psychological and Behavioral Sciences, vol. 5, pp.12-14., 2011.
  7. H. Kurniawan, A. V, Maslov, and M. Pechenizkiy, "Stress detection from speech and galvanic skin response signals," Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems IEEE, 2013. DOI: 10.1109/CBMS.2013.6627790
  8. J. J. Kang, M. J. Lim, and K. Y. Lee, "Design and Implementation of an Emotion Recognition System using Physiological Signal," The Journal of The Institute of Internet, Broadcasting and Communication, vol, 10. no.1, pp.57-62, 2010.
  9. J. E. Lee, B. N. Kim and S. K. Yoo, "Neural-network based Computerized Emotion Analysis using Multiple Biological Signals," Korean Journal of the science of Emotion & sensibility, vol. 20, no. 2, pp.161-170, 2017. https://doi.org/10.14695/KJSOS.2017.20.2.161