Science of Emotion and Sensibility (감성과학)

Korean Society for Emotion and Sensibility (한국감성과학회)
권호 표지
DOI QR코드

DOI QR Code

Affective Effect of Video Playback Style and its Assessment Tool Development

영상의 재생 스타일에 따른 감성적 효과와 감성 평가 도구의 개발

  • Received : 2016.02.29
  • Accepted : 2016.05.31
  • Published : 2016.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

This study investigated how video playback styles affect viewers' emotional responses to a video and then suggested emotion assessment tool for playback-edited videos. The study involved two in-lab experiments. In the first experiment, observers were asked to express their feelings while watching videos in both original playback and articulated playback simultaneously. By controlling the speed, direction, and continuity, total of twelve playback styles were created. Each of the twelve playback styles were applied to five kinds of original videos that contains happy, anger, sad, relaxed, and neutral emotion. Thirty college students participated and more than 3,800 words were collected. The collected words were comprised of 899 kinds of emotion terms, and these emotion terms were classified into 52 emotion categories. The second experiment was conducted to develop proper emotion assessment tool for playback-edited video. Total of 38 emotion terms, which were extracted from 899 emotion terms, were employed from the first experiment and used as a scales (given in Korean and scored on a 5-point Likert scale) to assess the affective quality of pre-made video materials. The total of eleven pre-made commercial videos which applied different playback styles were collected. The videos were transformed to initial (un-edited) condition, and participants were evaluated pre-made videos by comparing initial condition videos simultaneously. Thirty college students evaluated playback-edited video in the second study. Based on the judgements, four factors were extracted through the factor analysis, and they were labelled "Happy", "Sad", "Reflective" and "Weird (funny and at the same time weird)." Differently from conventional emotion framework, the positivity and negativity of the valence dimension were independently treated, while the arousal aspect was marginally recognized. With four factors from the second experiment, finally emotion assessment tool for playback-edited video was proposed. The practical value and application of emotion assessment tool were also discussed.

본 연구는 영상의 시간적 요소를 제어하였을 때 어떠한 감성적 효과가 나타나는가를 탐구하였고, 연구 결과를 기반으로 영상 감성 평가 도구를 개발하였다. 연구는 두 단계로 나누어 진행되었다. 첫 번째 연구에서는 원본 영상 대비 영상의 재생 스타일 적용이 야기할 수 있는 감성적 가치를 수집하고자 하였다. 영상의 배속, 방향성, 연속성 등 세가지 시간적 요소를 제어해 총 11 가지의 재생 스타일을 설정하였다. 그리고 재생 스타일 각각에 대하여 원본 영상과 견주어 어떠한 감성적 효과가 부가되는가를 어휘 형태로 수집하였다. 원본 영상으로는 중성적인 감성과 네 개의 감성 영상 - 기쁨, 여유로움, 화남, 슬픔 - 을 활용하였다. 실험을 통해 (N=30) 총 3,800 개의 단어들이 수집되었으며, 위 단어들은 899 종의 감성 어휘로 정리되었다. 그리고 감성 어휘들은 유의어 관계에 의해 총 52 가지의 감성 어휘 군집으로 최종 분류되었다. 두 번째 연구에서는 재생 스타일이 적용된 영상의 감성을 평가하는 도구를 개발하고자 하였다. 연구의 자극물로 재생 스타일이 적용된 11 가지 상업적 영상물을 수집하고, 각 영상을 재생 스타일이 적용되지 않은 원본 영상으로 변환하였다. 그리고 첫 번째 실험과 같이 재생 스타일이 적용된 영상과 원본 영상을 동시에 제시해, 재생 스타일에 의한 효과를 평가하였다. 평가자들은 (N=30) 감성 어휘 899 종 가운데 선별된 대표적인 영상 감성 어휘 38개에 대해 5 점 척도로 응답하였다. 요인 분석법을 통해 응답을 분석한 결과 총 4개의 감성 요인 - 기쁨, 슬픔, 회상적, 이상함 - 이 추출되었다. 이 4개 요인은 보편적인 정서 이론가 비교하여 기쁨과 슬픔이 공존한다는 차이점을 나타내었다. 추가적으로, 연구 결과를 토대로 애니메이션 기반의 감성 평가 도구를 개발한 후 이에 대한 활용 가치 및 응용 방안에 대하여 논의하였다.

Keywords

References

  1. Andrienko, N., Andrienko, G., Pelekis, N., & Spaccapietra, S. (2008). Basic concepts of movement data. In F. Giannotti, D. Pedreschi (Eds.), Mobility, Data Mining and Privacy - Geographic Knowledge Discovery, Berlin: Springer, 15-38.
  2. Block, B. (2008). The visual story: Creating the visual structure of film, TV and digital media, 2nd ed. Burlington, MA: Focal Press.
  3. Bonneel, N., Sunkavalli, K., Paris, S., & Pfister, H. (2013). Example-based video color grading. ACM Transactions on Graphics, 32(4), 39:1-39:12.
  4. Bradley, M. M. & Lang, P. J. (1994). Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry, 25(1), 49-59. https://doi.org/10.1016/0005-7916(94)90063-9
  5. Cacioppo, J. T., Bush, L. K., & Tassinary, L. G. (1992). Microexpressive facial actions as a function of affective stimuli: Replication and extension. Personality and Social Psychology Bulletin, 18(5), 515-526. https://doi.org/10.1177/0146167292185001
  6. Choi, E. Y. & Choi, H. (2010). Production techniques for mobile motion pictures base on smart phone. Korea Contents Association Thesis Journal, 10(5), 115-123.
  7. Desmet, P. (2003). Measuring emotion: Development and application of an instrument to measure emotional responses to products. In M. Blythe, K. Overbeeke, A.F. Monk, P. Wright (Eds.), Funology: From Usability to Enjoyment, Dordrecht: Kluwer Academic Publishers, 111-123.
  8. Detenber, B. H., Simons, R. F., & Reiss, J. E. (2000). The emotional significance of color in television presentations. Media Psychology, 2(4), 331-355. https://doi.org/10.1207/S1532785XMEP0204_02
  9. Hight, C. (2014). Automation within digital videography: From the Ken Burns effect to 'meaning-making' engines. Studies in Documentary Film, 8(3), 235-250. https://doi.org/10.1080/17503280.2014.961632
  10. Jeong, K. A., Choi, K., & Suk, H. J. (2015). Affective effect by articulation of the speed and color attributes of a video. 2015 Spring Conference of Korea Society of Color Studies (2015 한국색채학회 봄 학술 발표대회), 43-46.
  11. Kim, B., Kim, Y., Kim, D., & Park, Y. (2014). Analysis of sensibility based on color compensation in movie and drama. Journal of Korea Society of Color Studies, 28(2), 37-48. https://doi.org/10.17289/jkscs.28.2.201405.37
  12. Kim, K. B. & Kim, K. S. (2011). A study on UCC video editing for sensibility delivery. Journal of Digital Contents Society, 12(4), 449-456. https://doi.org/10.9728/dcs.2011.12.4.449
  13. Lang, P. J. (1980). Behavioral treatment and biobehavioral assessment: Computer applications. In J.B. Sidowski, J.H. Johnson, T.A. Williams (Eds.), Technology in mental health care delivery systems, Norwood, NJ: Ablex, 119-137.
  14. Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (2008). International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical report A-8, Gainesville, FL: University of Florida.
  15. Laban, R. (1975). Modern Educational Dance, 3rd ed. London: Macdonald & Evans.
  16. Lee, H. & Kim, Y. (2010). Analyses of users' responses and eye-movement patterns according to internet advertising purposes and forms. Journal of Korean Society of Design Science, 23(4), 195-206.
  17. Nam, T. J., Lee, J. H., Park, S., & Suk, H. J. (2014). Understanding the relation between emotion and physical movements. International Journal of Affective Engineering, 13(3), 217-226. https://doi.org/10.5057/ijae.13.217
  18. Pearlman, K. (2009). Cutting Rhythms: Shaping the Film Edit, 1st ed. Burlington, MA: Focal Press.
  19. Perrault, E. K. & Silk, K. J. (2014). Testing the effects of the addition of videos to a website promoting environmental breast cancer risk reduction practices: Are videos worth it? Journal of Applied Communication Research, 42(1), 20-40. https://doi.org/10.1080/00909882.2013.854400
  20. Schindler, K. & Van Gool, L. (2008). Action snippets: How many frames does human action recognition require? In Proceeding of IEEE Conference on Computer Vision and Pattern Recognition, 1-8.
  21. Suk, H. J. & Irtel, H. (2010). Emotional response to color across media. Color Research & Application, 35(1), 64-77. https://doi.org/10.1002/col.20554
  22. Visch, V. & Tan, E. (2007). Effect of film velocity on genre recognition. Media Psychology, 9(1), 59-75. https://doi.org/10.1080/15213260709336803
  23. Zettl, H. (2001). Sight, Sound, Motion: Applied Media Aesthetics, 3th ed. Belmont, CA: Wadsworth.