Journal of the Korea Society of Computer and Information (한국컴퓨터정보학회논문지)

Korean Society of Computer Information (한국컴퓨터정보학회)
권호 표지
DOI QR코드

DOI QR Code

Political Opinion Mining from Article Comments using Deep Learning

  • Sung, Dae-Kyung (Dept. of Computer Science and Engineering, Kyungpook National University) ;
  • Jeong, Young-Seob (Dept. of Big Data Engineering, Soonchunhyang University)
  • Received : 2017.11.01
  • Accepted : 2018.01.02
  • Published : 2018.01.31
Download PDF
⟨ Previous Next ⟩

Abstract

Policy polls, which investigate the degree of support that the policy has for policy implementation, play an important role in making decisions. As the number of Internet users increases, the public is actively commenting on their policy news stories. Current policy polls tend to rely heavily on phone and offline surveys. Collecting and analyzing policy articles is useful in policy surveys. In this study, we propose a method of analyzing comments using deep learning technology showing outstanding performance in various fields. In particular, we designed various models based on the recurrent neural network (RNN) which is suitable for sequential data and compared the performance with the support vector machine (SVM), which is a traditional machine learning model. For all test sets, the SVM model show an accuracy of 0.73 and the RNN model have an accuracy of 0.83.

Keywords

References

  1. KISA. "Internet Usage Survey in 2015", KISA, 2015.
  2. Jinju Hong, Sehan Kim, Jeawon Park & Jaehyun Choi. A Malicious Comments Detection Technique on the Internet using Sentiment Analysis and SVM, Journal of the Korea Institute of Information and Communication Engineering, 20(2), 260-267, 2016. https://doi.org/10.6109/jkiice.2016.20.2.260
  3. Hana Cho, Yeounoh Chung, Jaedong Lee and Jee-Hyong Lee, "Sentiment Analysis Using News Comments for Public Opinion Mining," Journal of the Korea Institute of Intelligent Systems, Vol. 23, No. 1, pp. 149-150, 2013.
  4. LeCun, Yann, Yoshua Bengio, and Geoffrey Hinton. "Deep learning." Nature 521.7553. 436-444, 2015 https://doi.org/10.1038/nature14539
  5. Dong, Chao, et al. "Image super-resolution using deep convolutional networks." IEEE transactions on pattern analysis and machine intelligence 38.2, 295-307. 2016. https://doi.org/10.1109/TPAMI.2015.2439281
  6. Lample, Guillaume, et al. "Neural architectures for named entity recognition." arXiv preprint arXiv:1603.01360, 2016.
  7. Nasukawa, Tetsuya, and Jeonghee Yi. "Sentiment analysis: Capturing favorability using natural language processing." Proceedings of the 2nd international conference on Knowledge capture. ACM, 2003.
  8. Jinju Hong, Sehan Kim, Jeawon Park and Jaehyun Choi, "A Malicious Comments Detection Technique on the Internet using Sentiment Analysis and SVM," Journal of the Korea Institute of Information and Communication Engineering, Vol. 20, No. 2, pp. 260-267, 2016. https://doi.org/10.6109/jkiice.2016.20.2.260
  9. Myo-Sil Kim and Seung-Shik Kang, "A Design and Implementation of Malicious Web Log Identification System by Using SVM," Proceedings of the 6th Annual Conference on Human and Cognitive Language Technology, , pp. 285-289, 2006
  10. Zhang, Dongwen, et al. "Chinese comments sentiment classification based on word2vec and SVM perf." Expert Systems with Applications 42.4 , 2015.
  11. Huang, Jin, Jingjing Lu, and Charles X. Ling. "Comparing naive Bayes, decision trees, and SVM with AUC and accuracy." Data Mining, 2003. ICDM 2003. Third IEEE International Conference on. IEEE, 2003.
  12. Kalchbrenner, Nal, and Phil Blunsom. "Recurrent Continuous Translation Models." EMNLP. Vol. 3. No. 39. 2013.
  13. Irsoy, Ozan, and Claire Cardie. "Opinion Mining with Deep Recurrent Neural Networks." EMNLP. 2014.
  14. Yang, Zichao, et al. "Hierarchical Attention Networks for Document Classification." HLT-NAACL. 2016.
  15. J.-P.S. Draye, D.A. Pavisic, G.A. Cheron, G.A. Libert, "Dynamic recurrent neural networks: a dynamical analysis", Systems Man and Cybernetics Part B: Cybernetics IEEE Transactions on, vol. 26, pp. 692-706, 1996 https://doi.org/10.1109/3477.537312
  16. Yao, Kaisheng, et al. "Recurrent neural networks for language understanding." Interspeech. 2013.
  17. Hochreiter, Sepp, and Jurgen Schmidhuber. "Long short-term memory." Neural computation 9.8, 1997.
  18. Chung, Junyoung, et al. "Empirical evaluation of gated recurrent neural networks on sequence modeling." arXiv preprint arXiv:1412.3555 2014.
  19. Fu, Rui, Zuo Zhang, and Li Li. "Using LSTM and GRU neural network methods for traffic flow prediction." Chinese Association of Automation (YAC), Youth Academic Annual Conference of. IEEE, 2016.
  20. Mikolov, Tomas, et al. "Efficient estimation of word representations in vector space." arXiv preprint arXiv:1301.3781 2013.
  21. M. Schuster and K. K. Paliwal, "Bidirectional recurrent neural networks," in IEEE Transactions on Signal Processing, vol. 45, no. 11, pp. 2673-2681, 1997. https://doi.org/10.1109/78.650093
  22. Pedregosa, Fabian, et al. "Scikit-learn: Machine learning in Python." Journal of Machine Learning Research 12.Oct 2825-2830, 2011.
  23. Luong, Minh-Thang, Hieu Pham, and Christopher D. Manning. "Effective approaches to attention-based neural machine translation." arXiv preprint arXiv:1508.04025 2015.
  24. Bahdanau, Dzmitry, et al. "End-to-end attention-based large vocabulary speech recognition." Acoustics, Speech and Signal Processing (ICASSP), 2016 IEEE International Conference on. IEEE, 2016.
  25. Yang, Zichao, et al. "Stacked attention networks for image question answering." Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. APA, 2016.
  26. Aharoni, Roee, Yoav Goldberg, and Israel Ramat-Gan. "Morphological Inflection Generation with Hard Monotonic Attention." Proceedings of ACL, 2017