The Journal of the Korea institute of electronic communication sciences (한국전자통신학회논문지)

Korea Institute of Electronic Communication Science (한국전자통신학회)
권호 표지
DOI QR코드

DOI QR Code

Design and Implementation of Hashtag Recommendation System Based on Image Label Extraction using Deep Learning

딥러닝을 이용한 이미지 레이블 추출 기반 해시태그 추천 시스템 설계 및 구현

  • 김선민 (동서대학교 컴퓨터공학부) ;
  • 조대수 (동서대학교 소프트웨어학과)
  • Received : 2020.05.27
  • Accepted : 2020.08.15
  • Published : 2020.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

In social media, when posting a post, tag information of an image is generally used because the search is mainly performed using a tag. Users want to expose the post to many people by attaching the tag to the post. Also, the user has trouble posting the tag to be tagged along with the post, and posts that have not been tagged are also posted. In this paper, we propose a method to find an image similar to the input image, extract the label attached to the image, find the posts on instagram, where the label exists as a tag, and recommend other tags in the post. In the proposed method, the label is extracted from the image through the model of the convolutional neural network (CNN) deep learning technique, and the instagram is crawled with the extracted label to sort and recommended tags other than the label. We can see that it is easy to post an image using the recommended tag, increase the exposure of the search, and derive high accuracy due to fewer search errors.

소셜 미디어에서 일반적으로 게시물을 올릴 때 이미지의 태그 정보를 사용하는데, 태그를 이용하여 주로 검색이 이루어지기 때문이다. 사용자는 태그를 게시물에 붙임으로써 게시물을 많은 사람들에게 노출시키길 원한다. 또한, 사용자는 게시물과 함께 태깅될 태그를 붙이는 행위를 번거롭게 여겨 태깅하지 않은 게시물도 올리게 된다. 본 논문에서는 입력 이미지와 유사한 이미지를 찾아 해당 이미지에 부착된 레이블을 추출하여 그 레이블이 태그로 존재하는 인스타그램의 게시물들을 찾아 게시물 속 존재하는 다른 태그들을 추천해주는 방법을 제안한다. 제안하는 방법에서는 CNN(Convolutional Neural Network) 딥러닝 기법의 모델을 통하여 이미지로 부터 레이블을 추출하여 추출된 레이블로 인스타그램을 크롤링하여 레이블 외의 태그를 정렬하여 추천해준다. 추천된 태그를 이용하여 이미지를 게시하기도 편해지고, 검색의 노출을 높일 수 있고, 검색오류가 적어 높은 정확도를 도출할 수 있음을 알 수 있다.

Keywords

References

  1. Messo Media, "2019 Social Medea Trend," MezzoMedia Media & Market Report, 2019.
  2. J. Schmidhuber, "Deep learning in neural networks: An overview," Neural networks, vol. 61, 2015, pp. 85-117. https://doi.org/10.1016/j.neunet.2014.09.003
  3. J. Kong and M. Jang, "Association Analysis of Convolution Layer, Kernel and Accuracy in CNN," J. of the Korea Institute of Electronic Communication Sciences, vol. 14, no. 6, 2019, pp. 1153-1160. https://doi.org/10.13067/JKIECS.2019.14.6.1153
  4. Y. Jeong and C. Mi, "Efficient iris recognition using deep-learning convolution neural network(CNN)," J. of the Korea Institute of Electronic Communication Sciences, vol. 15, no. 3, 2020, pp. 521-526. https://doi.org/10.13067/JKIECS.2020.15.3.521
  5. Y. Kim, D. Kim, and S. Park, "Research on Robust Face Recognition against Lighting Variation using CNN," J. of the Korea Institute of Electronic Communication Sciences, vol. 12, no. 2, 2017, pp. 325-330. https://doi.org/10.13067/JKIECS.2017.12.2.325
  6. S. Rendle, C. Freudenthaler, Z. Gantner, and L. Schmidt-Thieme, "BPR:Bayesian personalized ranking from implicit feedback," AUAI Press, 2009, pp. 452-461.
  7. Y. An, G. Kim, and D. Lee, "Personalized tag recommendation system using deep learning," Proceedings of Korea Information Science Society, 2018, pp. 112-114.
  8. H. Jang and S. Cho. "Automatic Tagging for Social Images using Convolution Neural Networks," Journal of Korea Institute of Information Scientists and Engineers, vol. 43, no. 1, 2016, pp. 47-53.
  9. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, "Going deeper with convolutions," Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp 1-9.
  10. C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, "Rethinking the inception architecture for computer vision," Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp 2818-2826.