Smart Media Journal (스마트미디어저널)

THE KOREAN INSTITUTE OF SMART MEDIA (한국스마트미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Real-time Worker Safety Management System Using Deep Learning-based Video Analysis Algorithm

딥러닝 기반 영상 분석 알고리즘을 이용한 실시간 작업자 안전관리 시스템 개발

  • Received : 2020.05.26
  • Accepted : 2020.06.29
  • Published : 2020.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of this paper is to implement a deep learning-based real-time video analysis algorithm that monitors safety of workers in industrial facilities. The worker's clothes were divided into six classes according to whether workers are wearing a helmet, safety vest, and safety belt, and a total of 5,307 images were used as learning data. The experiment was performed by comparing the mAP when weight was applied according to the number of learning iterations for 645 images, using YOLO v4. It was confirmed that the mAP was the highest with 60.13% when the number of learning iterations was 6,000, and the AP with the most test sets was the highest. In the future, we plan to improve accuracy and speed by optimizing datasets and object detection model.

본 논문에서는 산업 시설에서 작업자의 안전을 실시간으로 감시하는 딥러닝 기반 영상 분석 시스템을 구현하는 데 목적을 둔다. 작업자의 복장을 안전모, 안전조끼, 안전벨트 착용 여부에 따라 총 여섯 가지의 클래스로 나누고, 총 5,307개의 영상을 학습데이터로 이용하였다. 실험은 속도와 정확도가 준수한 YOLO v4를 이용하였으며, 총 645장의 영상에 대해 학습 반복 수에 따른 가중치를 적용했을 때의 mAP를 비교함으로써 수행되었다. 학습 반복 수 6,000에서의 mAP가 60.13%로 제일 높았으며, 테스트셋이 가장 많은 클래스의 AP가 가장 높음을 확인하였다. 추후 데이터셋과 객체 검출 모델을 최적화함으로써, 정확도와 속도를 개선할 예정이다.

Keywords

References

  1. 고용노동부, "산업재해 현황분석", 2020
  2. J. Redmon, S. Divvala, R. Girshick, A. Farhadi, "You only look once: Unified, real-time object detection," the IEEE conference on computer vision and pattern recognition(CVPR), pp. 779-788, 2016.
  3. Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, Alexander CBerg, "SSD: Single shot multibox detector," the European Conference on Computer Vision(ECCV), pp. 21-37, 2016.
  4. Tsung-Yi Lin, Priya Goyal, Ross Girshick, Kaiming He, Piotr Dollar, "Focal loss for dense object detection," the IEEE International Conference on Computer Vision(ICCV), pp. 2980-2988, 2017.
  5. Ross Girshick, Jeff Donahue, Trevor Darrell, Jitendra Malik, "Rich feature hierarchies for accurate object detection and semantic segmentation," the IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp. 580-587, 2014.
  6. Ross Girshick, "Fast R-CNN," the IEEE International Conference on Computer Vision (ICCV), pp. 1440-1448, 2015.
  7. Shaoqing Ren, Kaiming He, Ross Girshick, Jian Sun, "Faster R-CNN: Towards real-time object detection with region proposal networks," Advances in Neural Information Processing Systems(NIPS), pp. 91-99, 2015.
  8. A. Krizhevsky, I. Sutskever, G. Hinton, "Imagenet classification with deep convolutional neural networks," Advances in Neural Information Processing Systems(NIPS), 2012.
  9. Karen Simonyan, Andrew Zisserman, "Very deep convolutional networks for large-scale image recognition," arXiv preprint arXiv:1409.1556, 2014.
  10. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, A. Rabinovich., "Going deeper with convolutions," CoRR, abs/1409.4842, 2014.
  11. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun, "Deep residual learning for image recognition," the IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp. 770-778, 2016.
  12. Gao Huang, Zhuang Liu, Laurens Van Der Maaten, Kilian Q Weinberger, "Densely connected convolutional networks," the IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp. 4700-4708, 2017.
  13. Andrew G Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, Hartwig Adam, "MobileNets: Efficient convolutional neural networks for mobile vision applications," arXiv preprint arXiv:1704.04861, 2017.
  14. Xiangyu Zhang, Xinyu Zhou, Mengxiao Lin, and Jian Sun, "ShuffleNet: An extremely efficient convolutional neural network for mobile devices," the IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp. 6848-6856, 2018.
  15. Joseph Redmon, Ali Farhadi, "YOLO9000: better, faster, stronger," the IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp. 7263-7271, 2017.
  16. Joseph Redmon, Ali Farhadi, "YOLOv3: An incremental improvement," arXiv preprint arXiv:1804.02767, 2018.
  17. Alexey Bochkovskiy, Chien-Yao Wang, Hong-Yuan Mark Liao, "YOLOv4: Optimal Speed and Accuracy of Object Detection," arXivpreprint arXiv:2004.10934, 2020.04.
  18. 박선,김종원, "오픈 소스 기반의 딥러닝을 이용한 적조생물 이미지 분류," 스마트미디어저널, 제7권, 제2호, 34-39쪽, 2018년 6월 https://doi.org/10.30693/SMJ.2018.7.2.34
  19. 김서정, 이재수, 김형석, "딥러닝을 이용한 양파밭의 잡초 검출 연구," 스마트미디어저널, 제7권, 제3호, 16-21쪽, 2018년 9월 https://doi.org/10.30693/SMJ.2018.7.3.16
  20. 이한솔, 김영관, 홍지만, "사물인식을 위한 딥러닝모델 선정 플랫폼," 스마트미디어저널, 제8권, 제2호, 66-73쪽, 2019년 06월 https://doi.org/10.30693/smj.2019.8.2.66