Smart Media Journal (스마트미디어저널)

THE KOREAN INSTITUTE OF SMART MEDIA (한국스마트미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Vehicle License Plate Recognition System using SSD-Mobilenet and ResNet for Mobile Device

SSD-Mobilenet과 ResNet을 이용한 모바일 기기용 자동차 번호판 인식시스템

  • 김운기 (홍익대학교 대학원 전자전기공학과) ;
  • ;
  • 조성원 (홍익대학교 전자전기공학부)
  • Received : 2020.02.07
  • Accepted : 2020.05.06
  • Published : 2020.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes a vehicle license plate recognition system using light weight deep learning models without high-end server. The proposed license plate recognition system consists of 3 steps: [license plate detection]-[character area segmentation]-[character recognition]. SSD-Mobilenet was used for license plate detection, ResNet with localization was used for character area segmentation, ResNet was used for character recognition. Experiemnts using Samsung Galaxy S7 and LG Q9, accuracy showed 85.3% accuracy and around 1.1 second running time.

본 논문은 고성능의 서버 없이 안드로이드 스마트폰 단독으로 동작할 수 있도록 경량화 딥러닝 모델을 사용하여 구현한 자동차 번호판 인식 시스템을 제안한다. 자동차 번호판 인식시스템은 [번호판검출]-[문자영역 분할]-[문자인식]으로 3단계의 과정으로 구성되며, 번호판검출은 SSD-Mobilenet, 문자영역 분할은 ResNet에 localization을 추가하여 사용하였고 문자인식은 ResNet을 이용하여 구현하였다. 테스트한 기기는 삼성 갤럭시 S7, LG Q9이며 정확도는 약 85.3%, 실행속도는 약 1.1초가 소요된다.

Keywords

References

  1. 송영준, 안재형, 김남, "자동차 번호판 인식 기술동향," 정보통신연구진흥원 학술정보(IITA), 2006
  2. M. A. Rafique, W. Pedrycz, and M. Jeon, "Vehicle license plate detection using region-based convolutional neural networks," Soft Computing, June 2017.
  3. R.-C. Hendry, Rung-Ching Chen,"Automatic License Plate Recognition via sliding-window darknet-YOLO deep learning," Image and Vision Computing, vol. 87, pp. 47-56, July 2019. https://doi.org/10.1016/j.imavis.2019.04.007
  4. Mohanad Hazim Nsaif Al-Mayyahi, Nawaf Hazim Barnouti, and Mohammed Abomaali,"Vehicle Detection and License Plate Recognition System," International Journal of Engineering & Technology, vol. 7, no. 4, pp. 3170-3174, 2018.
  5. R. G. von Gioi, et al, "LSD:A Fast Line Segment Detector with a False Detection Control," IEEE PAMI , vol. 32, no. 4, pp. 722-732, Apr. 2010. https://doi.org/10.1109/TPAMI.2008.300
  6. 응웬탄빈, 정선태, "주변 전경 픽셀 전파 알고리즘기반 실시간 이동 객체 검출," 전자공학회논문지, 제41권, 2004년 1월
  7. K. He, G. Gkioxari, P. Dollár and R. Girshick, "Mask R-CNN," 2017 IEEE International Conference on Computer Vision (ICCV), Venice, pp. 2980-2988, 2017.
  8. Liu, Wei, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott E. Reed, Cheng-Yang Fu and Alexander C. Berg, "SSD: Single Shot MultiBox Detector," ECCV (2016).
  9. Howard, Andrew G., Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto and Hartwig Adam, "MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications," ArXiv abs/1704.04861 (2017).
  10. K. He, X. Zhang, S. Ren and J. Sun, "Deep Residual Learning for Image Recognition," 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, pp. 770-778, 2016.
  11. 연우, "딥러닝(DBN) 기반 임베디드 차량 번호판인식 시스템에 관한 연구", 홍익대학교 석사학위논문, 2017
  12. Redmon, Joseph et al., "You Only Look Once: Unified, Real-Time Object Detection," 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 779-788, 2016.