Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Optical Flow Based Vehicle Counting and Speed Estimation in CCTV Videos

Optical Flow 기반 CCTV 영상에서의 차량 통행량 및 통행 속도 추정에 관한 연구

  • 김지혜 (LIG넥스원 항공연구소.Project 5팀) ;
  • 신도경 (LIG넥스원 항공연구소.Project 5팀) ;
  • 김재경 (LIG넥스원 항공연구소.Project 5팀) ;
  • 권철희 (LIG넥스원 항공연구소.Project 5팀) ;
  • 변혜란 (연세대학교 컴퓨터과학과)
  • Received : 2017.04.03
  • Accepted : 2017.07.07
  • Published : 2017.07.30
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes a vehicle counting and speed estimation method for traffic situation analysis in road CCTV videos. The proposed method removes a distortion in the images using Inverse perspective Mapping, and obtains specific region for vehicle counting and speed estimation using lane detection algorithm. Then, we can obtain vehicle counting and speed estimation results from using optical flow at specific region. The proposed method achieves stable accuracy of 88.94% from several CCTV images by regional groups and it totally applied at 106,993 frames, about 3 hours video.

본 논문에서는 교통관제용 CCTV로부터 촬영된 영상에서 교통 상황 분석을 위해 차량의 통행량 및 통행 속도를 획득하는 방법을 제안한다. 제안하는 방법은 촬영된 영상에 역 투영 사상(IPM, Inverse Perspective Mapping) 방법을 이용하여 카메라 각도에 따른 시각적 관점에서 기인한 왜곡을 제거하고, 차선 검출 알고리즘을 통해 1) 차량 통행량, 2) 차량 통행 속도를 측정할 소정 영역을 획득한다. 소정 영역에 대하여 광류(Optical flow) 기반 모션 추정을 이용하여 차량 통행량 및 통행 속도를 획득한다. 본 논문에서 제안한 방법을 지역별 다양한 CCTV 영상인 총 106,993 프레임, 약 세 시간 길이의 영상에 적용하여 88.94%의 검출 성능을 얻을 수 있었다.

Keywords

References

  1. EunJu Lee, Jae-Yeal Nam, ByoungChul Ko, "Speed-limit Sign Recognition Using Convolutional Neural Network Based on Random Forest", The Korean Institute of Broadcast and Media Engineers, pp.938-949, 2015.
  2. Kum, Chang-Hoon, Cho, Dong-Chan, Kim, Whoi-Yul, "Development of Lane Detection System using Surrounding View Image of Vehicle", The Korean Institute of Broadcast and Media Engineers, pp.331-334, 2013.
  3. Hyung-Sub Kang, Dong-Chan Cho and Whoi-Yul Kim, "Passing Vehicle Detection using Local Binary Pattern Histogram", The Korean Institute of Broadcast and Media Engineers, pp.261-264, 2010.
  4. A. Tourani and A. Shahbahrami, "Vehicle Counting Method Based on Digital Image Processing Algorithms," IEEE Transactions on International Conference on Pattern Recognition and Image Analysis, pp. 1-6, 2015.
  5. Y. Xia, X. Shi, G. Song, Q. Geng and Y. Liu, "Towards imporving quality of video-based vehicle counting method for traffic flow estimation," Signal Processing, pp. 672-681, 2016.
  6. X. Qimin, L. Xu, W. Mingming, L. Bin and S. Xianghui, "A Methodology of Vehicle Speed Estimation Based on Optical Flow," IEEE International Conference on Service Operations and Logistics and Informaitcs, pp. 33-37, 2014.
  7. J. Lan, J. Li, G. Hu, B. Ran, L. Wang, "Vehicle speed measurement based on gray constraint optical flow algorithm," International Journal of Light and Eletron Optics, pp. 289-295, 2014.
  8. M.S. Shirazi and B. Morris, "A Typical Video-based Framework for Counting, Behavior and Safety Analysis at Intersections," IEEE Transactions on Intelligent Vehicles Symposium, pp. 1264-1269, 2015.
  9. S.C. Diamantas and P. Dasgupta, "Active Vision Speed Estimation from Optical Flow," Towardss Autonomous Robotic Systems, pp. 173-184, 2014.
  10. X. Yu, X. Gao, "Review of Vehicle State Estimation Problem under Driving Situation," Chinese Journal of Mechanical Engineering, pp. 20-33, 2009.
  11. D.C. Luvizon, B.T. Nassu and R. Minetto, "Vehicle speed estimation by license plate detection and tracking," IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 6563-6567, 2014.
  12. E. Patel and D. Shukla, "Comparison of Optical Flow Algorithms for Speed Determination of Moving Objects," International Journal of Computer Applications, Vol. 63, No. 5, pp. 32-37, 2013. https://doi.org/10.5120/10465-5180
  13. D. Ding, J.S. Yoo, J.K. Jung and S. Kwon, "An Urban Lane Detection Method Based on Inverse Perspective Mapping," NGCIT, Advanced Science and Technology Letters, vol. 63 pp.53-58, 2014.
  14. S. Aslani and H. Mahdavi-Nasab, "Optical Flow Based Moving Object Detection and Tracking for Traffic Surveillance," International Journal of Electrical, Computer, Energetic, Electronic and Communication Engineering, Vol. 7, No. 9, pp. 1252-1256, 2013.
  15. A. Glowacz, Z. Mikrut and P. Pawlik, "Video Detection Algorithm Using an Optical Flow Calculation Method," Multimedia Communications, Services and Security, Vol. 287, pp. 118-129, 2012.
  16. H.Y. Cheng and S.H. Hsu, "Intelligent Highway Traffic Surveillance With Self-Diagnosis Abilities," IEEE Transactions on Intelligent Transportation Systems, Vol. 12, No. 4, pp. 1462-1472, 2011. https://doi.org/10.1109/TITS.2011.2160171
  17. M. Mizushima, Y. Taniquchi, G. hasegawa, H. Nakano and M. Matsuoka, "Counting Pedestrians Passing through a Line in Video Sequences based on Optical Flow Extraction", Recent Advances in Circuits, Systems and Automatic Control, pp. 129-136, 2013.
  18. K. Jo, K. Chu, K. Lee, M. Sunwoo, "Integration of Multiple Vehicle Models with IMM Filter for Vehicle Localization," IEEE Transactions on Intelligent Vehicles Symposium, pp. 746-751, 2010.
  19. M. Bertozzi, A. Broggi and A. Fascioli, "An extension to the Inverse Perspective Mapping to handle non-flat roads," IEEE International Conference on Intelligent Vehicle, pp. 305-310, 1998.
  20. M. Aly, "Real time Detection of Lane Markers in Urban Streets", IEEE Transactions on Intelligent Vehicles Symposium, 2008.
  21. S. Suzuki and K. Abe, "Topological Structural Analysis of Digitized Binary Images by Border Following", Computer Vision, Graphics, and Image Processing, Vol. 30, No. 1, pp. 32-46, 1985. https://doi.org/10.1016/0734-189X(85)90016-7
  22. L. Imsland, T.A. Johansen, T.I. Fossen, et al, "Vehicle velocity estimation using nonliear observer," Automatica, pp. 2091-2103, 2006.
  23. R. Zhao and X. Wang, "Counting Vehicles from Semantic Rigions," IEEE Transactions on Intelligent Transportation Systems, Vol. 14, No. 2, pp. 1016-1022, 2013. https://doi.org/10.1109/TITS.2013.2248001