Journal of Korea Society of Industrial Information Systems (한국산업정보학회논문지)

Korea Society of Industrial Information Systems (한국산업정보학회)
권호 표지
DOI QR코드

DOI QR Code

Lane Departure Warning System using Deep Learning

딥러닝을 이용한 차로이탈 경고 시스템

  • 최승완 (한밭대학교 제어계측공학과) ;
  • 이건태 (한밭대학교 전자제어공학과) ;
  • 김광수 (한밭대학교 전자제어공학과) ;
  • 곽수영 (한밭대학교 전자제어공학과)
  • Received : 2019.01.31
  • Accepted : 2019.04.02
  • Published : 2019.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

As artificial intelligence technology has been developed rapidly, many researchers who are interested in next-generation vehicles have been studying on applying the artificial intelligence technology to advanced driver assistance systems (ADAS). In this paper, a method of applying deep learning algorithm to the lane departure warning system which is one of the main components of the ADAS was proposed. The performance of the proposed method was evaluated by taking a comparative experiments with the existing algorithm which is based on the line detection using image processing techniques. The experiments were carried out for two different driving situations with image databases for driving on a highway and on the urban streets. The experimental results showed that the proposed system has higher accuracy and precision than the existing method under both situations.

최근 인공지능 기술이 급격히 발전하면서 첨단 운전자 지원 시스템 분야에 딥러닝 기술을 접목하여 기존의 기술보다 뛰어난 성능을 보여주기 위한 여러 연구들이 진행 되고 있다. 이러한 동향에 맞춰 본 논문 또한 첨단 운전자 지원 시스템의 핵심 요소 중 하나인 차로이탈 경고시스템에 딥러닝 기술을 접목한 방법을 제안한다. 제안하는 방법과 기존의 차선검출 기반의 경고시스템과의 비교 실험을 통해 그 성능을 평가 하였다. 고속도로 주행영상과 시내 주행영상을 이용한 두 가지의 서로 다른 환경에서 모두 제안하는 방법이 정확도 및 정밀도 부분에서 더 높은 수치를 보여주었다.

Keywords

SOJBB3_2019_v24n2_25_f0001.png 이미지

Fig. 1 The comparison of data processing flow for lane departure warning a) existing method, b) proposed method

SOJBB3_2019_v24n2_25_f0002.png 이미지

Fig. 2 Overview of the line detection algorithm[6]

SOJBB3_2019_v24n2_25_f0003.png 이미지

Fig. 3 Determination of vehicle’s position between two lines a) center b) leaning to left c) leaning to right [6]

SOJBB3_2019_v24n2_25_f0004.png 이미지

Fig. 4 The overall structure of the proposed method

SOJBB3_2019_v24n2_25_f0005.png 이미지

Fig. 5 Examples of Training Data. a) Normal driving data, b) Lane departure data

SOJBB3_2019_v24n2_25_f0006.png 이미지

Fig. 6 Annotation of driving data without top-view transformation a) on a straight lane and b) on a curved lane

SOJBB3_2019_v24n2_25_f0007.png 이미지

Fig. 7 Annotation of driving data with top-view transformation a) on a straight lane and b) on a curved lane

SOJBB3_2019_v24n2_25_f0008.png 이미지

Fig. 8 The proposed CNN architecture.

SOJBB3_2019_v24n2_25_f0009.png 이미지

Fig. 9 The validation accuracy in relation to the different number of epoches

SOJBB3_2019_v24n2_25_f0010.png 이미지

Fig. 10 Sample images of experimental results

Table 1 The number of frames in the dataset for training CNN and validation

SOJBB3_2019_v24n2_25_t0001.png 이미지

Table 2 The result of a comparative experiment with a dataset consisting of highway driving images

SOJBB3_2019_v24n2_25_t0002.png 이미지

Table 3 The result of a comparative experiment with a dataset consisting of street driving images

SOJBB3_2019_v24n2_25_t0003.png 이미지

Table 4 The total result of experiments

SOJBB3_2019_v24n2_25_t0004.png 이미지

Table 5 Average processing time per frame

SOJBB3_2019_v24n2_25_t0005.png 이미지

References

  1. J. Redmon, S. Divvala, R. Girshick, and A Farhadi. "You only look once: unified, real-time object detection" The IEEE Conference on Computer Vision and Pattern Recognition, pp. 779-788, 2016
  2. S. Lee and N. Cho. "Pedestrian detection using YOLO and Tracking" Korea Broadcasting and Media Engineering Society 2018 Summer Conference, pp. 79-81, 2018
  3. R. Shaoqing, H. Kaiming, R. Girshick, and J. Sun. "Faster R-CNN: towards real-time object detection with region proposal networks" Computer Vision and Pattern Recognition, pp. 1-9, 2015
  4. Y. Byeon and K. Kwak, "Comparative analysis of performance using faster RCNN and ACF in people detection," Journal of Journal of Korean Institute of Information Technology, Vol. 15, No. 6, pp. 11-21, 2017
  5. Y. Ye, X. Hao, and H. Chen, "Lane detection method based on lane structural analysis and CNNs," Intelligent Transport Systems, Vol. 12, No. 6, pp. 513-520, 2018 https://doi.org/10.1049/iet-its.2017.0143
  6. K. Kim, S. Choi, and S. Kwak, "A lane detection and departure warning system robust to illumination change and road surface symbols," Journal of the Korea industrial information Systems Research, Vol. 19, No. 1, pp. 1-3, 2013 https://doi.org/10.9723/JKSIIS.2014.19.1.001
  7. H. Jung, J. Min, and J. Kim "An efficient lane detection algorithm for lane departure detection", 2013 IEEE Intelligent Vehicles Symposium, pp. 976-981, 2013