KSCE Journal of Civil and Environmental Engineering Research (대한토목학회논문집)

Korean Society of Civil Engeneers (대한토목학회)
권호 표지
DOI QR코드

DOI QR Code

Pine Wilt Disease Detection Based on Deep Learning Using an Unmanned Aerial Vehicle

무인항공기를 이용한 딥러닝 기반의 소나무재선충병 감염목 탐지

  • Received : 2020.09.02
  • Accepted : 2021.01.13
  • Published : 2021.06.01
Download PDF
⟨ Previous Next ⟩

Abstract

Pine wilt disease first appeared in Busan in 1998; it is a serious disease that causes enormous damage to pine trees. The Korean government enacted a special law on the control of pine wilt disease in 2005, which controls and prohibits the movement of pine trees in affected areas. However, existing forecasting and control methods have physical and economic challenges in reducing pine wilt disease that occurs simultaneously and radically in mountainous terrain. In this study, the authors present the use of a deep learning object recognition and prediction method based on visual materials using an unmanned aerial vehicle (UAV) to effectively detect trees suspected of being infected with pine wilt disease. In order to observe pine wilt disease, an orthomosaic was produced using image data acquired through aerial shots. As a result, 198 damaged trees were identified, while 84 damaged trees were identified in field surveys that excluded areas with inaccessible steep slopes and cliffs. Analysis using image segmentation (SegNet) and image detection (YOLOv2) obtained a performance value of 0.57 and 0.77, respectively.

1988년 부산에서 처음 발병된 소나무재선충병(Pine Wilt Disease, PWD)은 우리나라 소나무에 막대한 피해를 주고 있는 심각한 질병이다. 정부에서는 2005년 소나무재선충병 방제특별법을 제정하고 피해지역의 소나무 이동 금지와 방제를 시행하고 있다. 하지만, 기존의 예찰 및 방제방법은 산악지형에서 동시다발적이고 급진적으로 발생하는 소나무재선충병을 줄이기에는 물리적, 경제적 어려움이 있다. 따라서 본 연구에서는 소나무재선충병 감염의심목을 효율적으로 탐지하기 위해 무인항공기를 이용한 영상자료를 바탕으로 딥러닝 객체인식 예찰 방법의 활용가능성을 제시하고자 한다. 소나무재선충병 피해목을 관측하기 위해서 항공촬영을 통해 영상 데이터를 획득하고 정사영상을 제작하였다. 그 결과 198개의 피해목이 확인되었으며, 이를 검증하기 위해서 접근이 불가한 급경사지나 절벽과 같은 곳을 제외하고 현장 조사를 진행하여 84개의 피해목을 확인할 수 있었다. 검증된 데이터를 가지고 분할방법인 SegNet과 검출방법인 YOLOv2를 이용하여 분석한 결과 성능은 각각 0.57, 0.77로 나타났다.

Keywords

References

  1. Badrinarayanan, V., Kendall, A. and Cipolla, R. (2017). "Segnet: A deep convolutional encoder-decoder architecture for image segmentation." IEEE Transactions on Pattern Analysis and Machine Intelligence, IEEE, Vol. 39, No. 12, pp. 2481-2495. https://doi.org/10.1109/TPAMI.2016.2644615
  2. Dash, J. P., Watt, M. S., Pearse, G. D., Heaphy, M. and Dungey, H. S. (2017). "Assessing very high resolution UAV imagery for monitoring forest health during a simulated disease outbreak." ISPRS Journal of Photogrammetry and Remote Sensing, ISPRS, Vol. 131, pp. 1-14. https://doi.org/10.1016/j.isprsjprs.2017.07.007
  3. Derczynski, L. (2016). "Complementarity, F-score, and NLP evaluation." Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), European Language Resources Association (ELRA), pp. 261-266.
  4. Do, M. S., Lim, E. T., Chae, J. H. and Kim, S. H. (2018). "Accuracy evaluation and terrain model creation of urban space using unmanned aerial vehicle system." The Journal of the Korea Institute of Intelligent Transport Systems, KITS, Vol. 17, No. 5, pp. 117-127 (in Korean). https://doi.org/10.12815/kits.2018.17.5.117
  5. Dyson, J., Manc ini, A., Frontoni, E. and Zingaretti, P. (2019). "Deep learning for soil and crop segmentation from remotely sensed data." Remote Sensing, MDPI, Vol. 11, No. 16, pp. 1859. https://doi.org/10.3390/rs11161859
  6. Giuffrida, G., Meoni, G. and Fanucci, L. (2019). "A YOLOv2 convolutional neural network-based human-machine interface for the control of assistive robotic manipulators." Applied Sciences, MDPI, Vol. 9, No. 11, pp. 2243. https://doi.org/10.3390/app9112243
  7. Han, S. H. (2019). "Project design plan for drone photogrammetry." Journal of the Korean Society of Civil Engineers, KSCE, Vol. 39, No.1, pp.239-246 (in Korean). https://doi.org/10.12652/KSCE.2019.39.1.0239
  8. Im, S. H., Hassan, S. I., Minh, D. L., Min, K. B. and Moon, H. J. (2018). "Analysis of fusarium wilt based on normalized difference vegetation index for radish field images from unmanned aerial vehicle." The Transactions of The Korean Institute of Electrical Engineers, KIEE, Vol. 67, No. 10, pp. 1353-1357. https://doi.org/10.5370/KIEE.2018.67.10.1353
  9. Kim, D. I., Song, Y. S., Kim, G. H. and Kim, C. W. (2014). "A study on the application of UAV for Korean land monitoring." Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, KSGPC, Vol. 32, No. 1, pp. 29-38 (in Korean). https://doi.org/10.7848/ksgpc.2014.32.1.29
  10. Kim, E. N. and Kim, D. Y. (2008). "An investigation of pine wilt damage by using ground remote sensing technique." Journal of the Korean Association of Regional Geographers, KRG, Vol. 14, No. 1, pp. 84-92 (in Korean).
  11. Kim, J. B., Jo, M. H., Oh, J. S., Lee, K. J. and Park, S. J. (2001). "Extraction method of damaged area by pine wilt disease (Bursaphelenchus xylophilus) using remotely sensed data and GIS." In Proceedings of ACRS 2001, 22nd Asian Conference on Remote Sensing, Singapore.
  12. Kim, J. B., Kim, D. Y. and Park, N. C. (2010). "Development of an aerial precision forecasting techniques for the pine wilt disease damaged area based on GIS and GPS." Journal of the Korean Association of Geographic Information Studies, KAGIS, Vol. 13, No. 1, pp. 28-34 (in Korean). https://doi.org/10.11108/kagis.2010.13.1.028
  13. Kim, J. H., Seo, I. G. and Park, S. J. (2016). "An analysis on the situation of collection and utilization of the trees damaged by pine wilt disease." Journal of Environmental Science International, KENSS, Vol. 25, No. 1, pp. 127-134 (in Korean). https://doi.org/10.5322/JESI.2016.25.1.127
  14. Kim, M. J., Bang, H. S. and Lee, J. W. (2017). "Use of unmanned aerial vehicle for forecasting pine wood nematode in boundary area: A case study of Sejong Metropolitan Autonomous City." Journal of Korean Society of Forest Science, KFS, Vol. 106, No. 1, pp. 100-109 (in Korean). https://doi.org/10.14578/jkfs.2017.106.1.100
  15. Kim, S. R., Kim, E. S., Nam, Y. W., Choi, W. I. and Kim, C. M. (2015). "Distribution characteristics analysis of pine wilt disease using time series hyperspectral aerial imagery." Korean Journal of Remote Sensing, KSRS, Vol. 31, No. 5, pp. 385-394 (in Korean). https://doi.org/10.7780/kjrs.2015.31.5.3
  16. Kotsiantis, S., Kanellopoulos, D. and Pintelas, P. (2006). "Handling imbalanced datasets: A review." GESTS International Transactions on Computer Science and Engineering, Vol. 30, No. 1, pp. 25-36.
  17. Lee, H. D. (2017). Identification of damaged trees by pine wilt diseases using drone images and GIS, Master's thesis, Graduate School of Kyungil University (in Korean).
  18. Lee, J. B., Kim, E. S. and Lee, S. H. (2014). "An analysis of spectral pattern for detecting pine wilt disease using ground-based hyperspectral camera." Korean Journal of Remote Sensing, KSRS, Vol. 30, No. 5, pp. 665-675 (in Korean). https://doi.org/10.7780/kjrs.2014.30.5.11
  19. Lee, S. K., Park, S. J., Baek, G. M., Kim, H. B. and Lee, C. W. (2019). "Detection of damaged pine tree by the pine wilt disease using UAV Image." Korean Journal of Remote Sensing, KSRS, Vol. 35, No. 3, pp. 359-373 (in Korean). https://doi.org/10.7780/KJRS.2019.35.3.2
  20. Nagai, M., Chen, T., Shibasaki, R., Kumagai, H. and Ahmed, A. (2009). "UAV-borne 3-D mapping system by multisensor integration." IEEE Transactions on Geoscience and Remote Sensing, IEEE, Vol. 47, No. 3, pp. 701-708. https://doi.org/10.1109/TGRS.2008.2010314
  21. Redmon, J. and Farhadi, A. (2017). "YOLO9000: better, faster, stronger." In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR, pp. 7263-7271.
  22. Redmon, J., Divvala, S., Girshick, R. and Farhadi, A. (2016). "You only look once: Unified, real-time object detection." In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE, pp. 779-788.
  23. Rokhmana, C. A. (2015). "The potential of UAV-based remote sensing for supporting precision agriculture in Indonesia." Procedia Environmental Sciences, ELSEVIER, Vol. 24, pp. 245-253. https://doi.org/10.1016/j.proenv.2015.03.032
  24. Smigaj, M., Gaulton, R., Suarez, J. C. and Barr, S. L. (2019). "Canopy temperature from an Unmanned Aerial Vehicle as an indicator of tree stress associated with red band needle blight severity." Forest Ecology and Management, ELSEVIER, Vol. 433, pp. 699-708. https://doi.org/10.1016/j.foreco.2018.11.032
  25. Son, M. H., Lee, W. K., Lee, S. H., Cho, H. K. and Lee, J. H. (2006). "Natural spread pattern of damaged area by pine wilt disease using geostatistical analysis." Journal of Korean Society of Forest Science, KFS, Vol. 95, No. 3, pp. 240-249 (in Korean).
  26. Xu, C. X., Lim, J. H., Jin, X. M. and Yun, H. C. (2018). "Land cover mapping and availability evaluation based on drone images with multi-spectral camera." Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, KSGPC, Vol. 36, No. 6, pp. 589-599 (in Korean). https://doi.org/10.7848/KSGPC.2018.36.6.589