Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography (한국측량학회지)

Korean Society of Surveying, Geodesy, Photogrammetry and Cartography (한국측량학회)
권호 표지
DOI QR코드

DOI QR Code

Object Classification Using Point Cloud and True Ortho-image by Applying Random Forest and Support Vector Machine Techniques

랜덤포레스트와 서포트벡터머신 기법을 적용한 포인트 클라우드와 실감정사영상을 이용한 객체분류

  • Seo, Hong Deok (Department of Spatial Information Engineering, Namseoul University) ;
  • Kim, Eui Myoung (Department of Spatial Information Engineering, Namseoul University)
  • Received : 2019.08.12
  • Accepted : 2019.10.25
  • Published : 2019.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Due to the development of information and communication technology, the production and processing speed of data is getting faster. To classify objects using machine learning, which is a field of artificial intelligence, data required for training can be easily collected due to the development of internet and geospatial information technology. In the field of geospatial information, machine learning is also being applied to classify or recognize objects using images and point clouds. In this study, the problem of manually constructing training data using existing digital map version 1.0 was improved, and the technique of classifying roads, buildings and vegetation using image and point clouds were proposed. Through experiments, it was possible to classify roads, buildings, and vegetation that could clearly distinguish colors when using true ortho-image with only RGB (Red, Green, Blue) bands. However, if the colors of the objects to be classified are similar, it was possible to identify the limitations of poor classification of the objects. To improve the limitations, random forest and support vector machine techniques were applied after band fusion of true ortho-image and normalized digital surface model, and roads, buildings, and vegetation were classified with more than 85% accuracy.

정보통신기술의 발달로 인하여 데이터의 생산과 처리 속도가 빨라지고 있다. 인공지능의 한 분야인 머신러닝을 이용하여 객체를 분류하기 위해, 학습에 필요한 데이터는 인터넷과 공간정보기술의 발달로 인하여 손쉽게 수집할 수 있게 되었다. 공간정보 분야에서도 머신러닝은 영상, 포인트 클라우드 등을 이용하여 객체를 분류 또는 인식하는 것에 적용되고 있다. 본 연구에서는 기 구축된 수치지도 버전 1.0을 활용하여 학습 데이터를 수동으로 구축하는 문제점을 개선하고 영상과 포인트 클라우드를 이용하여 도로, 건물, 식생을 분류하는 기법을 제안하였다. 실험을 통해서 RGB 밴드만을 갖고 있는 실감정사영상을 사용하였을 경우 색상을 뚜렷하게 구분할 수 있는 도로, 건물, 식생의 분류가 가능하였지만 색상이 유사한 경우에는 분류가 잘 되지 않는 한계를 확인할 수 있었다. 이를 개선하기 위해 실감정사영상과 정규수치표면모델을 밴드 퓨전한 후 랜덤포레스트와 서포트벡터머신 기법을 적용하였으며 이를 통해 85%이상의 정확도로 도로, 건물, 식생을 분류하였다.

Keywords

References

  1. Biamonte, J., Wittek, P., Pancotti, N., Rebentrost, P., Wiebe, N., and Lloyd, S. (2017), Quantum machine learning. Nature. Vol. 549, pp. 195-202. https://doi.org/10.1038/nature23474
  2. Cho, D.Y. and Kim, E.M. (2010), Extraction of spatial information of tree using LIDAR data in urban area. The Journal of Korean Society for Geospatial Information Science, Vol. 18, No. 4, pp. 11-20. (in Korean with English abstract)
  3. Choi, S.P., Yang, I.T., and Cong, J.H. (2002), Evaluation of horizontal position accuracy of facilities in digital map. The Journal of Korean Society for Geospatial Information Science, Vol. 10, No. 4, pp. 95-103. (in Korean with English abstract)
  4. Daneshtalab, S. and Rastiveis, H. (2017), Decision level fusion of orthophoto and LIDAR data using confusion matrix information for land cover classification, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XLII-4/W4, 2017 Tehran's Joint ISPRS Conferences of GI Research, SMPR and EOEC 2017, 7-10 October, Tehran, Iran, pp. 59-64.
  5. Feng, Q., Liu, J., and Gong, J. (2015), UAV remote sensing for urban vegetation mapping using random forest and texture. Remote Sensing, Vol. 7, No. 1, pp. 1074-1094. https://doi.org/10.3390/rs70101074
  6. Han, S.H. (2016), Introduction to Photogrammetry and Remote Sensing, Goomibook, Seoul.
  7. Hong, I.Y. (2017), Land use classification using LBSN(Location-Based Social Network) data and machine learning technique, Journal of the Korean Cartographic Association, Vol. 17, No. 3, pp. 59-67. (in Korean with English abstract) https://doi.org/10.16879/jkca.2017.17.3.059
  8. Hong, S.P. and Kim, E.M. (2018), Classification of 3D road objects using machine learning. Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, Vol. 36, No. 6, pp. 535-544. (in Korean with English abstract) https://doi.org/10.7848/KSGPC.2018.36.6.535
  9. Jeong, D.H. and Jeong, W.T. (2019), Prediction of rolling noise based on machine learning technique using rail surface roughness data, Journal of the Korean Society for Railway, Vol. 22. No. 3, pp. 209-217. (in Korean with English abstract) https://doi.org/10.7782/jksr.2019.22.3.209
  10. Jo, W.H., Lim, Y.H., and Park, K.H. (2019), Deep learning based land cover classification using convolutional neural network: a case study of Korea. Journal of the Korean Geographical Society, Vol. 54, No. 1, pp. 1-16. (in Korean with English abstract)
  11. Jonsson, Sigurbjorn. (2019), RGB and multispectral UAV image classification of agricultural fields using a machine learning algorithm, Master's thesis, Lund University, Lund, Sweden, 88p.
  12. Jung, I.G., Sung, J.H., Lee, C.K., Kim, S.C., and Lee, Y.B. (2004), The prediction of spatial variability for soil information in Paddy field, Journal of Biosystems Engineering, Vol. 29, No. 1, pp. 65-70. (in Korean with English abstract) https://doi.org/10.5307/JBE.2004.29.1.065
  13. Kim, G.M. and Choi, J.W. (2018), Detection of cropland in reservoir area by using supervised classification of UAV imagery based on GLCM. Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, Vol. 36, No. 6, pp. 433-442. (in Korean with English abstract) https://doi.org/10.7848/KSGPC.2018.36.6.433
  14. Kim, E.M., Cho, H.S., and Park, J.H. (2017), Analysis of applicability of orthophoto using 3D mesh on aerial image with large file size, Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, Vol. 35, No. 3, pp. 155-166. (in Korean with English abstract) https://doi.org/10.7848/ksgpc.2017.35.3.155
  15. Kim, J.K., Lee, K.B., and Hong, S.G. (2017), ECG-based biometric authentication using random forest. Journal of the Institute of Electronics and Information Engineers, Vol. 54, No. 6, pp. 100-105. (in Korean with English abstract) https://doi.org/10.5573/ieie.2017.54.6.100
  16. Kwon, S.K., Lee, Y.S., Kim, D.S., and Jung, H.S. (2019), Classification of forest vertical structure using machine learning analysis, Korean Journal of Remote Sensing, Vol. 35, No. 2, pp. 229-239. (in Korean with English abstract) https://doi.org/10.7780/KJRS.2019.35.2.3
  17. Lee, G.W. and Yom, J.H. (2018), Design and implementation of web-based automatic preprocessing system of remote sensing imagery for machine learning modeling. The Journal of Korean Society for Geospatial Information Science, Vol. 26, No. 1, pp. 61-67. (in Korean with English abstract) https://doi.org/10.7319/kogsis.2018.26.1.061
  18. Liu, D. and Xia, F. (2010), Assessing object-based classification: advantages and limitations, Remote Sensing, Vol. 1, No. 4, pp. 187-194.
  19. Liu, P. (2015), A survey of remote-sensing big data. Frontiers in Environmental Science, Vol. 3, No. 45, pp. 1-6.
  20. Park, G.M. and Bae, Y.C. (2019), Performance comparison of machine learning in the various kind of prediction. The Journal of the Korea Institute of Electronic Communication Sciences, Vol. 14, No. 1, pp. 169-178. (in Korean with English abstract) https://doi.org/10.13067/JKIECS.2019.14.1.169
  21. Park, H.K. and Lee, D.K. (2019), Disaster prediction and policy simulation for evaluating mitigation effects using machine learning and system dynamics: case study of seasonal drought in gyeonggi province. Journal of the Korean Society of Hazard Mitigation, Vol. 19, No. 1, pp. 45-53. (in Korean with English abstract) https://doi.org/10.9798/kosham.2019.19.1.45
  22. Park, S., Kim, K.J., Lee, J.S., and Lee, S.R. (2011), Red tide prediction using neural network and SVM, The Institute of Electronics Engineers of Korea-Signal Processing, Vol. 48. No. 5, pp. 39-45. (in Korean with English abstract)
  23. Schonberger, J.L. and Frahm, J.M. (2016), Structure-from-motion revisited. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR, 27-30 June, Las Vegas, USA, pp. 4104-4113.
  24. Schopfer, E., Lang, S., and Strobl, J. (2010), Segmentation and object-based image analysis. Remote sensing of urban and suburban areas, Vol. 10, pp. 181-192. https://doi.org/10.1007/978-1-4020-4385-7_10
  25. Wang, C. and Li, Z. (2016), Weed recognition using SVM model with fusion height and monocular image features. Transactions of the Chinese Society of Agricultural Engineering, Vol. 32, No. 15, pp. 181-192.
  26. Wikipedia. (2019), Random forest, Wikimedia Foundation, Inc., URL: https://en.wikipedia.org/wiki/Random_forest(last date accessed: 26 June 2019).
  27. Yamamoto, K., Guo, W., Yoshioka, Y., and Ninomiya, S. (2014). On plant detection of intact tomato fruits using image analysis and machine learning methods. Sensors, Vol. 14, No. 7, pp. 12191-12206. https://doi.org/10.3390/s140712191
  28. Yu, B.H., P, H.C., and Lee, S.M. (2019), Improvement of randomforest OBIA algorithm for tree anomaly detection in UAV imagery: Focused on the Birobong-Peak Area of Sobaeksan National Park. The Korean Society of Environment and Ecology, 26 April, Wonju, Korea, pp. 54-54.
  29. Yun, T.G. and Yi, G.S. (2008), Application of random forest algorithm for the decision support system of medical diagnosis with the selection of significant. The transactions of The Korean Institute of Electrical Engineers, Vol. 57, No. 6, pp. 1058-1062. (in Korean with English abstract)
  30. Zhang, W., Qi, J., Wan, P., Wang, H., Xie, D., Wang, X., and Yan, G. (2016), An easy-to-use airborne LiDAR data filtering method based on cloth simulation, Remote Sensing, Vol. 8, No. 6, pp. 501. https://doi.org/10.3390/rs8060501

Cited by

  1. 포인트 클라우드에서 딥러닝을 이용한 객체 분류 및 변화 탐지 vol.50, pp.2, 2019, https://doi.org/10.22640/lxsiri.2020.50.2.37