Journal of Digital Contents Society (디지털콘텐츠학회 논문지)

Digital Contents Society (한국디지털콘텐츠학회)
권호 표지
DOI QR코드

DOI QR Code

Design of Anomaly Detection System Based on Big Data in Internet of Things

빅데이터 기반의 IoT 이상 장애 탐지 시스템 설계

  • Na, Sung Il (Graduate School of Information Security, Korea University) ;
  • Kim, Hyoung Joong (Graduate School of Information Security, Korea University)
  • 나성일 (고려대학교 정보보호대학원 빅데이터 응용 및 보안학과) ;
  • 김형중 (고려대학교 정보보호대학원 빅데이터 응용 및 보안학과)
  • Received : 2017.12.22
  • Accepted : 2018.02.26
  • Published : 2018.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

Internet of Things (IoT) is producing various data as the smart environment comes. The IoT data collection is used as important data to judge systems's status. Therefore, it is important to monitor the anomaly state of the sensor in real-time and to detect anomaly data. However, it is necessary to convert the IoT data into a normalized data structure for anomaly detection because of the variety of data structures and protocols. Thus, we can expect a good quality effect such as accurate analysis data quality and service quality. In this paper, we propose an anomaly detection system based on big data from collected sensor data. The proposed system is applied to ensure anomaly detection and keep data quality. In addition, we applied the machine learning model of support vector machine using anomaly detection based on time-series data. As a result, machine learning using preprocessed data was able to accurately detect and predict anomaly.

사물인터넷(IoT) 서비스는 스마트 환경이 발전하면서 다양한 데이터를 생산하고 있다. 이 데이터는 사용자의 상황을 판단하는 중요한 데이터로 사용된다. 그렇기 때문에 센서의 이상 상태를 실시간으로 모니터링하고 이상 데이터를 탐지하는 것이 중요하다. 하지만 데이터 구조와 프로토콜이 다양하기 때문에 표준화된 데이터 구조로 변환하는 과정이 필요하다. 그럼으로써 데이터의 품질을 보장하고 정확한 분석을 통해 서비스의 품질까지 좋아지는 효과를 기대할 수 있다. 본 논문은 수집된 센서의 이상탐지를 위해 빅데이터 기반의 이상탐지 시스템을 제안한다. 제안한 시스템은 이상탐지를 위해 데이터 표준화 전처리와 시계열 기반의 이상탐지가 우수한 SVM(Support Vector Machine) 모델을 적용하였다. 실험에서는 전처리와 전처리되지 않은 데이터를 각각 학습시키고 비교하였다. 그 결과, 전처리된 데이터는 이상 장애를 정확히 탐지하고 예측하였다.

Keywords

References

  1. J. C. Choi, I. K. Jang, D. H. Lee, M. E. Kim, and Y. S. Soen, "Technology status and prospects for develop intelligence internet of Things," IITP Series, No.1800, 2017. [Internet]. Available : http://www.itfind.or.kr/WZIN/jugidong/1800/file6216979542456700532-1800.pdf
  2. B. I. Jang and C. S. Kim, "A study on the security sechnology for the internet of things," Journal of the Korea Security Engineering, vol. 11, no.5 , pp. 429-438, 2014. https://doi.org/10.14257/jse.2014.10.05
  3. D. H. Kim, S. Y. Yoon, and Y. P. Lee, "Security for IoT services," Journal of the Korea Institute of Communications and Information Sciences, vol. 30, no. 8, pp. 53-59, 2013.
  4. D. H. Shin, J. Y. Jeong, and S. H. Kang, "Trend and prospects internet of things," Journal of the Korea Society for Internet Information, vol. 14, no. 2, pp. 32-46, 2013.
  5. M. S. Kong, H. J. Chae, and B. H. Ryu, "Trends and prospects of internet (IoT) technology," Journal of the Korea Society of Mechanical Engineers, vol. 56, no. 2, pp. 32-36, 2016.
  6. N. H. Kim, D. An, and J. H. Choi, Prognostics and Health Management of Engineering Systems: An Introduction, Springer International Publishing, 2017.
  7. B. I. Kwak, M. R. Han, A. R. Kang, and H. K. Kim, "A study on detection methodology of threat on cars from the viewpoint of IoT," Journal of the Korea Institute of Information Security & Cryptology, vol. 25, no. 2, pp. 411-421, 2015. https://doi.org/10.13089/JKIISC.2015.25.2.411
  8. B. Y. Lee, W. S. Choi, and D. H. Lee, "Privacy-preserving outlier detection in healthcare services," Journal of the Korea Institute of Information Security & Cryptology, vol. 25, no. 5, pp. 1187-1199, 2015. https://doi.org/10.13089/JKIISC.2015.25.5.1187
  9. S. J. Lee and D. H. Lee, "Real time predictive analytic system design and implementation using bigdata-log," Journal of the Korea Institute of Information Security & Cryptology, vol. 25, no. 6, pp. 1399-1410, 2015. https://doi.org/10.13089/JKIISC.2015.25.6.1399
  10. W. D. Cho, J. H. Seong, S. T. Choi, J. H. Kim, J. H. Ha, J. S. Baek, and J. Y. Lee, "Adaptive sensing and monitoring technologies for detecting big-data based on IoT multi-sensors," Journal of The Korea Institute of Information Scientists and Engineers, vol. 35, no. 7, pp. 26-34, 2017.
  11. J. H. Lim, Y. K. Park, J. M. Kwon, and J. U. Seo, "Machine learning technology in the internet of things environment," Journal of the Korea Institute of Communications and Information Sciences, vol. 33, no. 5, pp. 48-54, 2016.
  12. B. T. Jang, "Next-generation machine learning technologies," Journal of The Korea Institute of Information Scientists and Engineers, vol. 25, no. 3, pp. 96-107, 2007.
  13. T. Armerding, S. Ambati, and A. Gray "Machine Learning Guide," International Data Group(IDG), InfoWorld, 2016. [Internet]. Available : http://www.itworld.co.kr/techlibrary/97428
  14. C. W. Tsai, C. F. Lai, M. C. Chiang, and L. T. Yang, "Data mining for internet of things: A survey," IEEE Communications Surveys & Tutorials, vol. 16, no. 1, pp. 77-97, 2014. https://doi.org/10.1109/SURV.2013.103013.00206
  15. K.T. Choi, "Neural networks optimization for multi-dimensional digital signal processing in IoT devices," Journal of Digital Contents Society, vol. 18, no. 6, pp. 1165-1173, 2017.