The Journal of the Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회논문지)

The Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회)
권호 표지
DOI QR코드

DOI QR Code

Smart Factory Platform based on Multi-Touch and Image Recognition Technologies

멀티터치 기술과 영상인식 기술 기반의 스마트 팩토리 플랫폼

  • Received : 2018.01.16
  • Accepted : 2018.02.09
  • Published : 2018.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

In this work, we developed a platform that can monitor status and manage events of factory workplaces by providing events and data collected from various types of multi-touch technology based sensors installed in the workplace. By using the image recognition technology, faces of the people in the factory workplace are recognized and the customized contents for each worker are provided, and security of contents is enhanced by the authenticating an individual worker through face recognition. Contents control function through gesture recognition is constructed, so that workers can easily search documents. Also, it is possible to provide contents for workers by implementing face recognition function in mobile devices. The result of this work can be used to improve workplace safety, convenience of workers, contents security and can be utilized as a base technology for future smart factory construction.

본 연구에서는 팩토리 작업장에 설치된 여러 종류의 멀티터치 기술 기반 센서로부터 수집된 이벤트와 데이터를 제공함으로써 작업장의 상태 감시와 이벤트 관리를 용이하게 할 수 있는 플랫폼을 개발하였다. 영상인식 기술을 활용하여 팩토리 작업장 내 사람들의 얼굴을 인식하여 작업자별 맞춤형 콘텐츠를 제공하며, 얼굴인식을 통한 개별 작업자 인증으로 콘텐츠 보안을 강화하도록 하였다. 제스처 인식을 통한 콘텐츠 제어 기능을 구축하여 작업자가 간단하게 문서를 검색할 수 있도록 하였고, 모바일 장치에서도 얼굴인식 기능을 구현하여 작업자를 위한 콘텐츠 제공이 가능하게 하였다. 본 연구의 결과를 작업장 안전, 콘텐츠 보안, 작업자 편의 등을 향상시키는데 이용할 수 있으며 향후 스마트 팩토리 구축을 위한 기반기술로 활용할 수 있다.

Keywords

References

  1. S. J. Song, Y. H. Hong, Y. H. Han, J. S. Lee, and B. K. Lee, Dynamic contents collaboration system and method on cloud through clustering and de-clustering, Korea Patent Application 10-2016-0153765, Nov. 2016.
  2. https://developer.sonymobile.com/knowledge-base/technologies/floating-touch/
  3. A. Wagner, J. Wright, A. Ganesh, Z. Zhou, H. Mobahi, and Y. Ma, "Toward a Practical Face Recognition System: Robust Alignment and Illumination by Sparse Representation," IEEE Trans. on Pattern Analysis and Machine Intelligence, 34(2), pp. 372-386, Feb. 2012. https://doi.org/10.1109/TPAMI.2011.112
  4. M. S. Jang and W. B. Lee, "Implementation of Hand-Gesture Interface to manipulate a 3D Object of Augmented Reality," The Journal of the Institute of Internet, Broadcasting and Communication, 16(4), pp. 117-123, Aug. 2016. DOI: http://dx.doi.org/10.7236/JIIBC.2016.16.4.117
  5. D. H. Kim, A Study on the Gesture Spotting and Recognition from 3D Hand Motion, MS Thesis, Seoul National University, Seoul, Korea, Aug. 2012.
  6. D. Y. Kwon, "A Framework for 3D Hand Gesture Design and Modeling," Journal of the Korea Academia-Industrial cooperation Society, 14(10), pp. 5169-5175,. Oct. 2013. DOI: https://doi.org/10.5762/KAIS.2013.14.10.5169
  7. https://github.com/hrastnik/face_detect_n_track
  8. https://developer.microsoft.com/en-us/windows/kinect