Automation of Bio-Industrial Process Via Tele-Task Command(I) -identification and 3D coordinate extraction of object-

원격작업 지시를 이용한 생물산업공정의 생력화 (I) -대상체 인식 및 3차원 좌표 추출-

  • Kim, S. C. (Dept. of Bio-Mechanics Engineering, Sungkyunkwan University) ;
  • Choi, D. Y. (Dept. of Automated Manufacturing and Control, Daelim College) ;
  • Hwang, H. (Dept. of Bio-Mechanics Engineering, Sungkyunkwan University)
  • Published : 2001.02.01

Abstract

Major deficiencies of current automation scheme including various robots for bioproduction include the lack of task adaptability and real time processing, low job performance for diverse tasks, and the lack of robustness of take results, high system cost, failure of the credit from the operator, and so on. This paper proposed a scheme that could solve the current limitation of task abilities of conventional computer controlled automatic system. The proposed scheme is the man-machine hybrid automation via tele-operation which can handle various bioproduction processes. And it was classified into two categories. One category was the efficient task sharing between operator and CCM(computer controlled machine). The other was the efficient interface between operator and CCM. To realize the proposed concept, task of the object identification and extraction of 3D coordinate of an object was selected. 3D coordinate information was obtained from camera calibration using camera as a measurement device. Two stereo images were obtained by moving a camera certain distance in horizontal direction normal to focal axis and by acquiring two images at different locations. Transformation matrix for camera calibration was obtained via least square error approach using specified 6 known pairs of data points in 2D image and 3D world space. 3D world coordinate was obtained from two sets of image pixel coordinates of both camera images with calibrated transformation matrix. As an interface system between operator and CCM, a touch pad screen mounted on the monitor and remotely captured imaging system were used. Object indication was done by the operator’s finger touch to the captured image using the touch pad screen. A certain size of local image processing area was specified after the touch was made. And image processing was performed with the specified local area to extract desired features of the object. An MS Windows based interface software was developed using Visual C++6.0. The software was developed with four modules such as remote image acquisiton module, task command module, local image processing module and 3D coordinate extraction module. Proposed scheme shoed the feasibility of real time processing, robust and precise object identification, and adaptability of various job and environments though selected sample tasks.

Keywords

References

  1. J. of Korean Society for Agricultural Machinery v.17 no.1 Computer Vision Based Measurement, Error Analysis, and Calibration Lee, C. H.;H. Hwang
  2. J. of Korean Society for Agricultural Machinery v.23 no.4 Three dimensional geometric feature detection using computer vision and laser structured light Hwang, H.;Y. C. Chang;D. H. Yim
  3. ASAE Robotics for Bioproduction N. Kondo(ed.);K. C. Ting(ed.)