DOI QR코드

DOI QR Code

Simplified Integral Imaging Pickup Method for Real Objects Using a Depth Camera

  • Li, Gang (College of Electrical and Computer Engineering, Chungbuk National University) ;
  • Kwon, Ki-Chul (College of Electrical and Computer Engineering, Chungbuk National University) ;
  • Shin, Gwan-Ho (College of Electrical and Computer Engineering, Chungbuk National University) ;
  • Jeong, Ji-Seong (Department of Information and Industrial Engineering, Chungbuk National University) ;
  • Yoo, Kwan-Hee (Department of Information and Industrial Engineering, Chungbuk National University) ;
  • Kim, Nam (College of Electrical and Computer Engineering, Chungbuk National University)
  • Received : 2012.06.29
  • Accepted : 2012.08.20
  • Published : 2012.12.25

Abstract

In this paper, we present a novel integral imaging pickup method. We extract each pixel's actual depth data from a real object's surface using a depth camera, then generate elemental images based on the depth map. Since the proposed method generates elemental images without a lens array, it has simplified the pickup process and overcome some disadvantages caused by a conventional optical pickup process using a lens array. As a result, we can display a three-dimensional (3D) image in integral imaging. To show the usefulness of the proposed method, an experiment is presented. Though the pickup process has been simplified in the proposed method, the experimental results reveal that it can also display a full motion parallax image the same as the image reconstructed by the conventional method. In addition, if we improve calculation speed, it will be useful in a real-time integral imaging display system.

Keywords

References

  1. J. L. Fergason, S. D. Robinson, C. W. McLaughlin, B. Brown, A. Abileah, T. E. Baker, and P. J. Green, "An innovative beamsplitter-based stereoscopic/3D display design," Proc. SPIE 5664, 488-494 (2005).
  2. Y.-H. Tao, Q.-H. Wang, J. Gu, W.-X. Zhao, and D.-H. Li, "Autostereoscopic three-dimensional projector based on two parallax barriers," Opt. Lett. 34, 3220-3222 (2009). https://doi.org/10.1364/OL.34.003220
  3. K. Choi, J. Kim, Y. Lim, and B. Lee, "Full parallax viewingangle enhanced computer-generated holographic 3D display system using integral lens array," Opt. Express 13, 10494- 10502 (2005). https://doi.org/10.1364/OPEX.13.010494
  4. J.-L. Zhao, H. Jiang, and J. Di, "Recording and reconstruction of a color holographic image by using digital lensless Fourier transform holography," Opt. Express 16, 2514-2519 (2008). https://doi.org/10.1364/OE.16.002514
  5. G. Lippmann, "La photographie integrale," C. R. Acad. Sci. 146, 446-451 (1908).
  6. Y. Kim, K. Hong, and B. Lee, "Recent researches based on integral imaging display method," 3D Res. 1, 17-27 (2010).
  7. G. Baasantseren, J.-H. Park, K.-C. Kwon, and N. Kim, "View angle enhanced integral imaging display using two elemental image masks," Opt. Express 17, 14405-14417 (2009). https://doi.org/10.1364/OE.17.014405
  8. S.-g. Park, B.-S. Song, and S.-W. Min, "Analysis of image visibility in projection-type integral imaging system without diffuser," J. Opt. Soc. Korea 14, 121-126 (2010). https://doi.org/10.3807/JOSK.2010.14.2.121
  9. S. Yeom, Y.-H. Woo, and W.-W. Beak, "Distance extraction by means of photon-counting passive sensing combined with integral imaging," J. Opt. Soc. Korea 15, 357-361 (2011). https://doi.org/10.3807/JOSK.2011.15.4.357
  10. J.-H. Park, J. Kim, Y. Kim, and B. Lee, "Resolution-enhanced three-dimension/ two-dimension convertible display based on integral imaging," Opt. Express 13, 1875-1884 (2005). https://doi.org/10.1364/OPEX.13.001875
  11. Y. Kim, J. Kim, J.-M. Kang, J.-H. Jung, H. Choi, and B. Lee, "Point light source integral imaging with improved resolution and viewing angle by the use of electrically movable pinhole array," Opt. Express 15, 18253-18267 (2007). https://doi.org/10.1364/OE.15.018253
  12. F. Okano, H. Hoshino, J. Arai, and I. Yuyama, "Real-time pickup method for a three-dimensional image based on integral photography," Appl. Opt. 36, 1598-1603 (1997). https://doi.org/10.1364/AO.36.001598
  13. H. Navarro, R. Martinez-Cuenca, G. Saavedra, M. Martinez- Corral, and B. Javidi, "3D integral imaging display by smart pseudoscopic-to-orthoscopic conversion (SPOC)," Opt. Express 18, 25573-25583 (2010). https://doi.org/10.1364/OE.18.025573
  14. A. Tolosa, R. Martinez-Cuenca, A. Pons, G. Saavedra, M. Martinez-Corral, and B. Javidi, "Optical implementation of micro-zoom arrays for parallel focusing in integral imaging," J. Opt. Soc. Am. 27, 495-500 (2010). https://doi.org/10.1364/JOSAA.27.000495
  15. J.-S. Jang and B. Javidi, "Improved viewing resolution of three-dimensional integral imaging by use of nonstationary micro-optics," Opt. Lett. 27, 324-326 (2002). https://doi.org/10.1364/OL.27.000324
  16. J. Hahn, Y. Kim, E.-H. Kim, and B. Lee, "Undistorted pickup method of both virtual and real objects for integral imaging," Opt. Express 16, 13969-13978 (2008). https://doi.org/10.1364/OE.16.013969
  17. D.-Q. Pham, N. Kim, K.-C. Kwon, J.-H. Jung, K. Hong, B. Lee, and J.-H. Park, "Depth enhancement of integral imaging by using polymer-dispersed liquid-crystal films and a dual-depth configuration," Opt. Lett. 35, 3135-3137 (2010). https://doi.org/10.1364/OL.35.003135
  18. Y. Kim, H. Choi, J. Kim, S.-W. Cho, Y. Kim, G. Park, and B. Lee, "Depth-enhanced integral imaging display system with electrically variable image planes using polymerdispersed liquid-crystal layers," Appl. Opt. 46, 3766-3773 (2007). https://doi.org/10.1364/AO.46.003766
  19. K.-C. Kwon, C. Park, M.-U. Erdenebat, J.-S. Jeong, J.-H. Choi, N. Kim, J.-H. Park, Y.-T. Lim, and K.-H. Yoo, "High speed image space parrael processing for computergenerated integral imaging system," Opt. Express 20, 732-740 (2012). https://doi.org/10.1364/OE.20.000732

Cited by

  1. Integral imaging display for natural scene based on KinectFusion vol.127, pp.2, 2016, https://doi.org/10.1016/j.ijleo.2015.10.168
  2. Implementation of active-type Lamina 3D display system vol.23, pp.12, 2015, https://doi.org/10.1364/OE.23.015848
  3. Three-dimensional image acquisition and reconstruction system on a mobile device based on computer-generated integral imaging vol.56, pp.28, 2017, https://doi.org/10.1364/AO.56.007796
  4. Visualization of partially occluded 3D object using wedge prism-based axially distributed sensing vol.313, 2014, https://doi.org/10.1016/j.optcom.2013.09.060
  5. P-160L:Late-News Poster: Viewing Angle Analysis of Integral Imaging Display vol.46, pp.1, 2015, https://doi.org/10.1002/sdtp.10138
  6. Real-time interactive display for integral imaging microscopy vol.53, pp.20, 2014, https://doi.org/10.1364/AO.53.004450
  7. Synthesis of computer-generated spherical hologram of real object with 360° field of view using a depth camera vol.52, pp.15, 2013, https://doi.org/10.1364/AO.52.003567
  8. Real-time 3D display system based on computer-generated integral imaging technique using enhanced ISPP for hexagonal lens array vol.52, pp.34, 2013, https://doi.org/10.1364/AO.52.008411
  9. Lane Detection Algorithm for Night-time Digital Image Based on Distribution Feature of Boundary Pixels vol.17, pp.2, 2013, https://doi.org/10.3807/JOSK.2013.17.2.188
  10. 3D Image Correlator using Computational Integral Imaging Reconstruction Based on Modified Convolution Property of Periodic Functions vol.18, pp.4, 2014, https://doi.org/10.3807/JOSK.2014.18.4.388
  11. Viewing-Angle-Enhanced Integral Imaging Display System Using a Time-Multiplexed Two-Directional Sequential Projection Scheme and a DEIGR Algorithm vol.7, pp.1, 2015, https://doi.org/10.1109/JPHOT.2015.2396904
  12. Active integral imaging system based on multiple structured light method vol.23, pp.21, 2015, https://doi.org/10.1364/OE.23.027094
  13. Viewing-zone control of integral imaging display using a directional projection and elemental image resizing method vol.52, pp.28, 2013, https://doi.org/10.1364/AO.52.006969
  14. Real-time depth controllable integral imaging pickup and reconstruction method with a light field camera vol.54, pp.35, 2015, https://doi.org/10.1364/AO.54.010333
  15. Recent issues on integral imaging and its applications vol.15, pp.1, 2014, https://doi.org/10.1080/15980316.2013.867906
  16. Nonuniform viewing angle of integral imaging display vol.23, pp.10, 2015, https://doi.org/10.1002/jsid.385
  17. Three-dimensional integral imaging display system via off-axially distributed image sensing vol.85, 2016, https://doi.org/10.1016/j.optlaseng.2016.03.023
  18. Resolution Analysis of Axially Distributed Image Sensing Systems under Equally Constrained Resources vol.17, pp.5, 2013, https://doi.org/10.3807/JOSK.2013.17.5.405
  19. 3D Integral Imaging Display using Axially Recorded Multiple Images vol.17, pp.5, 2013, https://doi.org/10.3807/JOSK.2013.17.5.410
  20. Development of a real-time integral imaging display system based on graphics processing unit parallel processing using a depth camera vol.53, pp.1, 2014, https://doi.org/10.1117/1.OE.53.1.015103
  21. Real object-based integral imaging system using a depth camera and a polygon model vol.56, pp.1, 2017, https://doi.org/10.1117/1.OE.56.1.013110