International journal of advanced smart convergence

The Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회)
권호 표지
DOI QR코드

DOI QR Code

Image Based 3D Reconstruction of Texture-less Objects for VR Contents

  • Hafeez, Jahanzeb (Graduate School of Information Contents, Kwangwoon University) ;
  • Lee, Seunghyun (Graduate School of Information Contents, Kwangwoon University) ;
  • Kwon, Soonchul (Graduate School of Information Contents, Kwangwoon University) ;
  • Hamacher, Alaric (Graduate School of Information Contents, Kwangwoon University)
  • Received : 2017.01.29
  • Accepted : 2017.02.28
  • Published : 2017.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

Recent development in virtual and augmented reality increases the demand for content in many different fields. One of the fast ways to create content for VR is 3D modeling of real objects. In this paper we propose a system to reconstruct three-dimensional models of real objects from the set of two-dimensional images under the assumption that the subject does not has distinct features. We explicitly consider an object that is made of one or more surfaces and radiant constant energy isotropically. We design a low cost portable multi camera rig system that is capable of capturing images simultaneously from all cameras. In order to evaluate the performance of the proposed system, comparison is made between 3D model and a CAD model. A simple algorithm is also proposed to acquire original texture or color of the subject. Using best pattern found after the experiments, 3D model of the Pyeongchang Olympic Mascot "Soohorang" is created to use as VR content.

Keywords

References

  1. A.S.R. Junior, E. C. W. Gonzales, L. Valente, and B. Feijo, "First steps towards Live-action Virtual Reality Games," SBC J. Interact. Syst., Vol. 7, No. 1, pp. 3-16, November 2016.
  2. J. Torrente, B.A. Del, A. Serrano-Laguna, J.A. Vallejo-Pinto, P. Moreno-Ger, and B. Fernandez-Manjon, "Towards a low cost adaptation of educational games for people with disabilities," Comput. Sci. Inf. Syst., Vol. 11, No. 1, pp. 369-391, January 2014. https://doi.org/10.2298/CSIS121209013T
  3. A. Hamacher, S.J. Kim, S.T. Cho, S. Pardesahi, S.H. Lee, S.J. Eun, T.K. Whangbo, "Application of Virtual, Augmented, and Mixed Reality to Urology," Int. Neurourol. J., Vol. 20, No. 3, pp. 172-181, September 2016. https://doi.org/10.5213/inj.1632714.357
  4. F. Bruno, S. Bruno, G. De Sensi, M.-L. Luchi, S. Mancuso, and M. Muzzupappa, "From 3D reconstruction to virtual reality: A complete methodology for digital archaeological exhibition," J. Cult. Herit., Vol. 11, No. 1, pp. 42-49, March 2010. https://doi.org/10.1016/j.culher.2009.02.006
  5. E. Madrigal, S. Prajapati, and J. C. Hernandez-Prera, "Introducing a Virtual Reality Experience in Anatomic Pathology Education," Am. J. Clin. Pathol., Vol. 146, No. 4, pp. 462-468, October 2016. https://doi.org/10.1093/ajcp/aqw133
  6. F. Carroll, "Designing (for) experiences in photorealistic VR environments," New Rev. Hypermedia Multimed., Vol. 16, No. 1-2, pp. 181-194, April 2010. https://doi.org/10.1080/13614561003710250
  7. S. Aromaa and K. Vaananen, "Suitability of virtual prototypes to support human factors/ergonomics evaluation during the design," Appl. Ergon., Vol. 56, pp. 11-18, September 2016. https://doi.org/10.1016/j.apergo.2016.02.015
  8. J. Hafeez, A. Hamacher, H. Son, S. Pardeshi, and S.H. Lee, "Workflow Evaluation for Optimized Image - Based 3D Model Reconstruction," in the Proc. of International Conference on Electronics, Electrical Engineering, Computer Science (EEECS) : Innovation and Convergence, vol. 2, pp. 62-65, 2016.
  9. I. Detchev, A. Habib, and Y.-C. Chang, "Image Matching and Surface Registration for 3D Reconstruction of a Scoliotic Torso," GEOMATICA, Vol. 65, No. 2, pp. 175-187, June 2011. https://doi.org/10.5623/cig2011-026
  10. J. Schoning and G. Heidemann, "Evaluation of Multi-view 3D Reconstruction Software," in Proc. Of 16th International Conf. on Computer Analysis of Images and Patterns, pp. 450-461 2015.
  11. C. Santagati, L. Inzerillo, and F. Di Paola, "Image-Based Modeling Techniques For Architectural Heritage 3d Digitalization: Limits And Potentialities," Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci., Vol. XL-5, No. W2, pp. 555-560, September 2013.
  12. D. G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," Int. J. Comput. Vis., Vol. 60, No. 2, pp. 91-110, November 2004. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  13. M. Maruyama and S. Abe, "Range sensing by projecting multiple slits with random cuts," IEEE Trans. Pattern Anal. Mach. Intell., Vol. 15, No. 6, pp. 647-651, June 1993. https://doi.org/10.1109/34.216735
  14. S. Mahadevan, H. Pandzo, M. Bennamoun, and L. Williams, "A 3D acquisition and modelling system," in Proc. Of the 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing, Vol. 3, pp. 1941-1944, 2001.
  15. S.Y. Chen and Y.F. Li, "Automatic sensor placement for model-based robot vision," IEEE Trans. Syst. Man Cybern. Part B Cybern., Vol. 34, No. 1, pp. 393-408, February 2004.
  16. S. Larsson and J.A.P. Kjellander, "Path Planning for Laser Scanning with an Industrial Robot," Robot Auton Syst, Vol. 56, No. 7, pp. 615-624, July 2008. https://doi.org/10.1016/j.robot.2007.10.006
  17. S. Paulus, J. Behmann, A.-K. Mahlein, L. Plümer, and H. Kuhlmann, "Low-Cost 3D Systems: Suitable Tools for Plant Phenotyping," Sensors, Vol. 14, No. 2, pp. 3001-3018, February 2014. https://doi.org/10.3390/s140203001
  18. A. Hosseininaveh, R. Yazdan, A. Karami, M. Moradi, and F. Ghorbani, "A Low-Cost and Portable System for 3D Reconstruction of Texture-Less Objects," ISPRS - Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci., Vol. 15, pp. 327-332, December 2015.
  19. C. Wu, "Towards Linear-Time Incremental Structure from Motion," in Proceedings of the 2013 International Conference on 3D Vision, pp. 127-134, 2013.
  20. C. Wu, S. Agarwal, B. Curless, and S. M. Seitz, "Multicore Bundle Adjustment," in Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, pp. 3057-3064, 2011.
  21. Y. Furukawa and J. Ponce, "Accurate, Dense, and Robust Multiview Stereopsis," IEEE Trans. Pattern Anal. Mach. Intell., Vol. 32, No. 8, pp. 1362-1376, August 2010. https://doi.org/10.1109/TPAMI.2009.161
  22. M. Kazhdan, M. Bolitho, and H. Hoppe, "Poisson Surface Reconstruction," in Proceedings of the Fourth Eurographics Symposium on Geometry Processing, pp. 61-70, 2006.
  23. Y. Wang, W. Wang, and E. Wu, "Optimizing the Parameters for Patch-based Texture Synthesis," in Proceedings of the 2006 ACM International Conference on Virtual Reality Continuum and Its Applications, pp. 75-82, 2006.
  24. MeshLab, (version 1.3.4), http://meshlab.sourceforge.net/.
  25. CloudCompare, (version 2.7.0), http://www.cloudcompare.org/.
  26. P.J. Besl and H.D. McKay, "A method for registration of 3-D shapes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 2, pp. 239-256, February 1992. https://doi.org/10.1109/34.121791