Journal of KIISE:Databases (한국정보과학회논문지:데이타베이스)

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지

Design and Implementation of Multimedia Retrieval a System

멀티미디어 검색 시스템의 설계 및 구현

  • 노승민 (아주대학교 정보통신전문대학원) ;
  • 황인준 (아주대학교 정보통신전문대학원)
  • Published : 2003.10.01
Download PDF
⟨ Previous Next ⟩

Abstract

Recently, explosive popularity of multimedia information has triggered the need for retrieving multimedia contents efficiently from the database including audio, video and images. In this paper, we propose an XML-based retrieval scheme and a data model that complement the weak aspects of annotation and conent based retrieval methods. The Property and hierarchy structure of image and video data are represented and manipulated based on the Multimedia Description Schema (MDS) that conforms to the MPEG-7 standard. For audio contents, pitch contours extracted from their acoustic features are converted into UDR string. Especially, to improve the retrieval performance, user's access pattern and frequency are utilized in the construction of an index. We have implemented a prototype system and evaluated its performance through various experiments.

최근 들어 멀티미디어 정보의 사용량이 증가하면서 멀티미디어 데이타베이스로부터 오디오나 비디오, 이미지 둥 다양한 형태의 멀티미디어 컨텐츠를 효과적으로 찾아내는 멀티미디어 검색 시스템의 필요성이 증가하였다. 본 논문에서는 기존의 주석 및 내용 기반 검색 기법을 상호 보완하고 효과적인 멀티미디어 데이타 검색을 지원하는 XML 기반의 새로운 검색 기법과 이를 위한 데이타 모델을 제시한다. 이미지 및 비디오에 대한 데이타 모델은 MPEG-7 표준에 정의되어 있는 멀티미디어 기술 구조(MDS)와 기술 정의 언어인 XML Schema를 사용하여 멀티미디어 데이타의 특성 및 계층구조를 표현하였고 오디오 데이타의 경우 음향 특징들로부터 추출된 음높이를 분석하여 UDR 스트링으로 변환하고 자주 검색된 멜로디의 관리를 통해 검색 성능을 향상하였다. 본 논문에서는 제안된 모델을 기반으로 검색 시스템을 구현하였으며 다양한 실험을 통하여 성능 평가를 하였다.

Keywords

References

  1. E. Hwang and S. Lee, 'Spatial Similarity and Annotation-Based Image Retrieval System,' IEEE 4th International Symposium on Multimedia Software Engineering, California, December 2002 https://doi.org/10.1109/MMSE.2002.1181593
  2. E. Hwang and D. Park, 'Popularity-Adaptive Index Scheme For Fast Music Retrieval,' Proc. of IEEE Multimedia and Expo, Lausanne, Switzerland, August 2002 https://doi.org/10.1109/ICME.2002.1035733
  3. Virginia E. Ogle and Michael Stonebraker, 'Chabot : Retrieval from a Relational Database of Images,' IEEE Computer, vol. 28, no. 9, 1995 https://doi.org/10.1109/2.410150
  4. Alex Pentland, Rosalind Picard, and Stan Sclaroff, 'Photobook: Tools for Content-Based Manipulation of Image Databases,' SPIE PAPER 2185-05 Storage and Retrieval of Image and Video Databases II, San Jose, CA. February 6-10, 1994
  5. J. R. Smith and S.-F. Chang. 'VisualSEEk: a fully automated content-based image query system,' ACM Multimedia, Boston, May 1996
  6. C. Carson, M. Thomas, et al., 'Blobworld: A system for region-based image indexingand retrieval,' In Proc. Int. Conf. Visual Inf. Sys., 1999
  7. A. Ghias, J.Logan, D. Chamberlin, and B. Smith, 'Query by humming-musical information retrieval in an audio database,' Proc. of ACM Multimedia Conference, San Francisco, 1995 https://doi.org/10.1145/217279.215273
  8. R.J. McNab, L.A. Smith, D. Bainbridge, and I.H. Witten, 'The New Zealand digital library MELody inDEX,' D-Lib Magazine, May 1997
  9. Huron, D., C.S. Sapp, and B. Aarden, Theme-finder. 2000. http://www.themefinder.org
  10. M. Flickner et al., 'Query by image and video content: The QBIC system,' IEEE computer, vol. 28, no. 9, pp. 23-32, 1995 https://doi.org/10.1109/2.410146
  11. Song, Yong-Jun, Hyoung-Joo, et al., 'TIVRON: The Integrated Video Retrieval System based on OODBMS,' Journal of Korean Institute of Communication Sciences, April. 1999
  12. H. kosch, R Tusch, et al., 'The SMOOTH Video DB - Demonstration of an integrated generic indexing approach,' ACM Multimedia Conference, pp. 495-496, Los Angeles, USA, October-November 2000 https://doi.org/10.1145/354384.376413
  13. M. Carrer, L. Ligresti, and T.D.C. Little, 'A Tcl/Tk-Based Video Annotation Engine,' Proc. USENIX, Fifth Annual Tcl/Tk Workshop, Summer 1997
  14. B.Y. Ricardo and R.N. Berthier, Modem Information Retrieval, ACM press, 1999
  15. L. Wilcox and J. Boreczky, 'Annotation and Segmentatoin for Multimedia Indexing and Retrieval,' The 31st Annual Hawaii International Conference on System Sciences, Vol. II, pp. 259-267, Wailea, Hawaii, January 1998 https://doi.org/10.1109/HICSS.1998.651708
  16. B. Emond, M. Brooks, and A. Smith, 'A Broadband Web-based Application for Video Sharing and Annotation,' ACM Multimedia 2001, Ottawa, Canada, September 30-October 5, 2001 https://doi.org/10.1145/500141.500256
  17. S. Blackburn and D. DeRoure, 'A Tool for Content Based Navigation of Music,' Proc. of ACM Multimedia, 1998 https://doi.org/10.1145/290747.290802
  18. J.T. Foote, 'Content-Based Retrieval of Music and Audio,' Multimedia Storage and Archiving Systems II - Proc. of SPIE, Vol. 3229, pp. 138-147, 1997
  19. Guojun Lu, 'Indexing and Retrieval of Audio: A Survey,' Journal of Multimedia Tools and Applications, Vol. 15, pp. 269-290, 2001 https://doi.org/10.1023/A:1012491016871
  20. N. Kosugi, Y. Nishihara, and T. Sakata, 'A Practical Query-By-Humming System for a Large Music Database,' Proc. of ACM Multimedia 2000 Conference, November 2000 https://doi.org/10.1145/354384.354520
  21. E. Hwang and Y. Nam, 'XVIDEO: XML Based Video Annotation and Retrieval,' Proc. of Int'l Conf. on Internet Computing, Las Vegas, June 2002
  22. C. Carson, S. Belongies, H. Greenspan and J. Malik, 'Region-based image querying,' Proc. IEEE Workshop on Content-Based Access of Image and Video Libraries, June 1997 https://doi.org/10.1109/IVL.1997.629719
  23. jMusic Java library, http://jmusic.ci.qut.edu.au/
  24. L. H. Rodrigues, Building Imaging Applications with Java Technology, Addison Wesley, 2001
  25. K. Tan, B. Ooi and C. Yee, 'An Evaluation of Color-Spatial Retrieval Techniques for Large Image Databases,' Multimedia Tools and Applications, Vol. 14, pp. 55-78, 2001 https://doi.org/10.1023/A:1011359607594