The Journal of Korean Institute of Information Technology (한국정보기술학회논문지)

Korean Institute of Information Technology (한국정보기술학회)
권호 표지

The Analysis of De-identification for Privacy Protection in Intelligent Video Surveillance System

지능형 영상 감시 시스템에서 프라이버시 보호를 위한 De-identification 기술 분석

  • 문해민 (조선대학교 정보통신공학과) ;
  • 반성범 (조선대학교 제어계측로봇공학과)
  • Published : 2011.07.31
⟨ Previous Next ⟩

Abstract

Recently, the utilization of video surveillance system is increased due to the increase of terror and crime. However, surveillance systems has the problem of invasion of privacy. Therefore, the research on privacy protection has been progressed. Conventional research on privacy protection can protect the privacy in images, but has a problem that monitoring function is weakened. So methods are studied to prevent weakness of monitoring and to minimize the loss of data. In this paper, we analyze recent research and technology on the privacy protection. Now, privacy protection and monitoring can't be satisfied simultaneously in video surveillance. To compensate its problem in the future, technologies such as super resolution restore, long distance identification are expected to be studied.

최근 테러 및 범죄의 증가로 사회질서 유지, 범죄예방 등을 위해 영상 감시 시스템의 도입이 급증하고 있다. 그러나 프라이버시 침해라는 새로운 문제점을 발생시키고 있어, 프라이버시 보호에 대한 연구가 진행되었다. 프라이버시 보호에 관한 기존 연구는 영상에서 프라이버시를 보호할 수 있지만 감시 기능이 약해지는 문제점이 있다. 그래서 프라이버시 보호에 의한 영상 손실을 최소화하여 감시 기능의 저하를 막는 기술에 대한 연구가 진행되고 있다. 본 논문에서는 지능형 영상 감시 시스템에서 프라이버시 보호를 위한 최근 연구 및 기술들을 분석하였다. 현재 영상 감시 시스템에서 프라이버시 보호와 감시를 동시에 완전히 만족할 수 없다. 향후에는 이를 보완하기 위해 외란극복, 초해상도 복원, 원거리 신원확인 기술들이 연구될 것으로 예상된다.

Keywords

References

  1. S. Aramvith, S. Pumrin, T. Chalidabhongse, and S. Siddhichai, "Video Processing and Analysis for Surveillance Applications", in Proc. Int. Symp. Intelligent Signal Processing and Communication Systems 2009, pp. 607-610, 2009.
  2. S. Moncrieff, S. Venkatesh, and G. A. W. West, "Dynamic Privacy in Public Surveillance", IEEE Trans., Computer, Vol. 42, No. 9, pp. 22-28, 2009.
  3. A. Cavallaro, "Privacy in Video Surveillance", IEEE Trans. Image Signal Processing Magazine, Vol. 24, No. 2, pp. 168-169. 2007. https://doi.org/10.1109/MSP.2007.323270
  4. M. Gill and A. Spriggs, Assessing the Impact of CCTV, Home office research study 292, Home Office Research, Development and Statistics Directorate, 2005.
  5. H. M. Moon and S. B. Pan, "A New Human Identification Method for Intelligent Video Surveillance System", in Proc. IEEE Int. Conf. Computer Communications and Networks, Switzerland, Aug. 2010.
  6. H. M. Moon, C. H. Seo, Y. W. Chung, and S. B. Pan, "Privacy Protection Technology in Video Surveillance System", in Proc. Int. Conf. Embedded and Multimedia Computing, pp. 160-165, Dec. 2009.
  7. A. Criminisi, P. Perez, and K. Toyama, "Region Filling and Object Removal by Exemplar-based Image Inpainting", IEEE Transactions on Image Processing, Vol. 13, No. 9, pp. 1200-1212, 2004. https://doi.org/10.1109/TIP.2004.833105
  8. M. V. Venkatesh, S. -C. Cheung, J. Paruchuri, J. Zhao, and T. Nguyen, "Protecting and Managing Privacy Information in Video Surveillance Systems", Protecting Privacy in Video Surveillance, Andrew Senior, Springer, 2009.
  9. K. P. Jithendra, S. C. Sen-ching, and W. H. Michael, "Video Data Hiding for Managing Privacy Information in Surveillance Systems", EURASIP Journal on Information Security, 2009.
  10. EMITALL Surveillance, http://www.emitall.com/
  11. C. Cedras and M. Shah, "A Survey of Motion Analysis from Moving Light Displays", in Proc, IEEE Computer Society Conference on Comput. Vis. Pattern Recog., pp. 214-221, 1994.
  12. M. Pollefeys, L. Van Gool, M. Vergauwen, F. Verbiest, K. Cornelis, J. Tops, and R. Koch, "Visual Modeling with a Hand-held Camera", International Journal of Computer Vision, Vol. 59, No. 3, pp. 207- 232, Sep./Oct. 2004. https://doi.org/10.1023/B:VISI.0000025798.50602.3a
  13. T. Osawa, X. Wu, K. Wakabayashi, and T. Yasuno, "Human Tracking by Particle Filtering using Full 3D Model of both Target and Environment", in Proc. Int. Conf. Pattern Recog., Vol. 2, pp. 25-28, 2006.
  14. A. Dominguez-Caneda, C. Urdiales, and F. Sandoval, "Dynamic Background Subtraction for Object Extraction using Virtual Reality based Prediction", In Proc. IEEE Mediterranean MELECON 2006, pp. 66-469, 2006.
  15. J. L. Starck, F. Murtagh, E. J. Candes, and D. L. Donoho, "Gray and Color Image Contrast Enhancement by the Curvelet Transform", IEEE Transactions on Image Processing, Vol. 12, No. 6, pp. 706-717, June 2003. https://doi.org/10.1109/TIP.2003.813140
  16. M. Black and P. Anandan, "The Robust Estimation of Multiple Motions: Parametric and Piecewise Smooth Flow Fields", Computer Vision and Image Understanding, Vol. 63, No. 1. pp. 75-104, Jan. 1996. https://doi.org/10.1006/cviu.1996.0006
  17. B. K. P. Horn and B. G. Schunck, "Determining Optical Flow", Artif. Intell., Vol. 17, No. 1-3, pp. 185-203, Aug. 1981. https://doi.org/10.1016/0004-3702(81)90024-2
  18. J. L. Barron, D. J. Fleet, S. S. Beauchemin, and T. A. Burkitt, "Performance of Optical Flow Techniques", in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog., pp. 236-242, 1992.
  19. C. Cedras and M. Shah, "Motion-based Recognition, A survey", Image and Vision Computing, Vol. 13, No. 2, pp. 129-155, Mar. 1995. https://doi.org/10.1016/0262-8856(95)93154-K
  20. R. N. Hota, V. Venkoparao, and A. Rajagopal, "Shape based Object Classification for Automated Video Surveillance with Feature Selection", in Proc. Int. Conf. Inf. Technol., pp. 97-99, 2007.
  21. N. Dalal, B. Triggs, and C. Schmid, "Human Detection using Oriented Histograms of Flow and Appearance", in Proc. Eur. Conf. Comput. Vis. pp. 428-441, 2006.
  22. P. Viola and M. Jones, "Rapid Object Detection using a Boosted Cascade of Simple Features", in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001.
  23. K. Sobottka and I. Pitas, "A Novel Method for Automatic Face Segmentation", Facial Feature Extraction and Tracking, Signal Processing: Image Comm., Vol. 12, No. 3, pp. 263-281, 1998. https://doi.org/10.1016/S0923-5965(97)00042-8
  24. S. Yu, T. Tan, K. Huang, K. Jia, and X. Wu, "A Study on Gait-based Gender Classification", IEEE Transactions on Image Processing, Vol. 18, No. 8, 2009.
  25. C. R. Wren, A. Azabayejani, and A. Pentland, "Pfinder: Real-time Tracking of the Human Body", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 19, No. 7, pp. 780-785, 1997. https://doi.org/10.1109/34.598236
  26. D. Comaniciu and P. Meer, "Mean Shift: A Robust Approach toward Feature Space Analysis", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 24, No. 5, pp. 603-619, 2002. https://doi.org/10.1109/34.1000236
  27. D. Comaniciu, V. Ramesh, and P. Meer, "Kernel-based Object Tracking", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 25, No. 5, pp. 564-577, May 2003. https://doi.org/10.1109/TPAMI.2003.1195991
  28. A. Yilmaz, O. Javed, and M. Shah, "Object Tracking: A Survey", ACM Trans. Comput. Surv., Vol. 38, No. 4, pp. 1-45, 2006. https://doi.org/10.1145/1132952.1132953
  29. L. M. Fuentes and S. A. Velastin, "People Tracking in Surveillance Applications", Image and Vision Computing, Vol. 24, pp. 1165-1171, Nov. 2006. https://doi.org/10.1016/j.imavis.2005.06.006
  30. P. Perez, C. Hue, J. Vermaak, and M. Gangnet, "Color-based Probabilistic Tracking", Eur. Conf. Comput. Vis., pp. 661-675, 2002.
  31. J. Schiff, M. Meingast, Deirdre K. Mulligan, S. Sastry, and K. Goldberg, "Respectful Cameras: Detecting Visual Markers in Real-time to Address Privacy Concerns", in Proc. IEEE Int. Conf. Intelligent Robots and Systems, pp. 971-978, Oct. 2007.
  32. E. Newton, L. Sweeney, and B. Malin, "Preserving Privacy by De-identifying Facial Images", Carnegie Mellon University, Technical Report CMU-CS-03-119, 2003.
  33. R. Gross, L. Sweeney, F. de la Torre, and S. Baker, "Model-based Face De-identification", in Proc. Conf. on Computer Vision and Pattern Recognition Workshop, 2006.
  34. R. Gross, L. Sweeney, J. Cohn, F. d. l. Torre, and S. Baker, "Face De-identification", Protection Privacy In Video Surveillance, pp 129-146, 2009.
  35. R. Gross, "Face De-Identification using Multi-Factor Active Appearance Models", Phd thesis, Carnegie Mellon University, 2008.
  36. D. Bitouk, N. Kumar, S. Dhillon, P. Belhumeur, and S. K. Nayar, "Face Swapping: Automatically Replacing Faces in Photographs", ACM Transactions on Graphics, pp. 1672-1675, 2008.
  37. V. Blanz, K. Scherbaum, T. Vetter, and H.-P. Seidel, "Exchanging Faces in Images", Comput. Graph. Forum, Vol. 23, pp. 669-676, 2004.
  38. W. S. Tong, C. K. Tang, M. S. Brown, and Y. Q. Xu, "Example-based Cosmetic Transfer", in Proc. Pracific Conf. Computer Graphics and Applications, pp. 211-218, 2007.
  39. R. T. Collins, R. Gross, and J. Shi. "Silhouette-based Human Identification from Body Shape and Gait", in Proc. IEEE Conf. Face and Gesture Recognition, pp. 351-356, 2002.
  40. T. Koshimizu, T. Toriyama, and N. Babaguchi "Factors on the Sense of Privacy in Video Surveillance", in Proc. ACM Workshop CARPE' 06, pp. 35-44, 2006.
  41. X. Yu, K. Chinomi, T. Koshimizu, N. Nitta, Y. Ito, and N. Babaguchi, "Privacy Protecting Visual Processing for Secure Video Surveillance", in Proc. IEEE Int. Conf. ICIP, pp. 1672-1675, 2008.
  42. F. Dufaux and T. Ebrahimi, "Scrambling for Video Surveillance with Privacy", in Proc. Conf. Computer Vision and Pattern Recognition, pp. 160-167, June 2006.
  43. P. Agrawal, "De-Identification for Privacy Protection in Surveillance Videos", Int. Institute of Information Technology, Hyderabad, India, 2010.
  44. P. Agrawal and P. J. Narayanan, "Person De-identification in Videos", IEEE Trans. Circuits and Systems for Video Technology, Vol. 21, No. 3, pp. 299-310, 2011. https://doi.org/10.1109/TCSVT.2011.2105551
  45. P. KA, S. G, and B. M., "Video Inpainting under Constrained Camera Motion", IEEE Transactions on Image Processing, Vol. 16, pp. No. 2, 545-553, Feb. 2007. https://doi.org/10.1109/TIP.2006.888343
  46. D. Chen, Y. Chang, R. Yan, and J. Yang, "Tools for Protecting the Privacy of Specific Individuals in Video", EURASIP Journal on Advances in Signal Processing, pp. 107-107, 2007.
  47. M. V. Venkatesh, S. -C. Cheung, and J. Zhao, "Efficient Object based Video Inpainting", Pattern Recognition Letters, Vol. 30, pp. 168-179, 2009. https://doi.org/10.1016/j.patrec.2008.03.011
  48. K. A. Patwardhan, G. Sapiro, and M. Bertalmío, "Video Inpainting of Occluding and Occluded Objects", in Proc. IEEE Int. Conf. Image Processing, Genoa, Italy, 2005.
  49. M. Langheinrich, "Privacy Invasions in Ubiquitous Computing", Workshop on Socially-Informed Design of Privacy Enhancing Solutions in Ubiquitous Computing, UbiComp 2002, Oct. 2002.
  50. J. C. Alonso-Bayal, R. Santiago-Mozos, J. M. Leiva-Murillo, M. La'zaro, and A. Arte's- Rodriguez, "Real-time Tracking and Identification on an Intelligent IR-based Surveillance System", in Proc. IEEE Conf. Advanced Video and Signal Based Surveillance, pp. 277-282, 2007.
  51. D. M. Tsai, C. T. Lin, and J. F. Chen, "The Evaluation of Normalized Cross Correlations for Defect Detection", Pattern Recognition Letters, Vol. 24, No. 15, pp. 2525-2535, Nov. 2003. https://doi.org/10.1016/S0167-8655(03)00098-9
  52. X. Gu, D. Yu, and L. Zhang, "Image Shadow Removal using Pulse Coupled Neural Network", IEEE Transactions on Neural Networks, Vol. 16, No. 3, pp. 692-698, 2005. https://doi.org/10.1109/TNN.2005.844902
  53. J. D. van Ouwerkerk, "Image Super-resolution Survey", Image and Vision Computing, Vol. 24, pp. 1039-1052, 2006. https://doi.org/10.1016/j.imavis.2006.02.026
  54. M. E. Tipping and C. M. Bishop. "Bayesian Image Super-resolution", Advances in Neural Information Processing Systems, pp. 1279-1286, 2003.
  55. J. Park, Y. Kwon, and J. Kim, "An Example-based prior Model for Text Image Super-resolution", in Proc. Int. Conf. Document Analysis and Recognition(ICDAR'05), pp. 374-378, 2005.
  56. L. C. Pickup, D. P. Capel, S. J. Roberts, and A. Zisserman, "Bayesian Image Super-resolution, Continued", Advances in Neural Information Processing Systems 19, pp. 1089-1096, 2006.
  57. U. S. Government, Human ID at a Distance, DARPA Project, 2004.
  58. S. Tansuriyavong and S. I. Hanaki, "Privacy Protection by Concealing Persons in Circumstantial Video Image", in Proc. Perceptive User Interfaces, pp. 1-4, 2001.
  59. X. Huang and N. Boulgouris, "Human Gait Recognition based on Multiview Gait Sequences", EURASIP Journal on Advances in Signal Processing, pp. 1-8, 2008.
  60. J. H. Elder, S. J. D. Prince, Y. Hou, M. Sizintsev, and E. Olevskiy, "Pre-attentive and Attentive Detection of Humans in Wide-field Scenes", International Journal of Computer Vision, Vol. 72, No. 1, pp. 47-66, 2007. https://doi.org/10.1007/s11263-006-8892-7
  61. A. D. Bimbo and F. Pernici, "Towards on-line Saccade Planning for High-resolution Image Sensing", Pattern Recognition Letters, Vol. 27, pp. 1826-1834, 2006. https://doi.org/10.1016/j.patrec.2006.02.014
  62. M. Valera and S. A. Velastin, "Intelligent Distributed Surveillance Systems: A review", in Proc. Inst. Elect. Eng. Vision, Image Signal Process., Vol. 152, No. 2, pp. 192-204, 2005.
  63. S. Hengstler, D. Prashanth, S. Fong, and H. Aghajan, "Mesheye: a Hybrid-resolution Smart Camera Mote for Applications in Distributed Intelligent Surveillance", in Proc. Int. Conf. Information Processing in Sensor Networks, pp. 360-369, 2007.
  64. R. Cucchiara, A.Pratti, and R.Vezani, "An Intelligent Surveillance System for Dangerous Situation Detection in Home Environments", Intelligenza artificable, Vol. 1, No. 1, pp. 11-15, 2004.
  65. H. Foroughi, B. S. Aski, and H. Pourreza, "Intelligent Video Surveillance for Monitoring Fall Detection of Elderly in Home Environments", in Proc. Int. Conf. Computer and Information Technology, pp. 219-224, Dec. 2008.
  66. T. Ahmedali and J. J. Clark, "Collaborative Multi-camera Surveillance with Automated Person Detection", in Proc. Canadian Conf. Computer and Robot Vision, 2006.
  67. S. J. Krotosky and M. M. Trivedi, "Person Surveillance using Visual and Infrared Imagery", IEEE Transactions on Circuits and Systems for Video Technology, Vol. 18, No. 8, pp. 1096-1105, 2008. https://doi.org/10.1109/TCSVT.2008.928217
  68. B. P. L. Lo, J. Sun, and S. A. Velastin, "Fusing Visual and Audio Information in a Distributed Intelligent Surveillance System for Public Transport Systems", Acta Autom. Sin., Vol. 29, No. 3, pp. 393-407, 2003.