Smart Structures and Systems

Techno-Press (테크노프레스)
권호 표지
DOI QR코드

DOI QR Code

Computer vision-based displacement measurement with m-sequence target

  • Hu, Yi-ding (Faculty of Intelligent Manufacturing, Wuyi University) ;
  • Xia, Qi (School of Civil Engineering, Southeast University) ;
  • Hou, Rong-rong (Department of Civil and Environmental Engineering, The Hong Kong Polytechnic University) ;
  • Xia, Yong (Department of Civil and Environmental Engineering, The Hong Kong Polytechnic University) ;
  • Yan, Jian-yi (Faculty of Intelligent Manufacturing, Wuyi University)
  • Received : 2020.01.09
  • Accepted : 2021.01.05
  • Published : 2021.03.25
⟨ Previous Next ⟩

Abstract

The development of image sensors enables the application of vision-based techniques to the non-contact displacement measurement of large-scale structures. The features of the physical targets are critical to the accuracy, stability and anti-interference of the displacement measurement results. In this study, a novel m-sequence target and the associated circular correlation processing technique are developed for real-time displacement measurement. The properties of the m-sequence as a pseudo-random sequence are introduced. The vision-based displacement calculation method is then derived from the correlation property of the m-sequence. The algorithms and measurement systems are integrated in the LabVIEW environment. To verify the anti-interference performance of the developed system, static and dynamic experimental tests are carried out with various forms of interference, such as partial occlusion, uneven illumination, out of focus and smoke effect. Experimental results indicate that the developed system cannot only accurately measure structural displacement, but also has outstanding anti-interference performance, even if 30% of the target is masked.

Keywords

Acknowledgement

This research was supported by Guangdong Basic and Applied Basic Research Foundation, China (Project No. 2018A030313314); the Wuyi University Fund for Joint Research with Hong Kong and Macao (Project No. 2019WGALH18); the Research Grants Council of the Hong Kong Special Administrative Region, China (Project No. PolyU 152621/16E) and NSFC Joint Research Fund for Overseas and Hong Kong and Macao Scholars (Project No. 51629801).

References

  1. Bao, Y.Q., Tang, Z.Y., Li, H. and Zhang, Y.F. (2019), "Computer vision and deep learning-based data anomaly detection method for structural health monitoring", Struct. Health Monit., 18(2), 401-421. https://doi.org/10.1177/1475921718757405
  2. Brownjohn, J.M.W. (2006), "Structural health monitoring of civil infrastructure", Phil. Trans. R. Soc., 365, 589-622. https://doi.org/10.1098/rsta.2006.1925
  3. Busca, G., Cigada, A., Mazzoleni, P. and Zappa, E. (2015), "Vibration monitoring of multiple bridge points by means of a unique vision-based measuring system", Exp. Mech., 54, 255-271. https://doi.org/10.1007/s11340-013-9784-8
  4. Caetano, E., Silva, S. and Bateira, J. (2011), "A vision system for vibration monitoring of civil engineering structures", Exp. Tech. 35, 74-82. https://doi.org/10.1111/j.1747-1567.2010.00653.x
  5. Casciati, F., Casciati, S., Colnaghi, A., Faravelli, L., Rosadini, L. and Zhu, S. (2019), "Vision-based support in the characterization of superelastic U-shaped SMA elements," Smart Struct Syst., Int. J., 24(5), 669-681. https://doi.org/10.12989/sss.2019.24.5.641
  6. Catbas, F.N., Zaurin, R., Gul, M. and Gokce, H.B. (2012), "Sensor networks, computer imaging, and unit influence lines for structural health monitoring: case study for bridge load rating", J. Bridge Eng., 17, 662-670. https://doi.org/10.1061/(ASCE)BE.1943-5592.0000288
  7. Chen, J.G., Davis, A., Wadhwa, N., Durand, F., Freeman, W. and Buyukozturk, O. (2017), "Video Camera-based vibration measurement for civil infrastructure applications", J. Infrastruct. Syst., 23(3), B4016013. https://doi.org/10.1061/(ASCE)IS.1943-555X.0000348
  8. Ehrhart, M. and Lienhart, W. (2015), "Monitoring of civil engineering structures using a state-of-the-art image assisted total station", J. Appl. Geodesy., 9(3), 174-182. https://doi.org/10.1515/jag-2015-0005
  9. Feng, D.M. and Feng, M.Q. (2016), "Vision-based multipoint displacement measurement for structural health monitoring", Struct. Control Health Monit., 23, 876-890. https://doi.org/10.1002/stc.1819
  10. Feng, D.M. and Feng, M.Q. (2018), "Computer vision for SHM of civil infrastructure: From dynamic response measurement to damage detection - A review", Eng. Struct., 156, 105-117. https://doi.org/10.1016/j.engstruct.2017.11.018
  11. Feng, D.M., Feng, M.Q., Ozer, E. and Fukuda, Y. (2015), "A Vision-based sensor for noncontact structural displacement measurement", Sensors, 15(7), 16557-16575. https://doi.org/10.3390/s150716557
  12. Guo, J. and Zhu, C. (2016), "Dynamic displacement measurement of large-scale structures based on the Lucas-Kanade template tracking algorithm", Mech. Syst. Signal. Pr., 66-67, 425-436. https://doi.org/10.1016/j.ymssp.2015.06.004
  13. Hu, Y.D., Hou, R.R., Xia, Q. and Xia, Y. (2019), "Temperature-induced displacement of supertall structures: A case study", Adv. Struct. Eng., 22(4), 982-996. https://doi.org/10.1177/1369433218795288
  14. Jeon, H., Bang, Y. and Myung, H. (2011), "A paired visual servoing system for 6-DOF displacement measurement of structures", Smart Mater. Struct., 20, 045019. https://doi.org/10.1088/0964-1726/20/4/045019
  15. Jung, H.J., Lee, J.H. Yoon, S. and Kim, I.H. (2019), "Bridge Inspection and condition assessment using Unmanned Aerial Vehicles (UAVs): Major challenges and solutions from a practical perspective", Smart Struct. Syst., Int. J., 24(5), 669-681. http://doi.org/10.12989/sss.2019.24.5.669
  16. Khuc, T. and Catbas, F.N. (2017), "Computer vision-based displacement and vibration monitoring without using physical target on structures", Struct. Infrastruct. Eng., 13, 505-516. https://doi.org/10.1080/15732479.2016.1164729
  17. Kim, K., Kim, J. and Sohn, H. (2016), "Development and full-scale dynamic test of a combined system of heterogeneous laser sensors for structural displacement measurement", Smart Mater. Struct., 25, 065015. https://iopscience.iop.org/article/10.1088/0964-1726/25/6/065015
  18. Koo, K.Y., Brownjohn, J.M.W., List, D.I. and Cole, R. (2013), "Structural health monitoring of the Tamar suspension bridge", Struct. Control Health Monit., 20, 609-625. https://doi.org/10.1002/stc.1481
  19. Kuddus, M.A., Li, J., Hao, H., Li, C. and Bi. K.M. (2019), "Target-free vision-based technique for vibration measurements of structures subjected to out-of-plane movements", Eng. Struct., 190, 210-222. https://doi.org/10.1016/j.engstruct.2019.04.019
  20. Lee, J.H., Ho, H.N., Shinozuka, M. and Lee, J.J. (2012), "An advanced vision-based system for real-time displacement measurement of high-rise buildings", Smart Mater. Struct., 21, 125019. https://iopscience.iop.org/article/10.1088/0964-1726/21/12/125019
  21. Lee, J., Lee, K.C., Cho, S. and Sim, S.H. (2017), "Computer vision-based structural displacement measurement robust to light-induced image degradation for in-service bridges", Sensors, 17(10), 2317. https://doi.org/10.3390/s17102317
  22. Li, J. and Hao, H. (2016), "Health monitoring of joint conditions in steel truss bridges with relative displacement sensors", Measurement, 88, 360-371. https://doi.org/10.1016/j.measurement.2015.12.009
  23. Olaszek, P. (1999), "Investigation of the dynamic characteristic of bridge structures using a computer vision method", Measurement, 25, 227-236. https://doi.org/10.1016/S0263-2241(99)00006-8
  24. Otsu, N. (1979), "A Threshold Selection Method from Gray-Level Histograms", IEEE Trans. Syst. Man Cybern, 9, 62-66. https://doi.org/10.1109/TSMC.1979.4310076
  25. Ou, J.P. and Li, H. (2010), "Structural health monitoring in mainland china: review and future trends", Struct. Health Monit., 9(3), 219-231. https://doi.org/10.1177/1475921710365269
  26. Peterson, R.L., Ziemer, R.E. and Borth, D.E. (1995), Introduction to Spread Spectrum Communications, Prentice Hall, Inc.
  27. Ribeiro, D., Calcada, R., Ferreira, J. and Martins, T. (2014), "Non-contact measurement of the dynamic displacement of railway bridges using an advanced video-based system", Eng. Struct., 75, 164-180. https://doi.org/10.1016/j.engstruct.2014.04.051
  28. Song, Y.Z., Bowen, C.R., Kim, A.H., Nassehi, A., Padget, J. and Gathercole, N. (2014), "Virtual visual sensors and their application in structural health monitoring", Struct. Health Monit., 13, 251-264. https://doi.org/10.1177/1475921714522841
  29. Spencer, B.F. Jr., Hoskere, V. and Narazaki, Y. (2019), "Advances in Computer Vision-Based Civil Infrastructure Inspection and Monitoring", Engineering, 5(2), 199-222. https://doi.org/10.1016/j.eng.2018.11.030
  30. Welch, T.B., Wright, C.H.G. and Morrow, M.G. (2011), Real-Time Digital Signal Processing from MATLAB® to C with the TMS320C6x DSPs, (Second Edition), CRC Press.
  31. Xia, Y., Zhang, P., Ni, Y.Q. and Zhu, H.P. (2014), "Deformation monitoring of a super-tall structure using real-time strain data", Eng. Struct., 67, 29-38. https://doi.org/10.1016/j.engstruct.2014.02.009
  32. Xia, Q., Cheng, Y.Y., Zhang, J. and Zhu, F.Q. (2017), "In-service condition assessment of a long-span suspension bridge using temperature-induced strain data", J. Bridge Eng., 22(3), 04016124. https://doi.org/10.1061/(ASCE)BE.1943-5592.0001003
  33. Xia, Q., Liu, S.L. and Zhang, J. (2020), "Temperature analysis of a long-span suspension bridge based on a time-varying solar radiation model", Smart Struct. Syst., Int. J., 25(1), 23-35. https://doi.org/10.12989/sss.2020.25.1.023
  34. Xu, Y., Brownjohn, J.W.M. and Kong, D. (2018), "A non-contact vision-based system for multipoint displacement monitoring in a cable-stayed footbridge", Struct. Control Health Monit., 25, e2155. https://doi.org/10.1002/stc.2155
  35. Ye, X.W., Ni, Y.Q., Wai, T.T., Wong, K.Y., Zhang, X.M. and Xu, F. (2013), "A vision-based system for dynamic displacement measurement of long-span bridges: algorithm and verification", Smart Struct. Syst., Int. J., 12(3-4), 363-379. https://doi.org/10.12989/sss.2013.12.3_4.363
  36. Ye, X.W., Dong, C.Z. and Liu, T. (2016a), "Image-based structural dynamic displacement measurement using different multi-object tracking algorithms", Smart Struct. Syst., Int. J., 17(6), 935-956. https://doi.org/10.12989/sss.2016.17.6.935
  37. Ye, X.W., Yi, T.H., Dong, C.Z. and Liu, T. (2016b), "Vision-based structural displacement measurement: system performance evaluation and influence factor analysis", Measurement, 88, 372-384. https://doi.org/10.1016/j.measurement.2016.01.024
  38. Yi, T.H., Li, H.N. and Gu, M. (2013), "Experimental assessment of high-rate GPS receivers for deformation monitoring of bridge", Measurement, 46(1), 420-432. https://doi.org/10.1016/j.measurement.2012.07.018
  39. Yoon, H., Elanwar, H., Choi, H., Golparvar-Fard, M. and Spencer, Jr. B.F. (2016), "Target-free approach for vision-based structural system identification using consumer-grade cameras", Struct. Control Health Monit., 23, 1405-1416. https://doi.org/10.1002/stc.1850
  40. Zhou, X.Q., Xia, Y., Wei, Z.L. and Wu, Q.X. (2012), "A videogrammetric technique for measuring the vibration displacement of stay cables", Geo Spat. Inf. Sci., 15(2), 135-141. https://doi.org/10.1080/10095020.2012.714105