Research on the Detection Method of Hollowing and Missing for Building Exterior Walls Based on Visible and Infrared Image Fusion

WANG Wei; MI Qingren; XIAO Yun; YANG Xincong

doi:10.13204/j.gyjzG22112305

Volume 54 Issue 5

May 2024

Turn off MathJax

Article Contents

Abstract

References

Article Navigation > INDUSTRIAL CONSTRUCTION > 2024 > 54(5): 51-59

WANG Wei, MI Qingren, XIAO Yun, YANG Xincong. Research on the Detection Method of Hollowing and Missing for Building Exterior Walls Based on Visible and Infrared Image Fusion[J]. INDUSTRIAL CONSTRUCTION, 2024, 54(5): 51-59. doi: 10.13204/j.gyjzG22112305

Citation:

WANG Wei, MI Qingren, XIAO Yun, YANG Xincong. Research on the Detection Method of Hollowing and Missing for Building Exterior Walls Based on Visible and Infrared Image Fusion[J]. INDUSTRIAL CONSTRUCTION, 2024, 54(5): 51-59. doi: 10.13204/j.gyjzG22112305

Citation:

WANG Wei, MI Qingren, XIAO Yun, YANG Xincong. Research on the Detection Method of Hollowing and Missing for Building Exterior Walls Based on Visible and Infrared Image Fusion[J]. INDUSTRIAL CONSTRUCTION, 2024, 54(5): 51-59. doi: 10.13204/j.gyjzG22112305

PDF( 8980 KB)

Research on the Detection Method of Hollowing and Missing for Building Exterior Walls Based on Visible and Infrared Image Fusion

doi: 10.13204/j.gyjzG22112305

1. Guangzhou Metro Group Co., Ltd., Guangzhou 510220, China;
2. Harbin Institute of Technology(Shenzhen), Shenzhen 518055, China;
3. CRCC South China Construction Co., Ltd, Guangzhou 510220, China

Received Date: 2022-11-23
Available Online: 2024-06-22

Abstract

Abstract

The detection of hollowing and missing of building exterior walls is crucial to ensure the public safety around aging buildings in cities. The traditional artificial in-situ detection methods are time- and labor-consuming with safety risks. In addition, the detection results will also be affected by subjective factors such as professional experience and working status. The method of image acquisition by UAV and detection of building exterior wall defects by artificial intelligence model has become popular. However, the current research on defect detection only focuses on visible images or infrared images of a single modality, and only detect a certain defect without considering the mutual conversion between defects. To address this issue, this research combined the visible and infrared images of the building exterior wall, considered the image information from two modalities, and compared the UNet and Res-UNet models of different depths to identify the building exterior wall defects in the fused images. The experimental results showed that the Res-UNet model with a depth of 4 performed excellent on the hollowing and missing of the building exterior wall.
- multimodal fusion,
- visible and infrared image fusion,
- exterior wall defect detection,
- deep learning

FullText(HTML)

References(22)

References

[1]	TALAB A M A, HUANG Z, XI F, et al. Detection crack in image using Otsu method and multiple filtering in image processing techniques[J]. Optik, 2016, 127(3): 1030-1033.
[2]	周建. 公路隧道裂缝检测系统的研究与设计[D]. 西安:西安建筑科技大学, 2016.
[3]	ABDEL-QADER I, ABUDAYYEH O, KELLY M E. Analysis of edge-detection techniques for crack detection in bridges[J]. Journal of Computing in Civil Engineering, 2003, 17(4): 255-263.
[4]	徐为驰, 张磊, 张创, 等. 基于图像的路面病害检测方法研究[J]. 公路交通科技(应用技术版), 2018, 14(2): 157-161.
[5]	沈照庆, 彭余华, 舒宁. 一种基于SVM的路面影像损伤跨尺度识别方法[J]. 武汉大学学报(信息科学版), 2013, 38(8): 993-997.
[6]	瞿子易, 周文, 罗鑫, 等. 基于粒子群和支持向量机的裂缝识别[J]. 石油与天然气地质, 2009, 30(6): 786-792.
[7]	SALEEM M, GUTIERREZ H. Using artificial neural network and non-destructive test for crack detection in concrete surrounding the embedded steel reinforcement[J]. Structural Concrete, 2021, 22(5): 2849-2867.
[8]	YOO H S, KIM Y S. Development of a crack recognition algorithm from non-routed pavement images using artificial neural network and binary logistic regression[J]. KSCE Journal of Civil Engineering, 2016, 20(4): 1151-1162.
[9]	CHA Y J, CHOI W, BÜYÜKÖZTÜRK O. Deep learning-based crack damage detection using convolutional neural networks[J]. Computer-Aided Civil and Infrastructure Engineering, 2017, 32(5): 361-378.
[10]	王森, 伍星, 张印辉, 等. 基于深度学习的全卷积网络图像裂纹检测[J]. 计算机辅助设计与图形学学报, 2018, 30(5): 859-867.
[11]	YANG X, LI H, YU Y, et al. Automatic pixel-level crack detection and measurement using fully convolutional network[J]. Computer-Aided Civil and Infrastructure Engineering, 2018, 33(12): 1090-1109.
[12]	RONNEBERGER O, FISCHER P, BROX T. U-Net: convolutional networks for biomedical image segmentation[C]//Medical Image Computing and Computer-Assisted Intervention-MICCAI 2015. Springer, Cham: 2015: 234-241.
[13]	LIU Z, CAO Y, WANG Y, et al. Computer vision-based concrete crack detection using U-net fully convolutional networks[J]. Automation in Construction, 2019, 104: 129-139.
[14]	CHENG J, XIONG W, CHEN W, et al. Pixel-level crack detection using U-Net[C]//TENCON 2018-2018 IEEE Region 10 Conference. 2018: 462-466.
[15]	戴景民, 汪子君. 红外热成像无损检测技术及其应用现状[J]. 自动化技术与应用, 2007(1): 1-7.
[16]	CHUN P J, HAYASHI S. Development of a concrete floating and delamination detection system using infrared thermography[J]. IEEE/ASME Transactions on Mechatronics, 2021, 26(6): 2835-2844.
[17]	JANKǓ M, BŘEZINA I, GROšEK J. Use of infrared thermography to detect defects on concrete bridges[J]. Procedia Engineering, 2017, 190: 62-69.
[18]	FOX M, COLEY D, GOODHEW S, et al. Time-lapse thermography for building defect detection[J]. Energy and Buildings, 2015, 92: 95-106.
[19]	TANAKA H, TOTTORI S, NIHEI T. Detection of concrete spalling using active infrared thermography[J]. Quarterly Report of RTRI, 2006, 47(3): 138-144.
[20]	张淑仪. 超声红外热像技术及其在无损评价中的应用[J]. 应用声学, 2004(5): 1-6.
[21]	李国华, 吴立新, 吴淼, 等. 红外热像技术及其应用的研究进展[J]. 红外与激光工程, 2004(3): 227-230.
[22]	郭伟, 董丽虹, 徐滨士, 等. 主动红外热像无损检测技术的研究现状与进展[J]. 无损检测, 2016, 38(4): 58-66.

Relative Articles

[1]	YANG Zhao, YANG Quan, BAO Liang. EXPERIMENTAL STUDY ON SEISMIC DAMAGE OF INTERIOR JOINTS IN INTEGRALLY PREFABRICATED REINFORCED CONCRETE FRAMES[J]. INDUSTRIAL CONSTRUCTION, 2021, 51(1): 54-60. doi: 10.13204/j.gyjzG20190926006
[2]	Ding Hongyan, Yang Baokun, Zhang Puyang, Qiao Shuai. EXPERIMENTAL RESEARCH ON SEISMIC PERFORMANCE OF STORY-ADDED REINFORCED CONCRETE FRAME[J]. INDUSTRIAL CONSTRUCTION, 2015, 45(5): 49-54. doi: 10.13204/j.gyjz201505012
[3]	Chen Zongping, Zheng Wei, Ye Peihuan, Zhang Shiqian. EXPERIMENTAL STUDY ON MECHANICAL BEHAVIOUR OF REINFORCED RECYCLED COARSE AGGREGATE CONCRETE COLUMNS[J]. INDUSTRIAL CONSTRUCTION, 2014, 44(04): 65-68.
[4]	Li Bingnan, Dai Hang, Zhang Jiwen. RESEARCH ON REALIZATION OF SEISMIC DUCTILITY BY HIGH STRENGTHREBAR FOR RAILWAY PIERS WITH LOW REINFORCEMENT RATIOS[J]. INDUSTRIAL CONSTRUCTION, 2014, 44(08): 88-91.
[5]	Zhang Peng, Zhong Qingyu, Deng Yu, Nie Wei, Liu Wenbing, Mou Xiaohui. EXPERIMENT STUDY ON CRACK OF CONCRETE BEAMS OF CFRP-PCPs COMPOSITE TENDONS UNDER LOW CYCLIC LOADINGS[J]. INDUSTRIAL CONSTRUCTION, 2014, 44(10): 16-20. doi: 10.13204/j.gyjz201410004
[6]	Chen Zongping, Yang Yibin, Zheng Shufang, Su Yisheng. EXPERIMENTAL RESEARCH ON MECHANICAL PROPERTY OF REINFORCED RECYCLED AGGREGATE COARSE CONCRETE FLOOR-SLAB[J]. INDUSTRIAL CONSTRUCTION, 2013, 43(5): 52-56,127. doi: 10.13204/j.gyjz201305012
[7]	Sun Feifei, Yang Fang, Li Guoqiang, Chen Suwen. EXPERIMENTAL RESEARCH ON HIGH-STRENGTH HOT-ROLLED H-CANTILEVER BEAM UNDER CYCLIC LOADING[J]. INDUSTRIAL CONSTRUCTION, 2012, 42(1): 46-50,45. doi: 10.13204/j.gyjz201201008
[8]	Chen Lin-zhi, Feng Yuan. INFLUENCE OF RIGID ZONE SETTING FOR BEAMS AND COLUMNS ON SEISMIC PERFORMANCE OF REINFORCED CONRETE FRAME STRUCTURES[J]. INDUSTRIAL CONSTRUCTION, 2012, 42(9): 75-78. doi: 10.13204/j.gyjz201209017
[9]	Wang Hailiang, Yang Xinlei, Ren Quanchang, Dong Peng. EXPERIMENTAL STUDIES OF CFT COLUMN TO H-BEAM CONNECTIONS UNDER CYCLIC LOADING[J]. INDUSTRIAL CONSTRUCTION, 2011, 41(7): 114-119. doi: 10.13204/j.gyjz201107025
[10]	Liu Chunyang, Li Zhenbao, Ma Hua, Han Jianqiang. EXPERIMENT STUDY ON ASEISMIC BEHAVIOR OF RC FRAME SPACE JOINTS[J]. INDUSTRIAL CONSTRUCTION, 2011, 41(6): 67-70. doi: 10.13204/j.gyjz201106014
[11]	Han Jianqiang, Li Zhenbao, Song Jia, Liu Chunyang. STUDY ON SEISMIC PERFORMANCE OF PRECAST PRESTRESSED REINFORCED CONCRETE FRAME STRUCTURE[J]. INDUSTRIAL CONSTRUCTION, 2010, 40(5): 47-50. doi: 10.13204/j.gyjz201005009
[12]	Han Jianqiang, Li Zhenbao, Song Xiaosheng. A NEW TYPE OF CONNECTION FOR ASSEMBLING CONCRETE FRAME:STUDY ON PRESTRESSED ASSEMBLING FRAME STRUCTURES CONSTRUCTION[J]. INDUSTRIAL CONSTRUCTION, 2009, 39(11): 100-103. doi: 10.13204/j.gyjz200911023
[13]	Xing Guohua, Wu Tao, Liu Boquan, Yang Le, Yao Xiangui. CALCULATION ON CRACK RESISTANCE CAPACITY OF ABNORMAL INTERIOR JOINTS IN REINFORCED CONCRETE FRAME STRUCTURES[J]. INDUSTRIAL CONSTRUCTION, 2009, 39(6): 55-58. doi: 10.13204/j.gyjz200906014
[14]	Wang Weihua, Tao Zhong. TESTS ON TEMPERATURE FIELDS OF CONCRETE-FILLED STEEL TUBULAR COLUMN TO REINFORCED CONCRETE BEAM FRAMES UNDER FIRE[J]. INDUSTRIAL CONSTRUCTION, 2009, 39(4): 18-21. doi: 10.13204/j.gyjz200904005
[15]	Li Bin, Ren Limin, Shi Xiaoyan. EXPERIMENTAL RESEARCH ON BEHAVIOR OF CONCRETE-FILLED RHS FRAMES[J]. INDUSTRIAL CONSTRUCTION, 2008, 38(11): 97-101,105. doi: 10.13204/j.gyjz200811024
[16]	Wang Haichao, Li Yunfeng, Zhang Ximin. EFFECT OF INTERACTION BETWEEN LOADING AND ENVIRONMENT ON CORROSION FATIGUE OF REINFORCED CONCRETE BEAM[J]. INDUSTRIAL CONSTRUCTION, 2008, 38(2): 73-75,85. doi: 10.13204/j.gyjz200802020
[17]	Jiang Lizhong, Zou Fei, Qi Jingjing, Yu Zhiwu. THE INFLUENCE OF HORIZONTAL RElNFORCEMENT RATIO ON SEISMIC BEHAVIOR OF STEEL CONCRETE BEAM[J]. INDUSTRIAL CONSTRUCTION, 2007, 37(8): 1-4,13. doi: 10.13204/j.gyjz200708001
[18]	Chong Xun, Meng Shao-ping, Pan Qi-jian, Zhang Lin-zhen. STUDY ON FORM AND DESIGN APPROACH OF PRECAST PRESTRESSED CONCRETE FRAMES[J]. INDUSTRIAL CONSTRUCTION, 2006, 36(5): 5-7. doi: 10.13204/j.gyjz200605002
[19]	Wu Jing, Lu Jia-ping, Li Jin. RESEARCH ON TEMPERATURE STRESS OF CONCRETE FRAME STRUCTURES WITH LARGE LONGITUDINAL LENGTH[J]. INDUSTRIAL CONSTRUCTION, 2006, 36(5): 20-22. doi: 10.13204/j.gyjz200605006
[20]	Zhu Xiaowen, Sun Baojun, Shen Yingkun, Li Yanhe. FRAME STRENGTHENED WITH EXTERNAL PRESTRESSING STEEL TENDONS UNDER CYCLIC LOAD[J]. INDUSTRIAL CONSTRUCTION, 2004, 34(12): 80-82,66. doi: 10.13204/j.gyjz200412023