Li, J; Tao, B; Bosché, F; Lu, CX; Wilson, L; (2024) Extracting roof sub-components from orthophotos using deep-learning -based semantic segmentation. In: Proceedings of the 41st International Symposium on Automation and Robotics in Construction (ISARC 2024). (pp. pp. 675-682). International Association for Automation and Robotics in Construction (IAARC): Lille, France.

Preview

Text 087_ISARC_2024_Paper_109.pdf - Published Version Download (7MB) | Preview

Abstract

Best practice for the detection and annotation of visible defects in slated roofs is by annotation of photos, ideally orthophotos. If such a process is to be effectively automated in support of emerging Digital Twinning solutions, it is necessary to first recognise the external sub-components of the roof in the orthophotos, in particular the slated and leadwork areas. Using a dataset composed of many photos from two historic buildings, this study develops and compares different deep-learning -based semantic segmentation models to segment roof orthophotos into slated areas, leadwork, and ‘other’ areas. Since orthophotos typically contain pixels which do not belong to the roof panel (black ‘background’ pixels), the method employs a subsequent ‘background’ label correction step. The best-performing model is found to be PointRend with Focal Loss: overall aAcc = 99, mIoU = 88.91, and mAcc = 92.77; for slate class, IoU and Acc is nearly 100; for leadwork class, IoU and Acc is around 90.

Download activity - last month

Export as CSVXMLJSON

Download activity - last 12 months

Export as CSVXMLJSON

Downloads by country - last 12 months

Export as CSVXMLJSON

Archive Staff Only

View Item