Sun, Wenrui; Grau-Bove, Josep; Reggio, Daniela; (2024) Evaluating Large Language Models (LLMs)' Understanding of ‘Black Crusts’ Predictive Models for Built Heritage Preservation. In: Gauthier, Stephanie and Nicol, Fergus and Brotas, Luisa and Altamirano, Hector, (eds.) Proceedings of the 13th Masters Conference: People and Buildings. (pp. pp. 1-6). Network for Comfort & Energy Use in Buildings: NCEUB: London, UK.

Preview

Text MC2024KT8009_Wenrui_Sun.pdf - Published Version Download (1MB) | Preview

Abstract

This study evaluates the understanding of LLMs in predicting limestone sulphation, described in common language as ‘black crusts’, which is an environmental decay damaging for historic buildings, implying gypsum formation on the surface of carbonatic materials. The research question is: ‘To what extent can built heritage managers use LLMs for preservation advice?’. GPT4, Claude, and OpenArt were used for evaluation, and prompts were designed to test different aspects of limestone sulphation predictions. Gypsum thickness calculated at various time intervals from published studies was prompted to the LLMs to generate new predictions. These results were then cross-referenced with predictive models to assess accuracy. The findings indicate that LLMs produced varying results each time, with significant discrepancies compared to published models. Numerical predictions, data fitting, and image forecasting based on LLMs were explored, underscoring the limitations of LLMs in predictive modelling. Further testing is required to leverage LLMs capabilities in heritage preservation.

Download activity - last month

Export as JSONXMLCSV

Download activity - last 12 months

Export as JSONXMLCSV

Downloads by country - last 12 months

Export as XMLCSVJSON

Archive Staff Only

View Item