Natural Language Communication with Sensor Data Through a LLM-Integrated Protocol: A Case Study
2025 (English)In: Advances in Information Technology in Civil and Building Engineering / [ed] Francis, Adel; Miresco, Edmond; Melhado, Silvio, Springer Nature , 2025, Vol. 629, p. 64-75Conference paper, Published paper (Refereed)
Abstract [en]
The ability to share data can facilitate cooperation and decision making throughout the entire life cycle of buildings, from initial stages of planning, through design and construction, up to the management of assets and towards end of life and recycling or reuse. Accordingly, the different actors of the Construction industry can share data and functionalities across software platforms through automated processes. Such processes involve stakeholders with heterogeneous backgrounds; for this reason, it is of value to make data available to people without expert knowledge of specific programs or computer systems.
This study is concerned with digital protocols for automated capturing of real-time sensor data for the assessment of building performance. The research explores a Large Language Model (LLM) driven protocol for sensor data acquisition to evaluate building performance, leveraging the existing database where building data is stored. Using pre-written prompts which instruct how to carry out tasks in a step-by-step manner, the LLM can utilize pre-defined functions built upon API calls for communication with sensor data, including data acquisition, post-processing, and interpretation. The LLM receives instructions by the User using natural language. Initial tests underscore the protocol feasibility, highlighting its potential utility to improve the data communication of existing digital twins for individuals without professional expertise in building management. A case study exemplifies how human instructions in natural language trigger the LLM to invoke a request for indoor climate sensor data in a building.
The developed tool was tested by professionals working in the Construction industry and the Educational Sector to provide feedback on its practical application. This evaluation helped to identify weaknesses for future developments and proved the flexibility and adaptability of the method.
As advancements in Artificial Intelligence (AI), particularly in LLMs, continue to surge, there is anticipation for further refinements. This includes cost reduction, enhanced stability, and the integration of more advanced functionalities such as advanced data analysis using machine learning coded by LLM.
Place, publisher, year, edition, pages
Springer Nature , 2025. Vol. 629, p. 64-75
Keywords [en]
Digital Twin (DT);Artificial Intelligence (AI); Natural Processing Language (NPL); Large Language Models (LLMs)
National Category
Architectural Engineering Computer Engineering Artificial Intelligence
Research subject
Civil and Architectural Engineering, Building Service and Energy Systems
Identifiers
URN: urn:nbn:se:kth:diva-361909DOI: 10.1007/978-3-031-87364-5_6Scopus ID: 2-s2.0-105002399124OAI: oai:DiVA.org:kth-361909DiVA, id: diva2:1949461
Conference
The 20th conference of the International Society for Computing in Civil and Building Engineering, August 25-28, 2024, Montreal
Note
Part of proceedings ISBN 978-3-031-87363-8, 978-3-031-87364-5
QC 20250408
2025-04-022025-04-022025-04-23Bibliographically approved