IFC-QA: A Benchmark for Evaluating LLM Reliability over Industrial Building Information Model

Anastasia Volkova, Andrew Gromyko, Anton Gusarov, Evgenii Maslov, Valentin Khrulkov, Andrey Kuznetsov, Ivan Oseledets

Submission Type: I want my submission to be considered for both oral and poster presentation.

Keywords: Benchmarking, Building Information Model, LLM Reliability, Industrial AI

TL;DR: We introduce IFC-QA, a model-independent benchmark with five reasoning complexity levels for evaluating LLM reliability over building information models

Confirmation Of Submission Requirements: I submit an abstract. It uses the template provided on the submission page and is no longer than 2 pages.

Submission Number: 390