all research

Real Estate & Development · 10 min read

A number is not an estimate: the multi-agent study that produced cost distributions instead

Twelve cost engineers, three real buildings, and a measured comparison against deterministic BIM, manual probabilistic estimating and single-prompt GPT-4. The agents won, and the ablation says why.

12.5%

MAPE, against 18.7 to 27.4%

4.2 min

Per estimate, from 18.5 to 68

$0.15

API cost per run

Analysis of published research

Agentic AI and LLM framework for probabilistic cost estimation from fragmented BIM data

Published in Intelligent Infrastructure and Construction · MDPI Intelligent Infrastructure and Construction · 28 June 2026

Cost data for a building does not live anywhere. It lives in an IFC file, and a spreadsheet, and a PDF quote from a subcontractor, and someone's handwritten note, and a paragraph of contract text. Different units, different resolutions, different levels of confidence.

An estimator reconciles all of that by hand and then produces a single number. That number then travels through the business as though it were a fact.

The research team quantified both halves of that problem before building anything, which is the part I respect most. Interviews with twelve cost engineers and analysis of three real projects put manual reconciliation at an average of 14.3 hours per project, and cost overruns at an average of 15.8% against the initial deterministic estimate.

One agent per job

Rather than one model doing everything, the system assigns each part of the estimating job to an agent, coordinated by an orchestrator.

Agent roles, as specified in the paper
  1. 1

    Orchestrator

    Decomposes the task, allocates work, routes exceptions.

  2. 2

    Three ingestion agents

    One each for text, tabular and geometric sources. The formats never meet until they have been read.

  3. 3

    Integration and alignment

    Entity resolution and semantic conflicts. Metres against feet. Concrete grade 30 against C30.

  4. 4

    Uncertainty quantification

    Finds missing fields, infers distribution types (triangular, beta-PERT, lognormal) and flags its own assumptions.

  5. 5

    Monte Carlo

    Ten thousand iterations produce a cost distribution rather than a point.

Agents communicate over a publish-subscribe bus with shared memory that persists between runs. The stack is Python 3.11, AutoGen 0.2 for the agent roles, LangChain calling GPT-4 Turbo, IfcOpenShell for the IFC, pandas with pdfplumber and Tesseract for the documents, and NumPy with SciPy for the simulation.

Two temperature settings, and this is a nice detail: 0.2 for parsing, where you want determinism, and 0.7 for uncertainty reasoning, where you want the model to consider alternatives.

How it was measured

Three real buildings, a concert hall, an exhibition veranda and a teaching building, with between 98 and 386 cost elements each. Compared against three baselines: deterministic BIM using Revit and CostX, manual probabilistic estimation in @RISK, and a non-agentic single-prompt GPT-4 Turbo. Three runs each, paired t-tests, five-fold cross-validation, and sensitivity checks on temperature and sample count.

That last sentence is why this paper is worth your time. Most AI-in-construction papers compare against nothing.

Mean absolute percentage error by method, lower is better
MAPE, percent
Multi-agent framework12.5
Manual probabilistic (@RISK)18.7
Deterministic BIM (Revit + CostX)22.1
Single-prompt GPT-4 Turbo27.4

Note where the single-prompt LLM lands. Bottom. Handing the whole problem to one model in one call performed worse than a spreadsheet-based deterministic method. The agent architecture is doing the work, not the language model.

Time and manual effort per estimate
minutes
Manual probabilistic (@RISK)684.294%
Deterministic BIM424.290%
Single-prompt LLM18.54.277%
conventional agent-assisted

The finding that matters most

Accuracy is the headline, but calibration is the real result. The framework achieved 86% coverage on nominal 90% prediction intervals, against 74% for manual estimation and 62% for the LLM-only approach, with intervals 38 to 46% narrower.

Coverage is the question of whether your confidence interval means what it says. An estimate that claims 90% confidence and is right 62% of the time is worse than useless, because people make decisions on it. The LLM-only baseline was confidently wrong. The agent system was closer to honest.

A narrower interval is only an improvement if the interval was telling the truth in the first place.

The ablation isolates why. Removing the integration and alignment agent damaged entity resolution most, which ran at 86.5%. Removing the uncertainty quantification agent damaged calibration most. Those are two different failure modes and the architecture separates them cleanly.

What a developer would actually do with this

The caveats worth naming out loud

Three projects, all in Hong Kong and mainland China. Irish and UK cost structures, labour rates, procurement routes and contract forms are different enough that the MAPE figure will not transfer unchanged. It runs in batch rather than real time. And it depends on GPT-4, which is a genuine data privacy problem for anything commercially sensitive, and a reason to look hard at the small-model argument in the compliance research.

Work with me

Run this model against your own project

I am Kanishk Kapoor, Technical Accounts Manager at AI Institute in Dublin. I build agentic AI systems with built-environment teams across Ireland and the UK. If any figure here looks wrong for your business, that is the useful conversation. Send me your assumptions and I will re-run it.

Continue reading