All Engineering posts

Operations

What AI agents really cost to run — and how we keep them affordable

Six weeks of real meter readings from running autonomous agents for small businesses — what a run costs, the night retries burned $11.75 while everyone slept, and the five cost controls that came out of it.

Priyank Gandhi · · 7 min read

Most of what you read about AI agents is either hype or fear. This post is neither — it's our meter readings. Nova runs autonomous agents that do real work for local businesses: updating websites, writing blog posts, reviewing search performance, posting to social media, replying on Google. Every one of those runs costs real money, and because our customers pay a flat monthly price, that cost is our problem to engineer away — not yours.

We build in public, so here's what six weeks of running agents actually looked like, including the two days that went wrong, and the five lessons that came out of it.

What one agent run costs

When an agent updates a client's website, a frontier-class AI model reads the site's code, plans the change, makes the edits, checks its own work, and publishes. Across our ledger, a single run costs anywhere from about 8¢ (₹7) to $1.40 (₹123) depending on how much reading and checking the task needs. A typical day across all our businesses lands between $0 and $5.

Two days did not.

$0 $5 $10 $12.28 · 16 runs $12.81 · 19 runs Aug 7 Aug 17 Aug 27 Sep 6 Sep 16 $5/day per-business cap goes live Real spend from our run ledger, every business, 7 Aug – 17 Sep 2026. Grey ticks = days with no runs.

Those two red bars are the honest part of this post.

Lesson 1 — The expensive model only sits where work gets produced

The single biggest lever is architectural. Every message your receptionist answers, every chat you have with Nova, every summary you receive — those run on fast, lightweight models that cost a fraction of a rupee per message. The frontier-class model is reserved for the seats where work products come out the other end: editing your site, writing long-form content, analysing your search data.

Cheap models in the busy seats, the expensive model in the productive seat. Get this backwards and no amount of optimisation saves you.

Lesson 2 — Retries, not big jobs, are the silent budget-killer

That second red bar is the night of 17 September. A change had been approved and one step of it couldn't be finished automatically. The system did what it was built to do — try again. And again. Between 12:52 am and 2:08 am it launched 13 runs in 76 minutes, 8 of which failed, spending $11.75 (about ₹1,030) while everyone slept.

$0 $0.5 $1.0 $1.5 12:52 am 1:17 am 1:38 am 2:08 am failed completed waiting on owner 13 runs · 76 minutes · $11.75 · everyone asleep

No single run was expensive. The loop was expensive. Our fixes, live the same day:

Lesson 3 — Hard caps beat good intentions

Every guardrail above is logic, and logic can have bugs — ours did, that's how the night happened. So underneath the logic there is now a number that doesn't negotiate: a daily spend cap per business — $5 (about ₹440) by default. When the day's pipeline work reaches the cap, agents stop and resume tomorrow.

Two details we're proud of:

Lesson 4 — Remembering is ~10× cheaper than re-reading

Inside a single run, an agent works in rounds: read, think, act, look at the result, think again. The naive way, every round re-reads the entire conversation so far at full price — so cost grows with the square of the rounds. Model providers offer a fix: previously-seen context can be cached, and cached re-reads are billed at roughly a tenth of the price.

100% 0 re-reading everything, every round with memory (caching) ~86% less reading round 1 round 10 round 20 round 30 round 40 Illustrative: cumulative reading cost across one agent run, capped at 40 working rounds. Cached re-reads are billed at roughly a tenth of the price.

We restructured our agent loop so the frozen part of the conversation stays byte-for-byte identical between rounds (any change breaks the cache), and we project this cuts our model bill for agent runs by roughly half. We're measuring it in production now rather than taking our own projection's word for it.

The same idea applies outside the model too: our agents keep a read-cache ("you already read this file, nothing changed") and a verify budget (two checks per page, not nine). Agents are diligent to a fault — left alone, one of ours re-verified the same URL until we gave it a budget.

Lesson 5 — Everything gets a budget, because agents don't get tired

A human writer gets tired and stops. An agent will happily work — and bill — forever. So every dimension has a ceiling: 40 working rounds per run, a token backstop per run, two verifications per page, two retries per task, $5 per business per day. An agent without limits isn't autonomous; it's a meter without a dial.

What this means for you

That's the deal we think AI agents should come with. If you run a clinic, a store, or a practice and want an AI team with its own seatbelts, start with Nova on Telegram or see NovaHub.

Build with us

Want this for your business?

NovaBuildBot ships a full AI-managed site + chat assistant for your business. No code, no infra, paid monthly.

Start on Telegram →