Home
blog
cost allocation strategies and tokenomics

Abstract key visual representing a keyboard

FinOps

Why Your Cost Allocation Strategy Breaks When Agents Start Calling Agents

Q: What makes AI costs difficult to predict?

AI costs can be difficult to predict because consumption varies with the number of users, requests, tokens, workflow steps, and model interactions. Automated AI agents can also trigger additional tasks or model calls dynamically, making actual consumption different from initial estimates.

Released on

Monday, August 31, 2026

Markus Döpke

Why Your Cost Allocation Strategy Breaks When Agents Start Calling Agents

6:15

When AI agents spawn sub-agents at runtime, two identical user requests can differ in cost by an order of magnitude — and your FinOps dashboard won't explain why. This article shows platform engineers how to instrument agentic workloads for real cost visibility. AWS Solutions Architect Markus Döpke explains why agentic cost is fundamentally multiplicative rather than additive, who feels the pain first (SaaS providers, enterprise platform teams, and product managers alike), and what platform engineers can do about it today.

The true cost of AI sits under the hood

Cloud cost management runs on an assumption that has held for over a decade: spending is deterministic. You provision infrastructure, tag it, allocate the tags to cost centers, and optimize by right-sizing or reserving capacity. The bill is the sum of what you provisioned.

Agentic AI breaks that assumption. The cost of one user interaction now depends on what the agent decides to do at runtime: how many reasoning steps it takes, which tools it calls, whether it retries or spawns sub-agents to handle parts of the task. Two requests that look identical from the outside can differ in cost by an order of magnitude, because the difference sits in a decision tree you can't see from the outside.

This is the territory of tokenomics: attributing and governing the variable cost of intelligence, the way FinOps attributes and governs the variable cost of infrastructure. It's not a gap in your existing FinOps tooling. It's a different cost model, and it needs different instrumentation.

Why the bill stops following the architecture

Classical cloud cost is additive. You add up the resources you provisioned, multiply by usage, and you have your number. Agentic cost is multiplicative. Every runtime decision cascades into the next, and the layers compound rather than sum.

A few of these layers don't exist in classical workloads at all:

Model inference. Cost depends on model choice, context window size, and output length. Reasoning models add a layer you never see: internal chain-of-thought tokens billed as output even though the user never reads them.
Orchestration. A single user request commonly triggers multiple model calls under the hood. Add a retry loop or a fan-out to specialist sub-agents, and one request becomes a tree of invocations.
Tools and retrieval. Every tool call and retrieval step adds its own token cost: deciding to call, executing, and interpreting the result.

None of this shows up if you're only tagging EC2 instances and RDS clusters. The bill isn't the sum of what you provisioned anymore. It's the product of what the agent chose to do.

Who runs into this, and why

This problem doesn't land on everyone the same way. Software companies running multi-tenant agentic SaaS have a pricing problem: per-tenant unit economics stay invisible until the invoice arrives, and getting it wrong means underpricing into negative margins or overpricing out of deals. Enterprises rolling out AI across business units have an accountability problem: a legal contract-review agent costs a different order of magnitude than an HR FAQ bot, yet the shared-services cost center absorbs both. Product managers have a packaging and pricing problem: they can't tell whether an autonomous research mode belongs in the base tier or needs gating behind a premium plan without per-feature cost data.

Different motivations, same missing layer. And it's platform engineering teams who end up building it. Because they're the ones operating the orchestration layer where these numbers would actually have to be produced.

Building the orchestration layer for cost

Platform engineers need to instrument the layer that coordinates model calls, tool invocations, and agent-to-agent communication, so that every run produces a cost figure with enough business context attached to be useful: which tenant, which feature, which workflow.

Three areas do most of the work.

Step-level tracing. Every model call, tool call, and retrieval step should become a span carrying token counts, not a log line. OpenTelemetry's GenAI semantic conventions standardize this: the gen_ai.client.token.usage metric records input and output tokens per call, and gen_ai.invoke_agent.tool_calls and gen_ai.invoke_agent.inference_calls capture how many calls one agent invocation fans out into. Backends like Grafana Tempo or AWS X-Ray reconstruct the full call tree from these spans; turning the token counts into a dollar figure is a separate step, applying your own rate card per model and token type.

Business context propagation. Token counts alone don't attribute to anything. Tenant ID, feature name, and workflow name need to travel as span attributes or OpenTelemetry baggage from the entry point through every downstream call, including sub-agents.

Joining traces to what you're actually billed. Token counts in a trace are not yet dollars, and reconciling them against the invoice is its own problem. Where a provider offers native support, use it: Amazon Bedrock enriches inference costs with identity and other metadata. Where this is not supported natively, inference gateways such as LiteLLM can be introduced for the same purpose.

None of this is exotic. It's the same instrumentation discipline platform teams already apply to distributed tracing, pointed at a new kind of call. Build it now, while the bill is still explainable – not after it isn't.

You want to learn more?

Join our live webinar: How to measure and optimize cloud costs with FinOps

Join USU and Markus Döpke from AWS to get more insights in the hidden costs of agentic AI. Learn how how to build a FinOps framework that connects cloud spending to business outcomes.

When: November 04, 2026, 4:00 – 4:45 PM CET

What You'll Learn:

How to track operational and financial metrics, such as cost per deployment and margin per customer
How regular cost reviews improve visibility, accountability and optimization
How to connect cloud spending with measurable business outcomes

Frequently Asked Questions

What is AI cost allocation and why does it matter?

AI cost allocation is the process of assigning AI-related expenses to the teams, applications, projects, or business units that generate them. It matters because it gives organizations visibility into AI spending, improves financial accountability, and helps identify where AI workloads create the highest costs.

How do you calculate the cost of using AI?

The cost of using AI can be calculated by measuring the resources consumed by an AI workload and applying the corresponding pricing rates. Depending on the application, this may include input and output tokens, model inference, compute, data processing, storage, API requests, and other resources required to complete an AI task.

What makes AI costs difficult to predict?

AI costs can be difficult to predict because consumption varies with the number of users, requests, tokens, workflow steps, and model interactions. Automated AI agents can also trigger additional tasks or model calls dynamically, making actual consumption different from initial estimates.

How does token consumption affect AI costs?

Token consumption directly affects the cost of many AI workloads because models process input and generate output in tokens. Longer prompts, larger responses, higher request volumes, and workflows involving multiple model interactions can increase token consumption and therefore increase overall AI costs.

What is AI FinOps and how does it help control costs?

AI FinOps is the application of financial management and cost optimization practices to AI workloads. It helps organizations connect AI usage with its financial impact by combining cost visibility, usage monitoring, accountability, and continuous optimization across technical and business teams.

How can companies optimize AI costs without limiting innovation?

Companies can optimize AI costs by improving workflow efficiency, reducing unnecessary model calls, controlling token consumption, monitoring unit costs, and matching workloads with appropriate resources. This approach focuses on increasing the value generated per unit of AI spending rather than simply reducing usage.

What is the best way to measure AI cost efficiency?

AI cost efficiency can be measured using unit economics such as cost per request, cost per AI task, cost per workflow, or cost per business outcome. These metrics connect AI consumption with operational or business results and provide a more meaningful view of efficiency than total AI spending alone.

How should organizations manage AI costs as AI adoption grows?

Organizations should establish a scalable AI cost management framework that combines usage tracking, cost allocation, token monitoring, budgets, ownership, and regular optimization. As AI adoption grows, consistent measurement and clear attribution help organizations maintain financial visibility while expanding AI workloads.