Cost per completed task

Model price is only one part of cost; review, retries, failures, integration, and escalation also matter.

The practical distinction

Model price is only one part of cost; review, retries, failures, integration, and escalation also matter. Useful cost is total resources spent per output that meets acceptance criteria. Token price alone omits integration, review, retries, failures, escalations, latency, and the cost of correcting bad outcomes.

Worked example

Workflow A has a cheaper model call but needs substantially more review and correction than Workflow B. The calculation below makes those hidden costs comparable.

Calculation

Formula: cost per accepted task = (run cost + review labor + expected failure-correction cost + allocated integration and monitoring cost) ÷ acceptance rate.

Assume review labor is $60/hour and correction costs $8 per failed attempt. Before shared integration cost, Workflow A is ($0.03 + $10.00 + 15% × $8) ÷ 85% = $13.21 per accepted task. Workflow B is ($0.12 + $2.00 + 2% × $8) ÷ 98% = $2.33 per accepted task.

Decision threshold: prefer B only if it meets the same task-specific acceptance and critical-failure thresholds and remains below the current human or software baseline after allocated integration and monitoring cost. Never trade a required safety threshold for a lower average cost.

Apply it

Compare completed acceptable outcomes, not raw tokens or calls.

  1. Define completion and acceptance before collecting cost data.
  2. Measure model, infrastructure, review, retry, exception, and correction cost on the same evaluation set.
  3. Compare the AI workflow with the current human or deterministic baseline.

Evidence to collect

  • Report acceptance rate and escalation rate beside mean and tail cost.
  • Include expensive edge cases instead of averaging only easy successes.
  • Recalculate when volume, model, reviewer, latency target, or failure rate changes.

Common mistake

Choosing the cheapest model call while ignoring that lower quality transfers more work and risk to reviewers.

Scope limit

This guidance on cost per completed task helps define a task and its review evidence. It does not certify a model, source, reviewer, environment, legal position, or residual-risk level.