Skip to main content

Variable: MAX_COST_TOKENS_PER_MESSAGE

const MAX_COST_TOKENS_PER_MESSAGE: 8 = 8

Defined in: packages/agentos/src/api/runtime/modelPricing.ts:245

Prompt tokens allowed for each message of a request, and for its system prompt, beyond the bytes of its text: the role and turn markers a provider renders around each one. The counts the providers' counting endpoints gave on 2026-11-04 (src/api/runtime/__tests__/fixtures/max-cost-token-counts.json) never reached a message's JSON bytes, which already carry its role and its punctuation.