Token usage statistics for LLM API calls.
ITokenUsage
const usage: ITokenUsage = { promptTokens: 150, completionTokens: 75, totalTokens: 225}; Copy
const usage: ITokenUsage = { promptTokens: 150, completionTokens: 75, totalTokens: 225};
Number of tokens in the prompt (input)
Number of tokens in the completion (output)
Total tokens used (prompt + completion)
Token usage statistics for LLM API calls.
ITokenUsage
Example